skip to main content
10.1145/365024.365028acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
Article

Accuracy measures for evaluating computer pointing devices

Authors Info & Claims
Published:01 March 2001Publication History

ABSTRACT

In view of the difficulties in evaluating computer pointing devices across different tasks within dynamic and complex systems, new performance measures are needed. This paper proposes seven new accuracy measures to elicit (sometimes subtle) differences among devices in precision pointing tasks. The measures are target re-entry, task axis crossing, movement direction change, orthogonal direction change, movement variability, movement error, and movement offset. Unlike movement time, error rate, and throughput, which are based on a single measurement per trial, the new measures capture aspects of movement behaviour during a trial. The theoretical basis and computational techniques for the measures are described, with examples given. An evaluation with four pointing devices was conducted to validate the measures. A causal relationship to pointing device efficiency (viz. throughput) was found, as was an ability to discriminate among devices in situations where differences did not otherwise appear. Implications for pointing device research are discussed.

References

  1. 1.Accot, J., and Zhai, S. Beyond Fitts' law: Models for trajectory-based HCI tasks, In Proceedings of the CHI '97 Conference on Human Factors in Computing Systems. New York: ACM, 1997, pp. 295-302. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. 2.Akamatsu, M., MacKenzie, I. S., and Hasbrouq, T. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device, Ergonomics 38 (1995), 816-827.Google ScholarGoogle ScholarCross RefCross Ref
  3. 3.Bailey, R. W. Human performance engineering: Designing high quality, professional user interfaces for computer products, applications, and systems, 3rd ed. Upper Saddle River, NJ: Prentice Hall, 1996). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. 4.Card, S. K., English, W. K., and Burr, B. J. Evaluation of mouse, rate-controlled isometric joystick, step keys, and text keys for text selection on a CRT, Ergonomics 21 (1978), 601-613.Google ScholarGoogle ScholarCross RefCross Ref
  5. 5.Douglas, S. A., Kirkpatrick, A. E., and MacKenzie, I. S. Testing pointing device performance and user assessment with the ISO 9241, Part 9 standard, In Proceedings of the CHI '99 Conference on Human Factors in Computing Systems. New York: ACM, 1999, pp. 215-222. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6.English, W. K., Engelbart, D. C., and Berman, M. L. Display selection techniques for text manipulation, IEEE Transactions on Human Factors in Electronics HFE-8 (1967), 5-15.Google ScholarGoogle ScholarCross RefCross Ref
  7. 7.Epps, B. W. Comparison of six cursor control devices based on Fitts' law models, In Proceedings of the Human Factors Society 30th Annual Meeting. Santa Monica, CA: Human Factors Society, 1986, pp. 327-331.Google ScholarGoogle ScholarCross RefCross Ref
  8. 8.ISO ISO/TC 159/SC4/WG3 N147: Ergonomic requirements for office work with visual display terminals (VDTs) - Part 9 - Requirements for non-keyboard input devices, International Organisation for Standardisation, May 25, 1998.Google ScholarGoogle Scholar
  9. 9.Karat, J., McDonald, J. E., and Anderson, M. A comparison of selection techniques: touch panel, mouse, and keyboard, In Human-Computer Interaction--INTERACT '84. Elsevier Science Publishers, 1985, pp. 189-193.Google ScholarGoogle Scholar
  10. 10.MacKenzie, I. S. Fitts' law as a research and design tool in human-computer interaction, Human-Computer Interaction 7 (1992), 91-139.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. 11.MacKenzie, I. S., Sellen, A., and Buxton, W. A comparison of input devices in elemental pointing and dragging tasks, In Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI '91. New York: ACM, 1991, pp. 161-166. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. 12.Mithal, A. K., and Douglas, S. A. Differences in movement microstructure of the mouse and the fingercontrolled isometric joystick, In Proceedings of the ACM Conference on Human Factors in Computing Systems - CHI '96. New York: ACM, 1996, pp. 300-307. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13.Murata, A. An experimental evaluation of mouse, joystick, joycard, lightpen, trackball, and touchscreen for pointing: Basic study on human interface design, In Proceedings of the Fourth International Conference on Human-Computer Interaction. Elsevier, 1991, 123-127.Google ScholarGoogle Scholar
  14. 14.Stevens, J. Applied multivariate statistics for the social sciences, 3rd ed. (Mahwah, NJ: Erlbaum, 1996). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Accuracy measures for evaluating computer pointing devices

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CHI '01: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
        March 2001
        559 pages
        ISBN:1581133278
        DOI:10.1145/365024

        Copyright © 2001 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 March 2001

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • Article

        Acceptance Rates

        CHI '01 Paper Acceptance Rate69of352submissions,20%Overall Acceptance Rate6,199of26,314submissions,24%

        Upcoming Conference

        CHI '24
        CHI Conference on Human Factors in Computing Systems
        May 11 - 16, 2024
        Honolulu , HI , USA

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader