skip to main content
10.1145/1085777.1085838acmotherconferencesArticle/Chapter ViewAbstractPublication PagesmobilehciConference Proceedingsconference-collections
Article

ISeeU: camera-based user interface for a handheld computer

Authors Info & Claims
Published:19 September 2005Publication History

ABSTRACT

"Tilt scrolling" and "peephole display" are popular user interface ideas for small computers, and inertial sensors were often the choice for the realization of such ideas. Inertial sensors, however, have two fundamental limitations; the frame of reference is not the user but the earth, and drifting errors are difficult to overcome. A possibly better solution, free from such limitations, is machine vision. Machine vision was a luxury for small computers but is becoming a practical solution because a camera is now a common component of small computers and the required vision algorithm is already running in optical mice. The vision algorithm of our prototype, which we called ISeeU, tracks simple features in the user's face and calculates lateral displacements and changes in distance, which in turn are used to control scrolling and zooming. An informal test with scrolling tasks indicates that its performance is comparable with a user interface using arrow keys.

References

  1. Rekimoto, J. Tilting operations for small screen interfaces. In Proceedings of ACM User Interface Software Technology(UIST 1996), 167--168. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Small, D., Ishii, H. Design of spatially aware graspable displays. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 1997), 367--368. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Fitzmaurice, G. W. Situated information spaces and spatially aware palmtop computer. Communications of the ACM, Vol. 36, No. 7, 1993, 39--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Harrison, B.L., Fishkin, K.P., Gujar, A., Mochon, G., Want, R., Squeeze me, hold me, tilt me! An exploration of manipulative user interface. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 1998), 17--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bartlett, J.F. Rock'n' Scroll is Here to Stay, IEEE Computer Graphics and Applications, 2000, 40--45. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hinckley, K., Pierce, H., Sinclair, M., Horvitz, E. Sensing techniques for mobile interaction. In Proceedings of ACM User Interface Software Technology(UIST 2000), 91--100. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Yee, K.P. Peephole Displays: Pen Interaction on Spatially Aware Handheld Computers. In Proceedings of the SIGCHI conference on Human factors in computing systems (CHI 2003), 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Ebisawa, Y. Improved Video-Based Eye-Gaze Detection Method. IEEE Transactions on Instrumentation and Measurement, Vol. 47, No. 4. 1998, 948--955.Google ScholarGoogle ScholarCross RefCross Ref
  9. Yoo, DH., Kim, JH., Lee, BR., Chung, MJ. Non-contact eye gaze tracking system by mapping of corneal reflections. IEEE International Conference on Automatic Face and Gesture Recognition. 2002, 94--99. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Intel Open Source Computer Vision Library. http://www.intel.com/research/mrl/research/opencv/Google ScholarGoogle Scholar
  11. Bouguet, J.V. Pyramidal implementation of the Lucas Kanade Feature Tracker Description of the algorithm. Intel Corporation Microprocessor Research Labs. 1999.Google ScholarGoogle Scholar

Index Terms

  1. ISeeU: camera-based user interface for a handheld computer

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      MobileHCI '05: Proceedings of the 7th international conference on Human computer interaction with mobile devices & services
      September 2005
      400 pages
      ISBN:1595930892
      DOI:10.1145/1085777

      Copyright © 2005 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 19 September 2005

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • Article

      Acceptance Rates

      Overall Acceptance Rate202of906submissions,22%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader