Ken Hinckley
Richard Szeliski
ABSTRACT
The VideoMouse is a mouse that uses a camera as its input sensor. A real-time vision algorithm determines the six degree-of-freedom mouse posture, consisting of 2D motion, tilt in the forward/back and left/right axes, rotation of the mouse about its vertical axis, and some limited height sensing. Thus, a familiar 2D device can be extended for three-dimensional manipulation, while remaining suitable for standard 2D GUI tasks. We describe techniques for mouse functionality, 3D manipulation, navigating large 2D spaces, and using the camera for lightweight scanning tasks.
- 1.Balakrishnan, R., Baudel, T., Kurtenbach, G., Fitzmaurice, G., "The Rockin'Mouse: Integral 3D Manipulation on a Plane," CHI'97, 311-318. Google Scholar
Digital Library
- 2.Ballard, D.H., Brown, C.M., "Computer Vision". 1982, Englewood Cliffs, New Jersey: Prentice-Hall. Google ScholarDigital Library
- 3.Britton, E., Lipscomb, J., Pique, M., "Making Nested Rotations Convenient for the User," Computer Graphics, 12 (3): p. 222-227, 1978. Google ScholarDigital Library
- 4.Caprille, B., Torre, V., "Using Vanishing Points for Camera Calibration," International Journal of Computer Vision, 4 (2): p. 127-139, 1990. Google ScholarDigital Library
- 5.Dementhon, D., Davis, L.S., "Model-based object pose in 25 lines of code," International Journal of Computer Vision, 15 (112): p. 123-141, 1995. Google ScholarDigital Library
- 6.Fitzmaurice, G., Balakrishnan, R., Kurtenbach, G., Buxton, B., "An Exploration into Supporting Artwork Orientation in the User Interface," CHI'99. Google ScholarDigital Library
- 7.Fitzmaurice, G., Ishii, H., Buxton, W., "Bricks: Laying the Foundations for Graspable User Interfaces," CHI'95,442-449. Google ScholarDigital Library
- 8.Fryer, J., Brown, D., "Lens Distortion for Close-Range Photogrammetry," Photogrammetric and Remote Sensing, 52 (1): p. 51-58, 1986.Google Scholar
- 9.Harrison, Fishkin, Gujar, Mochon, & Want, "Squeeze Me, Hold Me, Tilt Me! An Exploration of Manipulative User Interfaces," CHI'98, 1998, 17-24. Google ScholarDigital Library
- 10.Hinckley, K., Pausch, R., Proffitt, D., Kassell, N., Two-Handed Virtual Manipulation, TOCHI 5 (3) 1998. Google ScholarDigital Library
- 11.Hinckley, K., Sinclair, M., "Touch-Sensing Input Devices," To appear in CHI'99. Google ScholarDigital Library
- 12.Hinckley, K., Tullio, J., Pausch, R., Proffitt, D., Kassell, N., "Usability Analysis of 3D Rotation Techniques," UIST'97, 1-10. Google ScholarDigital Library
- 13.Jacob, R., Sibert, L., McFarlane, D., Mullen, M., Jr., "Integrality and Separability of Input Devices," ACM TOCHI, 1 (1): p. 3-26, 1994. Google ScholarDigital Library
- 14.Johnson, W., Jellinek, H., Klotz, L., Rao, R., Card, S., "Bridging the paper and electronic worlds: the paper user interface," INTERCHI'93, 1993, 507-12. Google ScholarDigital Library
- 15.Kurtenbach, G., Fitzmaurice, G., Baudel, T., Buxton, B., "The Design of a GUI Paradigm based on Tablets, Two-hands, and Transparency," CHI'97, 35-42. Google ScholarDigital Library
- 16.Lyon, R., Haeberli, M., "Designing and testing the optical mouse," VLSI Design, Jan.: p. 20-30, 1982.Google Scholar
- 17.MacKenzie, I.S., Soukoreff, R.W., Pal, C., "A Two- Ball Mouse Affords Three Degrees of Freedom," CHI'97 Conference Companion, 1997, 303-304. Google ScholarDigital Library
- 18.Microsoft IntelliMouse Explorer, www.microsoft. com/presspass/features/1999/04-19mouse.htm, 1999Google Scholar
- 19.Perlin, K., Fox, D., "Pad: An Alternative Approach to the Computer Interface," SIGGRAPH '93, 1993. Google ScholarDigital Library
- 20.Rao, R., Card, S., Johnson, W., Klotz, L., Trigg, R., "Protofoil: Storing and Finding the Information Worker's Paper Documents in an Electronic File Cabinet," CHI'94, 1994, 180-185,477. Google ScholarDigital Library
- 21.Rekimoto, J., "Tilting Operations for Small Screen Interfaces," UIST'96, 167-168. Google ScholarDigital Library
- 22.Szeliski, R., Shum, H.-Y., "Creating full view panoramic image mosaics and texture-mapped models," SIGGRAPH'97, 251-258. Google ScholarDigital Library
- 23.Wacom Intuos tablet, http://www, wacom.com/ productinfo/intuos9x 12.html, 1999.Google Scholar
- 24.Zhai, S., "Human Performance Evaluation of Manipulation Schemes in Virtual Environments," Proc. IEEE VRAIS'93, 155-161. Google ScholarDigital Library
- 25.Zhai, S., Milgram, P., "Quantifying Coordination in Multiple DOF Movement and Its Application to Evaluating 6 DOF Input Devices," CHI'98, 320-327. Google ScholarDigital Library
- 26.Zhai, S., Milgram, P., Buxton, W., "The Effects of Using Fine Muscle Groups in Multiple Degree-of- Freedom Input," CHI'96, 308-315. Google ScholarDigital Library
- 27.Zhai, S., Smith, B.A., Selker, T., "Improving Browsing Performance: A study of four input devices for scrolling and pointing tasks," INTERACT'97,286-292. Google ScholarDigital Library
- 28.Zhang, Z., A Flexible New Technique for Camera Calibration. Microsoft Research Technical Report MSR-TR-98-71, 1998.Google Scholar
- 29.Zimmerman, T., Smith, J. R., Paradiso, J., Allport, D., Gershenfeld, N., "Applying Electric Field Sensing to Human-Computer Interfaces," CHI'95,280-287. Google ScholarDigital Library
Index Terms
- The VideoMouse: a camera-based multi-degree-of-freedom input device
Recommendations
A two-ball mouse affords three degrees of freedom
CHI EA '97: CHI '97 Extended Abstracts on Human Factors in Computing SystemsWe describe a prototype two-ball mouse containing the electronics and mechanics of two mice in a single chassis. Unlike a conventional mouse, which senses x-axis and y-axis displacement only, our mouse also senses z-axis angular motion. This is ...
An exploration of pen rolling for pen-based interaction
UIST '08: Proceedings of the 21st annual ACM symposium on User interface software and technologyCurrent pen input mainly utilizes the position of the pen tip, and occasionally, a button press. Other possible device parameters, such as rolling the pen around its longitudinal axis, are rarely used. We explore pen rolling as a supporting input ...
Mobile devices as multi-DOF controllers
3DUI '10: Proceedings of the 2010 IEEE Symposium on 3D User InterfacesConventional input devices such as the mouse and keyboard lack in intuitiveness when it comes to 3D manipulation tasks. In this paper, we explore the use of accelerometer and magnetometer equipped mobile phones as 3-DOF controllers in a 3D rotation ...
Comments