Hamed Ketabdar
ABSTRACT
We present a new technique based on using embedded compass (magnetic) sensor for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical boundary. Our proposed method is based on using compass (magnetic field) sensor integrated in new mobile devices (e.g. iPhone 3GS, G1/2 Android). In this method, a properly shaped permanent magnet (e.g. a rod, pen or a ring) is used for interaction. The user makes coarse gestures in 3D space around the device using the magnet. Movement of the magnet affects magnetic field sensed by the compass sensor integrated in the device. The temporal pattern of the gesture is then used as a basis for sending different interaction commands to the mobile device. The proposed method does not impose changes in hardware and physical specifications of the mobile device, and unlike optical methods is not limited by occlusion problems. Therefore, it allows for efficient use of 3D space around device, including back of device. Zooming, turning pages, accepting/rejecting calls, clicking items, controlling a music player, and mobile game interaction are some example use cases. Initial evaluation of our algorithm using a prototype application developed for iPhone shows convincing gesture classification results.
- Starner, T. and Auxier, J. and Ashbrook, D. and Gandy, M, The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring, International Symposium on Wearable Computing, 2000, pp. 87--94. Google Scholar
Digital Library
- Kratz, S., Rohs, M. HoverFlow: expanding the design space of around-device interaction. In Proc. of the 11th International Conference on Human Interaction with Mobile Devices and Services, Sep. 2009, Bonn, Germany. Google ScholarDigital Library
- Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. In Proc. of UIST '00. ACM, pp. 91--100. Google ScholarDigital Library
- Butler, A., Izadi, S., and Hodges, S. 2008. SideSight: Multi-"touch" interaction around small devices. In Proc. of UIST'08. ACM, 201--204. Google ScholarDigital Library
- Howard, B. and Howard, M.G.: Ubiquitous Computing Enabled by Optical Reflectance Controller. Whitepaper. Lightglove, Inc., http://lightglove.com/WhitePaper.htm. (Visited on 25.06.2009).Google Scholar
- Baudisch, P. and Chu, G. Back-of-device interaction allows creating very small touch devices. In Proc. of CHI '09. Google ScholarDigital Library
- Metzger, C., Anderson, M., and Starner, T. 2004. FreeDigiter: A Contact-Free Device for Gesture Control. In Proc. of the Eighth international Symposium on Wearable Computers. ISWC. IEEE Computer Society, 18--21. Google ScholarDigital Library
- Theremin, L.S. The Design of a Musical Instrument Based on Cathode Relays. Reprinted in Leonardo Music J., No. 6, 1996, 49--50.Google Scholar
- Smith, J., White, T., Dodge, C., Paradiso, J., Gershenfeld, N., and Allport, D. 1998. Electric Field Sensing For Graphical Interfaces. IEEE Comput. Graph. Appl. 18, 3 (May. 1998), 54--60. Google ScholarDigital Library
- Minsky M L and Papert S A 1969 Perceptrons (Cambridge, MA: MIT Press).Google Scholar
- Sheldon B. Akers. Binary Decision Diagrams, IEEE Transactions on Computers, C-27(6), pp. 509--516, June 1978. Google ScholarDigital Library
Index Terms
- Towards using embedded magnetic field sensor for around mobile device 3D interaction
Recommendations
MagiTact: interaction with mobile devices based on compass (magnetic) sensor
IUI '10: Proceedings of the 15th international conference on Intelligent user interfacesIn this work, we present a new technique for efficient use of 3D space around a mobile device for interaction with the device. Around Device Interaction (ADI) enables extending interaction space of small mobile and tangible devices beyond their physical ...
MagiWrite: towards touchless digit entry using 3D space around mobile devices
MobileHCI '10: Proceedings of the 12th international conference on Human computer interaction with mobile devices and servicesIn this work, we present a new approach for text (mainly digit) entry based on digit shaped gestures created in 3D space around a mobile device. Some new mobile devices such as Apple iPhone 3GS and Google Android are equipped with magnetic (compass) ...
Around-body interaction: sensing & interaction techniques for proprioception-enhanced input with mobile devices
MobileHCI '14: Proceedings of the 16th international conference on Human-computer interaction with mobile devices & servicesThe space around the body provides a large interaction volume that can allow for big interactions on small mobile devices. However, interaction techniques making use of this opportunity are underexplored, primarily focusing on distributing information ...
Comments