Tao Ni
Patrick Baudisch
ABSTRACT
In this paper, we extrapolate the evolution of mobile devices in one specific direction, namely miniaturization. While we maintain the concept of a device that people are aware of and interact with intentionally, we envision that this concept can become small enough to allow invisible integration into arbitrary surfaces or human skin, and thus truly ubiquitous use. This outcome assumed, we investigate what technology would be most likely to provide the basis for these devices, what abilities such devices can be expected to have, and whether or not devices that size can still allow for meaningful interaction. We survey candidate technologies, drill down on gesture-based interaction, and demonstrate how it can be adapted to the desired form factors. While the resulting devices offer only the bare minimum in feedback and only the most basic interactions, we demonstrate that simple applications remain possible. We complete our exploration with two studies in which we investigate the affordance of these devices more concretely, namely marking and text entry using a gesture alphabet.
- Baudisch, P and Chu, G. (2009). Back-of-device interaction allows creating very small touch devices. In Proc. CHI'09, pp. 1923--1932. Google Scholar
Digital Library
- Brumitt, B., Meyers, B., Robbins, D., Krumm, J., Czerwinski, M., and Shafer, S. (1998). The New EasyLiving Project at Microsoft Research. Proc. Joint DARPA/NIST Smart Spaces Workshop '98.Google Scholar
- Butler, A., Izadi, S., and Hodges, S. (2008). SideSight: multi-"touch" interaction around small devices. Proc. UIST '08, pp. 201--204. Google ScholarDigital Library
- Cao, X., A. Wilson, R. Balakrishnan, K. Hinckley, S. Hudson. (2008) ShapeTouch: Leveraging Contact Shape on Interactive Surfaces. In Proc. Tabletop'08, pp. 139--146.Google Scholar
- Chi, E. H., Song, J., and Corbin, G. (2004). "Killer App" of wearable computing: wireless force sensing body protectors for martial arts. Proc. UIST '04, pp. 277--285. Google ScholarDigital Library
- Feiner, S., Macintyre, B., and Seligmann, D. (1993). Knowledge-based augmented reality. Commun. ACM 36, 7 (Jul. 1993), pp. 53--62. Google ScholarDigital Library
- Fitzmaurice, G., Khan, A., Pieké, R., Buxton, W., Kurtenbach, G. (2003). Tracking menus. Proc. UIST'03, pp. 71--79. Google ScholarDigital Library
- Fukumoto, M. (2005). A finger-ring shaped wearable handset based on bone-conduction. Proc. ISWC '05, pp. 10--13. Google ScholarDigital Library
- Fukumoto, M. and Tonomura, Y. (1999). Whisper: a wrist-watch style wearable handset. In Proc. CHI'99, pp. 112--119. Google ScholarDigital Library
- Fukumoto, M. and Tonomura, Y. (1997) Body-coupled FingerRing: wireless wearable keyboard. Proc. CHI97, 147--154. Google ScholarDigital Library
- Goldberg, D. and Richardson, C. (1993). Touch-typing with a stylus. Proc. INTERCHI '93, pp. 80--87. Google ScholarDigital Library
- Graffiti. http://en.wikipedia.org/wiki/Graffiti_(Palm_OS)Google Scholar
- Harrison, C. and Hudson, S. (2008). Scratch input: creating large, inexpensive unpowered and mobile finger input surfaces. Proc. UIST '08, pp. 205--208. Google ScholarDigital Library
- Hinckley, K., Baudisch, P., Ramos, G., Guimbretiere, F. (2005). Design and analysis of delimiters for selection-action pen gesture phrases in scriboli. Proc. CHI '05, pp. 451--460. Google ScholarDigital Library
- Julien Couvreur's programming blog. Graffiti code download at http://blog.monstuff.com/archives/000012.htmlGoogle Scholar
- Hinckley, K. (2003). Synchronous gestures for multiple persons and computers. Proc. UIST '03. pp. 149--158. Google ScholarDigital Library
- Hudson, S. (2004). Using light emitting diode arrays as touch-sensitive input and output devices. Proc. UIST'04, pp. 287--290. Google ScholarDigital Library
- Kurtenbach, G. and Buxton, W. (1994). User learning and performance with marking menus. Proc. CHI '94, pp. 258--264. Google ScholarDigital Library
- Labrune, JB. And Mackay, W. (2006). Telebeads: social network mnemonics for teenagers. Proc. Conference on Interaction design and children'06, pp. 57--64. Google ScholarDigital Library
- Lawo, M., Herzog, O., Lukowicz, P., and Witt, H. (2008). Using wearable computing solutions in real-world applications. CHI '08 Extended Abstracts, pp. 3687--3692. Google ScholarDigital Library
- Li, K. A., Baudisch, P., and Hinckley, K. (2008). Blindsight: eyes-free access to mobile phones. Proc. CHI '08, 1389--1398. Google ScholarDigital Library
- Liess, M., Weijers, G., Heinks, C., van der Horst, A., Rommers, A., Duijve, R., and Mimnagh, G. (2002). A miniaturized multidirectional optical motion sensor and input device based on laser self-mixing. Measurement Science and Technology, 13(2002), pp. 2001--2006.Google ScholarCross Ref
- Luk, J., Pasquero, J., Little, S., MacLean, K., Levesque, V., and Hayward, V. (2006). A role for haptics in mobile interaction: initial design using a handheld tactile display prototype. Proc. CHI '06, pp. 171--180. Google ScholarDigital Library
- MacKenzie, I.S. and Zhang S.X. (1997). The immediate usability of graffiti. Proc. Graphics Interface '97, pp. 129--137. Google ScholarDigital Library
- MacKenzie, I.S. and Tanaka-Ishii, K. (2007). Text entry with a small number of buttons. In MacKenzie, I. S., and Tanaka--Ishii, K. (Eds.) Text entry systems: Mobility, accessibility, universality, pp. 105--121. San Francisco, CA: Morgan Kaufmann. Google ScholarDigital Library
- Mann, S. (1996). "Smart clothing": wearable multimedia computing and "personal imaging" to restore the balance between people and their intelligent environments. Proc. Multi-media '96, pp. 163--174. Google ScholarDigital Library
- Matias, E., MacKenzie, I. S., and Buxton, W. (1996). A wearable computer for use in microgravity space and other non-desktop environments. Proc. CHI '96, pp. 69--70. Google ScholarDigital Library
- Miner, C.S., Chan, D.M., and Campbell, C. (2001). Digital jewelry: wearable technology for everyday life. CHI '01 Extended Abstracts, pp. 45--46. Google ScholarDigital Library
- Morse code. http://en.wikipedia.org/wiki/Morse_codeGoogle Scholar
- Moscovich, T. and Hughes, J. F. (2004). Navigating documents with the virtual scroll ring. Proc. UIST '04, pp. 57--60. Google ScholarDigital Library
- Narayanaswami, C., Kamijoh, N., Raghunath, M., Inoue, T., Cipolla, T., Sanford, J., Schlig, E., Venkiteswaran, S., Guniguntala, D., Kulkarni, V., and Yamazaki, K. (2002). IBM's linux watch: the challenge of miniaturization. IEEE Computer, 35(1), January, 2002, pp. 33--41. Google ScholarDigital Library
- Olwal, A., Feiner, S., and Heyman, S. (2008). Rubbing and tapping for precise and rapid selection on touch-screen displays. Proc. CHI '08, pp. 295--304. Google ScholarDigital Library
- Popov, P., Pulov, S., and Pulov, V. (2004). A laser speckle pattern technique for designing an optical computer mouse. Opt Laser Eng, 42 (2004), pp. 21--26.Google ScholarCross Ref
- Potter, R., Weldon, L., Shneiderman, B. (1988). Improving the accuracy of touch screens: an experimental evaluation of three strategies. Proc. CHI '88, pp. 27--32. Google ScholarDigital Library
- Ramos, G., Boulos, M., and Balakrishnan, R. (2004). Pressure widgets. Proc. CHI '04, pp. 487--494. Google ScholarDigital Library
- Rekimoto, J. (2001). GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices. Proc. ISWC '01, pp. 21. Google ScholarDigital Library
- Russell, D. M., Streitz, N. A., and Winograd, T. (2005). Building disappearing computers. Commun. ACM 48, 3 (Mar. 2005), pp. 42--48. Google ScholarDigital Library
- Sawant, A.P. and Healey, C.G. (2005). A survey of display device properties and visual acuity for visualization. TR-2005-32, North Carolina State University.Google Scholar
- Schwesig, C., Poupyrev, I., and Mori, E. (2004). Gummi: a bendable computer. Proc. CHI '04, pp. 263--270. Google ScholarDigital Library
- Starner, T. (2002). The role of speech input in wearable computing. Pervasive Computing, 1(3), pp. 89--93. Google ScholarDigital Library
- Starner, T., Auxier, J., and Ashbrook, D. (2000). The gesture pendant: a self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. Proc. International Symposium on Wearable Computing '00, pp. 87--94. Google ScholarDigital Library
- Vogel, D. and Baudisch, P. (2007). Shift: A Technique for Operating Pen-Based Interfaces Using Touch. Proc. CHI'07, pp. 657--666. Google ScholarDigital Library
- Weiser, M. (1991). The Computer for the 21st Century. Scientific American Special Issue on Communications, Computers, and Networks, September, 1991.Google Scholar
- Werner, J., Wettach, R., and Hornecker, E. (2008). United-pulse: feeling your partner's pulse. Proc. MobileHCI '08, pp. 535--538. Google ScholarDigital Library
- Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. (2007). LucidTouch: a see-through mobile device. Proc. UIST '07, pp. 269--278. Google ScholarDigital Library
- Wilson, A.D., Cutrell, E. (2005). FlowMouse: a computer vision-based pointing and gesture input device. Proc. INTERACT'05, pp. 565--578. Google ScholarDigital Library
- Wobbrock, J. and Myers, B. (2006). Trackball text entry for people with motor impairments. Proc. CHI '06, pp. 479--488. Google ScholarDigital Library
- Wobbrock, J. O. and Myers, B. A. (2005). Gestural text entry on multiple devices. Proc. Assets '05, pp. 184--185. Google ScholarDigital Library
- Wobbrock, J.O., Myers, B.A., and Kembel, J.A. (2003). EdgeWrite: a stylus-based text entry method designed for high-accuracy and stability of motion. Proc. UIST '03, 61--70. Google ScholarDigital Library
- Yatani, K. and Truong, K. N. (2007). An evaluation of stylus-based text entry methods on handheld devices in stationary and mobile settings. Proc. MobileHCI '07, pp. 487--494. Google ScholarDigital Library
- Zhao, S. and Balakrishnan, R. (2004). Simple vs. compound mark hierarchical marking menus. Proc. UIST '04, pp. 33--42. Google ScholarDigital Library
- Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. (2007). Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proc. CHI '07, pp. 1395--1404. Google ScholarDigital Library
Index Terms
- Disappearing mobile devices
Recommendations
Rock-paper-fibers: bringing physical affordance to mobile touch devices
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe explore how to bring physical affordance to mobile touch devices. We present Rock-Paper-Fibers, a device that is functionally equivalent to a touchpad, yet that users can reshape so as to best match the interaction at hand. For efficiency, users ...
Improvements of chord input devices for mobile computer users
UAHCI'07: Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interactionThis study will be using a tablet computer as an example to study mobile products and make a comparison with keyboard and mouse by providing an input device consisting of a new form of touch pen in combination with chord input. The goal is to find the ...
Characteristics of pressure-based input for mobile devices
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsWe conducted a series of user studies to understand and clarify the fundamental characteristics of pressure in user interfaces for mobile devices. We seek to provide insight to clarify a longstanding discussion on mapping functions for pressure input. ...
Comments