Lung-Pan Cheng
Hsiang-Sheng Liang
Mike Y. Chen
ABSTRACT
Multitouch tablets, such as iPad and Android tablets, support virtual keyboards for text entry. Our 64-user study shows that 98% of the users preferred different keyboard layouts and positions depending on how they were holding these devices. However, current tablets either do not allow keyboard adjustment or require users to manually adjust the keyboards. We present iGrasp, which automatically adapts the layout and position of virtual keyboards based on how and where users are grasping the devices without requiring explicit user input. Our prototype uses 46 capacitive sensors positioned along the sides of an iPad to sense users' grasps, and supports two types of grasp-based automatic adaptation: layout switching and continuous positioning. Our two 18-user studies show that participants were able to begin typing 42% earlier using iGrasp's adaptive keyboard compared to the manually adjustable keyboard. Participants also rated iGrasp much easier to use than the manually adjustable keyboard (4.2 vs 2.9 on five-point Likert scale.)
Supplemental Material
- Benko, H., Izadi, S., Wilson, A. D., Cao, X., Rosenfeld, D., and Hinckley, K. Design and Evaluation of Interaction Models for Multi-touch Mice. In GI '10, ACM (2010), 253--260. Google Scholar
Digital Library
- Butler, A., Izadi, S., and Hodges, S. SideSight: multi-touch interaction around small devices. In Proceedings of the 21st annual ACM symposium on User interface software and technology, ACM (2008), 201--204. Google ScholarDigital Library
- Cheng, L.-P., Hsiao, F.-I., Liu, Y.-t., and Chen, M. Y. iRotate: Automatic Screen Rotation based on Face Orientation. In Proc. CHI '12, ACM (2012), 2203--2210. Google ScholarDigital Library
- Cheng, L.-P., Lee, M.-H., Wu, C.-Y., Hsiao, F.-i., Liu, Y.-t., Liang, H.-S., Chiu, Y.-C., Lee, M.-S., and Chen, M. Y. iRotateGrasp: Automatic Screen Rotation based on Grasp of Mobile Devices. In Porc. CHI '13, ACM (2013). Google ScholarDigital Library
- Faraj, K. A., Mojahid, M., and Vigouroux, N. BigKey: A Virtual Keyboard for Mobile Devices. In Proceedings of the 13th International Conference on Human-Computer Interaction. Part III: Ubiquitous and Intelligent Interaction, no. 60, Springer-Verlag (Berlin, Heidelberg, 2009), 3--10. Google ScholarDigital Library
- Fitrianie, S., and Rothkrantz, L. J. M. An adaptive circular (text) input for handheld devices. In Proc. CompSysTech '11, ACM (2011), 405--410. Google ScholarDigital Library
- Goel, M., Findlater, L., and Wobbrock, J. O. WalkType: Using Accelerometer Data to Accommodate Situational Impairments in Mobile Touch Screen Text Entry. In Proc. CHI '12, ACM (2012), 2687--2696. Google ScholarDigital Library
- Goel, M., Wobbrock, J. O., and Patel, S. N. GripSense: Using Built-In Sensors to Detect Hand Posture and Pressure on Commodity Mobile Phones. In Proc. UIST '12, ACM (2012), 545--554. Google ScholarDigital Library
- Gu, J., and Lee, G. TouchString: a flexible linear multi-touch sensor for prototyping a freeform multi-touch surface. In Adjunct Proc. UIST '11, ACM (2011), 75--76. Google ScholarDigital Library
- Gunawardana, A., Paek, T., and Meek, C. Usability Guided Key-Target Resizing for Soft Keyboards. In Proc IUI '10, ACM (2010), 111--118. Google ScholarDigital Library
- Harrison, B. L., Fishkin, K. P., Gujar, A., Mochon, C., and Want, R. Squeeze me, hold me, tilt me! An exploration of manipulative user interfaces. In Proc. CHI '98, CHI '98, ACM (1998), 17--24. Google ScholarDigital Library
- Hart, S. G., and Staveland, L. E. Development of Nasa Tlx (Task Load Index): Results of Empirical and Theoretical Research. Human Mental Workload. In Human Mental Workload (1988), 139--183.Google Scholar
- Himberg, J., Häkkilä, J., Kangas, P., and Mäntyjärvi, J. On-line personalization of a touch screen based keyboard. In Proc. IUI '03, ACM (2003), 77--84. Google ScholarDigital Library
- Hinckley, K., Pierce, J., Sinclair, M., and Horvitz, E. Sensing techniques for mobile interaction. In Proceedings of the 13th annual ACM symposium on User interface software and technology, vol. 2, ACM (2000), 91--100. Google ScholarDigital Library
- Hinckley, K., and Sinclair, M. Touch-sensing input devices. In Proc. CHI '99, no. May, ACM (1999), 223--230. Google ScholarDigital Library
- Kim, K., Chang, W., Cho, S.-j., Shim, J., Lee, H., Park, J., Lee, Y., and Kim, S. Hand grip pattern recognition for mobile user interfaces. In Proc. AAAI '06, vol. 21, MIT (2006), 1789--1794. Google ScholarDigital Library
- Kristensson, P.-O., and Zhai, S. SHARK2: a large vocabulary shorthand writing system for pen-based computers. In Proc. UIST '04, no. 2, ACM (2004), 43--52. Google ScholarDigital Library
- MacKenzie, I. S., and Soukoreff, R. W. Phrase sets for evaluating text entry techniques. In Proc. CHI '03 extended abstracts, ACM (2003), 754--755. Google ScholarDigital Library
- Mayzner, M., and Tresselt, M. Tables of Single-letter and Diagram Frequency Counts for Various Word-length and Letter-position Combinations. Psychonomic monograph supplements, v. 1, no. 2, 1965.Google Scholar
- Nybergh, K., and Himberg, J. Touch detection system for mobile terminals. In Proc. MobileHCI '05, ACM (2004), 331--336.Google Scholar
- Oliver, B. M. Time Domain Reflectometry. HP Journal (1964), 15(6).Google Scholar
- Pai, D. K., VanDerLoo, E. W., and Sadhukhan, S. The tango: A tangible tangoreceptive whole-hand human interface. In Proc. World Haptics '05, IEEE Computer Society (2005), 141--147. Google ScholarDigital Library
- Rudchenko, D., Paek, T., and Badger, E. Text text revolution: a game that improves text entry on mobile touchscreen keyboards. In Proc. Pervasive '11, Pervasive'11, Springer-Verlag (2011), 206--213. Google ScholarDigital Library
- Rudeck, F., and Baudisch, P. Rock-Paper-Fibers: Bringing Physical Affordance to Mobile Touch Devices. In Proc. CHI '12, no. d, ACM (2012), 1929--1932. Google ScholarDigital Library
- Sato, M., Poupyrev, I., and Harrison, C. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proc. CHI '12, ACM (May 2012), 483--492. Google ScholarDigital Library
- Savage, V., Zhang, X., and Hartmann, B. Midas: Fabricating Custom Capacitive Touch Sensors to Prototype Interactive Objects. In Proc. UIST '12, ACM (2012), 579--588. Google ScholarDigital Library
- Schmidt, A., Aidoo, K., Takaluoma, A., Tuomela, U., Van Laerhoven, K., and Van de Velde, W. Advanced interaction in context. In Handheld and ubiquitous computing, Springer (1999), 89--101. Google ScholarDigital Library
- Schmidt, A., Beigl, M., and Gellersen, H. There is more to context than location. Computers & Graphics 23, 6 (1999), 893--901.Google ScholarCross Ref
- Song, H., Benko, H., Guimbretiere, F., Izadi, S., Cao, X., and Hinckley, K. Grips and gestures on a multi-touch pen. In Proceedings of the 2011 annual conference on Human factors in computing systems, vol. 21, ACM (2011), 1323--1332. Google ScholarDigital Library
- Taylor, B., and Bove, Jr., V. Graspables: grasp-recognition as a user interface. In Proceedings of the 27th international conference on Human factors in computing systems, ACM (2009), 917--926. Google ScholarDigital Library
- Veldhuis, R., Bazen, A., Kauffman, J., and Hartel, P. Biometric verification based on grip-pattern recognition. In Security, Steganography, and Watermarking of Multimedia Contents, volume 5306 of Proceedings of SPIE, vol. 31, Centre for Telematics and Information Technology University of Twente (2004), 634--641.Google Scholar
- Wagner, J., Huot, S., and Mackay, W. BiTouch and BiPad : Designing Bimanual Interaction for Hand-held Tablets. In Proc. CHI '12, ACM (2012), 2317--2326. Google ScholarDigital Library
- Wimmer, R. FlyEye: grasp-sensitive surfaces using optical fiber. In Proc. TEI '10, ACM (2010), 245--248. Google ScholarDigital Library
- Wimmer, R., and Baudisch, P. Modular and deformable touch-sensitive surfaces based on time domain reflectometry. In Proc. UIST '11, no. 1, ACM (2011), 517--526. Google ScholarDigital Library
- Wimmer, R., and Boring, S. HandSense: discriminating different ways of grasping and holding a tangible user interface. In Proc. TEI '09, ACM (2009), 359--362. Google ScholarDigital Library
- Yu, N., Tsai, S., Hsiao, I.-c., Tsai, D., Lee, M., Chen, M., Hung, Y., and Others. Clip-on gadgets: expanding multi-touch interaction area with unpowered tactile controls. In Proc. UIST '11, ACM (2011), 367--372. Google ScholarDigital Library
Index Terms
- iGrasp: grasp-based adaptive keyboard for mobile devices
Recommendations
iGrasp: grasp-based adaptive keyboard for mobile devices
CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing SystemsMultitouch tablets, such as iPad and Android tablets, support virtual keyboards for text entry. Our 64-user study shows that 98% of the users preferred different keyboard layouts and positions depending on how they were holding these devices. However, ...
Effective manipulation of virtual objects within arm's reach
VR '11: Proceedings of the 2011 IEEE Virtual Reality ConferenceWe present a study that compares finger-based direct interaction to controller-based ray interaction in a CAVE as well as in head-mounted displays. We focus on interaction tasks within reach of the users' arms and hands and explore various feedback ...
Visual touchpad: a two-handed gestural input device
ICMI '04: Proceedings of the 6th international conference on Multimodal interfacesThis paper presents the Visual Touchpad, a low-cost vision-based input device that allows for fluid two-handed interactions with desktop PCs, laptops, public kiosks, or large wall displays. Two downward-pointing cameras are attached above a planar ...
Comments