Lisa Anthony
Quincy Brown
ABSTRACT
Surface gesture interaction styles used on modern mobile touchscreen devices are often dependent on the platform and application. Some applications show a visual trace of gesture input as it is made by the user, whereas others do not. Little work has been done examining the usability of visual feedback for surface gestures, especially for children. In this paper, we present results from an empirical study conducted with children, teens, and adults to explore characteristics of gesture interaction with and without visual feedback. We find that the gestures generated with and without visual feedback by users of different ages diverge significantly in ways that make them difficult to interpret. In addition, users prefer to see visual feedback. Based on these findings, we present several design recommendations for new surface gesture interfaces for children, teens, and adults on mobile touchscreen devices. In general, we recommend providing visual feedback, especially for children, wherever possible.
- Akamatsu, M., MacKenzie, I. S., and Hasbroucq, T. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics 38, 4 (1995), 816--827.Google Scholar
Cross Ref
- Anthony, L., Brown, Q., Nias, J., Tate, B., and Mohan, S. Interaction and Recognition Challenges in Interpreting Children's Touch and Gesture Input on Mobile Devices. Proc. ITS 2012, ACM Press (2012), 225--234. Google ScholarDigital Library
- Anthony, L., Vatavu, R.-D., and Wobbrock, J. O. Understanding the Consistency of Users' Pen and Finger Stroke Gesture Articulation. Proc. GI 2013, Canadian Information Processing Society (2013), to appear.Google Scholar
- Anthony, L. and Wobbrock, J. O. $N-protractor: a fast and accurate multistroke recognizer. Proc. GI 2012, Canadian Information Processing Society (2012), 117--120. Google ScholarDigital Library
- Beery, K., Buktenica, N., and Beery, N. A. The Beery-Buktenica Developmental Test of Visual-Motor Integration, 5th Edition. Modern Curriculum Press, New Jersey, 2004.Google Scholar
- Brown, Q. and Anthony, L. Toward Comparing the Touchscreen Interaction Patterns of Kids and Adults. ACM SIGCHI EIST Workshop 2012, (2012), 4pp.Google Scholar
- Brown, Q., Hatley, L., Bonsignore, E. M., and Druin, A. Mobile Natives: Unlocking the Potential of Educational Technology. ACM SIGCHI 2nd Workshop on UI Technologies and Their Impact on Educational Pedagogy 2011, (2011), 4pp.Google Scholar
- De Bruyn, D. and Davis, A. Visual feedback is not essential for children to make the perpendicular bias. Perception ECVP Abstract Supplement 37, (2008), 149.Google Scholar
- Clawson, J., Lyons, K., Starner, T., and Clarkson, E. The Impacts of Limited Visual Feedback on Mobile Text Entry for the Twiddler and Mini-QWERTY Keyboards. Proc. ISWC 2005, IEEE (2005), 170--177. Google ScholarDigital Library
- Dean, A. and Voss, D. Design and Analysis of Experiments. Springer-Verlag, New York, NY, USA, 1999.Google ScholarCross Ref
- Donker, A. and Reitsma, P. Aiming and clicking in young children's use of the computer mouse. Computers in Human Behavior 23, 6 (2007), 2863--2874. Google ScholarDigital Library
- Frisch, M., Heydekorn, J., and Dachselt, R. Investigating multi-touch and pen gestures for diagram editing on interactive surfaces. Proc. ITS 2009, ACM Press (2009), 149--156. Google ScholarDigital Library
- Gustafson, S. Imaginary interfaces: touchscreen-like interaction without the screen. Ext. Abstracts CHI 2012, ACM Press (2012), 927--930. Google ScholarDigital Library
- Harris, A., Rick, J., Bonnett, V., Yuill, N., Fleck, R., Marshall, P., and Rogers, Y. Around the Table: Are multiple-touch surfaces better than single-touch for children's collaborative interactions? Proc. CSCL 2009, ISLS (2009), 335--344. Google ScholarDigital Library
- Hinrichs, U. and Carpendale, S. Gestures in the wild. Proc. CHI 2011, ACM Press (2011), 3023--3032. Google ScholarDigital Library
- Hourcade, J. P., Bederson, B. B., Druin, A., and Guimbretière, F. Differences in pointing task performance between preschool children and adults using mice. ACM Transactions on Computer-Human Interaction 11, 4 (2004), 357--386. Google ScholarDigital Library
- Inkpen, K. M. Drag-and-drop versus point-and-click mouse interaction styles for children. ACM ToCHI 8, 1 (2001), 1--33. Google ScholarDigital Library
- Joiner, R., Messer, D., Light, P., and Littleton, K. It is best to point for young children: a comparison of children's pointing and dragging. Computers in Human Behavior 14, 3 (1998), 513--529.Google ScholarCross Ref
- Jones, T. An Empirical Study of Children's Use of Computer Pointing Devices. Journal of Educational Computing Research 7, 1 (1991), 61--76.Google ScholarCross Ref
- Kammer, D., Wojdziak, J., Keck, M., Groh, R., and Taranko, S. Towards a formalization of multi-touch gestures. Proc. DIS 2010, ACM Press (2010), 49--58. Google ScholarDigital Library
- Kane, S. K., Wobbrock, J. O., and Ladner, R. E. Usable gestures for blind people: understanding preference and performance. Proc. CHI 2011, ACM Press (2011), 413--422. Google ScholarDigital Library
- Kratz, S. and Ballagas, R. Unravelling seams: improvoing mobile gesture recognition with visual feedback techniques. Proc. CHI 2009, ACM Press (2009), 937--940. Google ScholarDigital Library
- Li, Y. Gesture search: a tool for fast mobile data access. Proc. UIST 2010, ACM Press (2010), 87--96. Google ScholarDigital Library
- Lin, E., Cassidy, A., Hook, D., and Baliga, A. Hand tracking using spatial gesture modeling and visual feedback for a virtual DJ system. Proc. ICMI 2002, IEEE (2002), 197--202. Google ScholarDigital Library
- Morris, M. R., Wobbrock, J. O., and Wilson, A. D. Understanding users' preferences for surface gestures. Proc. GI 2010, Canadian Information Processing Society (2010), 261--268. Google ScholarDigital Library
- Piaget, J. Piaget's Theory. In P. Mussen, ed., Handbook of Child Psychology. Wiley & Sons, New York, NY, USA, 1983.Google Scholar
- Read, J. C., MacFarlane, S., and Casey, C. Pens behaving badly-usability of pens and graphics tablets for text entry with children. Adj. Proc. UIST 2002, ACM Press (2002), 21--22.Google Scholar
- Rick, J., Harris, A., Marshall, P., Fleck, R., Yuill, N., and Rogers, Y. Children designing together on a multi-touch tabletop: An analysis of spatial orientation and user interactions. Proc. IDC 2009, ACM Press (2009), 106--114. Google ScholarDigital Library
- Rösblad, B. Reaching and eye-hand coordination. In A. Henderson and C. Pehoski, eds., Hand Function in the Child: Foundations for Remediation. Mosby Elsevier, St. Louis, MO, USA, 2006.Google Scholar
- Ryall, K., Morris, M. R., Everitt, K., Forlines, C., and Shen, C. Experiences with and observations of direct-touch tabletops. Proc. Tabletop 2006, IEEE (2006), 8pp. Google ScholarDigital Library
- Shuler, C. Pockets of Potential: Using Mobile Technologies to Promote Children's Learning. Joan Ganz Cooney Center at Sesame Workshop, New York, NY, 2009.Google Scholar
- Smyth, M. M. Visual control of movement patterns and the grammar of action. Acta psychologica 70, 3 (1989), 253--265.Google Scholar
- Tu, H., Ren, X., and Zhai, S. A comparative evaluation of finger and pen stroke gestures. Proc. CHI 2012, ACM Press (2012), 1287--1296. Google ScholarDigital Library
- Vinter, A. and Meulenbroek, R. The role of manual dominance and visual feedback in circular drawing movements. Journal of Human Movement Studies 25, (1993), 11--37.Google Scholar
- Wobbrock, J. O., Morris, M. R., and Wilson, A. D. User-defined gestures for surface computing. Proc. CHI 2009, ACM Press (2009), 1083--1092. Google ScholarDigital Library
- Zhai, S., Kristensson, P. O., Appert, C., Anderson, T. H., and Cao, X. Foundational Issues in Touch-Surface Stroke Gesture Design --- An Integrative Review. Foundations and Trends in Human--Computer Interaction 5, 2 (2012), 97--205.Google ScholarDigital Library
- Zhao, S., Dragicevic, P., Chignell, M., Balakrishnan, R., and Baudisch, P. Earpod: eyes-free menu selection using touch input and reactive audio feedback. Proc. CHI 2007, ACM Press (2007), 1395--1404. Google ScholarDigital Library
Index Terms
- Examining the need for visual feedback during gesture interaction on mobile touchscreen devices for kids
Recommendations
Interaction and recognition challenges in interpreting children's touch and gesture input on mobile devices
ITS '12: Proceedings of the 2012 ACM international conference on Interactive tabletops and surfacesAs mobile devices like the iPad and iPhone become increasingly commonplace, touchscreen interactions are quickly overtaking other interaction methods in terms of frequency and experience for many users. However, most of these devices have been designed ...
Using gamification to motivate children to complete empirical studies in lab environments
IDC '13: Proceedings of the 12th International Conference on Interaction Design and ChildrenIn this paper, we describe the challenges we encountered and solutions we developed while collecting mobile touch and gesture interaction data in laboratory conditions from children ages 5 to 7 years old. We identify several challenges of conducting ...
Children (and adults) benefit from visual feedback during gesture interaction on mobile touchscreen devices
Surface-gesture interaction styles used on mobile touchscreen devices often depend on the platform and application. Some applications show a visual trace of gesture input being made by the user, whereas others do not. Little work has been done examining ...
Comments