Surbhit Verma
ABSTRACT
With gestural interfaces becoming increasingly popular across multiple platforms and devices, there is a need to investigate suitable gestural inputs, its effectiveness and acceptance of such interaction techniques. In this paper, we present a study conducted to investigate four suitable gestural input methods (i) Grabbing (ii) Pointing (iii) Hand motion in 2D plane and (iv) Body movement in 3D space for menu selection, their performance and acceptance for gesture-controlled user interfaces using a game "Treasure Hunt". Study was conducted with two different sets of 20-20 participants in public and private environment. We investigated the gestures from participants for their ranking preferences, social acceptance (user and spectator) and positive-negativeaffect after experiencing each menu selection method. Each selection method was also evaluated for its usability through collecting error rates and task completion time. These parameters were analyzed for exploring trends within and between environments. We observed that Grabbing was most preferred for both public and private environment, however it took significantly higher time to complete the task. Pointing and Hand Motion in 2D Plane found most errors in both environments. Higher social acceptance was found in public environment than private environment. We also present subjective analysis and discuss them in detail.
- Bhuiyan, M., and Picking, R. 2009. Gesture-controlled user interfaces, what have we done and what's next. In Proceedings of the Fifth Collaborative Research Symposium on Security, E-Learning, Internet and Networking (SEIN 2009), Darmstadt, Germany (Nov. 2009), 25--29.Google Scholar
- Bobeth, J., Schmehl, S., Kruijff, E., Deutsch, S., and Tscheligi, M. 2012. Evaluating performance and acceptance of older adults using freehand gestures for TV menu control. In Proceedings of the 10th European conference on Interactive tv and video (EuroiTV '12). ACM, New York, NY, USA, 35--44. DOI=http://dx.doi.org/10.1145/2325616.2325625 Google ScholarDigital Library
- Characteristics and Guidelines of Great Public Spaces, Great Paces in America: Public Spaces. Retrieved October 25, 2015 from American Planning Association: http://www.planning.org/greatplaces/spaces/characteristics.htmGoogle Scholar
- Controls Basics WPF-C# Sample, Kinect for Window SDK 1.8 Documentation. Retrieved October25, 2015 from Microsoft Developer Network: https://msdn.microsoft.com/en-us/library/dn188701.aspxGoogle Scholar
- Dam, P., Braz, P., & Raposo, A. 2013. A Study of Navigation and Selection Techniques in Virtual Environments Using Microsoft Kinect®®. In Virtual Augmented and Mixed Reality. Designing and Developing Augmented and Virtual Environments,Springer, Berlin Heidelberg (July, 2013), 139--148. DOI=http://dx.doi.org/10.1007/978-3-642-39405-8_17Google ScholarCross Ref
- Dix, A., Rodden, T., Davies, N., Trevor, J., Friday, A., and Palfreyman, K. 2000. Exploiting space and location as a design framework for interactive mobile systems. ACM Trans. Comput.-Hum. Interact. 7, 3 (September 2000), 285--321. DOI=http://dx.doi.org/10.1145/355324.355325 Google ScholarDigital Library
- Eriksson, E., Hansen, T. R. and Lykke-Olesen, A. 2007. Reclaiming public space: designing for public interaction with private devices. In Proceedings of the 1st international conference on Tangible and embedded interaction (TEI '07). ACM, New York, NY, USA, 31--38. DOI=http://dx.doi.org/10.1145/1226969.1226976 Google ScholarDigital Library
- Gerling, K., Livingston, I., Nacke, L., Mandryk, R. 2012. Full-body motion-based game interaction for older adults. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1873--1882. DOI=http://dx.doi.org/10.1145/2207676.2208324. Google ScholarDigital Library
- Huang, E. M., and Mynatt, E. D. 2003. Semi-public displays for small, co-located groups. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '03). ACM, New York, NY, USA, 49--56. DOI=http://dx.doi.org/10.1145/642611.642622 Google ScholarDigital Library
- Interaction Gallery-WPF C# Sample, Kinect for Window SDK 1.8 Documentation. Retrieved October 25, 2015 from Microsoft Developer Network: https://msdn.microsoft.com/en-us/library/jj663801.aspxGoogle Scholar
- Jing, P., & Ye-peng, G. 2013. Human-computer Interaction using Pointing Gesture based on an Adaptive Virtual Touch Screen. International Journal of Signal Processing, Image Processing & Pattern Recognition, 6(4), 81--92Google Scholar
- Kim, D. and Kim, D. 2006. An Intelligent Smart Home Control Using Body Gestures. In the Proceedings of International Conference on Hybrid Information Technology, (ICHIT'06), IEEE, Korea (Nov. 2006), 439--446 DOI=http://dx.doi.org/10.1109/ICHIT.2006.253644 Google ScholarCross Ref
- Kulshreshth, A., & LaViola Jr, J. J. 2014. Exploring the usefulness of finger-based 3D gesture menu selection. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 1093--1102. DOI=http://dx.doi.org/10.1145/2556288.2557122 Google ScholarDigital Library
- Kurtenbach, G., & Buxton, W. 1994. User learning and performance with marking menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94), Beth Adelson, Susan Dumais, and Judith Olson (Eds.). ACM, New York, NY, USA, 258--264. DOI=http://dx.doi.org/10.1145/191666.191759 Google ScholarDigital Library
- Lee, H., Jeong, H., Lee, J., Yeom, K. W., Shin, H. J., & Park, J. H. 2008. Select-and-point: a novel interface for multi-device connection and control based on simple hand gestures. In CHI '08 Extended Abstracts on Human Factors in Computing Systems (CHI EA '08). ACM, New York, NY, USA, 3357--3362. DOI=http://dx.doi.org/10.1145/1358628.1358857 Google ScholarDigital Library
- Lewis, H. D. 1952. Private and Public Space. In Proceedings of the Aristotelian Society, Harrison & Sons, Ltd.(Jan. 1952), 79--94.Google Scholar
- Medhi, I., & Toyama, K. 2007. Full-context videos for first-time, non-literate PC users. In Information and Communication Technologies and Development(ICTD' 07). International Conference on, IEEE, (Dec, 2007) 1 --9. DOI=http://dx.doi.org/10.1109/ICTD.2007.4937400Google Scholar
- Montero, C. S., Alexander, J., Marshall, M. T., & Subramanian, S. 2010. Would you do that?: understanding social acceptance of gestural interfaces. In Proceedings of the 12th international conference on Human computer interaction with mobile devices and services (MobileHCI '10). ACM, New York, NY, USA, 275--278. DOI=http://dx.doi.org/10.1145 Google ScholarDigital Library
- Ni, T., McMahan, R. P., Bowman, D. A. 2008. Tech-note: rapMenu: Remote Menu Selection Using Freehand Gestural Input.In 3D User Interfaces, (3DUI' 08). IEEE Symposium on(March 2008), 55--58. DOI=http://dx.doi.org/10.1109/3DUI.2008.4476592 Google ScholarDigital Library
- Pakkanen, T., & Raisamo, R. 2004. Appropriateness of foot interaction for non-accurate spatial tasks. In CHI '04 Extended Abstracts on Human Factors in Computing Systems (CHI EA '04). ACM, New York, NY, USA, 1123--1126. DOI=http://dx.doi.org/10.1145/985921.986004 Google ScholarDigital Library
- Patterson, M.2011. In Between Public and Private: Emerging Spaces in Cities, Emerging Realities: A Social Sciences Graduate Conference, University of Waterloo (Oct. 2011).Google Scholar
- Raptis, D., Tselios, N., & Avouris, N. 2005. Context-based design of mobile applications for museums: a survey of existing practices. In Proceedings of the 7th international conference on Human computer interaction with mobile devices & services (MobileHCI '05). ACM, New York, NY, USA, 153--160. DOI=http://dx.doi.org/10.1145/1085777.1085803 Google ScholarDigital Library
- Rico, J., & Brewster, S. 2010. Usable gestures for mobile interfaces: evaluating social acceptability. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 887--896. DOI=http://dx.doi.org/10.1145/1753326.1753458 Google ScholarDigital Library
- Roccetti, M., Marfia, G., & Semeraro, A. 2012. Playing into the wild: A gesture-based interface for gaming in public spaces. Journal of Visual Communication and Image Representation, 23(3), (April 2012), 426--440. DOI= http://dx.doi.org/10.1016/j.jvcir.2011.12.006 Google ScholarDigital Library
- Rodrigues, P. G., Raposo, A. B., Soares, L. 2011. A Virtual Touch Interaction Device for Immersive Applications,International Journal of Virtual Reality, 10(4), (2011), 1 --10Google Scholar
- Russell, D. M., Drews, C., & Sue, A. 2002. Social aspects of using large public interactive displays for collaboration. In Ubiquitous Computing(UbiComp' 02), Springer Berlin Heidelberg(Sep. 2002), 229--236. DOI=http://dx.doi.org/10.1007/3-540-45809-3_18 Google ScholarCross Ref
- Simeone, A. L., Velloso, E., Alexander, J., & Gellersen, H. 2014. Feet movement in desktop 3D interaction. In 3D User Interfaces (3DUI' 14), IEEE Symposium on, IEEE(March 2014), 71 --74. DOI=http://dx.doi.org/10.1109/3DUI.2014.6798845Google Scholar
- Thompson, E. R. 2007. Development and validation of an internationally reliable short-form of the positive and negative affect schedule (PANAS). Journal of Cross-Cultural Psychology, 38(2), (March 2007), 227--242. DOI=http://dx.doi.org/10.1177/0022022106297301Google ScholarCross Ref
- Vatavu, R. D. 2013. Designing gestural interfaces for the interactive TV. In Proceedings of the 11th european conference on Interactive TV and video (EuroITV '13). ACM, New York, NY, USA, 167--168. DOI=http://dx.doi.org/10.1145/2465958.2465981 Google ScholarDigital Library
- Vogel, D. and Balakrishnan, R. 2005. Distant freehand pointing and clicking on very large, high resolution displays. In Proceedings of the 18th annual ACM symposium on User interface software and technology (UIST '05). ACM, New York, NY, USA, 33--42. DOI=http://dx.doi.org/10.1145/1095034.1095041 Google ScholarDigital Library
- Widmer, A., Schaer, R., Markonis, D., & Müüller, H. 2014. Gesture Interaction for Content--based Medical Image Retrieval. In Proceedings of International Conference on Multimedia Retrieval (ICMR '14). ACM, New York, NY, USA, 503--507. DOI=http://dx.doi.org/10.1145/2578726.2578804 Google ScholarDigital Library
Recommendations
Gestural Technology: Moving Interfaces in a New Direction
Gesture-based interfaces--which let users control devices with,for example, hand or finger motions--are becoming increasingly popular.
Gestural interfaces for elderly users: help or hindrance?
GW'09: Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer InteractionIn this paper we investigate whether finger gesture input is a suitable input method, especially for older users (60+) with respect to age-related changes in sensory, cognitive and motor abilities. We present a study in which we compare a group of older ...
Designing, Engineering, and Evaluating Gesture User Interfaces
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing SystemsThis course will introduce participants to the three main stages of the development life cycle of gesture-based interactions: (ul) how to design a gesture user interface (UI) by carefully considering key aspects, such as gesture recognition techniques, ...
Comments