Top

Published in:

2017 | OriginalPaper | Chapter

Understanding Gesture Articulations Variability

Authors : Orlando Erazo, Yosra Rekik, Laurent Grisoni, José A. Pino

Published in: Human-Computer Interaction - INTERACT 2017

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Interfaces based on mid-air gestures often use a one-to-one mapping between gestures and commands, but most remain very basic. Actually, people exhibit inherent intrinsic variations for their gesture articulations because gestures carry dependency with both the person producing them and the specific context, social or cultural, in which they are being produced. We advocate that allowing applications to map many gestures to one command is a key step to give more flexibility, avoid penalizations, and lead to better user interaction experiences. Accordingly, this paper presents our results on mid-air gesture variability. We are mainly concerned with understanding variability in mid-air gesture articulations from a pure user-centric perspective. We describe a comprehensive investigation on how users vary the production of gestures under unconstrained articulation conditions. The conducted user study consisted in two tasks. The first one provides a model of user conception and production of gestures; from this study we also derive an embodied taxonomy of gestures. This taxonomy is used as a basis for the second experiment, in which we perform a fine grain quantitative analysis of gesture articulation variability. Based on these results, we discuss implications for gesture interface designs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter TrackLine: Refining touch-to-track Interaction for Camera Motion Control on Mobile Devices

next chapter Watching Your Back While Riding Your Bike

Ackad, C., Clayphan, A., Tomitsch, M., Kay, J.: An in-the-wild study of learning mid-air gestures to browse hierarchical information at a large interactive public display. In: Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp 2015, pp. 1227–1238. ACM, New York, NY, USA (2015). http://doi.acm.org/10.1145/2750858.2807532

Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindbauer, D., Ion, A., Zhao, S., Koh, J.T.K.V.: Understanding mid-air hand gestures: a study of human preferences in usage of gesture types for HCI. Technical report, November 2012. https://www.microsoft.com/enus/research/publication/understanding-mid-air-hand-gestures-a-study-ofhuman-preferences-in-usage-of-gesture-types-for-hci/

Anthony, L., Wobbrock, J.O.: A lightweight multistroke recognizer for user interface prototypes. In: Proceedings of Graphics Interface 2010, GI 2010, pp. 245–252. Canadian Information Processing Society, Toronto, Ontario, Canada (2010). http://dl.acm.org/citation.cfm?id=1839214.1839258

Barkhuus, L.: Television on the internet: new practices, new viewers. In: CHI 2009 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2009, pp. 2479–2488. ACM, New York, NY, USA (2009). http://doi.acm.org/10.1145/1520340.1520351

Chen, L.-C., Chu, P.-Y., Cheng, Y.-M.: Exploring the ergonomic issues of user-defined mid-air gestures for interactive product exhibition. In: Streitz, N., Markopoulos, P. (eds.) DAPI 2016. LNCS, vol. 9749, pp. 180–190. Springer, Cham (2016). doi:10.1007/978-3-319-39862-4_17 CrossRef

Choi, E., Kim, H., Chung, M.K.: A taxonomy and notation method for three-dimensional hand gestures. Int. J. Ind. Ergon. 44(1), 171–188 (2014)CrossRef

Dahlbäck, N., Jönsson, A., Ahrenberg, L.: Wizard of Oz studies: why and how. In: Proceedings of the 1st International Conference on Intelligent User Interfaces, IUI 1993, pp. 193–200. ACM, New York, NY, USA (1993). http://doi.acm.org/10.1145/169891.169968

Dezfuli, N., Khalilbeigi, M., Mühlhäuser, M., Geerts, D.: A study on interpersonal relationships for social interactive television. In: Proceedings of the 9th International Interactive Conference on Interactive Television, EuroITV 2011, pp. 21–24. ACM, New York, NY, USA (2011). http://doi.acm.org/10.1145/2000119.2000123

Erazo, O., Pino, J.A.: Predicting task execution time on natural user interfaces based on touchless hand gestures. In: Proceedings of the 20th International Conference on Intelligent User Interfaces, IUI 2015, pp. 97–109. ACM, New York, NY, USA (2015). http://doi.acm.org/10.1145/2678025.2701394

10.

Erazo, O., Pino, J.A., Antunes, P.: Estimating production time of touchless hand drawing gestures. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9298, pp. 552–569. Springer, Cham (2015). doi:10.1007/978-3-319-22698-9_38 CrossRef

11.

Gallo, L., Placitelli, A.P., Ciampi, M.: Controller-free exploration of medical image data: experiencing the kinect. In: 2011 24th International Symposium on Computer-Based Medical Systems (CBMS), pp. 1–6, June 2011

12.

Henschke, M., Gedeon, T., Jones, R.: Touchless gestural interaction with wizard-of-Oz: analysing user behaviour. In: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction, OzCHI 2015, pp. 207–211. ACM, New York, NY, USA (2015). http://doi.acm.org/10.1145/2838739.2838792

13.

Hespanhol, L., Tomitsch, M., Grace, K., Collins, A., Kay, J.: Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. In: Proceedings of the 2012 International Symposium on Pervasive Displays, PerDis 2012, pp. 6:1–6:6. ACM, New York, NY, USA (2012). http://doi.acm.org/10.1145/2307798.2307804

14.

Ho, L., Hornecker, E., Bertel, S.: Modifying gesture elicitation: do kinaesthetic priming and increased production reduce legacy bias? In: Proceedings of the TEI 2016: Tenth International Conference on Tangible, Embedded, and Embodied Interaction, TEI 2016, pp. 86–91. ACM, New York, NY, USA (2016). http://doi.acm.org/10.1145/2839462.2839472

15.

Ismair, S., Wagner, J., Selker, T., Butz, A.: Mime: teaching mid-air pose-command mappings. In: Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2015, pp. 199–206. ACM, New York, NY, USA (2015). http://doi.acm.org/10.1145/2785830.2785854

16.

Kendon, A.: Gesture: Visible Action as Utterance. Cambridge University Press, Cambridge (2004)CrossRef

17.

Kistler, F., André, E.: User-defined body gestures for an interactive storytelling scenario. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) Human Computer – Interaction INTERACT 2013 14th IFIP TC 13 International Conference, pp. 264–281. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40480-1_17 CrossRef

18.

Kita, S., van Gijn, I., van der Hulst, H.: Movement phases in signs and co-speech gestures, and their transcription by human coders. In: Wachsmuth, I., Fröhlich, M. (eds.) GW 1997. LNCS, vol. 1371, pp. 23–35. Springer, Heidelberg (1998). doi:10.1007/BFb0052986 CrossRef

19.

Kratz, S., Rohs, M.: Protractor3D: a closed-form solution to rotation-invariant 3D gestures. In: Proceedings of the 16th International Conference on Intelligent User Interfaces, IUI 2011, pp. 371–374. ACM, New York, NY, USA (2011). http://doi.acm.org/10.1145/1943403.1943468

20.

Leyvand, T., Meekhof, C., Wei, Y.C., Sun, J., Guo, B.: Kinect identity: technology and experience. Computer 44(4), 94–96 (2011)CrossRef

21.

Mäkelä, V., Korhonen, H., Ojala, J., Järvi, A., Väänänen, K., Raisamo, R., Turunen, M.: Investigating mid-air gestures and handhelds in motion tracked environments. In: Proceedings of the 5th ACM International Symposium on Pervasive Displays, PerDis 2016, pp. 45–51. ACM, New York, NY, USA (2016). http://doi.acm.org/10.1145/2914920.2915015

22.

McNeill, D.: Hand and Mind: What Gestures Reveal about Thought. University of Chicago (1992)

23.

Mehler, A., Lücking, A., Abrami, G.: Wikinect: image schemata as a basis of gestural writing for kinetic museum wikis. Universal Access in the Information Society, pp. 333–349 (2015)

24.

Morris, M.R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., Schraefel, M.C., Wobbrock, J.O.: Reducing legacy bias in gesture elicitation studies. Interactions 21(3), 40–45 (2014). http://doi.acm.org/10.1145/2591689

25.

Nacenta, M.A., Kamber, Y., Qiang, Y., Kristensson, P.O.: Memorability of predesigned and user-defined gesture sets. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 1099–1108. ACM, New York, NY, USA (2013). http://doi.acm.org/10.1145/2470654.2466142

26.

Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2011, pp. 177–186. ACM, New York, NY, USA (2011). http://doi.acm.org/10.1145/1978942.1978969

27.

Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS, vol. 2915, pp. 409–420. Springer, Heidelberg (2004). doi:10.1007/978-3-540-24598-8_38 CrossRef

28.

Obaid, M., Häring, M., Kistler, F., Bühling, R., André, E.: User-defined body gestures for navigational control of a humanoid robot. In: Ge, S.S., Khatib, O., Cabibihan, J.-J., Simmons, R., Williams, M.-A. (eds.) ICSR 2012. LNCS, vol. 7621, pp. 367–377. Springer, Heidelberg (2012). doi:10.1007/978-3-642-34103-8_37 CrossRef

29.

Obaid, M., Kistler, F., Kasparavičiūtė, G., Yantaç, A.E., Fjeld, M.: How would you gesture navigate a drone?: a user-centered approach to control a drone. In: Proceedings of the 20th International Academic Mindtrek Conference, AcademicMindtrek 2016, pp. 113–121. ACM, New York, NY, USA (2016). http://doi.acm.org/10.1145/2994310.2994348

30.

Oh, U., Findlater, L.: The challenges and potential of end-user gesture customization. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 1129–1138. ACM, New York, NY, USA (2013). http://doi.acm.org/10.1145/2470654.2466145

31.

Piumsomboon, T., Clark, A., Billinghurst, M., Cockburn, A.: User-Defined Gestures for Augmented Reality. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 282–299. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40480-1_18 CrossRef

32.

Rekik, Y., Grisoni, L., Roussel, N.: Towards many gestures to one command: a user study for tabletops. In: Kotzé, P., Marsden, G., Lindgaard, G., Wesson, J., Winckler, M. (eds.) INTERACT 2013. LNCS, vol. 8118, pp. 246–263. Springer, Heidelberg (2013). doi:10.1007/978-3-642-40480-1_16 CrossRef

33.

Rekik, Y., Vatavu, R.D., Grisoni, L.: Match-up & conquer: a two-step technique for recognizing unconstrained bimanual and multi-fnger touch input. In: Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces, AVI 2014, pp. 201–208. ACM, New York, NY, USA (2014). http://doi.acm.org/10.1145/2598153.2598167

34.

Rekik, Y., Vatavu, R.D., Grisoni, L.: Understanding users’ perceived difficulty of multi-touch gesture articulation. In: Proceedings of the 16th International Conference on Multimodal Interaction, ICMI 2014, pp. 232–239. ACM, New York, NY, USA (2014). http://doi.acm.org/10.1145/2663204.2663273

35.

Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2010, pp. 887–896. ACM, New York, NY, USA (2010). http://doi.acm.org/10.1145/1753326.1753458

36.

Sheu, J.S., Huang, Y.L.: Implementation of an interactive TV interface via gesture and handwritten numeral recognition. Multimedia Tools Appl. 75, 1–22 (2015). http://dx.doi.org/10.1007/s11042-015-2739-6

37.

Silpasuwanchai, C., Ren, X.: Designing concurrent full-body gestures for intense gameplay. Int. J. Hum. Comput. Stud. 80, 1–13 (2015)CrossRef

38.

Spano, L.D., Cisternino, A., Paternò, F.: A compositional model for gesture definition. In: Winckler, M., Forbrig, P., Bernhaupt, R. (eds.) HCSE 2012. LNCS, vol. 7623, pp. 34–52. Springer, Heidelberg (2012). doi:10.1007/978-3-642-34347-6_3 CrossRef

39.

Sridhar, S., Feit, A.M., Theobalt, C., Oulasvirta, A.: Investigating the dexterity of multi-finger input for mid-air text entry. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, pp. 3643–3652. ACM, New York, NY, USA (2015). http://doi.acm.org/10.1145/2702123.2702136

40.

Vatavu, R.D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video, EuroiTV 2012, pp. 45–48. ACM, New York, NY, USA (2012) http://doi.acm.org/10.1145/2325616.2325626

41.

Vatavu, R.D., Casiez, G., Grisoni, L.: Small, medium, or large?: estimating the user-perceived scale of stroke gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2013, pp. 277–280. ACM, New York, NY, USA (2013). http://doi.acm.org/10.1145/2470654.2470692

42.

Vatavu, R.D., Vogel, D., Casiez, G., Grisoni, L.: Estimating the perceived difficulty of pen gestures. In: Campos, P., Graham, N., Jorge, J., Nunes, N., Palanque, P., Winckler, M. (eds.) INTERACT 2011. LNCS, vol. 6947, pp. 89–106. Springer, Heidelberg (2011). doi:10.1007/978-3-642-23771-3_9 CrossRef

43.

Vikram, S., Li, L., Russell, S.: Writing and sketching in the air, recognizing and controlling on the fly. In: CHI 2013 Extended Abstracts on Human Factors in Computing Systems, CHI EA 2013, pp. 1179–1184. ACM, New York, NY, USA (2013). http://doi.acm.org/10.1145/2468356.2468567

44.

Walter, R., Bailly, G., Valkanova, N., Muller, J.: Cuenesics: using mid-air gestures to select items on interactive public displays. In: Proceedings of the 16th International Conference on Human-computer Interaction with Mobile Devices & Services, MobileHCI 2014, pp. 299–308. ACM, New York, NY, USA (2014). http://doi.acm.org/10.1145/2628363.2628368

45.

Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 2009, pp. 1083–1092. ACM, New York, NY, USA (2009). http://doi.acm.org/10.1145/1518701.1518866

46.

Wong, A., Haith, A., Krakauer, J.: Motor planning. Neuroscientist 21(4), 385–398 (2015)CrossRef

Title: Understanding Gesture Articulations Variability
Authors: Orlando Erazo
Yosra Rekik
Laurent Grisoni
José A. Pino
Publisher: Springer International Publishing
Book: Human-Computer Interaction - INTERACT 2017
Print ISBN: 978-3-319-67683-8

Electronic ISBN: 978-3-319-67684-5

Copyright Year: 2017
DOI: https://doi.org/10.1007/978-3-319-67684-5_18

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"