Skip to main content

2017 | OriginalPaper | Buchkapitel

It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets

verfasst von : Hayati Havlucu, Mehmet Yarkın Ergin, İdil Bostan, Oğuz Turan Buruk, Tilbe Göksun, Oğuzhan Özcan

Erschienen in: Distributed, Ambient and Pervasive Interactions

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Research on gestural control interfaces is getting more widespread for the purpose of creating natural interfaces. Two of these popular gesture types are freehand and on-skin touch gestures, because they eliminate the use of an intermediary device. Previous studies investigated these modalities separately with user-elicitation methods; however, there is a gap in the field considering their comparison. In this study, we compare user-elicited on-skin touch and freehand gesture sets to explore users’ preferences. Thus, we conducted an experiment in which we compare 13 gestures to control computer tasks for each set. Eighteen young adults participated in our study and filled our survey consisted of NASA Task Load Index and 4 additional items of social acceptability, learnability, memorability, and the goodness. The results show that on-skin touch gestures were less physically demanding and more socially acceptable compared to freehand gestures. On the other hand, freehand gestures were more intuitive than on-skin touch gestures. Overall, our results suggest that different gesture types could be useful in different scenarios. Our contribution to the field might inspire designers and developers to make better judgments for designing new gestural interfaces for a variety of devices.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology - UIST 2005, p. 33 (2005) Vogel, D., Balakrishnan, R.: Distant freehand pointing and clicking on very large, high resolution displays. In: Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology - UIST 2005, p. 33 (2005)
2.
Zurück zum Zitat Harrison, C., Ramamurthy, S., Hudson, S.E.: On-body interaction: armed and dangerous. In: Proceedings of TEI 2012, pp. 69–76 (2012) Harrison, C., Ramamurthy, S., Hudson, S.E.: On-body interaction: armed and dangerous. In: Proceedings of TEI 2012, pp. 69–76 (2012)
3.
Zurück zum Zitat Matthies, D.J.C., Perrault, S.T., Urban, B., Zhao, S., Rostock, F.I.G.D.: Botential: localizing on-body gestures by measuring electrical signatures on t he human skin, pp. 207–216 (2015) Matthies, D.J.C., Perrault, S.T., Urban, B., Zhao, S., Rostock, F.I.G.D.: Botential: localizing on-body gestures by measuring electrical signatures on t he human skin, pp. 207–216 (2015)
4.
Zurück zum Zitat Nakatsuma, K., Takedomi, R., Eguchi, T., Oshima, Y., Torigoe, I.: Active bioacoustic measurement for human-to-human skin contact area detection, pp. 1–4 (2015) Nakatsuma, K., Takedomi, R., Eguchi, T., Oshima, Y., Torigoe, I.: Active bioacoustic measurement for human-to-human skin contact area detection, pp. 1–4 (2015)
5.
Zurück zum Zitat Zhang, Y., Zhou, J., Laput, G., Harrison, C.: SkinTrack. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI 2016, pp. 1491–1503 (2016) Zhang, Y., Zhou, J., Laput, G., Harrison, C.: SkinTrack. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI 2016, pp. 1491–1503 (2016)
6.
Zurück zum Zitat Wagner, J., Nancel, M., Gustafson, S.G., Huot, S., Mackay, W.E.: Body-centric design space for multi-surface interaction, pp. 1299–1308 (2013) Wagner, J., Nancel, M., Gustafson, S.G., Huot, S., Mackay, W.E.: Body-centric design space for multi-surface interaction, pp. 1299–1308 (2013)
7.
Zurück zum Zitat Harrison, C., Tan, D., Morris, D.: Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 453–462 (2010) Harrison, C., Tan, D., Morris, D.: Skinput: appropriating the body as an input surface. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 453–462 (2010)
8.
Zurück zum Zitat Gannon, M., Grossman, T., Fitzmaurice, G.: Tactum: a skin-centric approach to digital design and fabrication, pp. 1–10 Gannon, M., Grossman, T., Fitzmaurice, G.: Tactum: a skin-centric approach to digital design and fabrication, pp. 1–10
9.
Zurück zum Zitat Wobbrock, J.O., Aung, H.H., Rothrock, B., Myers, B.A.: Maximizing the guessability of symbolic input. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1869–1872 (2005) Wobbrock, J.O., Aung, H.H., Rothrock, B., Myers, B.A.: Maximizing the guessability of symbolic input. In: CHI 2005 Extended Abstracts on Human Factors in Computing Systems, pp. 1869–1872 (2005)
10.
Zurück zum Zitat Canat, M., Tezcan, M.O., Yurdakul, C., Tiza, E., Sefercik, B.C., Bostan, I., Buruk, O.T., Göksun, T., Özcan, O.: Sensation: measuring the effects of a human-to-human social touch based controller on the player experience. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3944–3955 (2016) Canat, M., Tezcan, M.O., Yurdakul, C., Tiza, E., Sefercik, B.C., Bostan, I., Buruk, O.T., Göksun, T., Özcan, O.: Sensation: measuring the effects of a human-to-human social touch based controller on the player experience. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3944–3955 (2016)
11.
Zurück zum Zitat Mauney, D., Howarth, J., Wirtanen, A., Capra, M.: Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. In: Extended Abstracts of the 28th International Conference on Human Factors in Computing Systems (CHI 2010), pp. 4015–4020 (2010) Mauney, D., Howarth, J., Wirtanen, A., Capra, M.: Cultural similarities and differences in user-defined gestures for touchscreen user interfaces. In: Extended Abstracts of the 28th International Conference on Human Factors in Computing Systems (CHI 2010), pp. 4015–4020 (2010)
12.
Zurück zum Zitat Canat, M., Tezcan, M.O., Yurdakul, C., Buruk, O.T., Özcan, O.: Experiencing human-to-human touch in digital games. In: CHI 2016 (2016) Canat, M., Tezcan, M.O., Yurdakul, C., Buruk, O.T., Özcan, O.: Experiencing human-to-human touch in digital games. In: CHI 2016 (2016)
13.
Zurück zum Zitat Bostan, İ., Buruk, O.T., Canat, M., Tezcan, M., Yurdakul, C., Göksun, T., Özcan, O.O.: Hands as a controller: user preferences for hand specific on-skin gestures. In: Proceedings of the Designing Interactive Systems Conference. ACM (2017) Bostan, İ., Buruk, O.T., Canat, M., Tezcan, M., Yurdakul, C., Göksun, T., Özcan, O.O.: Hands as a controller: user preferences for hand specific on-skin gestures. In: Proceedings of the Designing Interactive Systems Conference. ACM (2017)
14.
Zurück zum Zitat Vatavu, R.D.: A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments. J. Ambient Intell. Smart Environ. 5, 187–211 (2013) Vatavu, R.D.: A comparative study of user-defined handheld vs. freehand gestures for home entertainment environments. J. Ambient Intell. Smart Environ. 5, 187–211 (2013)
15.
Zurück zum Zitat Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)CrossRef Hart, S.G., Staveland, L.E.: Development of NASA-TLX (Task Load Index): results of empirical and theoretical research. Adv. Psychol. 52, 139–183 (1988)CrossRef
16.
Zurück zum Zitat Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 2009, p. 1083 (2009) Wobbrock, J.O., Morris, M.R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems - CHI 2009, p. 1083 (2009)
17.
Zurück zum Zitat Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S.: I’m home: defining and evaluating a gesture set for smart-home control. Int. J. Hum Comput Stud. 69, 693–704 (2011)CrossRef Kühnel, C., Westermann, T., Hemmert, F., Kratz, S., Müller, A., Möller, S.: I’m home: defining and evaluating a gesture set for smart-home control. Int. J. Hum Comput Stud. 69, 693–704 (2011)CrossRef
18.
Zurück zum Zitat Vatavu, R.D.: Nomadic gestures: a technique for reusing gesture commands for frequent ambient interactions. J. Ambient Intell. Smart Environ. 4, 79–93 (2012) Vatavu, R.D.: Nomadic gestures: a technique for reusing gesture commands for frequent ambient interactions. J. Ambient Intell. Smart Environ. 4, 79–93 (2012)
20.
Zurück zum Zitat Shoemaker, G., Tsukitani, T., Kitamura, Y., Booth, K.S.: Body-centric interaction techniques for very large wall displays. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries - NordiCHI 2010, pp. 463–472 (2010) Shoemaker, G., Tsukitani, T., Kitamura, Y., Booth, K.S.: Body-centric interaction techniques for very large wall displays. In: Proceedings of the 6th Nordic Conference on Human-Computer Interaction Extending Boundaries - NordiCHI 2010, pp. 463–472 (2010)
21.
Zurück zum Zitat Hespanhol, L., Tomitsch, M., Grace, K., Collins, A., Kay, J.: Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. In: Proceedings of the 2012 International Symposium on Pervasive Displays - PerDis 2012, pp. 1–6 (2012) Hespanhol, L., Tomitsch, M., Grace, K., Collins, A., Kay, J.: Investigating intuitiveness and effectiveness of gestures for free spatial interaction with large displays. In: Proceedings of the 2012 International Symposium on Pervasive Displays - PerDis 2012, pp. 1–6 (2012)
22.
Zurück zum Zitat Jansen, B.E.: Teaching users how to interact with gesture-based interfaces (2012) Jansen, B.E.: Teaching users how to interact with gesture-based interfaces (2012)
23.
Zurück zum Zitat Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays (2011). To cite this version Nancel, M., Wagner, J., Pietriga, E., Chapuis, O., Mackay, W.: Mid-air pan-and-zoom on wall-sized displays (2011). To cite this version
24.
Zurück zum Zitat Wu, H., Wang, J., Zhang, X.: (Luke): User-centered gesture development in TV viewing environment. Multimedia Tools Appl. 75, 733–760 (2016)CrossRef Wu, H., Wang, J., Zhang, X.: (Luke): User-centered gesture development in TV viewing environment. Multimedia Tools Appl. 75, 733–760 (2016)CrossRef
25.
Zurück zum Zitat Vatavu, R.-D., Zaiti, I.-A.: Leap gestures for TV: insights from an elicitation study. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video, pp. 131–138 (2014) Vatavu, R.-D., Zaiti, I.-A.: Leap gestures for TV: insights from an elicitation study. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video, pp. 131–138 (2014)
26.
Zurück zum Zitat Buruk, O.T., Özcan, O.: DubTouch: exploring human to human touch interaction for gaming in double sided displays. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction, pp. 333–342 (2014) Buruk, O.T., Özcan, O.: DubTouch: exploring human to human touch interaction for gaming in double sided displays. In: Proceedings of the 8th Nordic Conference on Human-Computer Interaction, pp. 333–342 (2014)
27.
Zurück zum Zitat Nacenta, M.A., Kamber, Y., Qiang, Y., Kristensson, P.O.: Memorability of pre-designed and user-defined gesture sets. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2013, p. 1099 (2013) Nacenta, M.A., Kamber, Y., Qiang, Y., Kristensson, P.O.: Memorability of pre-designed and user-defined gesture sets. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems - CHI 2013, p. 1099 (2013)
28.
Zurück zum Zitat Heydekorn, J., Frisch, M., Dachselt, R.: Evaluating a user-elicited gesture set for interactive displays. In: Mensch & Computer, pp. 191–200 (2011) Heydekorn, J., Frisch, M., Dachselt, R.: Evaluating a user-elicited gesture set for interactive displays. In: Mensch & Computer, pp. 191–200 (2011)
29.
Zurück zum Zitat Chan, E., Seyed, T., Stuerzlinger, W., Yang, X.-D., Maurer, F.: User elicitation on single-hand microgestures. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3403–3414 (2016) Chan, E., Seyed, T., Stuerzlinger, W., Yang, X.-D., Maurer, F.: User elicitation on single-hand microgestures. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, pp. 3403–3414 (2016)
30.
Zurück zum Zitat Yoo, S., Parker, C., Kay, J., Tomitsch, M.: To dwell or not to dwell: an evaluation of mid-air gestures for large information displays. In: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction on - OzCHI 2015, pp. 187–191 (2015) Yoo, S., Parker, C., Kay, J., Tomitsch, M.: To dwell or not to dwell: an evaluation of mid-air gestures for large information displays. In: Proceedings of the Annual Meeting of the Australian Special Interest Group for Computer Human Interaction on - OzCHI 2015, pp. 187–191 (2015)
31.
Zurück zum Zitat Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindlbauer, D., Ion, A., Zhao, S., Koh, J.T.K.V.: Understanding mid-air hand gestures: a study of human preferences in usage of gesture types for HCI. Technical report MSR-TR-2012-11, 10 p. (2012) Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindlbauer, D., Ion, A., Zhao, S., Koh, J.T.K.V.: Understanding mid-air hand gestures: a study of human preferences in usage of gesture types for HCI. Technical report MSR-TR-2012-11, 10 p. (2012)
32.
Zurück zum Zitat Henze, N., Hesselmann, T., Pielot, M.: Free-hand gestures for music playback: deriving gestures with a user-centred process. Methodology, p. 16 (2010) Henze, N., Hesselmann, T., Pielot, M.: Free-hand gestures for music playback: deriving gestures with a user-centred process. Methodology, p. 16 (2010)
33.
Zurück zum Zitat Zaiţi, I.-A., Pentiuc, Ş.-G., Vatavu, R.-D.: On free-hand TV control: experimental results on user-elicited gestures with leap motion. Pers. Ubiquit. Comput. 19, 821–838 (2015)CrossRef Zaiţi, I.-A., Pentiuc, Ş.-G., Vatavu, R.-D.: On free-hand TV control: experimental results on user-elicited gestures with leap motion. Pers. Ubiquit. Comput. 19, 821–838 (2015)CrossRef
34.
Zurück zum Zitat Vatavu, R.-D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video - EuroiTV 2012, p. 45. ACM Press, New York (2012) Vatavu, R.-D.: User-defined gestures for free-hand TV control. In: Proceedings of the 10th European Conference on Interactive TV and Video - EuroiTV 2012, p. 45. ACM Press, New York (2012)
35.
Zurück zum Zitat Hood, S.: The intuitiveness of bimanual, mid-air, gesture-based input methods which provide haptic feedback, pp. 5–7 (2012) Hood, S.: The intuitiveness of bimanual, mid-air, gesture-based input methods which provide haptic feedback, pp. 5–7 (2012)
36.
Zurück zum Zitat Karvinen, J.: Haptic feedback in freehand gesture interaction, 66 p. (2015) Karvinen, J.: Haptic feedback in freehand gesture interaction, 66 p. (2015)
37.
Zurück zum Zitat Jakobsen, M.R., Jansen, Y., Boring, S., Hornbæk, K.: Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9298, pp. 455–473. Springer, Cham (2015). doi:10.1007/978-3-319-22698-9_31 CrossRef Jakobsen, M.R., Jansen, Y., Boring, S., Hornbæk, K.: Should I stay or should I go? Selecting between touch and mid-air gestures for large-display interaction. In: Abascal, J., Barbosa, S., Fetter, M., Gross, T., Palanque, P., Winckler, M. (eds.) INTERACT 2015. LNCS, vol. 9298, pp. 455–473. Springer, Cham (2015). doi:10.​1007/​978-3-319-22698-9_​31 CrossRef
Metadaten
Titel
It Made More Sense: Comparison of User-Elicited On-skin Touch and Freehand Gesture Sets
verfasst von
Hayati Havlucu
Mehmet Yarkın Ergin
İdil Bostan
Oğuz Turan Buruk
Tilbe Göksun
Oğuzhan Özcan
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58697-7_11

Neuer Inhalt