Skip to main content
Top

2015 | OriginalPaper | Chapter

Designing Touchless Gestural Interactions for Public Displays In-the-Wild

Authors : Vito Gentile, Alessio Malizia, Salvatore Sorce, Antonio Gentile

Published in: Human-Computer Interaction: Interaction Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Public displays, typically equipped with touchscreens, are used for interactions in public spaces, such as streets or fairs. Currently low-cost visual sensing technologies, such as Kinect-like devices and high quality cameras, allow to easily implement touchless interfaces. Nevertheless, the arising interactions have not yet been fully investigated for public displays in-the-wild (i.e. in appropriate social contexts where public displays are typically deployed). Different audiences, cultures and social settings strongly affect users and their interactions. Besides gestures for public displays must be guessable to be easy to use for a wide audience. Issues like these could be solved with user-centered design: gestures must be chosen by users in different social settings, and then selected to be resilient to cultural bias and provide a good level of guessability. Therefore the main challenge is to define touchless gestures in-the-wild by using novel UCD methods applied out of controlled environments, and evaluating their effectiveness.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
As stated in [25], “today the word natural, as in “natural user interfaces” (NUI), is mainly used to highlight the contrast with classical computer interfaces that employ artificial control devices whose operation has to be learned”. In this context, interactions should be natural in the sense they allow users to communicate with the same familiarity they have in interacting with objects in everyday life.
 
Literature
1.
go back to reference Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–104 (1991)CrossRef Weiser, M.: The computer for the 21st century. Sci. Am. 265(3), 94–104 (1991)CrossRef
2.
go back to reference Gentile, V., Sorce, S., Gentile, A.: Continuous hand openness detection using a kinect-like device. In: 2014 Eighth International Conference on Complex, Intelligent and Software Intensive Systems, pp. 553–557. IEEE Press, Birmingham (2014) Gentile, V., Sorce, S., Gentile, A.: Continuous hand openness detection using a kinect-like device. In: 2014 Eighth International Conference on Complex, Intelligent and Software Intensive Systems, pp. 553–557. IEEE Press, Birmingham (2014)
3.
go back to reference Müller, J., Bailly, G., Bossuyt, T., Hillgreen, N.: MirrorTouch: combining touch and mid-air gestures for public displays. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 319–328. ACM Press, New York (2014) Müller, J., Bailly, G., Bossuyt, T., Hillgreen, N.: MirrorTouch: combining touch and mid-air gestures for public displays. In: Proceedings of the 16th International Conference on Human-Computer Interaction with Mobile Devices and Services, pp. 319–328. ACM Press, New York (2014)
4.
go back to reference Zhai, Y., Zhao, G., Alatalo, T., Heikkilä, J., Ojala, T., Huang, X.: Gesture interaction for wall-sized touchscreen display. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 175–178. ACM Press, New York (2013) Zhai, Y., Zhao, G., Alatalo, T., Heikkilä, J., Ojala, T., Huang, X.: Gesture interaction for wall-sized touchscreen display. In: Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication, pp. 175–178. ACM Press, New York (2013)
5.
go back to reference Hardy, J., Rukzio, E., Davies, N.: Real world responses to interactive gesture based public displays. In: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia, pp. 33–39. ACM Press, New York (2011) Hardy, J., Rukzio, E., Davies, N.: Real world responses to interactive gesture based public displays. In: Proceedings of the 10th International Conference on Mobile and Ubiquitous Multimedia, pp. 33–39. ACM Press, New York (2011)
6.
go back to reference Wobbrock, J. O., Morris, M. R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 1083–1092. ACM Press, New York (2009) Wobbrock, J. O., Morris, M. R., Wilson, A.D.: User-defined gestures for surface computing. In: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pp. 1083–1092. ACM Press, New York (2009)
7.
go back to reference Morris, M.R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., Schraefel, M.C., Wobbrock, J.O.: Reducing legacy bias in gesture elicitation studies. Interactions 21(3), 40–45 (2014)CrossRef Morris, M.R., Danielescu, A., Drucker, S., Fisher, D., Lee, B., Schraefel, M.C., Wobbrock, J.O.: Reducing legacy bias in gesture elicitation studies. Interactions 21(3), 40–45 (2014)CrossRef
8.
go back to reference Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems, pp. 887–896. ACM Press, New York (2010) Rico, J., Brewster, S.: Usable gestures for mobile interfaces: evaluating social acceptability. In: Proceedings of the 28th International Conference on Human Factors in Computing Systems, pp. 887–896. ACM Press, New York (2010)
9.
go back to reference Sharp, R., Rehman, K.: The 2005 UbiApp workshop: what makes good application-led research? IEEE Pervasive Comput. 4(3), 80–82 (2005)CrossRef Sharp, R., Rehman, K.: The 2005 UbiApp workshop: what makes good application-led research? IEEE Pervasive Comput. 4(3), 80–82 (2005)CrossRef
11.
go back to reference Chamberlain, A., Crabtree, A., Rodden, T., Jones, M., Rogers, Y.: Research in the wild: understanding “in the wild” approaches to design and development. In: Proceedings of Conference on Designing Interactive Systems Conference - DIS 2012, pp. 795–796. ACM Press, New York (2012) Chamberlain, A., Crabtree, A., Rodden, T., Jones, M., Rogers, Y.: Research in the wild: understanding “in the wild” approaches to design and development. In: Proceedings of Conference on Designing Interactive Systems Conference - DIS 2012, pp. 795–796. ACM Press, New York (2012)
12.
go back to reference Ojala, T., Kostakos, V., Kukka, H., Heikkinen, T., Linden, T., Jurmu, M., Hosio, S., Kruger, F., Zanni, D.: Multipurpose interactive public displays in the wild: three years later. Computer 45(5), 42–49 (2012)CrossRef Ojala, T., Kostakos, V., Kukka, H., Heikkinen, T., Linden, T., Jurmu, M., Hosio, S., Kruger, F., Zanni, D.: Multipurpose interactive public displays in the wild: three years later. Computer 45(5), 42–49 (2012)CrossRef
13.
go back to reference Johnson, R., Rogers, Y., van der Linden, J., Bianchi-Berthouze, N.: Being in the thick of in-the-wild studies: the challenges and insights of researcher participation. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems CHI 2012, pp. 1135–1144. ACM Press, New York (2012) Johnson, R., Rogers, Y., van der Linden, J., Bianchi-Berthouze, N.: Being in the thick of in-the-wild studies: the challenges and insights of researcher participation. In: Proceedings of the 2012 ACM Annual Conference on Human Factors in Computing Systems CHI 2012, pp. 1135–1144. ACM Press, New York (2012)
14.
go back to reference Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T., Luhtala, M.: Evaluating the experiential user experience of public display applications in the wild. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia MUM 2013, pp. 1–10. ACM Press, New York (2013) Keskinen, T., Hakulinen, J., Heimonen, T., Turunen, M., Sharma, S., Miettinen, T., Luhtala, M.: Evaluating the experiential user experience of public display applications in the wild. In: Proceedings of the 12th International Conference on Mobile and Ubiquitous Multimedia MUM 2013, pp. 1–10. ACM Press, New York (2013)
15.
go back to reference Messeter, J., Molenaar, D.: Evaluating ambient displays in the wild: highlighting social aspects of use in public settings. In: Proceedings of the Conference on Designing Interactive Systems DIS 2012, pp. 478–481. ACM Press, New York (2012) Messeter, J., Molenaar, D.: Evaluating ambient displays in the wild: highlighting social aspects of use in public settings. In: Proceedings of the Conference on Designing Interactive Systems DIS 2012, pp. 478–481. ACM Press, New York (2012)
16.
go back to reference Hinrichs, U., Carpendale, S.: Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI 2011, pp. 3023–3032. ACM Press, New York (2011) Hinrichs, U., Carpendale, S.: Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits. In: Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems - CHI 2011, pp. 3023–3032. ACM Press, New York (2011)
17.
go back to reference Müller, J., Wilmsmann, D., Exeler, J., Buzeck, M., Schmidt, A., Jay, T., Krüger, A.: Display blindness: the effect of expectations on attention towards digital signage. In: Tokuda, H., Beigl, M., Friday, A., Brush, A., Tobe, Y. (eds.) Pervasive 2009. LNCS, vol. 5538, pp. 1–8. Springer, Heidelberg (2009)CrossRef Müller, J., Wilmsmann, D., Exeler, J., Buzeck, M., Schmidt, A., Jay, T., Krüger, A.: Display blindness: the effect of expectations on attention towards digital signage. In: Tokuda, H., Beigl, M., Friday, A., Brush, A., Tobe, Y. (eds.) Pervasive 2009. LNCS, vol. 5538, pp. 1–8. Springer, Heidelberg (2009)CrossRef
18.
go back to reference Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces ITS 2010, pp. 121–130. ACM Press, New York (2010) Ballendat, T., Marquardt, N., Greenberg, S.: Proxemic interaction: designing for a proximity and orientation-aware environment. In: ACM International Conference on Interactive Tabletops and Surfaces ITS 2010, pp. 121–130. ACM Press, New York (2010)
19.
go back to reference Vogel, D., Balakrishnan, R.: Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology - UIST 2004, pp. 137–146. ACM Press, New York (2004) Vogel, D., Balakrishnan, R.: Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. In: Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology - UIST 2004, pp. 137–146. ACM Press, New York (2004)
20.
go back to reference Müller, J., Alt, F., Michelis, D., Schmidt, A.: Requirements and design space for interactive public displays. In: Proceedings of the International Conference on Multimedia - MM 2010, pp. 1285–1294. ACM Press, New York (2010) Müller, J., Alt, F., Michelis, D., Schmidt, A.: Requirements and design space for interactive public displays. In: Proceedings of the International Conference on Multimedia - MM 2010, pp. 1285–1294. ACM Press, New York (2010)
21.
go back to reference Schönböck, J., König, F., Kotsis, G., Gruber, D., Zaim, E., Schmidt, A.: MirrorBoard – an interactive billboard. In: Proceedings of Mensch und Computer 2008, pp. 207–216. Oldenbourg Verlag, Lübeck (2008) Schönböck, J., König, F., Kotsis, G., Gruber, D., Zaim, E., Schmidt, A.: MirrorBoard – an interactive billboard. In: Proceedings of Mensch und Computer 2008, pp. 207–216. Oldenbourg Verlag, Lübeck (2008)
22.
go back to reference Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004)CrossRef Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A procedure for developing intuitive and ergonomic gesture interfaces for HCI. In: Camurri, A., Volpe, G. (eds.) GW 2003. LNCS (LNAI), vol. 2915, pp. 409–420. Springer, Heidelberg (2004)CrossRef
23.
go back to reference Good, M.D., Whiteside, J.A., Wixon, D.R., Jones, S.J.: Building a user-derived interface. Commun. ACM 27(10), 1032–1043 (1984)CrossRef Good, M.D., Whiteside, J.A., Wixon, D.R., Jones, S.J.: Building a user-derived interface. Commun. ACM 27(10), 1032–1043 (1984)CrossRef
25.
go back to reference Malizia, A., Bellucci, A.: The artificiality of natural user interfaces. Commun. ACM 55(3), 36–38 (2012)CrossRef Malizia, A., Bellucci, A.: The artificiality of natural user interfaces. Commun. ACM 55(3), 36–38 (2012)CrossRef
26.
go back to reference Brignull, H., Rogers, Y.: Enticing people to interact with large public displays in public spaces. In: Rauterberg, M., Menozzi, M., Wesson, J. (eds.) Proceedings of the IFIP International Conference on Human-Computer Interaction - INTERACT 2003, pp. 17–24. IOS Press, Amsterdam (2003) Brignull, H., Rogers, Y.: Enticing people to interact with large public displays in public spaces. In: Rauterberg, M., Menozzi, M., Wesson, J. (eds.) Proceedings of the IFIP International Conference on Human-Computer Interaction - INTERACT 2003, pp. 17–24. IOS Press, Amsterdam (2003)
27.
go back to reference Fogg, B.J.: Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kauffman, San Francisco (2002) Fogg, B.J.: Persuasive Technology: Using Computers to Change What We Think and Do. Morgan Kauffman, San Francisco (2002)
28.
go back to reference Sorce, S., Augello, A., Santangelo, A., Gentile, A., Genco, A., Gaglio, S., Pilato, G.: Interacting with augmented environments. IEEE Pervasive Comput. 9(2), 57–58 (2010). doi:10.1109/MPRV.2010.34. ISSN 1536-1268CrossRef Sorce, S., Augello, A., Santangelo, A., Gentile, A., Genco, A., Gaglio, S., Pilato, G.: Interacting with augmented environments. IEEE Pervasive Comput. 9(2), 57–58 (2010). doi:10.​1109/​MPRV.​2010.​34. ISSN 1536-1268CrossRef
Metadata
Title
Designing Touchless Gestural Interactions for Public Displays In-the-Wild
Authors
Vito Gentile
Alessio Malizia
Salvatore Sorce
Antonio Gentile
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-20916-6_3