Skip to main content
Top
Published in: Universal Access in the Information Society 1/2019

24-10-2017 | Long Paper

Toward the gestural interface: comparative analysis between touch user interfaces versus gesture-based user interfaces on mobile devices

Authors: Gonzalo Pomboza-Junez, Juan A. Holgado-Terriza, Nuria Medina-Medina

Published in: Universal Access in the Information Society | Issue 1/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Human–computer interaction is transformed as well as the technology used to achieve it. This paper discusses the ease of use of a classic touch screen user interface (TUI) in contrast to a gesture-based user interface (GBUI) applied to a mobile device. Two basic positions are used for comparison: “normal” when individual is standing and “special” when individual is lying down. The first represents a common position for healthy individuals, while the second is used to represent sick, disabled or comfortable individuals. Two software applications have been developed in order to set an interaction test for TUI and GBUI, which was performed by 25 users. The interaction tests show that GBUI has a very reasonable average accuracy of 88.5% in special position and 89.8% in normal position, while TUI presents an average accuracy of 96.5% in special position and 97.4% in normal position. Therefore, GBUI could be a complementary form of interaction to TUI that can be useful to any user, especially for cases of illness or simple comfort of the user. As study case, we have developed a software solution called SICLLE (emergency call control interactive system) that manages phone calls in a smartphone and applies the concept of gestural control tree to set a gestural navigation through a gestural language from a gestural vocabulary. An architecture for mobile devices supporting GBUI has been proposed and used in the implementation of SICLLE. SICLLE allows the personalization of the gestures, which optimizes the gestural dictionary and achieves an easier learning and use. In addition, SICLLE incorporates a hearing guide which replaces the typical visual control, reaching total acceptance in the experiment conducted with real users.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
MYO is a trademark of Thalmic Labs Inc.
 
Literature
1.
go back to reference Abid, M.R., Shi, F., Petriu, E.M.: Dynamic hand gesture recognition from bag-of-features and local part model. In: Proceedings of 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012), IEEE, pp. 78–82 (2012). doi:10.1109/HAVE.2012.6374443 Abid, M.R., Shi, F., Petriu, E.M.: Dynamic hand gesture recognition from bag-of-features and local part model. In: Proceedings of 2012 IEEE International Workshop on Haptic Audio Visual Environments and Games (HAVE 2012), IEEE, pp. 78–82 (2012). doi:10.​1109/​HAVE.​2012.​6374443
3.
go back to reference Al-Timemy, A.H., Bugmann, G., Escudero, J., Outram, N.: Classification of finger movements for the dexterous hand prosthesis control with surface electromyography. IEEE J. Biomed. Health Inform. 17(3), 608–618 (2013). doi:10.1109/JBHI.2013.2249590 CrossRef Al-Timemy, A.H., Bugmann, G., Escudero, J., Outram, N.: Classification of finger movements for the dexterous hand prosthesis control with surface electromyography. IEEE J. Biomed. Health Inform. 17(3), 608–618 (2013). doi:10.​1109/​JBHI.​2013.​2249590 CrossRef
6.
go back to reference Card, S.K., Newell, A., Moran, T.P.: The Psychology of Human–Computer Interaction. Lawrence Erlbaum Associates Inc., Hillsdale, NJ (1983) Card, S.K., Newell, A., Moran, T.P.: The Psychology of Human–Computer Interaction. Lawrence Erlbaum Associates Inc., Hillsdale, NJ (1983)
10.
go back to reference de Waard, D., Westerhuis, F., Joling, D., Weiland, S., Stadtbäumer, R., Kaltofen, L.: Visual map and instruction-based bicycle navigation: a comparison of effects on behaviour. Ergonomics 0139(April), 1–14 (2017). doi:10.1080/00140139.2017.1282628 CrossRef de Waard, D., Westerhuis, F., Joling, D., Weiland, S., Stadtbäumer, R., Kaltofen, L.: Visual map and instruction-based bicycle navigation: a comparison of effects on behaviour. Ergonomics 0139(April), 1–14 (2017). doi:10.​1080/​00140139.​2017.​1282628 CrossRef
13.
go back to reference Fernandez, R.A.S., Sanchez-Lopez, J.L., Sampedro, C., Bavle, H., Molina, M., Campoy, P.: Natural user interfaces for human-drone multi-modal interaction. In: 2016 International Conference on Unmanned Aircraft Systems (ICUAS), IEEE, pp. 1013–1022 (2016). doi:10.1109/ICUAS.2016.7502665 Fernandez, R.A.S., Sanchez-Lopez, J.L., Sampedro, C., Bavle, H., Molina, M., Campoy, P.: Natural user interfaces for human-drone multi-modal interaction. In: 2016 International Conference on Unmanned Aircraft Systems (ICUAS), IEEE, pp. 1013–1022 (2016). doi:10.​1109/​ICUAS.​2016.​7502665
14.
go back to reference Fitts, P.M.: The amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954)CrossRef Fitts, P.M.: The amplitude of movement. J. Exp. Psychol. 47, 381–391 (1954)CrossRef
17.
go back to reference Francese, R., Passero, I., Tortora, G.: Wiimote and Kinect. In: Proceedings of the International Working Conference on Advanced Visual Interfaces—AVI ’12, ACM Press, New York, New York, USA, pp 116–123 (2012). doi:10.1145/2254556.2254580 Francese, R., Passero, I., Tortora, G.: Wiimote and Kinect. In: Proceedings of the International Working Conference on Advanced Visual Interfaces—AVI ’12, ACM Press, New York, New York, USA, pp 116–123 (2012). doi:10.​1145/​2254556.​2254580
20.
26.
go back to reference Ismirle, J., OBara, I., Swierenga, S.J., Jackson, J.E.: Touchscreen voting interface design for persons with disabilities: insights from usability evaluation of mobile voting prototype. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60(1), 780–784 (2016). doi:10.1177/1541931213601179 Ismirle, J., OBara, I., Swierenga, S.J., Jackson, J.E.: Touchscreen voting interface design for persons with disabilities: insights from usability evaluation of mobile voting prototype. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 60(1), 780–784 (2016). doi:10.​1177/​1541931213601179​
29.
go back to reference Jung, Y.: What a smartphone is to me: understanding user values in using smartphones. Inf. Syst. J. 24(4), 299–321 (2014). doi:10.1111/isj.12031 Jung, Y.: What a smartphone is to me: understanding user values in using smartphones. Inf. Syst. J. 24(4), 299–321 (2014). doi:10.​1111/​isj.​12031
30.
go back to reference Kane, S.K, Jayant, C., Wobbrock, J.O, Ladner, R.E.: Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In: Proceeding of the Eleventh International ACM SIGACCESS Conference on Computers and Accessibility—ASSETS ’09, ACM Press, New York, NY, USA, pp. 115–122 (2009). doi:10.1145/1639642.1639663 Kane, S.K, Jayant, C., Wobbrock, J.O, Ladner, R.E.: Freedom to roam: a study of mobile device adoption and accessibility for people with visual and motor disabilities. In: Proceeding of the Eleventh International ACM SIGACCESS Conference on Computers and Accessibility—ASSETS ’09, ACM Press, New York, NY, USA, pp. 115–122 (2009). doi:10.​1145/​1639642.​1639663
32.
go back to reference Kim, G.J.: Human-Computer Interaction: Fundamentals and Practice. CRC Press, Boca Raton (2015)CrossRef Kim, G.J.: Human-Computer Interaction: Fundamentals and Practice. CRC Press, Boca Raton (2015)CrossRef
39.
go back to reference Li, G., Li, Y., Zhang, Z., Geng, Y., Zhou, R.: Selection of sampling rate for EMG pattern recognition based prosthesis control. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, IEEE, vol. 2010, pp. 5058–5061 (2010). doi:10.1109/IEMBS.2010.5626224 Li, G., Li, Y., Zhang, Z., Geng, Y., Zhou, R.: Selection of sampling rate for EMG pattern recognition based prosthesis control. In: 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology, IEEE, vol. 2010, pp. 5058–5061 (2010). doi:10.​1109/​IEMBS.​2010.​5626224
43.
go back to reference Mehler, A., Lücking, A., Abrami, G.: WikiNect: image schemata as a basis of gestural writing for kinetic museum wikis. Univers. Access Inf. Soc. 14(3), 333–349 (2015). doi:10.1007/s10209-014-0386-8 Mehler, A., Lücking, A., Abrami, G.: WikiNect: image schemata as a basis of gestural writing for kinetic museum wikis. Univers. Access Inf. Soc. 14(3), 333–349 (2015). doi:10.​1007/​s10209-014-0386-8
44.
go back to reference Merletti, R., Botter, A., Troiano, A., Merlo, E., Minetto, M.A.: Technology and instrumentation for detection and conditioning of the surface electromyographic signal: state of the art. Clin. Biomech. 24(2), 122–134 (2009). doi:10.1016/j.clinbiomech.2008.08.006 Merletti, R., Botter, A., Troiano, A., Merlo, E., Minetto, M.A.: Technology and instrumentation for detection and conditioning of the surface electromyographic signal: state of the art. Clin. Biomech. 24(2), 122–134 (2009). doi:10.​1016/​j.​clinbiomech.​2008.​08.​006
49.
go back to reference Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In: Gesture-Based Communication in Human–Computer Interaction, pp. 409–420 (2004). doi:10.1007/978-3-540-24598-8 38 Nielsen, M., Störring, M., Moeslund, T.B., Granum, E.: A Procedure for Developing Intuitive and Ergonomic Gesture Interfaces for HCI. In: Gesture-Based Communication in Human–Computer Interaction, pp. 409–420 (2004). doi:10.​1007/​978-3-540-24598-8 38
52.
go back to reference Peters, A., Morrison, J.H.: Cerebral Cortex: Neurodegenerative and Age-Related Changes in Structure and Function of Cerebral Cortex, vol. 14. Springer, Berlin (2012) Peters, A., Morrison, J.H.: Cerebral Cortex: Neurodegenerative and Age-Related Changes in Structure and Function of Cerebral Cortex, vol. 14. Springer, Berlin (2012)
54.
go back to reference Pomboza-Junez, G., Holgado-Terriza, J.A.: Control of home devices based on hand gestures. In: 2015 IEEE 5th International Conference on Consumer Electronics—Berlin (ICCE-Berlin), IEEE, pp 510-514 (2015). DOI:10.1109/ICCE-Berlin.2015.7391325 Pomboza-Junez, G., Holgado-Terriza, J.A.: Control of home devices based on hand gestures. In: 2015 IEEE 5th International Conference on Consumer Electronics—Berlin (ICCE-Berlin), IEEE, pp 510-514 (2015). DOI:10.​1109/​ICCE-Berlin.​2015.​7391325
55.
go back to reference Pomboza-Junez, G., Holgado-Terriza, J.A.: Hand gesture recognition based on sEMG signals using Support Vector Machines. In: 2016 IEEE 6th International Conference on Consumer Electronics—Berlin (ICCE-Berlin), IEEE, pp. 174–178 (2016). doi:10.1109/ICCE-Berlin.2016.7684748 Pomboza-Junez, G., Holgado-Terriza, J.A.: Hand gesture recognition based on sEMG signals using Support Vector Machines. In: 2016 IEEE 6th International Conference on Consumer Electronics—Berlin (ICCE-Berlin), IEEE, pp. 174–178 (2016). doi:10.​1109/​ICCE-Berlin.​2016.​7684748
58.
go back to reference Quigley, M., Goodrich, M., Beard, R.: Semi-autonomous human–UAV interfaces for fixed-wing mini-UAVs. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), IEEE, vol. 3, pp. 2457–2462 (2004). doi:10.1109/IROS.2004.1389777 Quigley, M., Goodrich, M., Beard, R.: Semi-autonomous human–UAV interfaces for fixed-wing mini-UAVs. In: 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No. 04CH37566), IEEE, vol. 3, pp. 2457–2462 (2004). doi:10.​1109/​IROS.​2004.​1389777
59.
go back to reference Raez, M.B.I., Hussain, M.S., Mohd-Yasin, F., Reaz, M., Hussain, M.S., Mohd-Yasin, F.: Techniques of EMG signal analysis: detection, processing, classification and applications. Biol. Proced. Online 8(1), 11–35 (2006). doi:10.1251/bpo115 CrossRef Raez, M.B.I., Hussain, M.S., Mohd-Yasin, F., Reaz, M., Hussain, M.S., Mohd-Yasin, F.: Techniques of EMG signal analysis: detection, processing, classification and applications. Biol. Proced. Online 8(1), 11–35 (2006). doi:10.​1251/​bpo115 CrossRef
69.
go back to reference Turk, M.: Multimodal human–computer interaction. In: Real-Time Vision for Human–Computer Interaction, Springer-Verlag, New York, pp. 269–283 (2005). doi:10.1007/0-387-27890-7 Turk, M.: Multimodal human–computer interaction. In: Real-Time Vision for Human–Computer Interaction, Springer-Verlag, New York, pp. 269–283 (2005). doi:10.​1007/​0-387-27890-7
71.
go back to reference Von Neumann, J., Kurzweil, R.: The Computer and the Brain. Yale University Press, New Haven (2012) Von Neumann, J., Kurzweil, R.: The Computer and the Brain. Yale University Press, New Haven (2012)
76.
Metadata
Title
Toward the gestural interface: comparative analysis between touch user interfaces versus gesture-based user interfaces on mobile devices
Authors
Gonzalo Pomboza-Junez
Juan A. Holgado-Terriza
Nuria Medina-Medina
Publication date
24-10-2017
Publisher
Springer Berlin Heidelberg
Published in
Universal Access in the Information Society / Issue 1/2019
Print ISSN: 1615-5289
Electronic ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-017-0580-6

Other articles of this Issue 1/2019

Universal Access in the Information Society 1/2019 Go to the issue

Premium Partner