Skip to main content

2016 | OriginalPaper | Buchkapitel

Minimal Interaction Touchless Text Input with Head Movements and Stereo Vision

verfasst von : Adam Nowosielski

Erschienen in: Computer Vision and Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Many modern interfaces for human-computer interaction are based on some kind of visual system and offer touchless and convenient medium for communication for the user. These non-contact interfaces predominantly limit their operations to gesture recognition or a pointer manipulation in a graphical user interface. The problem of typing in most cases is omitted since touchless interfaces are not designed for text entry purposes. There is, however, a great number of people who suffer from some form of disability. They are unable to use standard input devices (mouse and keyboard) or modern touchless interfaces. For those physically challenged people a minimal interaction interface for text entry operated with head movements is proposed in the paper. It is based on processing video streams from a stereo webcam, uses only directional head movements and a dictionary support.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat World Health Organization: The World Bank: World Report on Disability. WHO Press, World Health Organization, Switzerland (2011) World Health Organization: The World Bank: World Report on Disability. WHO Press, World Health Organization, Switzerland (2011)
2.
Zurück zum Zitat Chattopadhyay, D., Bolchini, D.: Understanding visual feedback in large-display touchless interactions: an exploratory study. Research report, IUPUI Scholar Works, Indiana University (2014) Chattopadhyay, D., Bolchini, D.: Understanding visual feedback in large-display touchless interactions: an exploratory study. Research report, IUPUI Scholar Works, Indiana University (2014)
3.
Zurück zum Zitat Johnson, R., O’Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: ACM Conference on Computer-Human Interaction (CHI 2011), pp. 3323–3332 (2011) Johnson, R., O’Hara, K., Sellen, A., Cousins, C., Criminisi, A.: Exploring the potential for touchless interaction in image-guided interventional radiology. In: ACM Conference on Computer-Human Interaction (CHI 2011), pp. 3323–3332 (2011)
4.
Zurück zum Zitat Dostal, J., Hinrichs, U., Kristensson, P.O., Quigley, A.: SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI 2014, pp. 143–152, Haifa, Israel (2014) Dostal, J., Hinrichs, U., Kristensson, P.O., Quigley, A.: SpiderEyes: designing attention- and proximity-aware collaborative interfaces for wall-sized displays. In: Proceedings of the 19th International Conference on Intelligent User Interfaces, IUI 2014, pp. 143–152, Haifa, Israel (2014)
5.
Zurück zum Zitat Sarkar, A.R., Sanyal, G., Majumder, S.: Hand gesture recognition systems: a survey. Int. J. Comput. Appl. 71(15), 25–37 (2013) Sarkar, A.R., Sanyal, G., Majumder, S.: Hand gesture recognition systems: a survey. Int. J. Comput. Appl. 71(15), 25–37 (2013)
6.
Zurück zum Zitat Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37(3), 311–324 (2007)CrossRef Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans. Syst. Man Cybern. Part C Appl. Rev. 37(3), 311–324 (2007)CrossRef
7.
Zurück zum Zitat Rebman, C.M., Aiken, M.W., Cegielski, C.G.: Speech recognition in the human computer interface. Inform. Manage. 40(6), 509–519 (2003)CrossRef Rebman, C.M., Aiken, M.W., Cegielski, C.G.: Speech recognition in the human computer interface. Inform. Manage. 40(6), 509–519 (2003)CrossRef
8.
Zurück zum Zitat Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J.M., Brumberg, J.S.: Silent speech interfaces. Speech Commun. 52(4), 270–287 (2010)CrossRef Denby, B., Schultz, T., Honda, K., Hueber, T., Gilbert, J.M., Brumberg, J.S.: Silent speech interfaces. Speech Commun. 52(4), 270–287 (2010)CrossRef
9.
Zurück zum Zitat Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: The Minds Eye: Cognitive and Applied Aspects of Eye Movement Research. Elsevier Science, Oxford (2003) Jacob, R.J.K., Karn, K.S.: Eye tracking in human-computer interaction and usability research: ready to deliver the promises. In: The Minds Eye: Cognitive and Applied Aspects of Eye Movement Research. Elsevier Science, Oxford (2003)
11.
Zurück zum Zitat Ibraheem, N.A., Khan, R.Z.: Survey on various gesture recognition technologies and techniques. Int. J. Comput. Appl. 50(7), 38–44 (2012) Ibraheem, N.A., Khan, R.Z.: Survey on various gesture recognition technologies and techniques. Int. J. Comput. Appl. 50(7), 38–44 (2012)
12.
Zurück zum Zitat Nowosielski, A.: QWERTY- and 8pen- based touchless text input with hand movement. In: Chmielewski, L.J., Kozera, R., Shin, B.-S., Wojciechowski, K. (eds.) ICCVG 2014. LNCS, vol. 8671, pp. 470–477. Springer, Heidelberg (2014). doi:10.1007/978-3-319-11331-9_56 Nowosielski, A.: QWERTY- and 8pen- based touchless text input with hand movement. In: Chmielewski, L.J., Kozera, R., Shin, B.-S., Wojciechowski, K. (eds.) ICCVG 2014. LNCS, vol. 8671, pp. 470–477. Springer, Heidelberg (2014). doi:10.​1007/​978-3-319-11331-9_​56
14.
Zurück zum Zitat Markussen, A., Jakobsen, M.R., Hornbk, K.: Vulture: a mid-air word-gesture keyboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI 2014, pp. 1073–1082 (2014) Markussen, A., Jakobsen, M.R., Hornbk, K.: Vulture: a mid-air word-gesture keyboard. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems CHI 2014, pp. 1073–1082 (2014)
15.
Zurück zum Zitat Wierzchowski, M., Nowosielski, A.: Swipe text input for touchless interfaces. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 619–629. Springer, Heidelberg (2016). doi:10.1007/978-3-319-26227-7_58 CrossRef Wierzchowski, M., Nowosielski, A.: Swipe text input for touchless interfaces. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 619–629. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-26227-7_​58 CrossRef
17.
Zurück zum Zitat Nowosielski, A., Chodyła, Ł.: Touchless input interface for disabled. In: Burduk, R., Jackowski, K., Kurzynski, M., Wozniak, M., Zolnierek, A. (eds.) CORES 2013. AISC, vol. 226, pp. 701–709. Springer, Heidelberg (2013). doi:10.1007/978-3-319-00969-8_69 CrossRef Nowosielski, A., Chodyła, Ł.: Touchless input interface for disabled. In: Burduk, R., Jackowski, K., Kurzynski, M., Wozniak, M., Zolnierek, A. (eds.) CORES 2013. AISC, vol. 226, pp. 701–709. Springer, Heidelberg (2013). doi:10.​1007/​978-3-319-00969-8_​69 CrossRef
18.
Zurück zum Zitat Gizatdinova, Y., Spakov, O., Surakka, V.: Face typing: vision-based perceptual interface for hands-free text entry with a scrollable virtual keyboard. In: IEEE Workshop on Applications of Computer Vision 2012, Breckenridge, CO, USA, pp. 81–87 (2012) Gizatdinova, Y., Spakov, O., Surakka, V.: Face typing: vision-based perceptual interface for hands-free text entry with a scrollable virtual keyboard. In: IEEE Workshop on Applications of Computer Vision 2012, Breckenridge, CO, USA, pp. 81–87 (2012)
19.
Zurück zum Zitat Morris, T., Chauhan, V.: Facial feature tracking for cursor control. J. Netw. Comput. Appl. 29(2006), 62–80 (2006)CrossRef Morris, T., Chauhan, V.: Facial feature tracking for cursor control. J. Netw. Comput. Appl. 29(2006), 62–80 (2006)CrossRef
20.
Zurück zum Zitat Varona, J., Manresa-Yee, C., Perales, F.J.: Hands-free vision-based interface for computer accessibility. J. Netw. Comput. Appl. 31(4), 357–374 (2008)CrossRef Varona, J., Manresa-Yee, C., Perales, F.J.: Hands-free vision-based interface for computer accessibility. J. Netw. Comput. Appl. 31(4), 357–374 (2008)CrossRef
21.
Zurück zum Zitat Giorio, C., Fascinari, M.: Kinect in Motion Audio and Visual Tracking by Example Starting. Packt Publishing, Birmingham (2013) Giorio, C., Fascinari, M.: Kinect in Motion Audio and Visual Tracking by Example Starting. Packt Publishing, Birmingham (2013)
22.
Zurück zum Zitat Nowosielski, A.: Evaluation of touchless typing techniques with hand movement. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 441–449. Springer, Heidelberg (2016). doi:10.1007/978-3-319-26227-7_41 CrossRef Nowosielski, A.: Evaluation of touchless typing techniques with hand movement. In: Burduk, R., Jackowski, K., Kurzyński, M., Woźniak, M., Żołnierek, A. (eds.) Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015. AISC, vol. 403, pp. 441–449. Springer, Heidelberg (2016). doi:10.​1007/​978-3-319-26227-7_​41 CrossRef
23.
Zurück zum Zitat Placitelli, A.P.: Toward a framework for rapid prototyping of touchless user interfaces. In: 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 539–543 (2012) Placitelli, A.P.: Toward a framework for rapid prototyping of touchless user interfaces. In: 2012 Sixth International Conference on Complex, Intelligent, and Software Intensive Systems, pp. 539–543 (2012)
24.
Zurück zum Zitat Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef
25.
Zurück zum Zitat Kukharev, G., Nowosielski, A.: Fast and efficient algorithm for face detection in colour images. Mach. Graph. Vis. 13(4), 377–399 (2004) Kukharev, G., Nowosielski, A.: Fast and efficient algorithm for face detection in colour images. Mach. Graph. Vis. 13(4), 377–399 (2004)
26.
Zurück zum Zitat Kukharev, G., Kumiski, A.: Biometric Techniques Part I. Face Recognition Methods (in Polish). Szczecin University of Technology Press, Szczecin (2003) Kukharev, G., Kumiski, A.: Biometric Techniques Part I. Face Recognition Methods (in Polish). Szczecin University of Technology Press, Szczecin (2003)
Metadaten
Titel
Minimal Interaction Touchless Text Input with Head Movements and Stereo Vision
verfasst von
Adam Nowosielski
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46418-3_21