Skip to main content
Top

2016 | OriginalPaper | Chapter

Zoning-Based Gesture Recognition to Enable a Mobile Lorm Trainer

Authors : Michael Schmidt, Cathleen Bank, Gerhard Weber

Published in: Computers Helping People with Special Needs

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, a mobile learning tool for the Lorm-alphabet is developed. A person who is deaf-blind is lorming by finger spelling on another person’s palm and fingers. We aim to provide an easy and anywhere to use Lorm trainer for caregivers, companions, and the general public. A robust gesture recognition utilizing zoning techniques and matching of symbol sequences has been developed for touch sensitive mobile devices. Tests with three users of the target group were conducted and qualitative evaluation of three experts was obtained. Overall, our development got positive feedback and a broad demand for the application was communicated. It is promising not only to support students of Lorm in their training process, but to widen the application of Lorm, therefore, diminishing social isolation of deaf-blind.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
An analysis of pixel density may lead to further improvements of classification accuracy.
 
2
The app’s acronym works in English and German and means LEarning LORM.
 
3
Letter frequencies of phrases designed for tests - and used in evaluation - correlate at \(r=0.96\) with that in German language.
 
4
An Asus Transformer Pad TF300TG (NVIDIA Tegra 3, 1,3 GHz, 1 GB RAM, Android 4.2.1) with 10,1” screen with capacitive 10 finger multi-touch.
 
Literature
1.
go back to reference Andersson, C., Campbell, D., Farquharson, A., Furner, S., Gill, J., Jackson, A., Lucker, J., Nolde, K., Werner, E., Whybray, M., et al.: Assistive technology for the hearing-impaired, deaf and deafblind. Springer Science & Business Media, London (2006) Andersson, C., Campbell, D., Farquharson, A., Furner, S., Gill, J., Jackson, A., Lucker, J., Nolde, K., Werner, E., Whybray, M., et al.: Assistive technology for the hearing-impaired, deaf and deafblind. Springer Science & Business Media, London (2006)
2.
go back to reference Arato, A., Markus, N., Juhasz, Z.: Teaching morse language to a deaf-blind person for reading and writing SMS on an ordinary vibrating smartphone. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part II. LNCS, vol. 8548, pp. 393–396. Springer, Heidelberg (2014) Arato, A., Markus, N., Juhasz, Z.: Teaching morse language to a deaf-blind person for reading and writing SMS on an ordinary vibrating smartphone. In: Miesenberger, K., Fels, D., Archambault, D., Peňáz, P., Zagler, W. (eds.) ICCHP 2014, Part II. LNCS, vol. 8548, pp. 393–396. Springer, Heidelberg (2014)
3.
go back to reference Caporusso, N.: A wearable malossi alphabet interface for deafblind people. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2008, pp. 445–448. ACM, New York (2008) Caporusso, N.: A wearable malossi alphabet interface for deafblind people. In: Proceedings of the Working Conference on Advanced Visual Interfaces, AVI 2008, pp. 445–448. ACM, New York (2008)
4.
go back to reference Coyette, A., Schimke, S., Jean, V., Vielhauer, C.: An algorithm for pen-based gesture recognition based on levenshtein distance. Working paper 07/05, Louvain School of Management, Universität catholique de Louvain (2007) Coyette, A., Schimke, S., Jean, V., Vielhauer, C.: An algorithm for pen-based gesture recognition based on levenshtein distance. Working paper 07/05, Louvain School of Management, Universität catholique de Louvain (2007)
5.
go back to reference de Almendra Freitas, C.O., Oliveira, L.S., Aires, S.B.K., Bortolozzi, F.: Zoning and metaclasses for character recognition. In: Proceedings of the ACM Symposium on Applied Computing, SAC 2007, pp. 632–636. ACM, New York (2007) de Almendra Freitas, C.O., Oliveira, L.S., Aires, S.B.K., Bortolozzi, F.: Zoning and metaclasses for character recognition. In: Proceedings of the ACM Symposium on Applied Computing, SAC 2007, pp. 632–636. ACM, New York (2007)
6.
go back to reference Gollner, U., Bieling, T., Joost, G.: Mobile lorm glove: introducing a communication device for deaf-blind people. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012, pp. 127–130. ACM, New York (2012) Gollner, U., Bieling, T., Joost, G.: Mobile lorm glove: introducing a communication device for deaf-blind people. In: Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction, TEI 2012, pp. 127–130. ACM, New York (2012)
7.
go back to reference Hussain, A.B.S., Toussaint, G.T., Donaldson, R.W.: Results obtained using a simple character recognition procedure on munson’s handprinted. IEEE Trans. Comput. C–21(2), 201–205 (1972)CrossRef Hussain, A.B.S., Toussaint, G.T., Donaldson, R.W.: Results obtained using a simple character recognition procedure on munson’s handprinted. IEEE Trans. Comput. C–21(2), 201–205 (1972)CrossRef
8.
go back to reference Impedovo, D., Pirlo, G.: Zoning methods for handwritten character recognition. Pattern Recogn. 47(3), 969–981 (2014)CrossRef Impedovo, D., Pirlo, G.: Zoning methods for handwritten character recognition. Pattern Recogn. 47(3), 969–981 (2014)CrossRef
9.
go back to reference Jacob, R.J.K.: The use of eye movements in human-computer interaction techniques: what you look at is what you get. ACM Trans. Inf. Syst. (TOIS) 9(2), 152–169 (1991)CrossRef Jacob, R.J.K.: The use of eye movements in human-computer interaction techniques: what you look at is what you get. ACM Trans. Inf. Syst. (TOIS) 9(2), 152–169 (1991)CrossRef
10.
go back to reference Jaffe, D.L.: Evolution of mechanical fingerspelling hands for people who are deaf-blind. J. Rehabil. Res. Dev. 31(3), 236–244 (1994) Jaffe, D.L.: Evolution of mechanical fingerspelling hands for people who are deaf-blind. J. Rehabil. Res. Dev. 31(3), 236–244 (1994)
11.
go back to reference Lemke-Werner, G., für Blinden, V., Sehbehindertenpädagogik.: Taubblindheit, Hörsehbehinderung-ein Überblick. Ed. Bentheim (2009) Lemke-Werner, G., für Blinden, V., Sehbehindertenpädagogik.: Taubblindheit, Hörsehbehinderung-ein Überblick. Ed. Bentheim (2009)
12.
go back to reference Li, X., Plamondon, R., Parizeau, M.: Model-based on-line handwritten digit recognition. In: International Conference on Pattern Recognition 2, 1134 (1998) Li, X., Plamondon, R., Parizeau, M.: Model-based on-line handwritten digit recognition. In: International Conference on Pattern Recognition 2, 1134 (1998)
13.
go back to reference Scheithauer, M.C., Tiger, J.H.: A computer-based program to teach braille reading to sighted individuals. J. Appl. Behav. Anal. 45(2), 315–327 (2012)CrossRef Scheithauer, M.C., Tiger, J.H.: A computer-based program to teach braille reading to sighted individuals. J. Appl. Behav. Anal. 45(2), 315–327 (2012)CrossRef
14.
go back to reference Soraluze, I., Rodriguez, C., Boto, F., Perez, A.: Multidimensional multistage k-nn classifiers for handwritten digit recognition. In: Proceedings of Eighth International Workshop on Frontiers in Handwriting Recognition, pp. 19–23 (2002) Soraluze, I., Rodriguez, C., Boto, F., Perez, A.: Multidimensional multistage k-nn classifiers for handwritten digit recognition. In: Proceedings of Eighth International Workshop on Frontiers in Handwriting Recognition, pp. 19–23 (2002)
15.
go back to reference Szeto, A.Y.J., Christensen, K.M.: Technological devices for deaf-blind children: needs and potential impact. Eng. Med. Biol. Mag., IEEE 7(3), 25–29 (1988)CrossRef Szeto, A.Y.J., Christensen, K.M.: Technological devices for deaf-blind children: needs and potential impact. Eng. Med. Biol. Mag., IEEE 7(3), 25–29 (1988)CrossRef
Metadata
Title
Zoning-Based Gesture Recognition to Enable a Mobile Lorm Trainer
Authors
Michael Schmidt
Cathleen Bank
Gerhard Weber
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-41267-2_67