Skip to main content

2016 | OriginalPaper | Buchkapitel

Sign Language Recognition Model Combining Non-manual Markers and Handshapes

verfasst von : Luis Quesada, Gabriela Marín, Luis A. Guerrero

Erschienen in: Ubiquitous Computing and Ambient Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

People with disabilities have fewer opportunities. Technological developments should be used to help these people to have more opportunities. In this paper we present partial results of a research project which aims to help people with disabilities, specifically deaf and hard of hearing. We present a sign language recognition model. The model takes advantage of the natural user interfaces (NUI) and a classification algorithm (support vector machines). Moreover, we combine handshapes (signs) and non-manual markers (associated to emotions and face gestures) in the recognition process to enhance the sign language expressivity recognition. Additionally, non-manual markers representation is proposed. A model evaluation is also reported.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lewis, P., Simons, G., Fennig, C.: Ethnologue: Languages of the World. SIL International (2009) Lewis, P., Simons, G., Fennig, C.: Ethnologue: Languages of the World. SIL International (2009)
2.
Zurück zum Zitat Oviedo, A.: Descripción General Básica de la LESCO (2012) Oviedo, A.: Descripción General Básica de la LESCO (2012)
3.
Zurück zum Zitat Woodward, J.: Sign language varieties in Costa Rica. Sign Lang. Stud. 73(1), 329–345 (1991)CrossRef Woodward, J.: Sign language varieties in Costa Rica. Sign Lang. Stud. 73(1), 329–345 (1991)CrossRef
4.
Zurück zum Zitat Caridakis, G., Asteriadis, S., Karpouzis, K.: Non-manual cues in automatic sign language recognition. Pers. Ubiquit. Comput. 18(1), 37–46 (2014)CrossRef Caridakis, G., Asteriadis, S., Karpouzis, K.: Non-manual cues in automatic sign language recognition. Pers. Ubiquit. Comput. 18(1), 37–46 (2014)CrossRef
5.
Zurück zum Zitat Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the kinect. In: Proceedings of the 13th International Conference Multimodal Interfaces, pp. 279–286 (2011) Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the kinect. In: Proceedings of the 13th International Conference Multimodal Interfaces, pp. 279–286 (2011)
6.
Zurück zum Zitat Agarwal, A., Thakur, M.K.: Sign language recognition using Microsoft Kinect. In: Sixth International Conference on Contemporary Computing, pp. 181–185 (2013) Agarwal, A., Thakur, M.K.: Sign language recognition using Microsoft Kinect. In: Sixth International Conference on Contemporary Computing, pp. 181–185 (2013)
7.
Zurück zum Zitat Huang, J., Zhou, W., Li, W., Li, H.: Sign language recognition using real-sense. In: EEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 166–170 (2015) Huang, J., Zhou, W., Li, W., Li, H.: Sign language recognition using real-sense. In: EEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 166–170 (2015)
8.
Zurück zum Zitat Liu, J., Liu, B., Zhang, S., Yang, F., Yang, P., Metaxas, D.N., Neidle, C.: Non-manual grammatical marker recognition based on multi-scale, spatio-temporal analysis of head pose and facial expressions. Image Vis. Comput. 32(10), 671–681 (2014)CrossRef Liu, J., Liu, B., Zhang, S., Yang, F., Yang, P., Metaxas, D.N., Neidle, C.: Non-manual grammatical marker recognition based on multi-scale, spatio-temporal analysis of head pose and facial expressions. Image Vis. Comput. 32(10), 671–681 (2014)CrossRef
9.
Zurück zum Zitat Yang, H.D., Lee, S.W.: Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine. Pattern Recognit. Lett. 34(16), 2051–2056 (2013)MathSciNetCrossRef Yang, H.D., Lee, S.W.: Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine. Pattern Recognit. Lett. 34(16), 2051–2056 (2013)MathSciNetCrossRef
10.
Zurück zum Zitat Nguyen, T.D., Ranganath, S.: Facial expressions in American sign language: tracking and recognition. Pattern Recognit. 45(5), 1877–1891 (2012)CrossRefMATH Nguyen, T.D., Ranganath, S.: Facial expressions in American sign language: tracking and recognition. Pattern Recognit. 45(5), 1877–1891 (2012)CrossRefMATH
11.
Zurück zum Zitat Quesada, L., López, G., Guerrero, L.A.: Sign language recognition using leap motion. In: García-Chamizo, J.M., et al. (eds.) UCAml 2015. LNCS, vol. 9454, pp. 277–288. Springer, Heidelberg (2015) Quesada, L., López, G., Guerrero, L.A.: Sign language recognition using leap motion. In: García-Chamizo, J.M., et al. (eds.) UCAml 2015. LNCS, vol. 9454, pp. 277–288. Springer, Heidelberg (2015)
12.
Zurück zum Zitat Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)MATH
13.
Zurück zum Zitat Antonakos, E., Roussos, A., Zafeiriou, S.: A survey on mouth modeling and analysis for Sign Language recognition. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2015) Antonakos, E., Roussos, A., Zafeiriou, S.: A survey on mouth modeling and analysis for Sign Language recognition. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2015)
Metadaten
Titel
Sign Language Recognition Model Combining Non-manual Markers and Handshapes
verfasst von
Luis Quesada
Gabriela Marín
Luis A. Guerrero
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-48746-5_41