Skip to main content
Top

2016 | OriginalPaper | Chapter

Sign Language Recognition Model Combining Non-manual Markers and Handshapes

Authors : Luis Quesada, Gabriela Marín, Luis A. Guerrero

Published in: Ubiquitous Computing and Ambient Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

People with disabilities have fewer opportunities. Technological developments should be used to help these people to have more opportunities. In this paper we present partial results of a research project which aims to help people with disabilities, specifically deaf and hard of hearing. We present a sign language recognition model. The model takes advantage of the natural user interfaces (NUI) and a classification algorithm (support vector machines). Moreover, we combine handshapes (signs) and non-manual markers (associated to emotions and face gestures) in the recognition process to enhance the sign language expressivity recognition. Additionally, non-manual markers representation is proposed. A model evaluation is also reported.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Lewis, P., Simons, G., Fennig, C.: Ethnologue: Languages of the World. SIL International (2009) Lewis, P., Simons, G., Fennig, C.: Ethnologue: Languages of the World. SIL International (2009)
2.
go back to reference Oviedo, A.: Descripción General Básica de la LESCO (2012) Oviedo, A.: Descripción General Básica de la LESCO (2012)
3.
go back to reference Woodward, J.: Sign language varieties in Costa Rica. Sign Lang. Stud. 73(1), 329–345 (1991)CrossRef Woodward, J.: Sign language varieties in Costa Rica. Sign Lang. Stud. 73(1), 329–345 (1991)CrossRef
4.
go back to reference Caridakis, G., Asteriadis, S., Karpouzis, K.: Non-manual cues in automatic sign language recognition. Pers. Ubiquit. Comput. 18(1), 37–46 (2014)CrossRef Caridakis, G., Asteriadis, S., Karpouzis, K.: Non-manual cues in automatic sign language recognition. Pers. Ubiquit. Comput. 18(1), 37–46 (2014)CrossRef
5.
go back to reference Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the kinect. In: Proceedings of the 13th International Conference Multimodal Interfaces, pp. 279–286 (2011) Zafrulla, Z., Brashear, H., Starner, T., Hamilton, H., Presti, P.: American sign language recognition with the kinect. In: Proceedings of the 13th International Conference Multimodal Interfaces, pp. 279–286 (2011)
6.
go back to reference Agarwal, A., Thakur, M.K.: Sign language recognition using Microsoft Kinect. In: Sixth International Conference on Contemporary Computing, pp. 181–185 (2013) Agarwal, A., Thakur, M.K.: Sign language recognition using Microsoft Kinect. In: Sixth International Conference on Contemporary Computing, pp. 181–185 (2013)
7.
go back to reference Huang, J., Zhou, W., Li, W., Li, H.: Sign language recognition using real-sense. In: EEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 166–170 (2015) Huang, J., Zhou, W., Li, W., Li, H.: Sign language recognition using real-sense. In: EEE China Summit and International Conference on Signal and Information Processing (ChinaSIP), pp. 166–170 (2015)
8.
go back to reference Liu, J., Liu, B., Zhang, S., Yang, F., Yang, P., Metaxas, D.N., Neidle, C.: Non-manual grammatical marker recognition based on multi-scale, spatio-temporal analysis of head pose and facial expressions. Image Vis. Comput. 32(10), 671–681 (2014)CrossRef Liu, J., Liu, B., Zhang, S., Yang, F., Yang, P., Metaxas, D.N., Neidle, C.: Non-manual grammatical marker recognition based on multi-scale, spatio-temporal analysis of head pose and facial expressions. Image Vis. Comput. 32(10), 671–681 (2014)CrossRef
9.
go back to reference Yang, H.D., Lee, S.W.: Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine. Pattern Recognit. Lett. 34(16), 2051–2056 (2013)MathSciNetCrossRef Yang, H.D., Lee, S.W.: Robust sign language recognition by combining manual and non-manual features based on conditional random field and support vector machine. Pattern Recognit. Lett. 34(16), 2051–2056 (2013)MathSciNetCrossRef
10.
go back to reference Nguyen, T.D., Ranganath, S.: Facial expressions in American sign language: tracking and recognition. Pattern Recognit. 45(5), 1877–1891 (2012)CrossRefMATH Nguyen, T.D., Ranganath, S.: Facial expressions in American sign language: tracking and recognition. Pattern Recognit. 45(5), 1877–1891 (2012)CrossRefMATH
11.
go back to reference Quesada, L., López, G., Guerrero, L.A.: Sign language recognition using leap motion. In: García-Chamizo, J.M., et al. (eds.) UCAml 2015. LNCS, vol. 9454, pp. 277–288. Springer, Heidelberg (2015) Quesada, L., López, G., Guerrero, L.A.: Sign language recognition using leap motion. In: García-Chamizo, J.M., et al. (eds.) UCAml 2015. LNCS, vol. 9454, pp. 277–288. Springer, Heidelberg (2015)
12.
go back to reference Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)MATH Cortes, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20, 273–297 (1995)MATH
13.
go back to reference Antonakos, E., Roussos, A., Zafeiriou, S.: A survey on mouth modeling and analysis for Sign Language recognition. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2015) Antonakos, E., Roussos, A., Zafeiriou, S.: A survey on mouth modeling and analysis for Sign Language recognition. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2015)
Metadata
Title
Sign Language Recognition Model Combining Non-manual Markers and Handshapes
Authors
Luis Quesada
Gabriela Marín
Luis A. Guerrero
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-48746-5_41

Premium Partner