Skip to main content

2023 | OriginalPaper | Buchkapitel

Background Subtraction and Singular Value Decomposition Based Movement Epenthesis Detection in Isolated Gestures of Sign Language

verfasst von : Navneet Nayan, Debashis Ghosh, Pyari Mohan Pradhan

Erschienen in: Proceedings of the 6th International Conference on Advance Computing and Intelligent Engineering

Verlag: Springer Nature Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper addresses the issue of movement epenthesis detection in isolated gestures. A novel method based on background subtraction and singular value decomposition to detect movement epenthesis in isolated gestures are proposed in this paper. The singular values of the absolute difference matrix obtained after the background subtraction provide a set of discriminative features to segment the movement epenthesis frames and sign frames. An adaptive threshold value is determined using the statistical properties of singular values for movement epenthesis detection. We tested our method on the ChaLearn LAP IsoGD dataset and the videos containing Indian Sign Language words. Experimental results show that our approach detected movement epenthesis frames with an accuracy of 91.14% and 93.73% on the ChaLearn LAP IsoGD dataset and the Indian Sign Language dataset, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Wan, J., Li, S. Z., Zhao, Y., Zhou, S., Guyon, I., & Escalera, S. (2016). ChaLearn looking at people RGB-D isolated and continuous datasets for gesture recognition. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp. 761–769). Wan, J., Li, S. Z., Zhao, Y., Zhou, S., Guyon, I., & Escalera, S. (2016). ChaLearn looking at people RGB-D isolated and continuous datasets for gesture recognition. In IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp. 761–769).
2.
Zurück zum Zitat Vogler, C., & Metaxas, D. (1998). ASL recognition based on a coupling between HMMs and 3D Motion analysis. In ICCV. Vogler, C., & Metaxas, D. (1998). ASL recognition based on a coupling between HMMs and 3D Motion analysis. In ICCV.
3.
Zurück zum Zitat Vogler, C., & Metaxas, D. (2001). A framework for recognizing the simultaneous aspects of American sign language. Journal of Computer Vision and Image Understanding, 81(3), 358–384.CrossRefMATH Vogler, C., & Metaxas, D. (2001). A framework for recognizing the simultaneous aspects of American sign language. Journal of Computer Vision and Image Understanding, 81(3), 358–384.CrossRefMATH
4.
Zurück zum Zitat Gao, W., Fang, G., Zhao, D., & Chen, Y. (2004). Transition movement models for large vocabulary continuous sign language recognition. In 6th IEEE International Conference on Automatic Face and Gesture Recognition (pp. 553–558). Gao, W., Fang, G., Zhao, D., & Chen, Y. (2004). Transition movement models for large vocabulary continuous sign language recognition. In 6th IEEE International Conference on Automatic Face and Gesture Recognition (pp. 553–558).
5.
Zurück zum Zitat Ong, C. W., & Ranganath, S. (2005). Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(6), 873–891.CrossRef Ong, C. W., & Ranganath, S. (2005). Automatic sign language analysis: A survey and the future beyond lexical meaning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(6), 873–891.CrossRef
6.
Zurück zum Zitat Yang, R. D., Sarkar, S., & Loeding, B. (2007). Enhanced level building algorithm for the movement epenthesis problem in sign language recognition. In IEEE Conference on Computer Vision and Pattern Recognition (pp. 1–8). Yang, R. D., Sarkar, S., & Loeding, B. (2007). Enhanced level building algorithm for the movement epenthesis problem in sign language recognition. In IEEE Conference on Computer Vision and Pattern Recognition (pp. 1–8).
7.
Zurück zum Zitat Choudhury, A., Talukdar, A. K., Bhuyan, M. K., & Sarma, K. K. (2017). Movement epenthesis detection for continuous sign language recognition. Journal of Intelligent Systems, 26(3), 471–481.CrossRef Choudhury, A., Talukdar, A. K., Bhuyan, M. K., & Sarma, K. K. (2017). Movement epenthesis detection for continuous sign language recognition. Journal of Intelligent Systems, 26(3), 471–481.CrossRef
8.
Zurück zum Zitat Yang, R. D., Sarkar, S., & Loeding, B. (2010). Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3), 462–477.CrossRef Yang, R. D., Sarkar, S., & Loeding, B. (2010). Handling movement epenthesis and hand segmentation ambiguities in continuous sign language recognition using nested dynamic programming. IEEE Transactions on Pattern Analysis and Machine Intelligence, 32(3), 462–477.CrossRef
9.
Zurück zum Zitat Shanableh, T., Assaleh, K., & Al-Rousan, M. (2007). Spatio-temporal feature-extraction techniques for isolated gesture recognition in Arabic sign language. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 37(3), 641–650. Shanableh, T., Assaleh, K., & Al-Rousan, M. (2007). Spatio-temporal feature-extraction techniques for isolated gesture recognition in Arabic sign language. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 37(3), 641–650.
10.
Zurück zum Zitat Zhu, G., Zhang, L., Mei, L., Shao, J., Song, J., & Shen, P. (2016). Large-scale isolated gesture recognition using pyramidal 3D convolutional networks. In 23rd International Conference on Pattern Recognition (ICPR) (pp. 19–24). Zhu, G., Zhang, L., Mei, L., Shao, J., Song, J., & Shen, P. (2016). Large-scale isolated gesture recognition using pyramidal 3D convolutional networks. In 23rd International Conference on Pattern Recognition (ICPR) (pp. 19–24).
11.
Zurück zum Zitat Wang, P., Li, W., Liu, S., Gao, Z., Tang, C., & Ogunbona, P. (2016). Large-scale isolated gesture recognition using convolutional neural networks. In 23rd International Conference on Pattern Recognition (ICPR) (pp. 7–12). Wang, P., Li, W., Liu, S., Gao, Z., Tang, C., & Ogunbona, P. (2016). Large-scale isolated gesture recognition using convolutional neural networks. In 23rd International Conference on Pattern Recognition (ICPR) (pp. 7–12).
12.
Zurück zum Zitat Lin, C., Wan, J., Liang, Y., & Li, S. Z. (2018). Large-scale isolated gesture recognition using a refined fused model based on masked Res-C3D network and Skeleton LSTM. In 13th IEEE International Conference on Automatic Face and Gesture Recognition (pp. 52–58). Lin, C., Wan, J., Liang, Y., & Li, S. Z. (2018). Large-scale isolated gesture recognition using a refined fused model based on masked Res-C3D network and Skeleton LSTM. In 13th IEEE International Conference on Automatic Face and Gesture Recognition (pp. 52–58).
Metadaten
Titel
Background Subtraction and Singular Value Decomposition Based Movement Epenthesis Detection in Isolated Gestures of Sign Language
verfasst von
Navneet Nayan
Debashis Ghosh
Pyari Mohan Pradhan
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-19-2225-1_20

Neuer Inhalt