Skip to main content

2020 | OriginalPaper | Buchkapitel

Video-Based Marathi Sign Language Recognition and Text Conversion Using Convolutional Neural Network

verfasst von : Ashwini M. Deshpande, Snehal R. Kalbhor

Erschienen in: Emerging Trends in Electrical, Communications, and Information Technologies

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The communication between the deaf people and the hearing community is the challenging task. To overcome this barrier automatic sign language recognition plays an important role. It helps to remove the communication barrier between them. A Convolutional Neural Network (CNN) based approach for Marathi sign language is presented in this paper to help understand and interpret the hand gestures made for Marathi alphabets. This system using CNN is an automated process of constructing the handcrafted feature from gesture images. The system is able to recognize 25 Marathi sign language (MSL) alphabets with a testing accuracy of 99.28%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Taunk S, Sharma DK, Giri RN (2014) Static gesture recognition of devnagari sign language using feed-forward neural network. Int J Adv Res Comput Eng Technol (IJARCET) 3(10):3388–3392 Taunk S, Sharma DK, Giri RN (2014) Static gesture recognition of devnagari sign language using feed-forward neural network. Int J Adv Res Comput Eng Technol (IJARCET) 3(10):3388–3392
2.
Zurück zum Zitat Lin HI, Hsu M-H, Chen W-K (2014) Human hand gesture recognition using a convolution neural network. In: IEEE international conference on automation science and engineering (CASE), pp 1038–1043 Lin HI, Hsu M-H, Chen W-K (2014) Human hand gesture recognition using a convolution neural network. In: IEEE international conference on automation science and engineering (CASE), pp 1038–1043
3.
Zurück zum Zitat Flores CJL, Cutipa AG, Enciso RL (2017) Application of convolutional neural networks for static hand gestures recognition under different invariant features. In: IEEE XXIV international conference on electronics, electrical engineering and computing (INTERCON), Cusco, Peru, pp 1–4 Flores CJL, Cutipa AG, Enciso RL (2017) Application of convolutional neural networks for static hand gestures recognition under different invariant features. In: IEEE XXIV international conference on electronics, electrical engineering and computing (INTERCON), Cusco, Peru, pp 1–4
4.
Zurück zum Zitat Murthy GRS, Jadon RS (2010) Hand gesture recognition using neural networks. In: IEEE international advance computing conference (IACC), Patiala, pp 134–138 Murthy GRS, Jadon RS (2010) Hand gesture recognition using neural networks. In: IEEE international advance computing conference (IACC), Patiala, pp 134–138
5.
Zurück zum Zitat Shinde A, Kagalkar R (2015) Advanced Marathi sign language recognition using computer vision. Int J Comput Appl 118(13):1–7 Shinde A, Kagalkar R (2015) Advanced Marathi sign language recognition using computer vision. Int J Comput Appl 118(13):1–7
6.
Zurück zum Zitat Bhowmick S, Kumar S, Kumar A (2015) Hand gesture recognition of English alphabets using artificial neural network. In: IEEE 2nd international conference on recent trends in information systems (ReTIS), Kolkata, pp 405–410 Bhowmick S, Kumar S, Kumar A (2015) Hand gesture recognition of English alphabets using artificial neural network. In: IEEE 2nd international conference on recent trends in information systems (ReTIS), Kolkata, pp 405–410
7.
Zurück zum Zitat De O, Deb P, Mukherjee S, Nandy S, Chakraborty T, Saha S (2016) Computer vision based framework for digit recognition by hand gesture analysis. In: IEEE 7th annual information technology, electronics and mobile communication conference (IEMCON), pp 1–5 De O, Deb P, Mukherjee S, Nandy S, Chakraborty T, Saha S (2016) Computer vision based framework for digit recognition by hand gesture analysis. In: IEEE 7th annual information technology, electronics and mobile communication conference (IEMCON), pp 1–5
8.
Zurück zum Zitat Han M, Chen J, Li L, Chang Y (2016) Visual hand gesture recognition with convolution neural network. In: 17th IEEE/ACIS international conference on software engineering, artificial intelligence, networking and parallel/distributed computing (sNPD), pp 287–291 Han M, Chen J, Li L, Chang Y (2016) Visual hand gesture recognition with convolution neural network. In: 17th IEEE/ACIS international conference on software engineering, artificial intelligence, networking and parallel/distributed computing (sNPD), pp 287–291
9.
Zurück zum Zitat Islam MM, Siddiqua S, Afnan J (2017) Real-time hand gesture recognition using different algorithms based on American sign language. In: IEEE international conference on imaging, vision and pattern recognition (icIVPR), Dhaka, pp 1–6 Islam MM, Siddiqua S, Afnan J (2017) Real-time hand gesture recognition using different algorithms based on American sign language. In: IEEE international conference on imaging, vision and pattern recognition (icIVPR), Dhaka, pp 1–6
11.
Zurück zum Zitat Jianxin Wu (2017) Introduction to Convolutional neural networks. Nanjing University, China, May Jianxin Wu (2017) Introduction to Convolutional neural networks. Nanjing University, China, May
13.
Zurück zum Zitat Teow MYW (2017) Understanding convolutional neural networks using a minimal model for handwritten digit recognition. In: IEEE 2nd international conference on automatic control and intelligent systems (I2CACIS 2017), Kota Kinabalu, Malaysia, pp 167–172 Teow MYW (2017) Understanding convolutional neural networks using a minimal model for handwritten digit recognition. In: IEEE 2nd international conference on automatic control and intelligent systems (I2CACIS 2017), Kota Kinabalu, Malaysia, pp 167–172
15.
Zurück zum Zitat Garcia B, Viesca SA (2016) Real-time American sign language recognition with convolutional neural network. Stanford University, Stanford, CA, pp 225–232 Garcia B, Viesca SA (2016) Real-time American sign language recognition with convolutional neural network. Stanford University, Stanford, CA, pp 225–232
Metadaten
Titel
Video-Based Marathi Sign Language Recognition and Text Conversion Using Convolutional Neural Network
verfasst von
Ashwini M. Deshpande
Snehal R. Kalbhor
Copyright-Jahr
2020
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-8942-9_65