Skip to main content

2019 | OriginalPaper | Buchkapitel

Recognition of Libras Static Alphabet with MyoTM and Multi-Layer Perceptron

verfasst von : Jose Jair Alves Mendes Junior, Melissa La Banca Freitas, Sergio Luiz Stevan Jr., Sergio Francisco Pichorim

Erschienen in: XXVI Brazilian Congress on Biomedical Engineering

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A Sign Language is a structured set of corporal gestures used as a communication system, which uses movements of the arm, hand, forearm, facial expressions, and lips movements to ease the communication among deaf and/or hearing people. In Brazil, the official Sign Language is called Libras. This work presents the recognition of static alphabet of Libras (20 letters) using the armband MyoTM and a Multi-Layer Perceptron. MyoTM captures Electromyography signals from forearm and these signals are used to classification. The data were acquired from one male subject, 42 times for each gesture. The signals were segmented in periods of 750 ms using onset technique and 10 features were extract from these segments. The built MLP has one hidden layer, one input layer, and one output layer, trained by the backpropagation algorithm. The number of neurons in hidden layer was tested from 10 to 300 and the best approximation for MLP was 230 neurons. The classification has an accuracy of 91.3 ± 0.5% in training and 81.6 ± 0.9 in the test. Finally, the gestures presented accuracies above 80%, except the gestures ‘L’, ‘R’, and ‘W’.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Al-Ahdal, M.E., Nooritawati, M.T.: Review in sign language recognition systems. In: 2012 IEEE Symposium on Computers Informatics (ISCI), pp. 52–57 (2012) Al-Ahdal, M.E., Nooritawati, M.T.: Review in sign language recognition systems. In: 2012 IEEE Symposium on Computers Informatics (ISCI), pp. 52–57 (2012)
7.
Zurück zum Zitat Santos, J.R., Costa, M.G.F., Costa Filho, C.F.F.: Reconhecimento das configurações de mão de LIBRAS baseado na análise de discriminante de Fisher bidimensional, utilizando imagens de profundidade, pp. 165–174. Recife, PE (2015) Santos, J.R., Costa, M.G.F., Costa Filho, C.F.F.: Reconhecimento das configurações de mão de LIBRAS baseado na análise de discriminante de Fisher bidimensional, utilizando imagens de profundidade, pp. 165–174. Recife, PE (2015)
10.
Zurück zum Zitat De Paula Neto, F.M., Cambuim, L.F., Macieira, R.M., et al: Extreme learning machine for real time recognition of Brazilian Sign Language. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, pp. 1464–1469 (2015) De Paula Neto, F.M., Cambuim, L.F., Macieira, R.M., et al: Extreme learning machine for real time recognition of Brazilian Sign Language. In: 2015 IEEE International Conference on Systems, Man, and Cybernetics, pp. 1464–1469 (2015)
11.
Zurück zum Zitat Bastos, I.L.O., Angelo, M.F., Loula, A.C.: Recognition of static gestures applied to Brazilian Sign Language (Libras). In: 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 305–312 (2015) Bastos, I.L.O., Angelo, M.F., Loula, A.C.: Recognition of static gestures applied to Brazilian Sign Language (Libras). In: 2015 28th SIBGRAPI Conference on Graphics, Patterns and Images, pp. 305–312 (2015)
12.
Zurück zum Zitat Bastos, I.L.O.: Reconhecimento de sinais da libras utilizando descritores de forma e redes neurais artificiais (2016) Bastos, I.L.O.: Reconhecimento de sinais da libras utilizando descritores de forma e redes neurais artificiais (2016)
13.
Zurück zum Zitat Teodoro, B.T.: Sistema de reconhecimento automático de Língua Brasileira de Sinais. Text, Universidade de São Paulo (2015) Teodoro, B.T.: Sistema de reconhecimento automático de Língua Brasileira de Sinais. Text, Universidade de São Paulo (2015)
14.
Zurück zum Zitat Cram, J.R.: The history of surface electromyography. Appl. Psychophysiol. Biofeedback 28, 81–91 (2003) Cram, J.R.: The history of surface electromyography. Appl. Psychophysiol. Biofeedback 28, 81–91 (2003)
15.
Zurück zum Zitat De Luca, C.: Electromyography. In: Encyclopedia of Medical Devices and Instrumentation, 2nd edn., p. 3666. Wiley, New York (2006) De Luca, C.: Electromyography. In: Encyclopedia of Medical Devices and Instrumentation, 2nd edn., p. 3666. Wiley, New York (2006)
17.
Zurück zum Zitat Abreu, J.G., Teixeira, J.M., Figueiredo, L.S., Teichrieb, V.: Evaluating sign language recognition using the Myo Armband. In: 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), pp. 64–70 (2016) Abreu, J.G., Teixeira, J.M., Figueiredo, L.S., Teichrieb, V.: Evaluating sign language recognition using the Myo Armband. In: 2016 XVIII Symposium on Virtual and Augmented Reality (SVR), pp. 64–70 (2016)
18.
Zurück zum Zitat Mendes Junior, J.J.A.: Desenvolvimento de uma Armband para Captura de Sinais Eletromiográficos para Reconhecimento de Movimentos. Dissertação (Mestrado em Engenharia Elétrica), Universidade Tecnológica Federal do Paraná (2016) Mendes Junior, J.J.A.: Desenvolvimento de uma Armband para Captura de Sinais Eletromiográficos para Reconhecimento de Movimentos. Dissertação (Mestrado em Engenharia Elétrica), Universidade Tecnológica Federal do Paraná (2016)
19.
Zurück zum Zitat Costanza, E., Inverso, S.A., Allen, R., Maes, P.: Intimate interfaces in action: assessing the usability and subtlety of EMG-based motionless gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 819–828. ACM, New York, NY, USA (2007) Costanza, E., Inverso, S.A., Allen, R., Maes, P.: Intimate interfaces in action: assessing the usability and subtlety of EMG-based motionless gestures. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 819–828. ACM, New York, NY, USA (2007)
20.
Zurück zum Zitat Saponas, T.S., Tan, D.S., Morris, D., et al: Making muscle-computer interfaces more practical. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1–4. Atlanta, Georgia (2010) Saponas, T.S., Tan, D.S., Morris, D., et al: Making muscle-computer interfaces more practical. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1–4. Atlanta, Georgia (2010)
22.
Zurück zum Zitat Mendes Junior, J.J.A., Campos, D.P., Stevan Jr., S.L., et al.: Avaliação de técnicas de segmentação de sEMG de múltiplos canais. In: Anais do V Congresso Brasileiro de Eletromiografia e Cinesiologia e X Simpósio de Engenharia Biomédica. Uberlândia, Minas Gerais (2017) Mendes Junior, J.J.A., Campos, D.P., Stevan Jr., S.L., et al.: Avaliação de técnicas de segmentação de sEMG de múltiplos canais. In: Anais do V Congresso Brasileiro de Eletromiografia e Cinesiologia e X Simpósio de Engenharia Biomédica. Uberlândia, Minas Gerais (2017)
23.
Zurück zum Zitat Freitas, M.L.B., Mendes Junior, J.J.A., Pires, M.B., Stevan Jr., S.L.: Sistema de Extração de Características do Sinal de Eletromiografia de Tempo e Frequência em LabVIEW. An V Congr Bras Eletromiografia E Cinesiologia E X Simpósio Eng Bioméd Vol 1-Ano 2017:1 (2018). https://doi.org/10.29327/cobecseb.78825 Freitas, M.L.B., Mendes Junior, J.J.A., Pires, M.B., Stevan Jr., S.L.: Sistema de Extração de Características do Sinal de Eletromiografia de Tempo e Frequência em LabVIEW. An V Congr Bras Eletromiografia E Cinesiologia E X Simpósio Eng Bioméd Vol 1-Ano 2017:1 (2018). https://​doi.​org/​10.​29327/​cobecseb.​78825
Metadaten
Titel
Recognition of Libras Static Alphabet with MyoTM and Multi-Layer Perceptron
verfasst von
Jose Jair Alves Mendes Junior
Melissa La Banca Freitas
Sergio Luiz Stevan Jr.
Sergio Francisco Pichorim
Copyright-Jahr
2019
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-2517-5_63

Neuer Inhalt