Skip to main content
Erschienen in: Universal Access in the Information Society 4/2020

13.11.2019 | Long Paper

A machine translation system from Arabic sign language to Arabic

verfasst von: Hamzah Luqman, Sabri A. Mahmoud

Erschienen in: Universal Access in the Information Society | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Arabic sign language (ArSL) is one of the sign languages that is used in Arab countries. This language has structure and grammar that differ from spoken Arabic. Available ArSL recognition systems perform direct mapping between the recognized sign in the ArSL sentence and its corresponding Arabic word. This results in persevering the structure and grammar of the ArSL sentence. ArSL translation involves converting the recognized ArSL sentence into Arabic sentence that meets the structure and grammar of Arabic. We propose in this work a rule-based machine translation system between ArSL and Arabic. The proposed system performs morphological and syntactic analysis to translate the ArSL sentence lexically and syntactically into Arabic. To evaluate this work, we perform manual and automatic evaluation using a corpus on the health domain. The obtained results show that our translation system provides an accurate translation for more than 80% of the translated sentences.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
2
We will use the gloss annotation system proposed by [4] to represent ArSL sign words. This system encloses each sign word between two brackets.
 
4
Each sign repetition is represented in ArSL gloss notation by ’+’ symbol
 
Literatur
2.
Zurück zum Zitat Arab League Educational Cultural, Scientific Organization, First part of the Unified Arabic Sign language Dictionary, League Arab States Arab League Educ. Cult. Sci. Organ, (2001) Arab League Educational Cultural, Scientific Organization, First part of the Unified Arabic Sign language Dictionary, League Arab States Arab League Educ. Cult. Sci. Organ, (2001)
3.
Zurück zum Zitat Arab League Educational Cultural, Scientific Organization, Second part of the Unified Arabic Sign language Dictionary, League Arab States Arab League Educ. Cult. Sci. Organ, (2007) Arab League Educational Cultural, Scientific Organization, Second part of the Unified Arabic Sign language Dictionary, League Arab States Arab League Educ. Cult. Sci. Organ, (2007)
4.
Zurück zum Zitat Luqman, H., Mahmoud, S.A.: Automatic translation of Arabic text-to-Arabic sign language. Universal Access in the Information Society 1–13 (2018) Luqman, H., Mahmoud, S.A.: Automatic translation of Arabic text-to-Arabic sign language. Universal Access in the Information Society 1–13 (2018)
5.
Zurück zum Zitat Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C (Appl Rev) 37(3), 311–324 (2007)CrossRef Mitra, S., Acharya, T.: Gesture recognition: a survey. IEEE Trans Syst Man Cybern Part C (Appl Rev) 37(3), 311–324 (2007)CrossRef
6.
Zurück zum Zitat Cooper, H., Holt, B., Bowden, R.: Sign language recognition. In: Visual Analysis of Humans, pp. 539–562, Springer, Berlin (2011) Cooper, H., Holt, B., Bowden, R.: Sign language recognition. In: Visual Analysis of Humans, pp. 539–562, Springer, Berlin (2011)
7.
Zurück zum Zitat Abdel-Fattah, M.A.: Arabic sign language: a perspective. J. Deaf Stud. Deaf Educ. 10(2), 212–221 (2005)CrossRef Abdel-Fattah, M.A.: Arabic sign language: a perspective. J. Deaf Stud. Deaf Educ. 10(2), 212–221 (2005)CrossRef
8.
Zurück zum Zitat Semreen, S., Albinali, M.: The rules of Arab Qatari sign standardized language, Supreme Council of Family Affairs, (2010) Semreen, S., Albinali, M.: The rules of Arab Qatari sign standardized language, Supreme Council of Family Affairs, (2010)
10.
Zurück zum Zitat Trujillo, A.: Translation Engines: Techniques for Machine Translation. Springer, Berlin (2012)MATH Trujillo, A.: Translation Engines: Techniques for Machine Translation. Springer, Berlin (2012)MATH
11.
Zurück zum Zitat Morrissey, S.: Data-driven machine translation for sign languages, Ph.D. thesis, Dublin City University (2008) Morrissey, S.: Data-driven machine translation for sign languages, Ph.D. thesis, Dublin City University (2008)
13.
Zurück zum Zitat Almohimeed, A., Wald, M., Damper, R.: Arabic text to Arabic sign language translation system for the deaf and hearing-impaired community. In: Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies, Association for Computational Linguistics, pp. 101–109 (2011) Almohimeed, A., Wald, M., Damper, R.: Arabic text to Arabic sign language translation system for the deaf and hearing-impaired community. In: Proceedings of the Second Workshop on Speech and Language Processing for Assistive Technologies, Association for Computational Linguistics, pp. 101–109 (2011)
14.
Zurück zum Zitat Mohandes, M.: Automatic translation of Arabic text to Arabic sign language. AIML J. 6(4), 15–19 (2006) Mohandes, M.: Automatic translation of Arabic text to Arabic sign language. AIML J. 6(4), 15–19 (2006)
15.
Zurück zum Zitat Halawani, S.M.: Arabic sign language translation system on mobile devices. IJCSNS Int. J. Comput. Sci. Netw. Secur. 8(1), 251–256 (2008) Halawani, S.M.: Arabic sign language translation system on mobile devices. IJCSNS Int. J. Comput. Sci. Netw. Secur. 8(1), 251–256 (2008)
16.
Zurück zum Zitat Al Ameiri, F., Zemerly, M. J., Al Marzouqi, M.: M-learning and chatting using indexed Arabic sign language, Int. J. Inf. (IJI) 5: 10 (2012) Al Ameiri, F., Zemerly, M. J., Al Marzouqi, M.: M-learning and chatting using indexed Arabic sign language, Int. J. Inf. (IJI) 5: 10 (2012)
17.
Zurück zum Zitat Al-Nafjan, A., Al-Arifi, B., Al-Wabil, A.: Design and development of an educational Arabic sign language mobile application: collective impact with Tawasol. In: International Conference on Universal Access in Human–Computer Interaction, pp. 319–326, Springer, Berlin (2015) Al-Nafjan, A., Al-Arifi, B., Al-Wabil, A.: Design and development of an educational Arabic sign language mobile application: collective impact with Tawasol. In: International Conference on Universal Access in Human–Computer Interaction, pp. 319–326, Springer, Berlin (2015)
18.
Zurück zum Zitat Al-Khalifa, H. S.: Introducing Arabic sign language for mobile phones. In: International Conference on Computers for Handicapped Persons, pp. 213–220, Springer, Berlin (2010) Al-Khalifa, H. S.: Introducing Arabic sign language for mobile phones. In: International Conference on Computers for Handicapped Persons, pp. 213–220, Springer, Berlin (2010)
19.
Zurück zum Zitat Al-Rikabi, S., Hafner, AV.: Humanoid robot as a translator from text to sign language. In: 5th Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics (LTC 2011), pp. 375–379 (2011) Al-Rikabi, S., Hafner, AV.: Humanoid robot as a translator from text to sign language. In: 5th Language and Technology Conference: Human Language Technologies as a Challenge for Computer Science and Linguistics (LTC 2011), pp. 375–379 (2011)
20.
Zurück zum Zitat Almasoud, A.M., Al-Khalifa, H.S.: Semsignwriting: a proposed semantic system for Arabic text-to-signwriting translation. J. Softw. Eng. Appl. 5, 604–612 (2012)CrossRef Almasoud, A.M., Al-Khalifa, H.S.: Semsignwriting: a proposed semantic system for Arabic text-to-signwriting translation. J. Softw. Eng. Appl. 5, 604–612 (2012)CrossRef
21.
Zurück zum Zitat El Alfi, A.E.E., El Basuony, M.M.R., Atawy, S.M.: Intelligent Arabic text to Arabic sign language translation for easy deaf communication. Int. J. Comput. Appl. 92(8), 22–29 (2014) El Alfi, A.E.E., El Basuony, M.M.R., Atawy, S.M.: Intelligent Arabic text to Arabic sign language translation for easy deaf communication. Int. J. Comput. Appl. 92(8), 22–29 (2014)
24.
Zurück zum Zitat Mohandes, M., Quadri, S., Deriche, M.: Arabic sign language recognition an image-based approach. In: 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW’07), pp. 272–276 (2007) https://doi.org/10.1109/AINAW.2007.98 Mohandes, M., Quadri, S., Deriche, M.: Arabic sign language recognition an image-based approach. In: 21st International Conference on Advanced Information Networking and Applications Workshops (AINAW’07), pp. 272–276 (2007) https://​doi.​org/​10.​1109/​AINAW.​2007.​98
25.
Zurück zum Zitat Shanableh, T., Assaleh, K., Al-Rousan, M.: Spatio-temporal feature-extraction techniques for isolated gesture recognition in Arabic sign language. IEEE Trans. Syst. Man Cybern. Part B Cybern. Publ. IEEE Syst. Man Cybern. Soc. 37(3), 641–650 (2007)CrossRef Shanableh, T., Assaleh, K., Al-Rousan, M.: Spatio-temporal feature-extraction techniques for isolated gesture recognition in Arabic sign language. IEEE Trans. Syst. Man Cybern. Part B Cybern. Publ. IEEE Syst. Man Cybern. Soc. 37(3), 641–650 (2007)CrossRef
28.
Zurück zum Zitat Aly, S., Mohammed, S.: Arabic sign language recognition using Spatio-Temporal Local Binary Patterns and Support Vector Machine. In: Hassanien, A., Tolba, M., Taher Azar, A. (eds.) Advanced Machine Learning Technologies and Applications, Vol. 488 of Communications in Computer and Information Science, Springer, Berlin, 2014, pp. 36–45. https://doi.org/10.1007/978-3-319-13461-1-5 Aly, S., Mohammed, S.: Arabic sign language recognition using Spatio-Temporal Local Binary Patterns and Support Vector Machine. In: Hassanien, A., Tolba, M., Taher Azar, A. (eds.) Advanced Machine Learning Technologies and Applications, Vol. 488 of Communications in Computer and Information Science, Springer, Berlin, 2014, pp. 36–45. https://​doi.​org/​10.​1007/​978-3-319-13461-1-5
29.
Zurück zum Zitat Tharwat, A., Gaber, T., Hassanien, A. E., Shahin, M., Refaat, B.: Sift-based Arabic sign language recognition system. In: Afro-European Conference for Industrial Advancement, pp. 359–370, Springer, Berlin (2015) Tharwat, A., Gaber, T., Hassanien, A. E., Shahin, M., Refaat, B.: Sift-based Arabic sign language recognition system. In: Afro-European Conference for Industrial Advancement, pp. 359–370, Springer, Berlin (2015)
30.
Zurück zum Zitat Aujeszky, T., Eid, M.: A gesture recognition architecture for Arabic sign language communication system. Multimed. Tools Appl. 75(14), 8493–8511 (2016)CrossRef Aujeszky, T., Eid, M.: A gesture recognition architecture for Arabic sign language communication system. Multimed. Tools Appl. 75(14), 8493–8511 (2016)CrossRef
31.
Zurück zum Zitat Aly, S., Osman, B., Aly, W., Saber, M.: Arabic sign language fingerspelling recognition from depth and intensity images. In: 2016 12th International Computer Engineering Conference (ICENCO), pp. 99–104, IEEE (2016) Aly, S., Osman, B., Aly, W., Saber, M.: Arabic sign language fingerspelling recognition from depth and intensity images. In: 2016 12th International Computer Engineering Conference (ICENCO), pp. 99–104, IEEE (2016)
32.
Zurück zum Zitat Cooper, H., Ong, E.-J., Pugeault, N., Bowden, R.: Sign language recognition using sub-units. J. Mach. Learn. Res. 13, 2205–2231 (2012) Cooper, H., Ong, E.-J., Pugeault, N., Bowden, R.: Sign language recognition using sub-units. J. Mach. Learn. Res. 13, 2205–2231 (2012)
33.
Zurück zum Zitat Paulraj, M. P., Yaacob, S., Zanar Azalan, M. S., Palaniappan, R.: A phoneme based sign language recognition system using 2D moment invariant interleaving feature and neural network. In: Proceedings—2011 IEEE Student Conference on Research and Development, SCOReD 2011, pp. 111–116 (2011) https://doi.org/10.1109/SCOReD.2011.6148718 Paulraj, M. P., Yaacob, S., Zanar Azalan, M. S., Palaniappan, R.: A phoneme based sign language recognition system using 2D moment invariant interleaving feature and neural network. In: Proceedings—2011 IEEE Student Conference on Research and Development, SCOReD 2011, pp. 111–116 (2011) https://​doi.​org/​10.​1109/​SCOReD.​2011.​6148718
35.
Zurück zum Zitat Tolba, M., Samir, A., Abull-ela, M.: 3D Arabic sign language recognition using liner combination of Multible 2D views. In: 2012 8th International Conference on Informatics and Systems (INFOS), IEEE, Cairo (2012) Tolba, M., Samir, A., Abull-ela, M.: 3D Arabic sign language recognition using liner combination of Multible 2D views. In: 2012 8th International Conference on Informatics and Systems (INFOS), IEEE, Cairo (2012)
37.
Zurück zum Zitat Awad, G., Han, J., Sutherland, A.: A unified system for segmentation and tracking of face and hands in sign language recognition. In: Proceedings—International Conference on Pattern Recognition, vol. 1, pp. 239–242 (2006). https://doi.org/10.1109/ICPR.2006.194 Awad, G., Han, J., Sutherland, A.: A unified system for segmentation and tracking of face and hands in sign language recognition. In: Proceedings—International Conference on Pattern Recognition, vol. 1, pp. 239–242 (2006). https://​doi.​org/​10.​1109/​ICPR.​2006.​194
38.
Zurück zum Zitat Pasha, A., Al-Badrashiny, M., Diab, M. T., El Kholy, A., Eskander, R., Habash, N., Pooleery, M., Rambow, O., Roth, R.: MADAMIRA: a fast, comprehensive tool for morphological analysis and disambiguation of Arabic. In: LREC, Vol. 14, 2014, pp. 1094–1101 Pasha, A., Al-Badrashiny, M., Diab, M. T., El Kholy, A., Eskander, R., Habash, N., Pooleery, M.,  Rambow, O., Roth, R.: MADAMIRA: a fast, comprehensive tool for morphological analysis and disambiguation of Arabic. In: LREC, Vol. 14, 2014, pp. 1094–1101
39.
Zurück zum Zitat Heafield, K., KenLM: Faster and smaller language model queries. In: Proceedings of the Sixth Workshop on Statistical Machine Translation, Association for Computational Linguistics, pp. 187–197 (2011) Heafield, K., KenLM: Faster and smaller language model queries. In: Proceedings of the Sixth Workshop on Statistical Machine Translation, Association for Computational Linguistics, pp. 187–197 (2011)
40.
Zurück zum Zitat Stolcke, A.: SRILM-an extensible language modeling toolkit. In: Proceedings International Conference on Spoken Language Processing, pp. 257–286 (2002) Stolcke, A.: SRILM-an extensible language modeling toolkit. In: Proceedings International Conference on Spoken Language Processing, pp. 257–286 (2002)
41.
Zurück zum Zitat Federico, M., Bertoldi, N., Cettolo, M.: IRSTLM: an open source toolkit for handling large scale language models. In: Interspeech, pp. 1618–1621 (2008) Federico, M., Bertoldi, N., Cettolo, M.: IRSTLM: an open source toolkit for handling large scale language models. In: Interspeech, pp. 1618–1621 (2008)
42.
Zurück zum Zitat Neme, A.A., Laporte, E.: Pattern-and-root inflectional morphology: the arabic broken plural. Lang. Sci. 40, 221–250 (2013)CrossRef Neme, A.A., Laporte, E.: Pattern-and-root inflectional morphology: the arabic broken plural. Lang. Sci. 40, 221–250 (2013)CrossRef
43.
Zurück zum Zitat Attia, M., Pecina, P., Tounsi, L., Toral, A., Van Genabith, J.: Lexical profiling for Arabic. In: Proceedings of eLex, pp. 23–33 (2011) Attia, M., Pecina, P., Tounsi, L., Toral, A., Van Genabith, J.: Lexical profiling for Arabic. In: Proceedings of eLex, pp. 23–33 (2011)
44.
Zurück zum Zitat Elghamry, K.: A lexical-syntactic solution to the problem of broken plural in Arabic. In: G. U. R. T. G. 2010) (Ed.), Arabic Natural Language Processing Track, Washington, USA, (2010) Elghamry, K.: A lexical-syntactic solution to the problem of broken plural in Arabic. In: G. U. R. T. G. 2010) (Ed.), Arabic Natural Language Processing Track, Washington, USA, (2010)
45.
Zurück zum Zitat Yaqoub, E. B.: The detailed dictionary in the plurals. (In Arabic), Scientific Book House, (2004) Yaqoub, E. B.: The detailed dictionary in the plurals. (In Arabic), Scientific Book House, (2004)
46.
Zurück zum Zitat Chennoufi, A., Mazroui, A.: Morphological, syntactic and diacritics rules for automatic diacritization of Arabic sentences. J. King Saud Univ. Comput. Inf. Sci. 29(2), 156–163 (2017) Chennoufi, A., Mazroui, A.: Morphological, syntactic and diacritics rules for automatic diacritization of Arabic sentences. J. King Saud Univ. Comput. Inf. Sci. 29(2), 156–163 (2017)
47.
Zurück zum Zitat Gonàlez, M., Giménez, J., Màrquez, L.: A Graphical interface for MT evaluation and error analysis. In: The 50th Annual Meeting of the Association for Computational Linguistics (2012) Gonàlez, M., Giménez, J., Màrquez, L.: A Graphical interface for MT evaluation and error analysis. In: The 50th Annual Meeting of the Association for Computational Linguistics (2012)
48.
Zurück zum Zitat Papineni, K., Roukos, S., Ward, T., Zhu, W.-J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Association for Computational Linguistics, pp. 311–318 (2002) Papineni, K., Roukos, S., Ward, T., Zhu, W.-J.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, Association for Computational Linguistics, pp. 311–318 (2002)
49.
Zurück zum Zitat Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of Association for Machine Translation in the Americas, Vol. 200, (2006) Snover, M., Dorr, B., Schwartz, R., Micciulla, L., Makhoul, J.: A study of translation edit rate with targeted human annotation. In: Proceedings of Association for Machine Translation in the Americas, Vol. 200, (2006)
Metadaten
Titel
A machine translation system from Arabic sign language to Arabic
verfasst von
Hamzah Luqman
Sabri A. Mahmoud
Publikationsdatum
13.11.2019
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 4/2020
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-019-00695-6

Weitere Artikel der Ausgabe 4/2020

Universal Access in the Information Society 4/2020 Zur Ausgabe