Skip to main content
Top

2018 | OriginalPaper | Chapter

An Open and Extensible Platform for Machine Translation of Spoken Languages into Sign Languages

Authors : Rostand Costa, Tiago Maritan, Renan Soares, Vinicius Veríssimo, Suanny Vieira, Alexandre Santos, Manuella Aschoff, Guido Lemos

Published in: Applications and Usability of Interactive Television

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The purpose of this paper is to investigate the feasibility of offering a multilingual platform for text-to-sign translation, i.e., a solution where a machine translates digital contents in several spoken languages to several sign languages in scenarios such as Digital TV, Web and Cinema. This solution called OpenSigns, is an open platform that has several common components for generic functionalities, initially originated from the Suíte VLibras, including the creation and manipulation of 3D animation models, and interchangeable mechanisms specific for each sign language, such as a text-to-gloss machine translation engine, a sign dictionary for each sign language, among others. Our motivation is that the concentration of efforts and resources around a single solution could provide some state-of-the-art improvement, such as a standard solution for the industry and a greater functional flexibility for common components. In addition, we could also share techniques and heuristics between the translation mechanisms, reducing the effort to make a new sign language available on the platform, which may further enhance digital inclusion and accessibility, especially for poorest countries.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The Suíte VLIBRAS is the result of a partnership between – removed for blind review, and consists of a set of tools (text, audio and video) for the Brazilian Sign Language (LIBRAS), making TVs, computers, mobile devices and Web platforms accessible to deaf. Currently, VLibras is used in several governmental and private sites, among them the main sites of the Brazilian government (brasil.​gov.​br), Chamber of Deputies (camara.​leg.​br) and the Federal Senate (senado.​leg.​br). Further information can be obtained from http://​www.​vlibras.​gov.​br.
 
2
This API is able to identify the input language of a sentence and translate it automatically into a target spoken language (www.​google.​com/​translate).
 
4
In this test, the authors randomly selected 69 sentences and two LS interpreters generated a sequence of glosses in LIBRAS for each one. Then the VLibras translator was used to automatically generate a sequence of glosses of these same sentences and the values of the WER and BLEU metrics were calculated for the two scenarios.
 
Literature
7.
go back to reference Araújo, T.M.U.: Uma solução para geração automática de trilhas em língua brasileira de sinais em conteúdos multimídia (2012) Araújo, T.M.U.: Uma solução para geração automática de trilhas em língua brasileira de sinais em conteúdos multimídia (2012)
8.
go back to reference Araújo, T.M.U., Ferreira, F.L.S., et al.: An approach to generate and embed sign language video tracks into multimedia contents. Inf. Sci. 281, 762–780 (2014)CrossRef Araújo, T.M.U., Ferreira, F.L.S., et al.: An approach to generate and embed sign language video tracks into multimedia contents. Inf. Sci. 281, 762–780 (2014)CrossRef
10.
go back to reference Freitas, C., Rocha, P., Bick, E.: Floresta sintá(c)tica: bigger, thicker and easier. In: Proceedings of the 8th International Conference on Computational Processing of the Portuguese Language, PROPOR 2008, Aveiro, Portugal, pp. 216–219 (2008) Freitas, C., Rocha, P., Bick, E.: Floresta sintá(c)tica: bigger, thicker and easier. In: Proceedings of the 8th International Conference on Computational Processing of the Portuguese Language, PROPOR 2008, Aveiro, Portugal, pp. 216–219 (2008)
11.
go back to reference Lima, M.A., Araújo, T.M., Oliveira, E.S.: Incorporation of syntactic-semantic aspects in a libras machine translation service to multimedia platforms. In: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web, Webmedia 2015, pp. 133–140 (2015) Lima, M.A., Araújo, T.M., Oliveira, E.S.: Incorporation of syntactic-semantic aspects in a libras machine translation service to multimedia platforms. In: Proceedings of the 21st Brazilian Symposium on Multimedia and the Web, Webmedia 2015, pp. 133–140 (2015)
12.
go back to reference Melo, F.R., Matos, H.C.O., Dias, E.R.B.: Aplicação da métrica bleu para avaliação comparativa dos tradutores automáticos bing tradutor e google tradutor. E-scrita 5(3), 33–45 (2014) Melo, F.R., Matos, H.C.O., Dias, E.R.B.: Aplicação da métrica bleu para avaliação comparativa dos tradutores automáticos bing tradutor e google tradutor. E-scrita 5(3), 33–45 (2014)
13.
go back to reference World Health Organization (WHO), et al.: Deafness and hearing loss, fact sheet n 300, updated February 2013 World Health Organization (WHO), et al.: Deafness and hearing loss, fact sheet n 300, updated February 2013
14.
go back to reference Papineni, K., Roukos, S., Ward, T., Zhu, W.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2001) Papineni, K., Roukos, S., Ward, T., Zhu, W.: BLEU: a method for automatic evaluation of machine translation. In: Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics, pp. 311–318 (2001)
15.
go back to reference San-segundo, R., Barra, R., et al.: Speech to sign language translation system for Spanish. Speech Commun. 50(11), 1009–1020 (2008)CrossRef San-segundo, R., Barra, R., et al.: Speech to sign language translation system for Spanish. Speech Commun. 50(11), 1009–1020 (2008)CrossRef
16.
go back to reference Stumpf, M.R.: Língua de sinais: escrita dos surdos na internet. In: V Congresso Ibero-Americano de Informática na Educação–RIBIE–Chile (2000) Stumpf, M.R.: Língua de sinais: escrita dos surdos na internet. In: V Congresso Ibero-Americano de Informática na Educação–RIBIE–Chile (2000)
17.
go back to reference Su, H.Y., Wu, C.H.: Improving structural statistical machine translation for sign language with small corpus using thematic role templates as translation memory. Trans. Audio Speech Lang. Proc. 17(7), 1305–1315 (2009)CrossRef Su, H.Y., Wu, C.H.: Improving structural statistical machine translation for sign language with small corpus using thematic role templates as translation memory. Trans. Audio Speech Lang. Proc. 17(7), 1305–1315 (2009)CrossRef
18.
go back to reference Wauters, L.N.: Reading comprehension in deaf children: the impact of the mode of acquisition of word meanings. EAC, Research Centre on Atypical Communication, Radboud University, Nijmegen (2005) Wauters, L.N.: Reading comprehension in deaf children: the impact of the mode of acquisition of word meanings. EAC, Research Centre on Atypical Communication, Radboud University, Nijmegen (2005)
Metadata
Title
An Open and Extensible Platform for Machine Translation of Spoken Languages into Sign Languages
Authors
Rostand Costa
Tiago Maritan
Renan Soares
Vinicius Veríssimo
Suanny Vieira
Alexandre Santos
Manuella Aschoff
Guido Lemos
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-90170-1_12

Premium Partner