Skip to main content
Top

2017 | OriginalPaper | Chapter

Holographic Signing Avatars for Deaf Education

Authors : Nicoletta Adamo-Villani, Saikiran Anasingaraju

Published in: E-Learning, E-Education, and Online Training

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper describes the development and initial evaluation of an Augmented Reality (AR) system aimed at improving deaf children’s competence in mathematics. The system allows for creating 3D animated avatars that translate from spoken English to Signed English (SE) in real time. The virtual sign language interpreters, displayed as 3D holograms in a mixed reality environment, can be used in the classroom to translate in real time the math lessons delivered by the teacher, at home to facilitate communication between hearing parents and deaf children, and at home or in the lab when children interact with math digital learning materials. An initial formative evaluation with deaf students, parents and educators supports the usability and usefulness of the AR system.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Blanchfield, B.B., Dunbar, J., Feldman, J.J., Gardner, E.N.: The severely to profoundly hearing impaired population in the United States: prevalence and demographics. Bethesda, Project HOPE Center for Health Affairs, MD (A shorter Policy Analysis Brief (Series H, vol. 1, no. 1, October 1999), August 1999 Blanchfield, B.B., Dunbar, J., Feldman, J.J., Gardner, E.N.: The severely to profoundly hearing impaired population in the United States: prevalence and demographics. Bethesda, Project HOPE Center for Health Affairs, MD (A shorter Policy Analysis Brief (Series H, vol. 1, no. 1, October 1999), August 1999
3.
go back to reference Burgstahler, S.: Increasing the representation of people with disabilities in science. J. Inf. Technol. Disabil. 24(4) (1994) Burgstahler, S.: Increasing the representation of people with disabilities in science. J. Inf. Technol. Disabil. 24(4) (1994)
4.
go back to reference Lee, K.: Augmented reality in education and training. Tech. Trends 56, 13–21 (2013)CrossRef Lee, K.: Augmented reality in education and training. Tech. Trends 56, 13–21 (2013)CrossRef
6.
go back to reference Diegmann, P., Schmidt-Kraepelin, M., Eynden, S., and Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. In: Wirtschaftsinformatik Proceedings 2015. Paper 103 (2015). http://aisel.aisnet.org/wi2015/103 Diegmann, P., Schmidt-Kraepelin, M., Eynden, S., and Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. In: Wirtschaftsinformatik Proceedings 2015. Paper 103 (2015). http://​aisel.​aisnet.​org/​wi2015/​103
7.
go back to reference Bacca, J., Baldiris, S., Fabregat, R., Graf, S., Kinshuk.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014) Bacca, J., Baldiris, S., Fabregat, R., Graf, S., Kinshuk.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014)
10.
go back to reference Adamo-Villani, N., Wilbur, R.: Two novel technologies for accessible math and science education. IEEE Multimed. Spec. Iss. Accessibility 15, 38–46 (2008)CrossRef Adamo-Villani, N., Wilbur, R.: Two novel technologies for accessible math and science education. IEEE Multimed. Spec. Iss. Accessibility 15, 38–46 (2008)CrossRef
11.
go back to reference Hayward, K., Adamo-Villani, N., Lestina, J.: A computer animation system for creating deaf-accessible math and science curriculum materials. In: Proceedings of Eurographics 2010 - Education Papers, Norrkoping, Sweden, May 2010. EG Digital Library (2010) Hayward, K., Adamo-Villani, N., Lestina, J.: A computer animation system for creating deaf-accessible math and science curriculum materials. In: Proceedings of Eurographics 2010 - Education Papers, Norrkoping, Sweden, May 2010. EG Digital Library (2010)
12.
go back to reference Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: White, John, S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 54–67. Springer, Heidelberg (2000). doi:10.1007/3-540-39965-8_6 CrossRef Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: White, John, S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 54–67. Springer, Heidelberg (2000). doi:10.​1007/​3-540-39965-8_​6 CrossRef
13.
go back to reference Huenerfauth, M.: A multi-path architecture for machine translation of English text into American sign language animation. In: Proceedings of the Student Workshop at the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLTNAACL) (2004) Huenerfauth, M.: A multi-path architecture for machine translation of English text into American sign language animation. In: Proceedings of the Student Workshop at the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLTNAACL) (2004)
14.
go back to reference Grieve-Smith, Angus, B.: SignSynth: a sign language synthesis application using Web3D and perl. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 134–145. Springer, Heidelberg (2002). doi:10.1007/3-540-47873-6_14 CrossRef Grieve-Smith, Angus, B.: SignSynth: a sign language synthesis application using Web3D and perl. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 134–145. Springer, Heidelberg (2002). doi:10.​1007/​3-540-47873-6_​14 CrossRef
16.
go back to reference Adamo-Villani, N., Wright, K.: SMILE: an immersive learning game for deaf and hearing children. In: Proceedings of SIGGRAPH 2007 - Educators, San Diego, 5–10 August 2007. ACM Digital Library (2007) Adamo-Villani, N., Wright, K.: SMILE: an immersive learning game for deaf and hearing children. In: Proceedings of SIGGRAPH 2007 - Educators, San Diego, 5–10 August 2007. ACM Digital Library (2007)
17.
go back to reference Read, J.C., Macfarlane, S.J., Casey, C.: Endurability, Engagement and Expectations: Measuring Children’s Fun. Shaker Publishing, Interaction Design and Children, Eindhoven (2002) Read, J.C., Macfarlane, S.J., Casey, C.: Endurability, Engagement and Expectations: Measuring Children’s Fun. Shaker Publishing, Interaction Design and Children, Eindhoven (2002)
18.
go back to reference Hanna, L., Neapolitan, D., Risden, K.: . Evaluating computer game concepts with children. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community, Maryland, pp. 49–56 (2004) Hanna, L., Neapolitan, D., Risden, K.: . Evaluating computer game concepts with children. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community, Maryland, pp. 49–56 (2004)
Metadata
Title
Holographic Signing Avatars for Deaf Education
Authors
Nicoletta Adamo-Villani
Saikiran Anasingaraju
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-49625-2_7

Premium Partner