Skip to main content

2017 | OriginalPaper | Buchkapitel

Holographic Signing Avatars for Deaf Education

verfasst von : Nicoletta Adamo-Villani, Saikiran Anasingaraju

Erschienen in: E-Learning, E-Education, and Online Training

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper describes the development and initial evaluation of an Augmented Reality (AR) system aimed at improving deaf children’s competence in mathematics. The system allows for creating 3D animated avatars that translate from spoken English to Signed English (SE) in real time. The virtual sign language interpreters, displayed as 3D holograms in a mixed reality environment, can be used in the classroom to translate in real time the math lessons delivered by the teacher, at home to facilitate communication between hearing parents and deaf children, and at home or in the lab when children interact with math digital learning materials. An initial formative evaluation with deaf students, parents and educators supports the usability and usefulness of the AR system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Blanchfield, B.B., Dunbar, J., Feldman, J.J., Gardner, E.N.: The severely to profoundly hearing impaired population in the United States: prevalence and demographics. Bethesda, Project HOPE Center for Health Affairs, MD (A shorter Policy Analysis Brief (Series H, vol. 1, no. 1, October 1999), August 1999 Blanchfield, B.B., Dunbar, J., Feldman, J.J., Gardner, E.N.: The severely to profoundly hearing impaired population in the United States: prevalence and demographics. Bethesda, Project HOPE Center for Health Affairs, MD (A shorter Policy Analysis Brief (Series H, vol. 1, no. 1, October 1999), August 1999
3.
Zurück zum Zitat Burgstahler, S.: Increasing the representation of people with disabilities in science. J. Inf. Technol. Disabil. 24(4) (1994) Burgstahler, S.: Increasing the representation of people with disabilities in science. J. Inf. Technol. Disabil. 24(4) (1994)
4.
Zurück zum Zitat Lee, K.: Augmented reality in education and training. Tech. Trends 56, 13–21 (2013)CrossRef Lee, K.: Augmented reality in education and training. Tech. Trends 56, 13–21 (2013)CrossRef
6.
Zurück zum Zitat Diegmann, P., Schmidt-Kraepelin, M., Eynden, S., and Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. In: Wirtschaftsinformatik Proceedings 2015. Paper 103 (2015). http://aisel.aisnet.org/wi2015/103 Diegmann, P., Schmidt-Kraepelin, M., Eynden, S., and Basten, D.: Benefits of augmented reality in educational environments - a systematic literature review. In: Wirtschaftsinformatik Proceedings 2015. Paper 103 (2015). http://​aisel.​aisnet.​org/​wi2015/​103
7.
Zurück zum Zitat Bacca, J., Baldiris, S., Fabregat, R., Graf, S., Kinshuk.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014) Bacca, J., Baldiris, S., Fabregat, R., Graf, S., Kinshuk.: Augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014)
10.
Zurück zum Zitat Adamo-Villani, N., Wilbur, R.: Two novel technologies for accessible math and science education. IEEE Multimed. Spec. Iss. Accessibility 15, 38–46 (2008)CrossRef Adamo-Villani, N., Wilbur, R.: Two novel technologies for accessible math and science education. IEEE Multimed. Spec. Iss. Accessibility 15, 38–46 (2008)CrossRef
11.
Zurück zum Zitat Hayward, K., Adamo-Villani, N., Lestina, J.: A computer animation system for creating deaf-accessible math and science curriculum materials. In: Proceedings of Eurographics 2010 - Education Papers, Norrkoping, Sweden, May 2010. EG Digital Library (2010) Hayward, K., Adamo-Villani, N., Lestina, J.: A computer animation system for creating deaf-accessible math and science curriculum materials. In: Proceedings of Eurographics 2010 - Education Papers, Norrkoping, Sweden, May 2010. EG Digital Library (2010)
12.
Zurück zum Zitat Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: White, John, S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 54–67. Springer, Heidelberg (2000). doi:10.1007/3-540-39965-8_6 CrossRef Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: White, John, S. (ed.) AMTA 2000. LNCS (LNAI), vol. 1934, pp. 54–67. Springer, Heidelberg (2000). doi:10.​1007/​3-540-39965-8_​6 CrossRef
13.
Zurück zum Zitat Huenerfauth, M.: A multi-path architecture for machine translation of English text into American sign language animation. In: Proceedings of the Student Workshop at the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLTNAACL) (2004) Huenerfauth, M.: A multi-path architecture for machine translation of English text into American sign language animation. In: Proceedings of the Student Workshop at the Human Language Technology Conference/North American Chapter of the Association for Computational Linguistics (HLTNAACL) (2004)
14.
Zurück zum Zitat Grieve-Smith, Angus, B.: SignSynth: a sign language synthesis application using Web3D and perl. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 134–145. Springer, Heidelberg (2002). doi:10.1007/3-540-47873-6_14 CrossRef Grieve-Smith, Angus, B.: SignSynth: a sign language synthesis application using Web3D and perl. In: Wachsmuth, I., Sowa, T. (eds.) GW 2001. LNCS (LNAI), vol. 2298, pp. 134–145. Springer, Heidelberg (2002). doi:10.​1007/​3-540-47873-6_​14 CrossRef
16.
Zurück zum Zitat Adamo-Villani, N., Wright, K.: SMILE: an immersive learning game for deaf and hearing children. In: Proceedings of SIGGRAPH 2007 - Educators, San Diego, 5–10 August 2007. ACM Digital Library (2007) Adamo-Villani, N., Wright, K.: SMILE: an immersive learning game for deaf and hearing children. In: Proceedings of SIGGRAPH 2007 - Educators, San Diego, 5–10 August 2007. ACM Digital Library (2007)
17.
Zurück zum Zitat Read, J.C., Macfarlane, S.J., Casey, C.: Endurability, Engagement and Expectations: Measuring Children’s Fun. Shaker Publishing, Interaction Design and Children, Eindhoven (2002) Read, J.C., Macfarlane, S.J., Casey, C.: Endurability, Engagement and Expectations: Measuring Children’s Fun. Shaker Publishing, Interaction Design and Children, Eindhoven (2002)
18.
Zurück zum Zitat Hanna, L., Neapolitan, D., Risden, K.: . Evaluating computer game concepts with children. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community, Maryland, pp. 49–56 (2004) Hanna, L., Neapolitan, D., Risden, K.: . Evaluating computer game concepts with children. In: Proceedings of the 2004 Conference on Interaction Design and Children: Building a Community, Maryland, pp. 49–56 (2004)
Metadaten
Titel
Holographic Signing Avatars for Deaf Education
verfasst von
Nicoletta Adamo-Villani
Saikiran Anasingaraju
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-49625-2_7

Premium Partner