Skip to main content
Erschienen in: Universal Access in the Information Society 2/2012

01.06.2012 | Long Paper

Effect of spatial reference and verb inflection on the usability of sign language animations

verfasst von: Matt Huenerfauth, Pengfei Lu

Erschienen in: Universal Access in the Information Society | Ausgabe 2/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Computer-generated animations of American Sign Language (ASL) can improve the accessibility of information, communication, and services for the significant number of deaf adults in the US with difficulty in reading English text. Unfortunately, there are several linguistic aspects of ASL that current automatic generation or translation systems cannot produce (or are time-consuming for human animators to create). To determine how important such phenomena are to user satisfaction and the comprehension of ASL animations, studies were conducted in which native ASL signers evaluated ASL animations with and without: establishment of spatial reference points around the virtual human signer representing entities under discussion, pointing pronoun signs, contrastive role shift, and spatial inflection of ASL verbs. It was found that adding these phenomena to ASL animations led to a significant improvement in user comprehension of the animations, thereby motivating future research on automating the generation of these animations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Huenerfauth, M.: Improving spatial reference in American sign language animation through data collection from native ASL signers. In: Proceedings of the Universal Access in Human Computer Interaction conference (UAHCI’09), pp. 530–539. (2009). doi:10.1007/978-3-642-02713-0_56 Huenerfauth, M.: Improving spatial reference in American sign language animation through data collection from native ASL signers. In: Proceedings of the Universal Access in Human Computer Interaction conference (UAHCI’09), pp. 530–539. (2009). doi:10.​1007/​978-3-642-02713-0_​56
2.
Zurück zum Zitat Mitchell, R., Young, T.A., Bachleda, B., Karchmer, M.A.: How many people use ASL in the United States? Why estimates need updating. Sign Lang. Stud. 6(4), 306–335 (2006)CrossRef Mitchell, R., Young, T.A., Bachleda, B., Karchmer, M.A.: How many people use ASL in the United States? Why estimates need updating. Sign Lang. Stud. 6(4), 306–335 (2006)CrossRef
3.
Zurück zum Zitat Traxler, C.: The Stanford achievement test, ninth edition: national norming and performance standards for deaf and hard-of-hearing students. J. Deaf Stud. Deaf Educ. 5(4), 337–348 (2000). doi:10.1093/deafed/5.4.337 CrossRef Traxler, C.: The Stanford achievement test, ninth edition: national norming and performance standards for deaf and hard-of-hearing students. J. Deaf Stud. Deaf Educ. 5(4), 337–348 (2000). doi:10.​1093/​deafed/​5.​4.​337 CrossRef
4.
Zurück zum Zitat Huenerfauth, M., Hanson, V.L.: Sign language in the interface: access for Deaf signers. In: Stephanidis, C. (ed.) The Universal Access Handbook. Lawrence Erlbaum Associates, Mahwah (2009) Huenerfauth, M., Hanson, V.L.: Sign language in the interface: access for Deaf signers. In: Stephanidis, C. (ed.) The Universal Access Handbook. Lawrence Erlbaum Associates, Mahwah (2009)
5.
Zurück zum Zitat Lane, H., Hoffmeister, R., Bahan, B.: A Journey into the Deaf World. DawnSign Press, San Diego (1996) Lane, H., Hoffmeister, R., Bahan, B.: A Journey into the Deaf World. DawnSign Press, San Diego (1996)
6.
Zurück zum Zitat Padden, C., Humphries, T.: Inside Deaf Culture. Harvard University Press, Cambridge (2005) Padden, C., Humphries, T.: Inside Deaf Culture. Harvard University Press, Cambridge (2005)
7.
Zurück zum Zitat Elliott, R., Glauert, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. Univ. Access Inf. Soc. 6(4), 375–391 (2006). doi:10.1007/s10209-007-0102-z CrossRef Elliott, R., Glauert, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modelling and language-processing technologies for Avatar-based sign language presentation. Univ. Access Inf. Soc. 6(4), 375–391 (2006). doi:10.​1007/​s10209-007-0102-z CrossRef
8.
10.
Zurück zum Zitat Chiu, Y.H., Wu, C.H., Su, H.Y., Cheng, C.J.: Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 29(1):28–39. IEEE Press, New York (2007). doi:10.1109/TPAMI.2007.15 Chiu, Y.H., Wu, C.H., Su, H.Y., Cheng, C.J.: Joint optimization of word alignment and epenthesis generation for Chinese to Taiwanese sign synthesis. IEEE Trans. Pattern Anal. Mach. Intell. 29(1):28–39. IEEE Press, New York (2007). doi:10.​1109/​TPAMI.​2007.​15
12.
Zurück zum Zitat Marshall, I., Safar, E.: Grammar development for sign language avatar-based synthesis. In: Stephanidis, C. (ed.) Universal Access in HCI: Exploring New Dimensions of Diversity—Volume 8 of the Proceedings of the 11th International Conference on Human-Computer Interaction, Lawrence Erlbaum Associates, Mahwah (2005) Marshall, I., Safar, E.: Grammar development for sign language avatar-based synthesis. In: Stephanidis, C. (ed.) Universal Access in HCI: Exploring New Dimensions of Diversity—Volume 8 of the Proceedings of the 11th International Conference on Human-Computer Interaction, Lawrence Erlbaum Associates, Mahwah (2005)
14.
Zurück zum Zitat Stein, D., Bungeroth, J., Ney, H.: Morpho-syntax based statistical methods for sign language translation. In: Proceedings of the European Association for Machine Translation, pp. 169–177. European Association for Machine Translation, Allschwil (2006) Stein, D., Bungeroth, J., Ney, H.: Morpho-syntax based statistical methods for sign language translation. In: Proceedings of the European Association for Machine Translation, pp. 169–177. European Association for Machine Translation, Allschwil (2006)
15.
Zurück zum Zitat Morrissey, S., Way, A.: An example-based approach to translating sign language. In: Proceedings of the Workshop on Example-Based Machine Translation, pp 109–116 (2005) Morrissey, S., Way, A.: An example-based approach to translating sign language. In: Proceedings of the Workshop on Example-Based Machine Translation, pp 109–116 (2005)
16.
Zurück zum Zitat Shionome, T., Kamata, K., Yamamoto, H., Fischer, S.: Effects of display size on perception of Japanese sign language—mobile access in signed language. In: Proceedings of the Human-Computer Interaction Conference, pp 22–27 (2005) Shionome, T., Kamata, K., Yamamoto, H., Fischer, S.: Effects of display size on perception of Japanese sign language—mobile access in signed language. In: Proceedings of the Human-Computer Interaction Conference, pp 22–27 (2005)
17.
Zurück zum Zitat Sumihiro, K., Yoshihisa, S., Takao, K.: Synthesis of sign animation with facial expression and its effects on understanding of sign language. IEIC Tech. Rep. 100(331), 31–36 (2000) Sumihiro, K., Yoshihisa, S., Takao, K.: Synthesis of sign animation with facial expression and its effects on understanding of sign language. IEIC Tech. Rep. 100(331), 31–36 (2000)
19.
Zurück zum Zitat Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: Proceedings of the 4th Conference of the Association for Machine Translation in the Americas on Envisioning Machine Translation in the Information Future (Lecture Notes in Computer Science 1934). Springer, Heidelberg, pp. 54–67 (2000). doi:10.1007/3-540-39965-8_6 Zhao, L., Kipper, K., Schuler, W., Vogler, C., Badler, N., Palmer, M.: A machine translation system from English to American sign language. In: Proceedings of the 4th Conference of the Association for Machine Translation in the Americas on Envisioning Machine Translation in the Information Future (Lecture Notes in Computer Science 1934). Springer, Heidelberg, pp. 54–67 (2000). doi:10.​1007/​3-540-39965-8_​6
20.
Zurück zum Zitat Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.: The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. MIT Press, Cambridge (2000) Neidle, C., Kegl, J., MacLaughlin, D., Bahan, B., Lee, R.: The Syntax of American Sign Language: Functional Categories and Hierarchical Structure. MIT Press, Cambridge (2000)
21.
Zurück zum Zitat Liddell, S.: Grammar Gesture and Meaning in American Sign Language. Cambridge University Press, Cambridge (2003) Liddell, S.: Grammar Gesture and Meaning in American Sign Language. Cambridge University Press, Cambridge (2003)
22.
Zurück zum Zitat Padden, C.: Interaction of Morphology and Syntax in American Sign Language. Outstanding Dissertations in Linguistics, Series IV. Garland Press, New York (1988) Padden, C.: Interaction of Morphology and Syntax in American Sign Language. Outstanding Dissertations in Linguistics, Series IV. Garland Press, New York (1988)
24.
Zurück zum Zitat Marshall, I., Safar, E.: A prototype text to British sign language (BSL) translation system. In: Companion Volume to the Proceedings of the Association for Computational Linguistics Conference, pp 113–116 (2003). doi:10.3115/1075178.1075194 Marshall, I., Safar, E.: A prototype text to British sign language (BSL) translation system. In: Companion Volume to the Proceedings of the Association for Computational Linguistics Conference, pp 113–116 (2003). doi:10.​3115/​1075178.​1075194
25.
Zurück zum Zitat Iwarsson, S., Stahl, A.: Accessibility, usability and universal design-positioning and definition of concepts describing person-environment relationships. Disabil. Rehabil. 25(2), 57–66 (2003). doi:10.1080/0963828021000007969 Iwarsson, S., Stahl, A.: Accessibility, usability and universal design-positioning and definition of concepts describing person-environment relationships. Disabil. Rehabil. 25(2), 57–66 (2003). doi:10.​1080/​0963828021000007​969
26.
Zurück zum Zitat Nielsen, J.: Usability Engineering. Academic Press, Boston (1993)MATH Nielsen, J.: Usability Engineering. Academic Press, Boston (1993)MATH
28.
Zurück zum Zitat Huenerfauth, M.: Evaluation of a psycholinguistically motivated timing model for animations of american sign language. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 129–136, ACM Press, New York (2008). doi:10.1145/1530064.1530067 Huenerfauth, M.: Evaluation of a psycholinguistically motivated timing model for animations of american sign language. In: Proceedings of the 10th International ACM SIGACCESS Conference on Computers and Accessibility, pp. 129–136, ACM Press, New York (2008). doi:10.​1145/​1530064.​1530067
29.
Zurück zum Zitat Huenerfauth, M.: A linguistically motivated model for speed and pausing in animations of American sign language. ACM Trans. Access. Comput. 2(2):1–31. ACM Press, New York (2009). doi:10.1145/1530064.1530067 Huenerfauth, M.: A linguistically motivated model for speed and pausing in animations of American sign language. ACM Trans. Access. Comput. 2(2):1–31. ACM Press, New York (2009). doi:10.​1145/​1530064.​1530067
30.
Zurück zum Zitat Huenerfauth, M., Zhao, L., Gu, E., Allbeck, J.: Evaluation of American sign language generation by native ASL signers. ACM Trans. Access. Comput. 1(1):1–27. ACM Press, New York (2008). doi:10.1145/1361203.1361206 Huenerfauth, M., Zhao, L., Gu, E., Allbeck, J.: Evaluation of American sign language generation by native ASL signers. ACM Trans. Access. Comput. 1(1):1–27. ACM Press, New York (2008). doi:10.​1145/​1361203.​1361206
31.
Zurück zum Zitat Lucas, C., Valli, C.: Language Contact in the American Deaf Community. Academic Press, San Diego (1992) Lucas, C., Valli, C.: Language Contact in the American Deaf Community. Academic Press, San Diego (1992)
34.
Zurück zum Zitat Huenerfauth, M., Lu, P.: Annotating spatial reference in a motion-capture corpus of American sign language discourse. In: Proceedings of the Fourth Workshop on the Representation and Processing of Signed Languages: Corpora and Sign Language Technologies, the 7th International Conference on Language Resources and Evaluation (LREC 2010). ELRA, Paris (2010) Huenerfauth, M., Lu, P.: Annotating spatial reference in a motion-capture corpus of American sign language discourse. In: Proceedings of the Fourth Workshop on the Representation and Processing of Signed Languages: Corpora and Sign Language Technologies, the 7th International Conference on Language Resources and Evaluation (LREC 2010). ELRA, Paris (2010)
35.
Zurück zum Zitat Bungeroth, J., Stein, D., Dreuw, P., Zahedi, M., Ney, H.: A German sign language corpus of the domain weather report. In: Vettori, C. (ed.) 2nd Workshop on the Representation and Processing of Sign Languages, pp. 2000–2003. ELRA, Paris (2006) Bungeroth, J., Stein, D., Dreuw, P., Zahedi, M., Ney, H.: A German sign language corpus of the domain weather report. In: Vettori, C. (ed.) 2nd Workshop on the Representation and Processing of Sign Languages, pp. 2000–2003. ELRA, Paris (2006)
36.
Zurück zum Zitat Crasborn, O., Sloetjes, H., Auer, E., Wittenburg, P.: Combining video and numeric data in the analysis of sign languages within the ELAN annotation software. In: Vettori, C. (ed.) 2nd Workshop on the Representation and Processing of Sign Languages, the 5th International Conference on Language Resources and Evaluation (LREC 2006), pp. 82–87. ELRA, Paris (2006) Crasborn, O., Sloetjes, H., Auer, E., Wittenburg, P.: Combining video and numeric data in the analysis of sign languages within the ELAN annotation software. In: Vettori, C. (ed.) 2nd Workshop on the Representation and Processing of Sign Languages, the 5th International Conference on Language Resources and Evaluation (LREC 2006), pp. 82–87. ELRA, Paris (2006)
37.
Zurück zum Zitat Efthimiou, E., Fotinea, S.E.: GSLC: Creation and annotation of a Greek sign language corpus for HCI. In: Universal Access in Human Computer Interaction. (Lecture Notes in Computer Science 4554), pp. 657–666. Springer, Heidelberg (2007) Efthimiou, E., Fotinea, S.E.: GSLC: Creation and annotation of a Greek sign language corpus for HCI. In: Universal Access in Human Computer Interaction. (Lecture Notes in Computer Science 4554), pp. 657–666. Springer, Heidelberg (2007)
38.
Zurück zum Zitat Brashear, H., Starner, T., Lukowicz, P., Junker, H.: Using multiple sensors for mobile sign language recognition. IEEE International Symposium on Wearable Computers, p. 45, IEEE Press, New York (2003). doi:10.1109/ISWC.2003.1241392 Brashear, H., Starner, T., Lukowicz, P., Junker, H.: Using multiple sensors for mobile sign language recognition. IEEE International Symposium on Wearable Computers, p. 45, IEEE Press, New York (2003). doi:10.​1109/​ISWC.​2003.​1241392
39.
Zurück zum Zitat Cox, S., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., Abbott, S.: Tessa, a system to aid communication with deaf people. In: 5th International ACM Conference on Assistive Technologies, pp. 205–212. ACM Press, New York (2002). doi:10.1145/638249.638287 Cox, S., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., Abbott, S.: Tessa, a system to aid communication with deaf people. In: 5th International ACM Conference on Assistive Technologies, pp. 205–212. ACM Press, New York (2002). doi:10.​1145/​638249.​638287
40.
Zurück zum Zitat Vogler, C., Metaxas, D.: Handshapes and movements: Multiple-channel ASL recognition. (Lecture Notes in Artificial Intelligence 2915), pp. 247–258, Springer, Heidelberg (2004). doi:10.1007/11678816 Vogler, C., Metaxas, D.: Handshapes and movements: Multiple-channel ASL recognition. (Lecture Notes in Artificial Intelligence 2915), pp. 247–258, Springer, Heidelberg (2004). doi:10.​1007/​11678816
Metadaten
Titel
Effect of spatial reference and verb inflection on the usability of sign language animations
verfasst von
Matt Huenerfauth
Pengfei Lu
Publikationsdatum
01.06.2012
Verlag
Springer-Verlag
Erschienen in
Universal Access in the Information Society / Ausgabe 2/2012
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-011-0247-7

Weitere Artikel der Ausgabe 2/2012

Universal Access in the Information Society 2/2012 Zur Ausgabe

Premium Partner