Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Bücher
Zeitschriften
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
ATZ-Fachkongress

Chassis.tech plus 2024


4 Kongresse in einer Veranstaltung

Treffen Sie in München die Fachleute von Chassis, Lenkung, Bremsen sowie Reifen/Räder.
Erweiterte Suche
Anmelden
nach oben
Universal Access in the Information Society
Erschienen in: Universal Access in the Information Society 4/2016

01.11.2016 | Long paper

Building a Swiss German Sign Language avatar with JASigning and evaluating it among the Deaf community

verfasst von: Sarah Ebling, John Glauert

Erschienen in: Universal Access in the Information Society | Ausgabe 4/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper reports on the development of a system that translates German train announcements of the Swiss Federal Railways (Schweizerische Bundesbahnen, SBB) into Swiss German Sign Language (Deutschschweizerische Gebärdensprache, DSGS) in real time and displays the result via an avatar. The system used to animate the avatar is called JASigning. Deliverables of the projects during which JASigning was developed are the main source of documentation for the system along with notes on the Web site. Not all planned features have been fully implemented: some because they are used very infrequently; others because there is insufficient linguistic research on which to base an implementation. The team of hearing and Deaf researchers identified the avatar functionality needed for the project and built a first version of the avatar. A focus group study with seven Deaf signers was then carried out to obtain feedback on how to further improve the avatar. This paper reports the evaluation results. It also discusses the workarounds introduced for features that were not yet directly available in the JASigning system. These features were not specific to train announcements. Hence, knowledge of how to achieve their designated effects in JASigning can be useful to persons working with other types of sign language data as well.
Vorheriger Artikel Emotional facial expressions in synthesised sign language avatars: a manual evaluation
Nächster Artikel Hefestos: an intelligent system applied to ubiquitous accessibility

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Fußnoten
1
It is a widely recognized convention to use the upper-cased word ‘Deaf’ for describing members of the linguistic community of sign language users and, in contrast, to use the lower-cased word ‘Deaf’ when describing the audiological state of a hearing loss [16].
 
6
Other customer service systems have been developed: For example, the TESSA system [2] and its successor VANESSA [20] translate a post office clerk’s (spoken or written) utterances into British Sign Language.
 
7
To what extent DSGS is similar to German Sign Language is the subject of an ongoing study.
 
8
The SBB use two different systems for this.
 
9
Where possible, they used the notations available in the DSGS database of Boyes Braem [1].
 
10
The mouthings used in DSGS are derived from Standard German rather than from one of the Swiss German dialects.
 
11
The use of fingerspelling is relatively recent in the DSGS community. As a result, DSGS users today have a varying ability in the production and comprehension of fingerspelled words.
 
12
Note that syllable and accent information has been omitted from the SAMPA notation. It is ignored by the SiGML interpreter in JASigning, as it makes little difference to the visual appearance.
 
13
Apart from the \({\texttt{<mouthing\_tier\!>}}\) element shown in Fig. 4, the SiGML document type definition (DTD) permits the elements \({\texttt{<facialexpr\_tier\!>}}, {\texttt{<shoulder\_tier\!>}}, {\texttt{<body\_tier\!>}}, {\texttt{<head\_tier\!>}}, {\texttt{<eyegaze\_tier\!>}}\), and \({\texttt{<extra\_tier\!>}}\).
 
15
The minimum version of JASigning required for this is 095k.
 
Literatur
1.
Boyes Braem, P.: A multimedia bilingual database for the lexicon of Swiss German Sign Language. Sign Lang. Linguist. 4, 133–143 (2001)CrossRef
2.
Cox, S., Lincoln, M., Tryggvason, J., Nakisa, M., Wells, M., Tutt, M., Abbott, S.: Tessa, a system to aid communication with deaf people. In: Proceedings of the fifth international ACM conference on Assistive technologies. Assets ’02, New York, NY, USA, pp. 205–212 (2002)
3.
Efthimiou, E., Fotinea, S.E., Hanke, T., Glauert, J., Bowden, R., Braffort, A., Collet, C., Maragos, P., Lefebvre-Albaret, F.: The dicta-sign wiki: enabling web communication for the Deaf. In: Miesenberger, K., Karshmer, A., Penaz, P., Zagler, W. (eds.) Computers Helping People with Special Needs, Lecture Notes in Computer Science, vol. 7383. Springer, pp. 205–212 (2012)
4.
Elliott, R., Glauert, J. R. W., Kennaway, J. R., Marshall, I.: The development of language processing support for the ViSiCAST project. In: Proceedings of the fourth international ACM conference on Assistive technologies. Assets ’00, Arlington, Virginia, USA. ACM, pp. 101–108 (2000)
5.
Elliott, R., Glauert, J., Kennaway, R., Parsons, K.: ViSiCAST Deliverable D5–2: SiGML Definition. Technical report, ViSiCAST project (2001)
6.
Elliott, R., Glauert, J.R.W., Kennaway, J.R., Marshall, I., Safar, E.: Linguistic modelling and language-processing technologies for avatar-based sign language presentation. UAIS J. 6, 375–391 (2008)CrossRef
7.
Elliott, R., Bueno, J., Kennaway, R., Glauert, J.: Towards the integration of synthetic SL animation with avatars into corpus annotation tools. In: 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies, pp. 84–87 (2010)
8.
Glauert, J., Elliott, R.: Extending the SiGML notation—a progress report. In: Second International Workshop on Sign Language Translation and Avatar Technology (SLTAT), Dundee, Scotland (2011)
9.
Hanke, T.: ViSiCAST Deliverable D5–1: Interface Definitions. Technical report, ViSiCAST project (2001)
10.
Huenerfauth, M., Zhao, L., Gu, E., Allbeck, J.: Evaluating american sign language generation through the participation of native asl signers. In: Proceedings of Assets’07 (2007)
11.
Jennings, V., Elliott, R., Kennaway, R., Glauert, J.: Requirements for a signing avatar. In: 4th Workshop on the Representation and Processing of Sign Languages: Corpora and Sign Language Technologies (2010)
12.
Kennaway, J.R., Glauert, J.R.W., Zwitserlood, I.: Providing signed content on the internet by synthesized animation. ACM Trans. Comput. Hum. Interact. 14(3), 15 (2007)CrossRef
13.
Kipp, M., Nguyen, Q., Heloir, A., Matthes, S.: Assessing the Deaf user perspective on sign language avatars. In: Proceedings of the 13th International ACM Sigaccess conference on computers and accessibility. Assets ’11. ACM, New York, NY, USA, pp. 107–114 (2011)
14.
15.
Morgan, D.L.: Focus Groups as Qualitative Research. Qualitative Research Methods, vol. 16. Sage, Thousand Oaks (1997)CrossRef
16.
Morgan, G., Woll, B. (eds.): Directions in Sign Language Acquisition—Trends in Language Acquisition Research. John Benjamins, Amsterdam (2002)
17.
Portele, T., Krämer, J., Stock, D.: Symbolverarbeitung im Sprachsynthesesystem Hadifix. In: Proceedings of the 6. konferenz elektronische sprachsignalverarbeitung. Wolfenbüttel, pp. 97–104 (1995)
18.
Prillwitz, S., Leven, R., Zienert, H., Hanke, T., Henning, J.: HamNoSys: Version 2.0: Hamburg Notation System for Sign Languages. An Introductory Guide. Signum, Hamburg (1989)
19.
Segouat, J.: Modélisation de la coarticulation en langue des signes française pour la diffusion. PhD diss., Université Paris Sud (2010)
20.
21.
Wells, J.C.: SAMPA computer readable phonetic alphabet. In: Winski, R., Gibbon, D., Moore, R. (eds.) Handbook of Standards and Resources for Spoken Language Systems. Mouton de Gruyter, Berlin (1997)
Metadaten
Titel
Building a Swiss German Sign Language avatar with JASigning and evaluating it among the Deaf community
verfasst von
Sarah Ebling
John Glauert
Publikationsdatum
01.11.2016
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 4/2016
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-015-0408-1

Weitere Artikel der Ausgabe 4/2016

Universal Access in the Information Society 4/2016 Zur Ausgabe

Long paper

Culture and HCI: a review of recent cultural studies in HCI and social networks

Long Paper

A rule triggering system for automatic text-to-sign translation

Communication

Benefit factors: American students, International students, and deaf/hard of hearing students’ willingness to pay for captioned online courses

Long paper

From grammar-based MT to post-processed SL representations

Long paper

Emotional facial expressions in synthesised sign language avatars: a manual evaluation

Long paper

Proactive and reactive e-government services recommendation

Premium Partner

    Bildnachweise