Skip to main content
Erschienen in: AI & SOCIETY 1/2017

16.10.2014 | Original Article

Real-time gesture translation in intercultural communication

verfasst von: Béatrice S. Hasler, Oren Salomon, Peleg Tuchman, Amir Lev-Tov, Doron Friedman

Erschienen in: AI & SOCIETY | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nonverbal behavior plays a crucial role in human communication and often leads to misunderstandings between people from different cultures, even if they speak the same language fluently. While translation systems are available for verbal communication, translators for nonverbal communication do not exist yet. We present the conceptual design and an early prototype of a real-time gesture translator using body tracking and gesture recognition in avatar-mediated intercultural interactions. It contributes to the ambitious goal of bridging between cultures by translating culture-specific gestures to enhance mutual understanding. Possible applications of the gesture translator are discussed as a facilitating tool for global business meetings and as a means of technology-enhanced conflict resolution and prevention.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Andersen PA, Hecht ML, Hoobler GD, Smallwood M (2003) Nonverbal communication across cultures. Cross-cultural and intercultural communication. Sage Publications, Thousand Oaks, pp 73–90 Andersen PA, Hecht ML, Hoobler GD, Smallwood M (2003) Nonverbal communication across cultures. Cross-cultural and intercultural communication. Sage Publications, Thousand Oaks, pp 73–90
Zurück zum Zitat Archer D (1991) A world of gestures: culture and nonverbal communication (video). Berkley Media LLC, Berkley Archer D (1991) A world of gestures: culture and nonverbal communication (video). Berkley Media LLC, Berkley
Zurück zum Zitat Archer D (1997) Unspoken diversity: cultural differences in gestures. Qual Sociol 20(1):79–105CrossRef Archer D (1997) Unspoken diversity: cultural differences in gestures. Qual Sociol 20(1):79–105CrossRef
Zurück zum Zitat Armstrong N, Wagner M (2003) Field guide to gestures. How to identify and interpret virtually every gesture known to man. Quirk Books, Philadelphia Armstrong N, Wagner M (2003) Field guide to gestures. How to identify and interpret virtually every gesture known to man. Quirk Books, Philadelphia
Zurück zum Zitat Assan M, Grobel K (1997) Video-based sign language recognition using hidden Markov models. In: Gesture and sign language in human-computer interaction. Proceedings of international gesture workshop, Bielefeld, Germany Assan M, Grobel K (1997) Video-based sign language recognition using hidden Markov models. In: Gesture and sign language in human-computer interaction. Proceedings of international gesture workshop, Bielefeld, Germany
Zurück zum Zitat Axtell RE (1998) Gestures: the do’s and taboos of body language around the world. Wiley, New York Axtell RE (1998) Gestures: the do’s and taboos of body language around the world. Wiley, New York
Zurück zum Zitat Barna LM (1994) Stumbling blocks in intercultural communication. In: Samovar LA, Porter RE (eds) Intercultural communication: a reader, 7th ed. Wadsworth Publishing Company, Belmont, pp 337–346 Barna LM (1994) Stumbling blocks in intercultural communication. In: Samovar LA, Porter RE (eds) Intercultural communication: a reader, 7th ed. Wadsworth Publishing Company, Belmont, pp 337–346
Zurück zum Zitat Cooper H, Holt B, Bowden R (2011) Sign language recognition. In: Moeslund TB, Hilton A, Krüger V, Sigal L (eds) Visual Analysis of Humans: Looking at People. Springer, London, pp 539–562 Cooper H, Holt B, Bowden R (2011) Sign language recognition. In: Moeslund TB, Hilton A, Krüger V, Sigal L (eds) Visual Analysis of Humans: Looking at People. Springer, London, pp 539–562
Zurück zum Zitat D’Andrade R (1984) Cultural meaning systems. In: Shweder RA, LeVine RA (eds) Culture theory: essays on mind, self, and emotion. Cambridge University Press, Cambridge D’Andrade R (1984) Cultural meaning systems. In: Shweder RA, LeVine RA (eds) Culture theory: essays on mind, self, and emotion. Cambridge University Press, Cambridge
Zurück zum Zitat de-Graft Aikins A (2011) Nonverbal communication in everyday multicultural life. In: Hook D, Franks B, Bauer MW (eds) The social psychology of communication. Palgrave Macmillan, New York, pp 67–86 de-Graft Aikins A (2011) Nonverbal communication in everyday multicultural life. In: Hook D, Franks B, Bauer MW (eds) The social psychology of communication. Palgrave Macmillan, New York, pp 67–86
Zurück zum Zitat Dreuw P, Rybach D, Deselaers T, Zahedi M, Ney H (2007). Speech recognition techniques for a sign language recognition system. In: Proceedings of Interspeech 2007, Antwerp, Belgium, pp 2513–2516 Dreuw P, Rybach D, Deselaers T, Zahedi M, Ney H (2007). Speech recognition techniques for a sign language recognition system. In: Proceedings of Interspeech 2007, Antwerp, Belgium, pp 2513–2516
Zurück zum Zitat Ekman P, Friesen WV (1969) The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica 1(1):49–98CrossRef Ekman P, Friesen WV (1969) The repertoire of nonverbal behavior: categories, origins, usage, and coding. Semiotica 1(1):49–98CrossRef
Zurück zum Zitat Ekman P, Friesen WV (1986) A new pan cultural expression of emotion. Motivation Emotion 10:159–168CrossRef Ekman P, Friesen WV (1986) A new pan cultural expression of emotion. Motivation Emotion 10:159–168CrossRef
Zurück zum Zitat Goldin-Meadow S (1999) The role of gesture in communication and thinking. Trends Cognit Sci 3(11):419–429CrossRef Goldin-Meadow S (1999) The role of gesture in communication and thinking. Trends Cognit Sci 3(11):419–429CrossRef
Zurück zum Zitat Hall BJ (1992) Theories of culture and communication. Commun Theory 2(1):50–70CrossRef Hall BJ (1992) Theories of culture and communication. Commun Theory 2(1):50–70CrossRef
Zurück zum Zitat Johnson WL, Marsella S, Mote N, Viljalmsson H, Narayanan S, Choi S (2004) Tactical language training system: supporting the rapid acquisition of foreign language and cultural skills. In: InSTIL/ICALL symposium: NLP and speech technologies in advanced language learning systems, Venice Johnson WL, Marsella S, Mote N, Viljalmsson H, Narayanan S, Choi S (2004) Tactical language training system: supporting the rapid acquisition of foreign language and cultural skills. In: InSTIL/ICALL symposium: NLP and speech technologies in advanced language learning systems, Venice
Zurück zum Zitat Kendon A (1982) The study of gesture: some remarks on its history. Semiotic Inquiry 2:45–62 Kendon A (1982) The study of gesture: some remarks on its history. Semiotic Inquiry 2:45–62
Zurück zum Zitat Liu S, Volcic Z, Gallois C (2011) Introducing intercultural communication. Global cultures and contexts. Sage, Los Angeles Liu S, Volcic Z, Gallois C (2011) Introducing intercultural communication. Global cultures and contexts. Sage, Los Angeles
Zurück zum Zitat Maniar N, Bennett E (2007) Designing a mobile game to reduce culture shock. In: International conference on advances in computer games technology, ACM Press, Lisbon, pp 252–253 Maniar N, Bennett E (2007) Designing a mobile game to reduce culture shock. In: International conference on advances in computer games technology, ACM Press, Lisbon, pp 252–253
Zurück zum Zitat McNeill D (1992) Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago McNeill D (1992) Hand and mind: what gestures reveal about thought. University of Chicago Press, Chicago
Zurück zum Zitat Morris D, Collett P, Marsh P, O’Shaughnessy M (1979) Gestures, their origins and distribution. Stein and Day, New York Morris D, Collett P, Marsh P, O’Shaughnessy M (1979) Gestures, their origins and distribution. Stein and Day, New York
Zurück zum Zitat Ong SCW, Ranganath S (2005) Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans Pattern Anal Mach Intell 27(6):873–891CrossRef Ong SCW, Ranganath S (2005) Automatic sign language analysis: a survey and the future beyond lexical meaning. IEEE Trans Pattern Anal Mach Intell 27(6):873–891CrossRef
Zurück zum Zitat Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–285CrossRef Rabiner LR (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–285CrossRef
Zurück zum Zitat Salomon G (1981) Communication and education: social and psychological interaction. Sage, Beverly Hills Salomon G (1981) Communication and education: social and psychological interaction. Sage, Beverly Hills
Zurück zum Zitat Schneller R (1989) Intercultural and intrapersonal processes and factors of misunderstanding: Implications for multicultural training. Int J Intercult Relat 13:465–484CrossRef Schneller R (1989) Intercultural and intrapersonal processes and factors of misunderstanding: Implications for multicultural training. Int J Intercult Relat 13:465–484CrossRef
Zurück zum Zitat Starner T, Pentland A (1995) Visual recognition of American Sign Language using hidden Markov models. In: Proceedings of international workshop on automatic face- and gesture-recognition, Zurich Starner T, Pentland A (1995) Visual recognition of American Sign Language using hidden Markov models. In: Proceedings of international workshop on automatic face- and gesture-recognition, Zurich
Zurück zum Zitat Steed A, Steptoe W, Oyekoya W, Pece F, Weyrich T et al (2012) Beaming: an asymmetric telepresence system. In: Spatial interfaces. IEEE Computer Graphics and Applications, pp 10–17 Steed A, Steptoe W, Oyekoya W, Pece F, Weyrich T et al (2012) Beaming: an asymmetric telepresence system. In: Spatial interfaces. IEEE Computer Graphics and Applications, pp 10–17
Zurück zum Zitat Stening BW (1979) Problems in cross-cultural contact: a literature review. Internat J Intercult Relat 3:269–313CrossRef Stening BW (1979) Problems in cross-cultural contact: a literature review. Internat J Intercult Relat 3:269–313CrossRef
Zurück zum Zitat Ting-Toomey S (1999) Communicating across cultures. Guilford Press, New York Ting-Toomey S (1999) Communicating across cultures. Guilford Press, New York
Zurück zum Zitat Turk M (2002) Gesture recognition. In: Hale KS, Stanney KM (eds) Handbook of virtual environment technology: design, implementation, and applications. Lawrence Erlbaum, Mahwah, pp 223–238 Turk M (2002) Gesture recognition. In: Hale KS, Stanney KM (eds) Handbook of virtual environment technology: design, implementation, and applications. Lawrence Erlbaum, Mahwah, pp 223–238
Zurück zum Zitat Zieren J, Canzler U, Bauer B, Kraiss KF (2006) Sign language recognition. In: Kraiss KF (ed) Advanced man-machine interaction. Signals and communication technology. Springer, Berlin, pp 95–139 Zieren J, Canzler U, Bauer B, Kraiss KF (2006) Sign language recognition. In: Kraiss KF (ed) Advanced man-machine interaction. Signals and communication technology. Springer, Berlin, pp 95–139
Metadaten
Titel
Real-time gesture translation in intercultural communication
verfasst von
Béatrice S. Hasler
Oren Salomon
Peleg Tuchman
Amir Lev-Tov
Doron Friedman
Publikationsdatum
16.10.2014
Verlag
Springer London
Erschienen in
AI & SOCIETY / Ausgabe 1/2017
Print ISSN: 0951-5666
Elektronische ISSN: 1435-5655
DOI
https://doi.org/10.1007/s00146-014-0573-4

Weitere Artikel der Ausgabe 1/2017

AI & SOCIETY 1/2017 Zur Ausgabe

Curmudgeon Corner

The web and its sorceries