Skip to main content
Erschienen in: AI & SOCIETY 1/2017

19.10.2014 | Original Article

Eloquence of eyes and mouth of virtual agents: cultural study of facial expression perception

verfasst von: Tomoko Koda, Zsofia Ruttkay

Erschienen in: AI & SOCIETY | Ausgabe 1/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper reports the results of a cross-cultural study on facial regions as cues to recognize facial expressions of virtual agents. The experiment was conducted between Japan and Hungary using 30 facial expressions of cartoonish faces designed by Hungarians. The results suggest the following: (1) cultural differences exist when using facial regions as cues to recognize cartoonish facial expressions between Hungary and Japan. Japanese weighed facial cues more heavily in the eye region than Hungarians, who weighed facial cues more heavily in the mouth region than Japanese. (2) The mouth region is more effective for conveying the emotions of facial expressions than the eye region, regardless of country. Our findings can be used not only to derive design guidelines for virtual agent facial expressions when aiming at users of a single culture, but as adaptation strategies in applications with users from various cultures.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Breazeal C (2003) Emotion and sociable humanoid robots. Int J Hum Comput Stud 59(1–2):11–155 Breazeal C (2003) Emotion and sociable humanoid robots. Int J Hum Comput Stud 59(1–2):11–155
Zurück zum Zitat Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17:124–129CrossRef Ekman P, Friesen WV (1971) Constants across cultures in the face and emotion. J Pers Soc Psychol 17:124–129CrossRef
Zurück zum Zitat Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial cues. Prentice Hall, Englewood Cliffs, NK Ekman P, Friesen WV (1975) Unmasking the face: a guide to recognizing emotions from facial cues. Prentice Hall, Englewood Cliffs, NK
Zurück zum Zitat Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto Ekman P, Friesen WV (1978) Facial action coding system: a technique for the measurement of facial movement. Consulting Psychologists Press, Palo Alto
Zurück zum Zitat Ekman P, Friesen WV, O’Sullivan M, Chan A, Diacoyanni-Tarlatzis I, Heider K, Krause R, LeCompte WA, Pitcairn T, Ricci-Bitti PE, Scherer KR, Tomita M, Tzavaras A (1987) Universals and cultural differences in the judgment of facial expressions of emotion. J Pers Soc Psychol 53:712–717CrossRef Ekman P, Friesen WV, O’Sullivan M, Chan A, Diacoyanni-Tarlatzis I, Heider K, Krause R, LeCompte WA, Pitcairn T, Ricci-Bitti PE, Scherer KR, Tomita M, Tzavaras A (1987) Universals and cultural differences in the judgment of facial expressions of emotion. J Pers Soc Psychol 53:712–717CrossRef
Zurück zum Zitat Elfenbein H, Beaupré M, Leveque M, Hess U (2007) Toward a dialect theory: cultural differences in expressing and recognizing facial expressions. Emotion 7:131–146CrossRef Elfenbein H, Beaupré M, Leveque M, Hess U (2007) Toward a dialect theory: cultural differences in expressing and recognizing facial expressions. Emotion 7:131–146CrossRef
Zurück zum Zitat Fridlund AJ (1994) Human facial expression: an evolutionary review. Academic Press, San Diego, CA Fridlund AJ (1994) Human facial expression: an evolutionary review. Academic Press, San Diego, CA
Zurück zum Zitat Ishiguro H (2005) Android science: toward a new cross-disciplinary framework. In: CogSci-2005 Workshop: Toward Social Mechanisms of Android Science, pp 1–6 Ishiguro H (2005) Android science: toward a new cross-disciplinary framework. In: CogSci-2005 Workshop: Toward Social Mechanisms of Android Science, pp 1–6
Zurück zum Zitat Jack RE, Blais C, Scheepers C, Schyns PG, Caldara R (2009) Cultural confusions show facial expressions are not universal. Curr Biol 19(18):1543–1548CrossRef Jack RE, Blais C, Scheepers C, Schyns PG, Caldara R (2009) Cultural confusions show facial expressions are not universal. Curr Biol 19(18):1543–1548CrossRef
Zurück zum Zitat Koda T, Ishida T, Rehm M, Andre E (2009) Avatar culture: cross-cultural evaluations of avatar facial expressions. J AI Soc 24(3):237–250CrossRef Koda T, Ishida T, Rehm M, Andre E (2009) Avatar culture: cross-cultural evaluations of avatar facial expressions. J AI Soc 24(3):237–250CrossRef
Zurück zum Zitat Koda T, Ruttkay Z, Nakagawa Y, Tabuchi K (2010) Cross-cultural Study on facial regions as cues to recognize emotions of virtual agents. In: Ishida T (ed) Culture Comput., Lecture Notes in Computer Science. Vol. 6259Springer, Berlin, pp 16–27CrossRef Koda T, Ruttkay Z, Nakagawa Y, Tabuchi K (2010) Cross-cultural Study on facial regions as cues to recognize emotions of virtual agents. In: Ishida T (ed) Culture Comput., Lecture Notes in Computer Science. Vol. 6259Springer, Berlin, pp 16–27CrossRef
Zurück zum Zitat Matsumoto D, Ekman P (1989) American-Japanese cultural differences in intensity ratings. Motivation Emotion 13:143–157CrossRef Matsumoto D, Ekman P (1989) American-Japanese cultural differences in intensity ratings. Motivation Emotion 13:143–157CrossRef
Zurück zum Zitat Mori M: Bukimi no Tani (1970) The Uncanny Valley (trans: MacDorman KF, Minato T). Energy, 7(4):33–35 (Originally in Japanese) Mori M: Bukimi no Tani (1970) The Uncanny Valley (trans: MacDorman KF, Minato T). Energy, 7(4):33–35 (Originally in Japanese)
Zurück zum Zitat Rickel J, Marsella S, Gratch J, Hill R, Traum D, Swartout B (2002) Towards a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems, pp 32–38 Rickel J, Marsella S, Gratch J, Hill R, Traum D, Swartout B (2002) Towards a new generation of virtual humans for interactive experiences. IEEE Intelligent Systems, pp 32–38
Zurück zum Zitat Ruttkay Z (2009) Cultural dialects of real and synthetic emotional facial expressions. J AI Soc 24(3):307–315CrossRef Ruttkay Z (2009) Cultural dialects of real and synthetic emotional facial expressions. J AI Soc 24(3):307–315CrossRef
Zurück zum Zitat Ruttkay, Z., Noot, H. (2000) Animated chartoon faces. In: International Symposium on Non-photorealistic Animation and Rendering, 91–100 Ruttkay, Z., Noot, H. (2000) Animated chartoon faces. In: International Symposium on Non-photorealistic Animation and Rendering, 91–100
Zurück zum Zitat Van Breemen AJN (2005) iCat: Experimenting with Animabotics. In: AISB Creative Robotics Symposium Van Breemen AJN (2005) iCat: Experimenting with Animabotics. In: AISB Creative Robotics Symposium
Zurück zum Zitat Yuki M, Maddux WW, Masuda T (2007) Are the windows to the soul the same in the East and West? J Exp Soc Psychol 43:30–311CrossRef Yuki M, Maddux WW, Masuda T (2007) Are the windows to the soul the same in the East and West? J Exp Soc Psychol 43:30–311CrossRef
Metadaten
Titel
Eloquence of eyes and mouth of virtual agents: cultural study of facial expression perception
verfasst von
Tomoko Koda
Zsofia Ruttkay
Publikationsdatum
19.10.2014
Verlag
Springer London
Erschienen in
AI & SOCIETY / Ausgabe 1/2017
Print ISSN: 0951-5666
Elektronische ISSN: 1435-5655
DOI
https://doi.org/10.1007/s00146-014-0571-6

Weitere Artikel der Ausgabe 1/2017

AI & SOCIETY 1/2017 Zur Ausgabe

Curmudgeon Corner

The web and its sorceries