Skip to main content
Erschienen in: International Journal of Social Robotics 5/2018

23.01.2018

The Effects of Humanlike and Robot-Specific Affective Nonverbal Behavior on Perception, Emotion, and Behavior

verfasst von: Astrid M. Rosenthal-von der Pütten, Nicole C. Krämer, Jonathan Herrmann

Erschienen in: International Journal of Social Robotics | Ausgabe 5/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Research demonstrated that humans are able to interpret humanlike (affective) nonverbal behavior (HNB) in artificial entities (e.g. Beck et al., in: Proceedings of the 19th IEEE international symposium on robot and human interactive communication, IEEE Press, Piscataway, 2010. https://​doi.​org/​10.​1109/​ROMAN.​2010.​5598649; Bente et al. in J Nonverbal Behav 25: 151–166, 2001; Mumm and Mutlu, in: Proceedings of the 6th international conference on human–robot interaction, HRI. ACM Press, New York, 2011. https://​doi.​org/​10.​1145/​1957656.​1957786). However, some robots lack the possibility to produce HNB. Using robot-specific nonverbal behavior (RNB) such as different eye colors to convey emotional meaning might be a fruitful mechanism to enhance HRI experiences, but it is unclear whether RNB is as effective as HNB. We present a review on affective nonverbal behaviors in robots and an experimental study. We experimentally tested the influence of HNB and RNB (colored LEDs) on users’ perception of the robot (e.g. likeability, animacy), their emotional experience, and self-disclosure. In a between-subjects design, users (\(n=80\)) interacted with either (a) a robot displaying no nonverbal behavior, (b) a robot displaying affective RNB, (c) a robot displaying affective HNB or (d) a robot displaying affective HNB and RNB. Results show that HNB, but not RNB, has a significant effect on the perceived animacy of the robot, participants’ emotional state, and self-disclosure. However, RNB still slightly influenced participants’ perception, emotion, and behavior: Planned contrasts revealed having any type of nonverbal behavior significantly increased perceived animacy, positive affect, and self-disclosure. Moreover, observed linear trends indicate that the effects increased with the addition of nonverbal behaviors (control< RNB< HNB). In combination, our results suggest that HNB is more effective in transporting the robot’s communicative message than RNB.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Banse R, Scherer KR (1996) Acoustic profiles in vocal emotion expression. J Pers Soc Psychol 70:614–636CrossRef Banse R, Scherer KR (1996) Acoustic profiles in vocal emotion expression. J Pers Soc Psychol 70:614–636CrossRef
2.
Zurück zum Zitat Bartneck C, Kulić D, Croft E, Zoghbi S (2009) Measurement Instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot 1:71–81CrossRef Bartneck C, Kulić D, Croft E, Zoghbi S (2009) Measurement Instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot 1:71–81CrossRef
3.
Zurück zum Zitat Beck A, Canamero L, Bard KA (2010) Towards an affect space for robots to display emotional body language. In: Proceedings of the 19th IEEE international symposium on robot and human interactive communication, RO-MAN. IEEE Press, Piscataway, New Jersey, pp 464–469. https://doi.org/10.1109/ROMAN.2010.5598649 Beck A, Canamero L, Bard KA (2010) Towards an affect space for robots to display emotional body language. In: Proceedings of the 19th IEEE international symposium on robot and human interactive communication, RO-MAN. IEEE Press, Piscataway, New Jersey, pp 464–469. https://​doi.​org/​10.​1109/​ROMAN.​2010.​5598649
4.
Zurück zum Zitat Beck A, Cañamero L, Hiolle A, Damiano L, Cosi P, Tesser F, Sommavilla G (2013) Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int J Soc Robot 5:325–334CrossRef Beck A, Cañamero L, Hiolle A, Damiano L, Cosi P, Tesser F, Sommavilla G (2013) Interpretation of emotional body language displayed by a humanoid robot: a case study with children. Int J Soc Robot 5:325–334CrossRef
6.
Zurück zum Zitat Bente G, Krämer NC (2003) Integrierte Registrierung und Analyse verbaler und nonverbaler Kommunikation. In: Herrmann T, Grabowski, J (ed) Sprachproduktion. Enzyklopädie der Psychologie. Themenbereich C Serie 3, Band 1. Hogrefe, Göttingen, pp 219–246 Bente G, Krämer NC (2003) Integrierte Registrierung und Analyse verbaler und nonverbaler Kommunikation. In: Herrmann T, Grabowski, J (ed) Sprachproduktion. Enzyklopädie der Psychologie. Themenbereich C Serie 3, Band 1. Hogrefe, Göttingen, pp 219–246
7.
Zurück zum Zitat Bente G, Krämer NC, Petersen A, de Ruiter JP (2001) Computer animated movement and person perception: methodological advances in nonverbal behavior research. J Nonverbal Behav 25:151–166CrossRef Bente G, Krämer NC, Petersen A, de Ruiter JP (2001) Computer animated movement and person perception: methodological advances in nonverbal behavior research. J Nonverbal Behav 25:151–166CrossRef
8.
Zurück zum Zitat Breazeal C, Kidd C, Thomaz A, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human–robot teamwork. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, IROS, pp 708–713. https://doi.org/10.1109/IROS.2005.1545011 Breazeal C, Kidd C, Thomaz A, Hoffman G, Berlin M (2005) Effects of nonverbal communication on efficiency and robustness in human–robot teamwork. In: Proceedings of the IEEE/RSJ international conference on intelligent robots and systems, IROS, pp 708–713. https://​doi.​org/​10.​1109/​IROS.​2005.​1545011
9.
Zurück zum Zitat Burgoon JK, Bacue AE (2003) Nonverbal communication skills. In: Greene JO, Burleson BR (eds) Handbook of communication and social interaction skills. LEA’s communication series. Lawrence Erlbaum Associates, Mahwah, pp 179–220 Burgoon JK, Bacue AE (2003) Nonverbal communication skills. In: Greene JO, Burleson BR (eds) Handbook of communication and social interaction skills. LEA’s communication series. Lawrence Erlbaum Associates, Mahwah, pp 179–220
10.
Zurück zum Zitat Burgoon JK, Guerrero LK, Manusov V (2011) Nonverbal signals. In: Knapp ML, Daly JA (eds) The sage handbook of interpersonal communication. Sage, Thousand Oaks, pp 239–282 Burgoon JK, Guerrero LK, Manusov V (2011) Nonverbal signals. In: Knapp ML, Daly JA (eds) The sage handbook of interpersonal communication. Sage, Thousand Oaks, pp 239–282
11.
Zurück zum Zitat Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:284–290CrossRef Cicchetti DV (1994) Guidelines, criteria, and rules of thumb for evaluating normed and standardized assessment instruments in psychology. Psychol Assess 6:284–290CrossRef
12.
Zurück zum Zitat Collins EC, Prescott TJ, Mitchinson B (2015) Saying it with light: a pilot study of affective communication using the MIRO robot. In: Wilson SP, Verschure PF, Mura A, Prescott TJ (eds) Biomimetic and biohybrid systems. Lecture notes in computer science. Springer, Cham, pp 243–255. https://doi.org/10.1007/978-3-319-22979-9_25 CrossRef Collins EC, Prescott TJ, Mitchinson B (2015) Saying it with light: a pilot study of affective communication using the MIRO robot. In: Wilson SP, Verschure PF, Mura A, Prescott TJ (eds) Biomimetic and biohybrid systems. Lecture notes in computer science. Springer, Cham, pp 243–255. https://​doi.​org/​10.​1007/​978-3-319-22979-9_​25 CrossRef
13.
Zurück zum Zitat Dael N, Mortillaro M, Scherer KR (2012) Emotion expression in body action and posture. Emotion 12:1085–1101CrossRef Dael N, Mortillaro M, Scherer KR (2012) Emotion expression in body action and posture. Emotion 12:1085–1101CrossRef
14.
Zurück zum Zitat Ekman P (1993) Facial expression and emotion. Am Psychol 48:384–392CrossRef Ekman P (1993) Facial expression and emotion. Am Psychol 48:384–392CrossRef
15.
16.
Zurück zum Zitat Häring M, Bee N, André E (2011) Creation and Evaluation of emotion expression with body movement, sound and eye color for humanoid robots. In: The 20th IEEE international symposium on robot and human interactive communication, RO-MAN, pp 204–209. https://doi.org/10.1109/ROMAN.2011.6005263 Häring M, Bee N, André E (2011) Creation and Evaluation of emotion expression with body movement, sound and eye color for humanoid robots. In: The 20th IEEE international symposium on robot and human interactive communication, RO-MAN, pp 204–209. https://​doi.​org/​10.​1109/​ROMAN.​2011.​6005263
17.
Zurück zum Zitat Hurlbert AC, Ling Y (2007) Biological components of sex differences in color preference. Curr Biol 17:R623CrossRef Hurlbert AC, Ling Y (2007) Biological components of sex differences in color preference. Curr Biol 17:R623CrossRef
18.
Zurück zum Zitat Johnson DO, Cuijpers RH, van der Pol D (2013) Imitating human emotions with artificial facial expressions. Int J Soc Robot 5:503–513CrossRef Johnson DO, Cuijpers RH, van der Pol D (2013) Imitating human emotions with artificial facial expressions. Int J Soc Robot 5:503–513CrossRef
19.
Zurück zum Zitat Kang SH, Gratch J (2010) Virtual humans elicit socially anxious interactants’ verbal self-disclosure. Comput Animat Virt W 21:473–482 Kang SH, Gratch J (2010) Virtual humans elicit socially anxious interactants’ verbal self-disclosure. Comput Animat Virt W 21:473–482
20.
Zurück zum Zitat Kishi T, Endo N, Nozawa T et al. (2010) Bipedal humanoid robot that makes humans laugh with use of the method of comedy and affects their psychological state actively. In: Proceedings of the IEEE international conference on robotics and automation (ICRA’10), pp 1965–1970 Kishi T, Endo N, Nozawa T et al. (2010) Bipedal humanoid robot that makes humans laugh with use of the method of comedy and affects their psychological state actively. In: Proceedings of the IEEE international conference on robotics and automation (ICRA’10), pp 1965–1970
21.
Zurück zum Zitat Krämer NC, Kopp S, Becker-Asano C, Sommer N (2013) Smile and the world will smile with you—the effects of a virtual agent’s smile on users’ evaluation and behavior. Int J Hum Comput St 71:335–349CrossRef Krämer NC, Kopp S, Becker-Asano C, Sommer N (2013) Smile and the world will smile with you—the effects of a virtual agent’s smile on users’ evaluation and behavior. Int J Hum Comput St 71:335–349CrossRef
22.
Zurück zum Zitat Leite I, Martinho C, Pereira A, Paiva A (2008) iCat: an affective game buddy based on anticipatory mechanisms. In: Proceedings of the 7th international conference on autonomous agents and multiagent systems, AAMAS. Estoril, Portugal, pp 1229–1232 Leite I, Martinho C, Pereira A, Paiva A (2008) iCat: an affective game buddy based on anticipatory mechanisms. In: Proceedings of the 7th international conference on autonomous agents and multiagent systems, AAMAS. Estoril, Portugal, pp 1229–1232
23.
Zurück zum Zitat Leite I, Mascarenhas S, Pereira A, Martinho C, Prada R, Paiva A (2010) ”Why can’t we be friends?” an empathic game companion for long-term interaction. In: Hutchison D et al (eds) Intelligent virtual agents. Lecture notes in computer science. Springer, Berlin, pp 215–321. https://doi.org/10.1007/978-3-642-15892-6_32 CrossRef Leite I, Mascarenhas S, Pereira A, Martinho C, Prada R, Paiva A (2010) ”Why can’t we be friends?” an empathic game companion for long-term interaction. In: Hutchison D et al (eds) Intelligent virtual agents. Lecture notes in computer science. Springer, Berlin, pp 215–321. https://​doi.​org/​10.​1007/​978-3-642-15892-6_​32 CrossRef
24.
Zurück zum Zitat Li J, Chignell M (2011) Communication of emotion in social robots through simple head and arm movements. Int J Soc Robot 3:125–142CrossRef Li J, Chignell M (2011) Communication of emotion in social robots through simple head and arm movements. Int J Soc Robot 3:125–142CrossRef
25.
Zurück zum Zitat Manav B (2007) Color-emotion associations and color preferences: a case study for residences. Color Res App 32:144–150CrossRef Manav B (2007) Color-emotion associations and color preferences: a case study for residences. Color Res App 32:144–150CrossRef
26.
Zurück zum Zitat Manstead ASR, Fischer AH, Jakobs EB (1999) The social and emotional functions of facial displays. In: Phillipot P, Feldman RS, Coats EJ (eds) The social context of nonverbal behavior. Cambridge University Press, Cambridge, pp 287–316 Manstead ASR, Fischer AH, Jakobs EB (1999) The social and emotional functions of facial displays. In: Phillipot P, Feldman RS, Coats EJ (eds) The social context of nonverbal behavior. Cambridge University Press, Cambridge, pp 287–316
27.
Zurück zum Zitat McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30–46CrossRef McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30–46CrossRef
31.
Zurück zum Zitat Nass C, Moon Y (2000) Machines and mindlessness: social responses to computers. J Soc Issues 56:81–103CrossRef Nass C, Moon Y (2000) Machines and mindlessness: social responses to computers. J Soc Issues 56:81–103CrossRef
33.
Zurück zum Zitat Nomura T, Suzuki T, Kanda T et al. (2007) Measurement of anxiety toward robots. In: Proceedings of the 16th IEEE international conference on robot and human interactive communication. IEEE Press; IEEE, Piscataway, NJ, pp 372–377 Nomura T, Suzuki T, Kanda T et al. (2007) Measurement of anxiety toward robots. In: Proceedings of the 16th IEEE international conference on robot and human interactive communication. IEEE Press; IEEE, Piscataway, NJ, pp 372–377
34.
Zurück zum Zitat Pereira A, Leite I, Mascarenhas S, Martinho C, Paiva A (2011) Using empathy to improve human-robot relationships. In: Akan O, Bellavista P, Cao J, Dressler F, Ferrari D, Gerla M, Kobayashi H, Pallazo S, Sahni S, Shen X, Stan M, Xiaohua J, Zomaya A, Coulson G, Lamers MH, Verbeek FJ (eds) Human-robot personal relationships. Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering. Springer, Berlin, pp 130–138. https://doi.org/10.1007/978-3-642-19385-9_17 CrossRef Pereira A, Leite I, Mascarenhas S, Martinho C, Paiva A (2011) Using empathy to improve human-robot relationships. In: Akan O, Bellavista P, Cao J, Dressler F, Ferrari D, Gerla M, Kobayashi H, Pallazo S, Sahni S, Shen X, Stan M, Xiaohua J, Zomaya A, Coulson G, Lamers MH, Verbeek FJ (eds) Human-robot personal relationships. Lecture notes of the institute for computer sciences, social informatics and telecommunications engineering. Springer, Berlin, pp 130–138. https://​doi.​org/​10.​1007/​978-3-642-19385-9_​17 CrossRef
35.
Zurück zum Zitat Press C (2011) Action observation and robotic agents: learning and anthropomorphism. Neurosci Biobehav R 35:1410–1418CrossRef Press C (2011) Action observation and robotic agents: learning and anthropomorphism. Neurosci Biobehav R 35:1410–1418CrossRef
36.
Zurück zum Zitat Rosenthal-von der Pütten AM, Krämer NC, Hoffmann L, Sobieraj S, Eimler SC (2013) An experimental study on emotional reactions towards a robot. Int J Soc Robot 5:17–34CrossRef Rosenthal-von der Pütten AM, Krämer NC, Hoffmann L, Sobieraj S, Eimler SC (2013) An experimental study on emotional reactions towards a robot. Int J Soc Robot 5:17–34CrossRef
38.
39.
40.
Zurück zum Zitat Suzuki Y, Galli L, Ikeda A et al (2015) Measuring empathy for human and robot hand pain using electroencephalography. Sci Rep 5:15924CrossRef Suzuki Y, Galli L, Ikeda A et al (2015) Measuring empathy for human and robot hand pain using electroencephalography. Sci Rep 5:15924CrossRef
43.
Zurück zum Zitat Valdez P, Mehrabian A (1994) Effects of color on emotions. J Exp Psychol Gen 123:394–409CrossRef Valdez P, Mehrabian A (1994) Effects of color on emotions. J Exp Psychol Gen 123:394–409CrossRef
44.
Zurück zum Zitat von der Pütten AM, Klatt J, Hoffmann L, Krämer NC (2011) Quid pro quo? Reciprocal self-disclosure and communicative accomodation towards a virtual interviewer. In: Lecture notes in computer science 6895. Springer, Berlin, pp. 183–194 von der Pütten AM, Klatt J, Hoffmann L, Krämer NC (2011) Quid pro quo? Reciprocal self-disclosure and communicative accomodation towards a virtual interviewer. In: Lecture notes in computer science 6895. Springer, Berlin, pp. 183–194
45.
Zurück zum Zitat von der Pütten AM, Krämer NC, Gratch J, Kang S-H (2010) It doesn’t matter what you are! Explaining social effects of agents and avatars. Comput Hum Behav 26:1641–1650CrossRef von der Pütten AM, Krämer NC, Gratch J, Kang S-H (2010) It doesn’t matter what you are! Explaining social effects of agents and avatars. Comput Hum Behav 26:1641–1650CrossRef
46.
Zurück zum Zitat Wallbott HG (1988) In and out of context: influences of facial expression and context information on emotion attributions. Brit J Soc Psychol 27:357–369CrossRef Wallbott HG (1988) In and out of context: influences of facial expression and context information on emotion attributions. Brit J Soc Psychol 27:357–369CrossRef
47.
Zurück zum Zitat Watson D, Tellegen A, Clark LA (1988) Development and validation of brief measure of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54:1063–1070CrossRef Watson D, Tellegen A, Clark LA (1988) Development and validation of brief measure of positive and negative affect: the PANAS scales. J Pers Soc Psychol 54:1063–1070CrossRef
48.
Zurück zum Zitat Wu Y, Babu SV, Armstrong R, Bertrand JW, Luo J, Roy T, Daily SB, Dukes LC, Hodges LF, Fasolino T (2014) Effects of virtual human animation on emotion contagion in simulated inter-personal experiences. IEEE T Vis Comput Gr 20:626–635CrossRef Wu Y, Babu SV, Armstrong R, Bertrand JW, Luo J, Roy T, Daily SB, Dukes LC, Hodges LF, Fasolino T (2014) Effects of virtual human animation on emotion contagion in simulated inter-personal experiences. IEEE T Vis Comput Gr 20:626–635CrossRef
49.
Zurück zum Zitat Xu J, Broekens J, Hindriks K, Neerincx MA (2014) Robot mood is contagious: effects of robot body language in the imitation game. In: Proceedings of the 2014 international conference on autonomous agents and multi-agent systems. International foundation for autonomous agents and multiagent systems, Paris, France, pp 973–980 Xu J, Broekens J, Hindriks K, Neerincx MA (2014) Robot mood is contagious: effects of robot body language in the imitation game. In: Proceedings of the 2014 international conference on autonomous agents and multi-agent systems. International foundation for autonomous agents and multiagent systems, Paris, France, pp 973–980
50.
Zurück zum Zitat Zatsiorsky VM, Prilutsky BI (2012) Biomechanics of skeletal muscles. Human Kinetics, Champaign Zatsiorsky VM, Prilutsky BI (2012) Biomechanics of skeletal muscles. Human Kinetics, Champaign
51.
Zurück zum Zitat Zecca M, Endo N, Momoki S, Itoh K, Takanishi A (2008) Design of the humanoid robot KOBIAN -preliminary analysis of facial and whole body emotion expression capabilities-. In: 2008 8th IEEE-RAS international conference on humanoid robots, Humanoids, pp 487–492. https://doi.org/10.1109/ICHR.2008.4755969 Zecca M, Endo N, Momoki S, Itoh K, Takanishi A (2008) Design of the humanoid robot KOBIAN -preliminary analysis of facial and whole body emotion expression capabilities-. In: 2008 8th IEEE-RAS international conference on humanoid robots, Humanoids, pp 487–492. https://​doi.​org/​10.​1109/​ICHR.​2008.​4755969
Metadaten
Titel
The Effects of Humanlike and Robot-Specific Affective Nonverbal Behavior on Perception, Emotion, and Behavior
verfasst von
Astrid M. Rosenthal-von der Pütten
Nicole C. Krämer
Jonathan Herrmann
Publikationsdatum
23.01.2018
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 5/2018
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-018-0466-7

Weitere Artikel der Ausgabe 5/2018

International Journal of Social Robotics 5/2018 Zur Ausgabe

EditorialNotes

Editorial

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.