Skip to main content
Top

2019 | OriginalPaper | Chapter

“Am I Talking to a Human or a Robot?”: A Preliminary Study of Human’s Perception in Human-Humanoid Interaction and Its Effects in Cognitive and Emotional States

Authors : Evangelia Baka, Ajay Vishwanath, Nidhi Mishra, Georgios Vleioras, Nadia Magnenat Thalmann

Published in: Advances in Computer Graphics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The current preliminary study concerns the identification of the effects human-humanoid interaction can have on human emotional states and behaviors, through a physical interaction. Thus, we have used three cases where people face three different types of physical interaction with a neutral person, Nadine social robot and the person on which Nadine was modelled, Professor Nadia Thalmann. To support our research, we have used EEG recordings to capture the physiological signals derived from the brain during each interaction, audio recordings to compare speech features and a questionnaire to provide psychometric data that can complement the above. Our results mainly showed the existence of frontal theta oscillations while interacting with the humanoid that probably shows the higher cognitive effort of the participants, as well as differences in the occipital area of the brain and thus, the visual attention mechanisms. The level of concentration and motivation of participants while interacting with the robot were higher indicating also higher amount of interest. The outcome of this experiment can broaden the field of human-robot interaction, leading to more efficient, meaningful and natural human-robot interaction.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ekman, P.: Darwin and Facial Expressions. Academic Press, New York (1973) Ekman, P.: Darwin and Facial Expressions. Academic Press, New York (1973)
4.
go back to reference Urgen, B.A., Plank, M., Ishiguro, H., Poizner, H., Saygin, A.P.: EEG theta and Mu oscillations during perception of human and robot actions. Front. Neurorobot. 7, 1–13 (2013)CrossRef Urgen, B.A., Plank, M., Ishiguro, H., Poizner, H., Saygin, A.P.: EEG theta and Mu oscillations during perception of human and robot actions. Front. Neurorobot. 7, 1–13 (2013)CrossRef
5.
go back to reference Esposito, A., Esposito, A.M., Vogel, C.: Needs and challenges in human computer interaction for processing social emotional information. Pattern Recogn. Lett. 66, 41–51 (2015)CrossRef Esposito, A., Esposito, A.M., Vogel, C.: Needs and challenges in human computer interaction for processing social emotional information. Pattern Recogn. Lett. 66, 41–51 (2015)CrossRef
7.
go back to reference Poria, S., Cambria, E., Hussain, A., Huang, G.B.: Towards an intelligent framework for multimodal affective data analysis. Neural Netw. 63, 104–116 (2015)CrossRef Poria, S., Cambria, E., Hussain, A., Huang, G.B.: Towards an intelligent framework for multimodal affective data analysis. Neural Netw. 63, 104–116 (2015)CrossRef
10.
go back to reference Wan Ismail, W.O.A.S., Hanif, M., Mohamed, S.B., Hamzah, N., Rizman, Z.I.: Human emotion detection via brain waves study by using electroencephalogram (EEG). Int. J. Adv. Sci. Eng. Inf. Technol. 6(6), 1005 (2016)CrossRef Wan Ismail, W.O.A.S., Hanif, M., Mohamed, S.B., Hamzah, N., Rizman, Z.I.: Human emotion detection via brain waves study by using electroencephalogram (EEG). Int. J. Adv. Sci. Eng. Inf. Technol. 6(6), 1005 (2016)CrossRef
11.
go back to reference Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
13.
go back to reference de Borst, A., de Gelder, B.: Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective. Front. Psychol. 6, 576 (2015)CrossRef de Borst, A., de Gelder, B.: Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective. Front. Psychol. 6, 576 (2015)CrossRef
14.
go back to reference Cheetham, M., Pavlovic, I., Jordan, N., Suter, P., Jancke, L.: Category processing and the human likeness dimension of the uncanny valley hypothesis: eye tracking data. Front. Psychol. 4, 108 (2013)CrossRef Cheetham, M., Pavlovic, I., Jordan, N., Suter, P., Jancke, L.: Category processing and the human likeness dimension of the uncanny valley hypothesis: eye tracking data. Front. Psychol. 4, 108 (2013)CrossRef
15.
go back to reference Cheetham, M., Suter, P., Jäncke, L.: The human likeness dimension of the uncanny valley hypothesis: behavioral and functional MFR findings. Front. Hum. Neurosci. 5, 126 (2011)CrossRef Cheetham, M., Suter, P., Jäncke, L.: The human likeness dimension of the uncanny valley hypothesis: behavioral and functional MFR findings. Front. Hum. Neurosci. 5, 126 (2011)CrossRef
16.
go back to reference Moser, E., Derntl, B., Robinson, S., et al.: Amygdala activation at 3T in response to human and avatar facial expressions of emotions. J. Neurosci. Methods 161, 126–133 (2007)CrossRef Moser, E., Derntl, B., Robinson, S., et al.: Amygdala activation at 3T in response to human and avatar facial expressions of emotions. J. Neurosci. Methods 161, 126–133 (2007)CrossRef
17.
go back to reference Chaminade, T., Cheng, G.: Social cognitive neuroscience and humanoid robotics. J. Physiol. 103, 286–295 (2009) Chaminade, T., Cheng, G.: Social cognitive neuroscience and humanoid robotics. J. Physiol. 103, 286–295 (2009)
18.
go back to reference Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Interact. 59, 119–155 (2003) Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Interact. 59, 119–155 (2003)
19.
go back to reference Lisetti, C.L., Nasoz, F., Lerouge, C., Ozyer, O., Alvarez, K.: Developing multimodal intelligent affective interfaces for tele-home health care. Int. J. Hum.-Comput. Stud. Spec. Issue Appl. Affect. Comput. HCI 59(1–2), 245–255 (2003)CrossRef Lisetti, C.L., Nasoz, F., Lerouge, C., Ozyer, O., Alvarez, K.: Developing multimodal intelligent affective interfaces for tele-home health care. Int. J. Hum.-Comput. Stud. Spec. Issue Appl. Affect. Comput. HCI 59(1–2), 245–255 (2003)CrossRef
20.
go back to reference Babiloni, C., Del Percio, C., Vecchio, F., et al.: Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans. Clin. Neurophysiol. 127(1), 641–654 (2016)CrossRef Babiloni, C., Del Percio, C., Vecchio, F., et al.: Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans. Clin. Neurophysiol. 127(1), 641–654 (2016)CrossRef
21.
go back to reference Cavanagh, J.F., Frank, M.J.: Frontal theta as a mechanism of cognitive control. Trends Cogn. Sci. 18(8), 414–421 (2014)CrossRef Cavanagh, J.F., Frank, M.J.: Frontal theta as a mechanism of cognitive control. Trends Cogn. Sci. 18(8), 414–421 (2014)CrossRef
22.
go back to reference Baka, E., Stavroulia, K.E., Magnenat-Thalmann, N., Lanitis, A.: An EEG-based evaluation for comparing the sense of presence between virtual and physical environments. In: Proceedings of Computer Graphics International (CGI 2018), 10 p. ACM, New York (2018) Baka, E., Stavroulia, K.E., Magnenat-Thalmann, N., Lanitis, A.: An EEG-based evaluation for comparing the sense of presence between virtual and physical environments. In: Proceedings of Computer Graphics International (CGI 2018), 10 p. ACM, New York (2018)
Metadata
Title
“Am I Talking to a Human or a Robot?”: A Preliminary Study of Human’s Perception in Human-Humanoid Interaction and Its Effects in Cognitive and Emotional States
Authors
Evangelia Baka
Ajay Vishwanath
Nidhi Mishra
Georgios Vleioras
Nadia Magnenat Thalmann
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-22514-8_20

Premium Partner