Skip to main content

2019 | OriginalPaper | Buchkapitel

“Am I Talking to a Human or a Robot?”: A Preliminary Study of Human’s Perception in Human-Humanoid Interaction and Its Effects in Cognitive and Emotional States

verfasst von : Evangelia Baka, Ajay Vishwanath, Nidhi Mishra, Georgios Vleioras, Nadia Magnenat Thalmann

Erschienen in: Advances in Computer Graphics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The current preliminary study concerns the identification of the effects human-humanoid interaction can have on human emotional states and behaviors, through a physical interaction. Thus, we have used three cases where people face three different types of physical interaction with a neutral person, Nadine social robot and the person on which Nadine was modelled, Professor Nadia Thalmann. To support our research, we have used EEG recordings to capture the physiological signals derived from the brain during each interaction, audio recordings to compare speech features and a questionnaire to provide psychometric data that can complement the above. Our results mainly showed the existence of frontal theta oscillations while interacting with the humanoid that probably shows the higher cognitive effort of the participants, as well as differences in the occipital area of the brain and thus, the visual attention mechanisms. The level of concentration and motivation of participants while interacting with the robot were higher indicating also higher amount of interest. The outcome of this experiment can broaden the field of human-robot interaction, leading to more efficient, meaningful and natural human-robot interaction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ekman, P.: Darwin and Facial Expressions. Academic Press, New York (1973) Ekman, P.: Darwin and Facial Expressions. Academic Press, New York (1973)
4.
Zurück zum Zitat Urgen, B.A., Plank, M., Ishiguro, H., Poizner, H., Saygin, A.P.: EEG theta and Mu oscillations during perception of human and robot actions. Front. Neurorobot. 7, 1–13 (2013)CrossRef Urgen, B.A., Plank, M., Ishiguro, H., Poizner, H., Saygin, A.P.: EEG theta and Mu oscillations during perception of human and robot actions. Front. Neurorobot. 7, 1–13 (2013)CrossRef
5.
Zurück zum Zitat Esposito, A., Esposito, A.M., Vogel, C.: Needs and challenges in human computer interaction for processing social emotional information. Pattern Recogn. Lett. 66, 41–51 (2015)CrossRef Esposito, A., Esposito, A.M., Vogel, C.: Needs and challenges in human computer interaction for processing social emotional information. Pattern Recogn. Lett. 66, 41–51 (2015)CrossRef
7.
Zurück zum Zitat Poria, S., Cambria, E., Hussain, A., Huang, G.B.: Towards an intelligent framework for multimodal affective data analysis. Neural Netw. 63, 104–116 (2015)CrossRef Poria, S., Cambria, E., Hussain, A., Huang, G.B.: Towards an intelligent framework for multimodal affective data analysis. Neural Netw. 63, 104–116 (2015)CrossRef
10.
Zurück zum Zitat Wan Ismail, W.O.A.S., Hanif, M., Mohamed, S.B., Hamzah, N., Rizman, Z.I.: Human emotion detection via brain waves study by using electroencephalogram (EEG). Int. J. Adv. Sci. Eng. Inf. Technol. 6(6), 1005 (2016)CrossRef Wan Ismail, W.O.A.S., Hanif, M., Mohamed, S.B., Hamzah, N., Rizman, Z.I.: Human emotion detection via brain waves study by using electroencephalogram (EEG). Int. J. Adv. Sci. Eng. Inf. Technol. 6(6), 1005 (2016)CrossRef
11.
Zurück zum Zitat Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
13.
Zurück zum Zitat de Borst, A., de Gelder, B.: Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective. Front. Psychol. 6, 576 (2015)CrossRef de Borst, A., de Gelder, B.: Is it the real deal? Perception of virtual characters versus humans: an affective cognitive neuroscience perspective. Front. Psychol. 6, 576 (2015)CrossRef
14.
Zurück zum Zitat Cheetham, M., Pavlovic, I., Jordan, N., Suter, P., Jancke, L.: Category processing and the human likeness dimension of the uncanny valley hypothesis: eye tracking data. Front. Psychol. 4, 108 (2013)CrossRef Cheetham, M., Pavlovic, I., Jordan, N., Suter, P., Jancke, L.: Category processing and the human likeness dimension of the uncanny valley hypothesis: eye tracking data. Front. Psychol. 4, 108 (2013)CrossRef
15.
Zurück zum Zitat Cheetham, M., Suter, P., Jäncke, L.: The human likeness dimension of the uncanny valley hypothesis: behavioral and functional MFR findings. Front. Hum. Neurosci. 5, 126 (2011)CrossRef Cheetham, M., Suter, P., Jäncke, L.: The human likeness dimension of the uncanny valley hypothesis: behavioral and functional MFR findings. Front. Hum. Neurosci. 5, 126 (2011)CrossRef
16.
Zurück zum Zitat Moser, E., Derntl, B., Robinson, S., et al.: Amygdala activation at 3T in response to human and avatar facial expressions of emotions. J. Neurosci. Methods 161, 126–133 (2007)CrossRef Moser, E., Derntl, B., Robinson, S., et al.: Amygdala activation at 3T in response to human and avatar facial expressions of emotions. J. Neurosci. Methods 161, 126–133 (2007)CrossRef
17.
Zurück zum Zitat Chaminade, T., Cheng, G.: Social cognitive neuroscience and humanoid robotics. J. Physiol. 103, 286–295 (2009) Chaminade, T., Cheng, G.: Social cognitive neuroscience and humanoid robotics. J. Physiol. 103, 286–295 (2009)
18.
Zurück zum Zitat Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Interact. 59, 119–155 (2003) Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Interact. 59, 119–155 (2003)
19.
Zurück zum Zitat Lisetti, C.L., Nasoz, F., Lerouge, C., Ozyer, O., Alvarez, K.: Developing multimodal intelligent affective interfaces for tele-home health care. Int. J. Hum.-Comput. Stud. Spec. Issue Appl. Affect. Comput. HCI 59(1–2), 245–255 (2003)CrossRef Lisetti, C.L., Nasoz, F., Lerouge, C., Ozyer, O., Alvarez, K.: Developing multimodal intelligent affective interfaces for tele-home health care. Int. J. Hum.-Comput. Stud. Spec. Issue Appl. Affect. Comput. HCI 59(1–2), 245–255 (2003)CrossRef
20.
Zurück zum Zitat Babiloni, C., Del Percio, C., Vecchio, F., et al.: Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans. Clin. Neurophysiol. 127(1), 641–654 (2016)CrossRef Babiloni, C., Del Percio, C., Vecchio, F., et al.: Alpha, beta and gamma electrocorticographic rhythms in somatosensory, motor, premotor and prefrontal cortical areas differ in movement execution and observation in humans. Clin. Neurophysiol. 127(1), 641–654 (2016)CrossRef
21.
Zurück zum Zitat Cavanagh, J.F., Frank, M.J.: Frontal theta as a mechanism of cognitive control. Trends Cogn. Sci. 18(8), 414–421 (2014)CrossRef Cavanagh, J.F., Frank, M.J.: Frontal theta as a mechanism of cognitive control. Trends Cogn. Sci. 18(8), 414–421 (2014)CrossRef
22.
Zurück zum Zitat Baka, E., Stavroulia, K.E., Magnenat-Thalmann, N., Lanitis, A.: An EEG-based evaluation for comparing the sense of presence between virtual and physical environments. In: Proceedings of Computer Graphics International (CGI 2018), 10 p. ACM, New York (2018) Baka, E., Stavroulia, K.E., Magnenat-Thalmann, N., Lanitis, A.: An EEG-based evaluation for comparing the sense of presence between virtual and physical environments. In: Proceedings of Computer Graphics International (CGI 2018), 10 p. ACM, New York (2018)
Metadaten
Titel
“Am I Talking to a Human or a Robot?”: A Preliminary Study of Human’s Perception in Human-Humanoid Interaction and Its Effects in Cognitive and Emotional States
verfasst von
Evangelia Baka
Ajay Vishwanath
Nidhi Mishra
Georgios Vleioras
Nadia Magnenat Thalmann
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-22514-8_20