Skip to main content
Erschienen in: International Journal of Social Robotics 1/2020

01.03.2019

Cognitive Performance and Physiological Response Analysis

Analysis of the Variation of Physiological Parameters Based on User’s Personality, Sensory Profile, and Morningness–Eveningness Type in a Human–Robot Interaction Scenario

verfasst von: Roxana Agrigoroaie, Adriana Tapus

Erschienen in: International Journal of Social Robotics | Ausgabe 1/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For more socially natural interactions between robots and humans there is a need for the robots to detect and understand the current internal state of the individuals they interact with. In this paper, we investigate the impact of personality, user sensory profile, and morningness–eveningness type of an individual on the variation of different physiological parameters (i.e., blinking, galvanic skin response, facial temperature variation), as well as the performance in a non-verbal word-color Stroop task. The TIAGo humanoid robot displayed two interaction styles that are based on visual and auditory stimuli. The visual and auditory stimuli used by the robot are in accordance with the user sensory profile. We report the results of a within participants study carried out with 24 participants. Our results show that personality, user sensory profile, and morningness–eveningness type have an impact on the variation of the chosen physiological parameters. Furthermore, the interaction style of the robot has an influence on the variation of the physiological parameters.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdelrahman Y, Velloso E, Dingler T, Schmidt A, Vetere F (2017) Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. Proc ACM Interact Mob Wearable Ubiquitous Technol 1(3):33CrossRef Abdelrahman Y, Velloso E, Dingler T, Schmidt A, Vetere F (2017) Cognitive heat: exploring the usage of thermal imaging to unobtrusively estimate cognitive load. Proc ACM Interact Mob Wearable Ubiquitous Technol 1(3):33CrossRef
2.
Zurück zum Zitat Adan A (1991) Influence of morningness-eveningness preference in the relationship between body temperature and performance: a diurnal study. Pers Individ Dif 12(11):1159–1169CrossRef Adan A (1991) Influence of morningness-eveningness preference in the relationship between body temperature and performance: a diurnal study. Pers Individ Dif 12(11):1159–1169CrossRef
3.
Zurück zum Zitat Adan A, Archer SN, Hidalgo MP, Di Milia L, Natale V, Randler C (2012) Circadian typology: a comprehensive review. Chronobiol Int 29(9):1153–1175CrossRef Adan A, Archer SN, Hidalgo MP, Di Milia L, Natale V, Randler C (2012) Circadian typology: a comprehensive review. Chronobiol Int 29(9):1153–1175CrossRef
4.
Zurück zum Zitat Agrigoroaie R, Tapus A (2017) Contactless physiological data analysis for user quality of life improving by using a humanoid social robot. In: International conference on image analysis and processing, pp 696–706 Agrigoroaie R, Tapus A (2017) Contactless physiological data analysis for user quality of life improving by using a humanoid social robot. In: International conference on image analysis and processing, pp 696–706
5.
Zurück zum Zitat Agrigoroaie R, Tapus A (2017) Influence of robot’s interaction style on performance in a stroop task. In: International conference on social robotics Agrigoroaie R, Tapus A (2017) Influence of robot’s interaction style on performance in a stroop task. In: International conference on social robotics
6.
Zurück zum Zitat Agrigoroaie R, Tapus A (2018) ’oh! i am so sorry!’: understanding user physiological variation while spoiling a game task. In: IROS Agrigoroaie R, Tapus A (2018) ’oh! i am so sorry!’: understanding user physiological variation while spoiling a game task. In: IROS
7.
Zurück zum Zitat Bandura A (1999) Social cognitive theory of personality. In: Pervin LA, John OP (eds) Handbook of personality: theory and research. Elsevier, Amsterdam pp 154–196 Bandura A (1999) Social cognitive theory of personality. In: Pervin LA, John OP (eds) Handbook of personality: theory and research. Elsevier, Amsterdam pp 154–196
8.
Zurück zum Zitat Bandura A, Jourden FJ (1991) Self-regulatory mechanisms governing the impact of social comparison on complex decision making. J Pers Soc Psychol 60(6):941CrossRef Bandura A, Jourden FJ (1991) Self-regulatory mechanisms governing the impact of social comparison on complex decision making. J Pers Soc Psychol 60(6):941CrossRef
9.
Zurück zum Zitat Bellotto N, Fernandez-Carmona M, Cosar S, et al. (2017) Enrichme integration of ambient intelligence and robotics for aal. In: AAAI spring symposium series, AAAI Bellotto N, Fernandez-Carmona M, Cosar S, et al. (2017) Enrichme integration of ambient intelligence and robotics for aal. In: AAAI spring symposium series, AAAI
10.
Zurück zum Zitat Bentivoglio AR et al (1997) Analysis of blink rate patterns in normal subjects. Mov Disord 12(6):1028–1034CrossRef Bentivoglio AR et al (1997) Analysis of blink rate patterns in normal subjects. Mov Disord 12(6):1028–1034CrossRef
11.
Zurück zum Zitat Brown C, Dunn W (2002) Adult/adolescent sensory profile: self questionnaire. Pearson Clinical, Bengaluru Brown C, Dunn W (2002) Adult/adolescent sensory profile: self questionnaire. Pearson Clinical, Bengaluru
12.
Zurück zum Zitat Brown C, Tollefson N, Dunn W, Cromwell R, Filion D (2001) The adult sensory profile: measuring patterns of sensory processing. Am J Occup Ther 55(1):75–82CrossRef Brown C, Tollefson N, Dunn W, Cromwell R, Filion D (2001) The adult sensory profile: measuring patterns of sensory processing. Am J Occup Ther 55(1):75–82CrossRef
13.
Zurück zum Zitat Campagne A, Pebayle T, Muzet A (2005) Oculomotor changes due to road events during prolonged monotonous simulated driving. Biol Psychol 68(3):353–368CrossRef Campagne A, Pebayle T, Muzet A (2005) Oculomotor changes due to road events during prolonged monotonous simulated driving. Biol Psychol 68(3):353–368CrossRef
14.
Zurück zum Zitat Cassell J, Bickmore T (2000) External manifestations of trustworthiness in the interface. Commun ACM 43(12):50–56CrossRef Cassell J, Bickmore T (2000) External manifestations of trustworthiness in the interface. Commun ACM 43(12):50–56CrossRef
15.
Zurück zum Zitat Charles RL, Nixon J (2019) Measuring mental workload using physiological measures: a systematic review. Appl Ergon 74:221–232CrossRef Charles RL, Nixon J (2019) Measuring mental workload using physiological measures: a systematic review. Appl Ergon 74:221–232CrossRef
16.
Zurück zum Zitat Corr P, Cooper A (2016) The reinforcement sensitivity theory of personality questionnaire: development and validation. Psychol Assess 28(11):1427CrossRef Corr P, Cooper A (2016) The reinforcement sensitivity theory of personality questionnaire: development and validation. Psychol Assess 28(11):1427CrossRef
17.
Zurück zum Zitat Cruz-Maya A, Tapus A (2018) Negotiating with a robot: analysis of regulatory focus behavior. In: Proceedings of the IEEE international conference on robotics and automation Cruz-Maya A, Tapus A (2018) Negotiating with a robot: analysis of regulatory focus behavior. In: Proceedings of the IEEE international conference on robotics and automation
18.
Zurück zum Zitat Dunn W (1997) The impact of sensory processing abilities on the daily lives of young children and their families: a conceptual model. Infants Young Child 9:23–35CrossRef Dunn W (1997) The impact of sensory processing abilities on the daily lives of young children and their families: a conceptual model. Infants Young Child 9:23–35CrossRef
19.
Zurück zum Zitat Ehrlich S, Wykowska A, Ramirez-Amaro K, Cheng G (2014) When to engage in interaction and how? eeg-based enhancement of robot’s ability to sense social signals in hri. In: 2014 14th IEEE-RAS international conference on humanoid robots (humanoids), IEEE, pp 1104–1109 Ehrlich S, Wykowska A, Ramirez-Amaro K, Cheng G (2014) When to engage in interaction and how? eeg-based enhancement of robot’s ability to sense social signals in hri. In: 2014 14th IEEE-RAS international conference on humanoid robots (humanoids), IEEE, pp 1104–1109
20.
Zurück zum Zitat Eysenck H (1967) The biological basis of personality. Taylor & Francis Springfield Eysenck H (1967) The biological basis of personality. Taylor & Francis Springfield
21.
Zurück zum Zitat Eysenck H (1983) Psychophysiology and personality: extraversion, neuroticism and psychoticism. Physiol Correl Hum behav 3:13–30 Eysenck H (1983) Psychophysiology and personality: extraversion, neuroticism and psychoticism. Physiol Correl Hum behav 3:13–30
22.
Zurück zum Zitat Eysenck HJ (1991) Dimensions of personality: 16, 5 or 3?–criteria for a taxonomic paradigm. Pers Individ Dif 12(8):773–790CrossRef Eysenck HJ (1991) Dimensions of personality: 16, 5 or 3?–criteria for a taxonomic paradigm. Pers Individ Dif 12(8):773–790CrossRef
23.
Zurück zum Zitat Eysenck HJ, Eysenck SBG (1975) Manual of the eysenck personality questionnaire (junior and adult). Hodder and Stoughton, London Eysenck HJ, Eysenck SBG (1975) Manual of the eysenck personality questionnaire (junior and adult). Hodder and Stoughton, London
24.
Zurück zum Zitat Fukuda K (2001) Eye blinks: new indices for the detection of deception. Int J Psychophysiol 40(3):239–245CrossRef Fukuda K (2001) Eye blinks: new indices for the detection of deception. Int J Psychophysiol 40(3):239–245CrossRef
25.
Zurück zum Zitat Goldberg L (1990) An alternative ‘description of personality’: the big-five factor structure. J Pers Soc Psychol 59(6):1216CrossRef Goldberg L (1990) An alternative ‘description of personality’: the big-five factor structure. J Pers Soc Psychol 59(6):1216CrossRef
26.
Zurück zum Zitat Gray J, McNaughton N (2000) The neuropsychology of anxiety: an enquiry into the functions of the septo-hippocampal system, 2nd edn. Oxford University Press, New York Gray J, McNaughton N (2000) The neuropsychology of anxiety: an enquiry into the functions of the septo-hippocampal system, 2nd edn. Oxford University Press, New York
27.
Zurück zum Zitat Hall ET (1990) The hidden dimension. Bantam Doubleday Dell Publishing Group Inc, p 217 Hall ET (1990) The hidden dimension. Bantam Doubleday Dell Publishing Group Inc, p 217
28.
Zurück zum Zitat Horne J, Ostberg O (1976) A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. Int J Chronobiol 4(2):97–110 Horne J, Ostberg O (1976) A self-assessment questionnaire to determine morningness-eveningness in human circadian rhythms. Int J Chronobiol 4(2):97–110
29.
Zurück zum Zitat Ioannou S, Morris P, Mercer H, Baker M, Gallese V, Reddy V (2014) Proximity and gaze influences facial temperature: a thermal infrared imaging study. Front Psychol 5:845CrossRef Ioannou S, Morris P, Mercer H, Baker M, Gallese V, Reddy V (2014) Proximity and gaze influences facial temperature: a thermal infrared imaging study. Front Psychol 5:845CrossRef
30.
Zurück zum Zitat Kahneman D (1973) Attention and effort. Prentice-Hall, New Jersey Kahneman D (1973) Attention and effort. Prentice-Hall, New Jersey
31.
Zurück zum Zitat Kramer AF (1991) Physiological metrics of mental workload: a review of recent progress. Mult Task Perform pp 279–328 Kramer AF (1991) Physiological metrics of mental workload: a review of recent progress. Mult Task Perform pp 279–328
32.
Zurück zum Zitat Liu C, et.al. (2008) Online affect detection and robot behavior adaptation for intervention of children with autism. In: IEEE transactions on robotics Liu C, et.al. (2008) Online affect detection and robot behavior adaptation for intervention of children with autism. In: IEEE transactions on robotics
33.
Zurück zum Zitat MacLeod C (1991) Half a century of research on the stroop effect: an integrative review. Psychol Bull 109(2):163CrossRef MacLeod C (1991) Half a century of research on the stroop effect: an integrative review. Psychol Bull 109(2):163CrossRef
34.
Zurück zum Zitat Mitsunaga N et al (2006) Robot behavior adaptation for hri based on policy gradient reinforcement learning. J Robot Soc Jpn 24(7):820–829CrossRef Mitsunaga N et al (2006) Robot behavior adaptation for hri based on policy gradient reinforcement learning. J Robot Soc Jpn 24(7):820–829CrossRef
35.
Zurück zum Zitat Mower E, Feil-Seifer DJ, Mataric MJ, Narayanan S (2007) Investigating implicit cues for user state estimation in human–robot interaction using physiological measurements. In: RO-MAN 2007-The 16th IEEE international symposium on robot and human interactive communication, IEEE, pp 1125–1130 Mower E, Feil-Seifer DJ, Mataric MJ, Narayanan S (2007) Investigating implicit cues for user state estimation in human–robot interaction using physiological measurements. In: RO-MAN 2007-The 16th IEEE international symposium on robot and human interactive communication, IEEE, pp 1125–1130
36.
Zurück zum Zitat Nakatsu R (1998) Toward the creation of a new medium for the multimedia era. Proc IEEE 86(5):825–836CrossRef Nakatsu R (1998) Toward the creation of a new medium for the multimedia era. Proc IEEE 86(5):825–836CrossRef
37.
Zurück zum Zitat Nourbakhsh N, Chen F, Wang Y, Calvo RA (2017) Detecting users cognitive load by galvanic skin response with affective interference. ACM Trans Interact Intell Syst 7(3):12:1–12:20CrossRef Nourbakhsh N, Chen F, Wang Y, Calvo RA (2017) Detecting users cognitive load by galvanic skin response with affective interference. ACM Trans Interact Intell Syst 7(3):12:1–12:20CrossRef
38.
Zurück zum Zitat Nourbakhsh N, Wang Y, Chen F (2013) Gsr and blink features for cognitive load classification. In: IFIP conference on human–computer interaction. Springer, pp 159–166 Nourbakhsh N, Wang Y, Chen F (2013) Gsr and blink features for cognitive load classification. In: IFIP conference on human–computer interaction. Springer, pp 159–166
39.
Zurück zum Zitat Nourbakhsh N, Wang Y, Chen F, Calvo RA (2012) Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks. In: Proceedings of the 24th Australian computer–human interaction conference, ACM Nourbakhsh N, Wang Y, Chen F, Calvo RA (2012) Using galvanic skin response for cognitive load measurement in arithmetic and reading tasks. In: Proceedings of the 24th Australian computer–human interaction conference, ACM
40.
Zurück zum Zitat Or CK, Duffy VG (2007) Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occup Ergon 7(2):83–94 Or CK, Duffy VG (2007) Development of a facial skin temperature-based methodology for non-intrusive mental workload measurement. Occup Ergon 7(2):83–94
41.
Zurück zum Zitat Paas FG, Van Merriënboer JJ (1993) The efficiency of instructional conditions: an approach to combine mental effort and performance measures. Hum Factors 35(4):737–743CrossRef Paas FG, Van Merriënboer JJ (1993) The efficiency of instructional conditions: an approach to combine mental effort and performance measures. Hum Factors 35(4):737–743CrossRef
42.
Zurück zum Zitat Pages J, Marchionni L, Ferro F (2016) Tiago: the modular robot that adapts to different research needs. In: International workshop on robot modularity, IROS Pages J, Marchionni L, Ferro F (2016) Tiago: the modular robot that adapts to different research needs. In: International workshop on robot modularity, IROS
43.
Zurück zum Zitat Randler C (2008) Differences between smokers and nonsmokers in morningness–eveningness. Soc Behav Pers 36(5):673–80CrossRef Randler C (2008) Differences between smokers and nonsmokers in morningness–eveningness. Soc Behav Pers 36(5):673–80CrossRef
44.
Zurück zum Zitat Reeves B, Nass CI (1996) The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, Cambridge Reeves B, Nass CI (1996) The media equation: how people treat computers, television, and new media like real people and places. Cambridge University Press, Cambridge
45.
Zurück zum Zitat Renaud P, Blondin JP (1997) The stress of stroop performance: physiological and emotional responses to color-word interference, task pacing, and pacing speed. Int J Psychophysiol 27(2):87–97CrossRef Renaud P, Blondin JP (1997) The stress of stroop performance: physiological and emotional responses to color-word interference, task pacing, and pacing speed. Int J Psychophysiol 27(2):87–97CrossRef
46.
Zurück zum Zitat Setz C, Arnrich B, Schumm J, La Marca R, Tröster G, Ehlert U (2010) Discriminating stress from cognitive load using a wearable eda device. IEEE Trans Inf Technol Biomed 14(2):410–417CrossRef Setz C, Arnrich B, Schumm J, La Marca R, Tröster G, Ehlert U (2010) Discriminating stress from cognitive load using a wearable eda device. IEEE Trans Inf Technol Biomed 14(2):410–417CrossRef
47.
Zurück zum Zitat Shi Y, Ruiz N, Taib R, Choi E, Chen F (2007) Galvanic skin response (gsr) as an index of cognitive load. In: Begole B, Payne S, Churchill E, Amant RS, Gilmore D, Rosson MB (eds) CHI’07 extended abstracts on human factors in computing systems, ACM, NY, pp 2651–2656 Shi Y, Ruiz N, Taib R, Choi E, Chen F (2007) Galvanic skin response (gsr) as an index of cognitive load. In: Begole B, Payne S, Churchill E, Amant RS, Gilmore D, Rosson MB (eds) CHI’07 extended abstracts on human factors in computing systems, ACM, NY, pp 2651–2656
48.
Zurück zum Zitat Sorostinean M, Ferland F, Tapus A (2015) Reliable stress measurement using face temperature variation with a thermal camera in human–robot interaction. In: 15th IEEE-RAS international conference on humanoid robots Sorostinean M, Ferland F, Tapus A (2015) Reliable stress measurement using face temperature variation with a thermal camera in human–robot interaction. In: 15th IEEE-RAS international conference on humanoid robots
49.
Zurück zum Zitat Sprent P, Smeeton NC (2000) Applied nonparametric statistical methods. Chapman and Hall/CRC, Santa ClaritaCrossRef Sprent P, Smeeton NC (2000) Applied nonparametric statistical methods. Chapman and Hall/CRC, Santa ClaritaCrossRef
50.
Zurück zum Zitat Stelmack RM (1981) The psychophysiology of extraversion and neuroticism. Springer, Berlin, pp 38–64 Stelmack RM (1981) The psychophysiology of extraversion and neuroticism. Springer, Berlin, pp 38–64
51.
Zurück zum Zitat Stern JA, Walrath LC, Goldstein R (1984) The endogenous eyeblink. Psychophysiology 21(1):22–33CrossRef Stern JA, Walrath LC, Goldstein R (1984) The endogenous eyeblink. Psychophysiology 21(1):22–33CrossRef
52.
Zurück zum Zitat Stroop J (1935) Studies of interference in serial verbal reactions. J Explor Psychol 18(6):643CrossRef Stroop J (1935) Studies of interference in serial verbal reactions. J Explor Psychol 18(6):643CrossRef
53.
Zurück zum Zitat Svetlak M et al (2010) Electrodermal complexity during the stroop colour word test. Auton Neurosci 152(1–2):101–107CrossRef Svetlak M et al (2010) Electrodermal complexity during the stroop colour word test. Auton Neurosci 152(1–2):101–107CrossRef
54.
Zurück zum Zitat Tanaka Y, Yamaoka K (1993) Blink activity and task difficulty. Percept Mot Skills 77(1):55–66CrossRef Tanaka Y, Yamaoka K (1993) Blink activity and task difficulty. Percept Mot Skills 77(1):55–66CrossRef
55.
Zurück zum Zitat Tapus A, Tapus C, Mataric MJ (2007) Hands-off therapist robot behavior adaptation to user personality for post-stroke rehabilitation therapy. In: 2007 IEEE international conference on robotics and automation Tapus A, Tapus C, Mataric MJ (2007) Hands-off therapist robot behavior adaptation to user personality for post-stroke rehabilitation therapy. In: 2007 IEEE international conference on robotics and automation
56.
Zurück zum Zitat Tulen J et al (1989) Characterization of stress reactions to the stroop color word test. Pharmacol Biochem Behav 32(1):9–15CrossRef Tulen J et al (1989) Characterization of stress reactions to the stroop color word test. Pharmacol Biochem Behav 32(1):9–15CrossRef
57.
Zurück zum Zitat Walters M, et.al. (2005) The influence of subjects’ personality traits on personal spatial zones in a human–robot interaction experiment. In: IEEE international workshop on robot and human interactive communication Walters M, et.al. (2005) The influence of subjects’ personality traits on personal spatial zones in a human–robot interaction experiment. In: IEEE international workshop on robot and human interactive communication
58.
Zurück zum Zitat Yanco HA, Drury JL, Scholtz J (2004) Beyond usability evaluation: analysis of human–robot interaction at a major robotics competition. Hum Comput Interact 19(1–2):117–149CrossRef Yanco HA, Drury JL, Scholtz J (2004) Beyond usability evaluation: analysis of human–robot interaction at a major robotics competition. Hum Comput Interact 19(1–2):117–149CrossRef
Metadaten
Titel
Cognitive Performance and Physiological Response Analysis
Analysis of the Variation of Physiological Parameters Based on User’s Personality, Sensory Profile, and Morningness–Eveningness Type in a Human–Robot Interaction Scenario
verfasst von
Roxana Agrigoroaie
Adriana Tapus
Publikationsdatum
01.03.2019
Verlag
Springer Netherlands
Erschienen in
International Journal of Social Robotics / Ausgabe 1/2020
Print ISSN: 1875-4791
Elektronische ISSN: 1875-4805
DOI
https://doi.org/10.1007/s12369-019-00532-z

Weitere Artikel der Ausgabe 1/2020

International Journal of Social Robotics 1/2020 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.