Skip to main content

2020 | OriginalPaper | Buchkapitel

Developing a Multimodal Affect Assessment for Aviation Training

verfasst von : Tianshu Li, Imène Jraidi, Alejandra Ruiz Segura, Leo Holton, Susanne Lajoie

Erschienen in: Intelligent Tutoring Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper presents a multimodal affect assessment protocol developed for aviation training, which consists of physiological, behavioral measures of affect and subjective self-report of affective correlates. Data convergence is examined by comparing physiological and behavioral data output with self-report variables. We found significant correlations between arousal inferred from electro-dermal activity (EDA) and self-reported workload, fatigue and effort. We also found that the intensities of emotions inferred from facial expression correlate with self-reported variables. These findings support the validity of EDA and facial expression as measures of affect in aviation training context.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gross, J.J.: Emotion regulation: affective, cognitive, and social consequences. Psychophysiology 39(3), 281–291 (2002)CrossRef Gross, J.J.: Emotion regulation: affective, cognitive, and social consequences. Psychophysiology 39(3), 281–291 (2002)CrossRef
2.
Zurück zum Zitat Pekrun, R., Linnenbrink-Garcia, L.: Introduction to emotions in education. In: International Handbook of Emotions in Education, pp. 11–20. Routledge, Abingdon (2014) Pekrun, R., Linnenbrink-Garcia, L.: Introduction to emotions in education. In: International Handbook of Emotions in Education, pp. 11–20. Routledge, Abingdon (2014)
3.
Zurück zum Zitat Kaempf, G.L., Klein, G.: Aeronautical decision making: the next generation. In: Aviation Psychology in Practice, p. 223 (2017) Kaempf, G.L., Klein, G.: Aeronautical decision making: the next generation. In: Aviation Psychology in Practice, p. 223 (2017)
4.
Zurück zum Zitat Jensen, R.S.: Pilot Judgment and Crew Resource Management. Routledge, Abingdon (2017)CrossRef Jensen, R.S.: Pilot Judgment and Crew Resource Management. Routledge, Abingdon (2017)CrossRef
5.
Zurück zum Zitat Causse, M., et al.: The effects of emotion on pilot decision-making: a neuroergonomic approach to aviation safety. Transp. Res. Part C Emerg. Technol. 33, 272–281 (2013)CrossRef Causse, M., et al.: The effects of emotion on pilot decision-making: a neuroergonomic approach to aviation safety. Transp. Res. Part C Emerg. Technol. 33, 272–281 (2013)CrossRef
6.
Zurück zum Zitat Harley, J.M.: Measuring emotions: a survey of cutting edge methodologies used in computer-based learning environment research. In: Emotions, Technology, Design, and Learning, pp. 89–114. Elsevier (2016) Harley, J.M.: Measuring emotions: a survey of cutting edge methodologies used in computer-based learning environment research. In: Emotions, Technology, Design, and Learning, pp. 89–114. Elsevier (2016)
7.
Zurück zum Zitat Regula, M., et al.: Study of heart rate as the main stress indicator in aircraft pilots. In: Proceedings of ME 2014. IEEE (2014) Regula, M., et al.: Study of heart rate as the main stress indicator in aircraft pilots. In: Proceedings of ME 2014. IEEE (2014)
8.
Zurück zum Zitat Pekrun, R., Linnenbrink-Garcia, L.: International Handbook of Emotions in Education. Routledge, London (2014)CrossRef Pekrun, R., Linnenbrink-Garcia, L.: International Handbook of Emotions in Education. Routledge, London (2014)CrossRef
9.
Zurück zum Zitat Pekrun, R., Perry, R.P.: Control-value theory of achievement emotions. In: International Handbook of Emotions in Education, pp. 130–151. Routledge (2014) Pekrun, R., Perry, R.P.: Control-value theory of achievement emotions. In: International Handbook of Emotions in Education, pp. 130–151. Routledge (2014)
10.
Zurück zum Zitat Duffy, E.: Activation and Behavior. Wiley, New York (1962) Duffy, E.: Activation and Behavior. Wiley, New York (1962)
11.
Zurück zum Zitat Storbeck, J., Clore, G.L.: Affective arousal as information: how affective arousal influences judgments, learning, and memory. Soc. Pers. Psychol. Compass 2(5), 1824–1843 (2008)CrossRef Storbeck, J., Clore, G.L.: Affective arousal as information: how affective arousal influences judgments, learning, and memory. Soc. Pers. Psychol. Compass 2(5), 1824–1843 (2008)CrossRef
12.
Zurück zum Zitat Dettmers, S., et al.: Students’ emotions during homework in mathematics: testing a theoretical model of antecedents and achievement outcomes. Contemp. Educ. Psychol. 36(1), 25–35 (2011)CrossRef Dettmers, S., et al.: Students’ emotions during homework in mathematics: testing a theoretical model of antecedents and achievement outcomes. Contemp. Educ. Psychol. 36(1), 25–35 (2011)CrossRef
13.
Zurück zum Zitat D’Mello, S., et al.: Confusion can be beneficial for learning. Learn. Instr. 29, 153–170 (2014)CrossRef D’Mello, S., et al.: Confusion can be beneficial for learning. Learn. Instr. 29, 153–170 (2014)CrossRef
14.
Zurück zum Zitat Murray, P.S., Martin, W.L.: Beyond situational awareness: a skill set analysis for situational control. In: AAvPA Symposium, Sydney, Australia (2012) Murray, P.S., Martin, W.L.: Beyond situational awareness: a skill set analysis for situational control. In: AAvPA Symposium, Sydney, Australia (2012)
15.
Zurück zum Zitat Flin, R., et al.: Human factors in the development of complications of airway management: preliminary evaluation of an interview tool. Anaesthesia 68(8), 817–825 (2013)CrossRef Flin, R., et al.: Human factors in the development of complications of airway management: preliminary evaluation of an interview tool. Anaesthesia 68(8), 817–825 (2013)CrossRef
16.
Zurück zum Zitat Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Los Angeles (2006) Hart, S.G.: NASA-task load index (NASA-TLX); 20 years later. In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting. Sage Publications, Los Angeles (2006)
17.
Zurück zum Zitat Burnham, J.F.: Scopus database: a review. Biomed. Digit. Libr. 3(1), 1 (2006)CrossRef Burnham, J.F.: Scopus database: a review. Biomed. Digit. Libr. 3(1), 1 (2006)CrossRef
18.
Zurück zum Zitat Perry, R.P., et al.: Perceived academic control and failure in college students: a three-year study of scholastic attainment. Res. High. Educ. 46(5), 535–569 (2005)CrossRef Perry, R.P., et al.: Perceived academic control and failure in college students: a three-year study of scholastic attainment. Res. High. Educ. 46(5), 535–569 (2005)CrossRef
19.
Zurück zum Zitat Wigfield, A., Eccles, J.S.: Expectancy-value theory of achievement motivation. Contemp. Educ. Psychol. 25(1), 68–81 (2000)CrossRef Wigfield, A., Eccles, J.S.: Expectancy-value theory of achievement motivation. Contemp. Educ. Psychol. 25(1), 68–81 (2000)CrossRef
20.
Zurück zum Zitat Nittala, S.K., et al.: Pilot skill level and workload prediction for sliding-scale autonomy. In: 2018 17th IEEE (ICMLA). IEEE (2018) Nittala, S.K., et al.: Pilot skill level and workload prediction for sliding-scale autonomy. In: 2018 17th IEEE (ICMLA). IEEE (2018)
21.
Zurück zum Zitat Shiomi, K., Itano, K., Suzuki, A.: Development and evaluation of the fatigue and drowsiness predictor. In: Archives of 28th ICAS (2012) Shiomi, K., Itano, K., Suzuki, A.: Development and evaluation of the fatigue and drowsiness predictor. In: Archives of 28th ICAS (2012)
22.
Zurück zum Zitat D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012)CrossRef D’Mello, S., Graesser, A.: Dynamics of affective states during complex learning. Learn. Instr. 22(2), 145–157 (2012)CrossRef
24.
Zurück zum Zitat Braithwaite, J.J., et al.: A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49(1), 1017–1034 (2013) Braithwaite, J.J., et al.: A guide for analysing electrodermal activity (EDA) & skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49(1), 1017–1034 (2013)
25.
26.
Zurück zum Zitat Den Uyl, M., Van Kuilenburg, H.: The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior. Citeseer (2005) Den Uyl, M., Van Kuilenburg, H.: The FaceReader: online facial expression recognition. In: Proceedings of Measuring Behavior. Citeseer (2005)
27.
Zurück zum Zitat Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef
28.
Zurück zum Zitat Muis, K.R., et al.: The role of epistemic emotions in mathematics problem solving. Contemp. Educ. Psychol. 42, 172–185 (2015)CrossRef Muis, K.R., et al.: The role of epistemic emotions in mathematics problem solving. Contemp. Educ. Psychol. 42, 172–185 (2015)CrossRef
Metadaten
Titel
Developing a Multimodal Affect Assessment for Aviation Training
verfasst von
Tianshu Li
Imène Jraidi
Alejandra Ruiz Segura
Leo Holton
Susanne Lajoie
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-49663-0_5