Skip to main content

2019 | OriginalPaper | Buchkapitel

Exploring Novel Methodology for Classifying Cognitive Workload

verfasst von : Seth Siriya, Martin Lochner, Andreas Duenser, Ronnie Taib

Erschienen in: Intelligent Technologies for Interactive Entertainment

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper describes our work in extracting useful cognitive load classification information from a relatively simple and non-invasive physiological measurement technique, with application in a range of Human Factors and Human-Computer Interaction contexts. We employ novel methodologies, including signal processing, machine learning and genetic algorithms, to classify Galvanic Skin Response/Electrodermal Activity (GSR/EDA) signals during performance of a customised game task (UAV Defender) in high- and low-workload conditions. Our results reveal that Support Vector Machine Linear was the most successful technique for classifying the level of cognitive load that an operator is undergoing during easy, medium, and difficult operation conditions. This methodology has the advantage of applicability in critical task situations, where other cognitive load measurement methodologies are problematic due to sampling delay (e.g. questionnaires), or difficulty of implementation (e.g. other psych-physiological measures). A proposed cognitive load classification pipeline for real-time implementation and its use in human factors contexts is discussed.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ayaz, H., et al.: Cognitive workload assessment of air traffic controllers using optical brain imaging sensors. In: Rice, V. (ed.) Advances in Understanding Human Performance, vol. 20105280, pp. 21–31. CRC Press, Boca Raton (2010)CrossRef Ayaz, H., et al.: Cognitive workload assessment of air traffic controllers using optical brain imaging sensors. In: Rice, V. (ed.) Advances in Understanding Human Performance, vol. 20105280, pp. 21–31. CRC Press, Boca Raton (2010)CrossRef
2.
Zurück zum Zitat Baddeley, A.D.: Working memory. Science 255(556–559), 5044 (1992) Baddeley, A.D.: Working memory. Science 255(556–559), 5044 (1992)
4.
Zurück zum Zitat Cawley, G.C., Talbot, N.L.: On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Mach. Learn. Res. 11(Jul), 2079–2107 (2010)MathSciNetMATH Cawley, G.C., Talbot, N.L.: On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Mach. Learn. Res. 11(Jul), 2079–2107 (2010)MathSciNetMATH
5.
Zurück zum Zitat Dünser, A., Mancero, G.: The use of depth in change detection and multiple object tracking. Ergon. Open J. 2, 142–149 (2009)CrossRef Dünser, A., Mancero, G.: The use of depth in change detection and multiple object tracking. Ergon. Open J. 2, 142–149 (2009)CrossRef
6.
Zurück zum Zitat Bureau d’Enquetes et d’Analyses France (BEA): Final Report: Accident to Airbus A330–203 Registered F-GZCP, Air France AF 447 Rio de Janeiro - Paris, 1st June 2009. Technical report, Air Accident Investigation Unit (AAIU), October 2014. http://www.aaiu.ie/node/687 Bureau d’Enquetes et d’Analyses France (BEA): Final Report: Accident to Airbus A330–203 Registered F-GZCP, Air France AF 447 Rio de Janeiro - Paris, 1st June 2009. Technical report, Air Accident Investigation Unit (AAIU), October 2014. http://​www.​aaiu.​ie/​node/​687
8.
Zurück zum Zitat Healey, J., Picard, R.: SmartCar: detecting driver stress. In: Proceedings 15th International Conference on Pattern Recognition, ICPR-2000, vol. 4, pp. 218–221 (2000) Healey, J., Picard, R.: SmartCar: detecting driver stress. In: Proceedings 15th International Conference on Pattern Recognition, ICPR-2000, vol. 4, pp. 218–221 (2000)
9.
Zurück zum Zitat Hjorth, B.: EEG analysis based on time domain properties. Electroencephalogr. Clin. Neurophysiol. 29(3), 306–310 (1970)CrossRef Hjorth, B.: EEG analysis based on time domain properties. Electroencephalogr. Clin. Neurophysiol. 29(3), 306–310 (1970)CrossRef
10.
Zurück zum Zitat International Organization for Standardization: ISO 17488:2016(en), Road vehicles - transport information and control systems - detection-response task (DRT) for assessing attentional effects of cognitive load in driving. Technical Report ISO 17488:2016(en), International (2016) International Organization for Standardization: ISO 17488:2016(en), Road vehicles - transport information and control systems - detection-response task (DRT) for assessing attentional effects of cognitive load in driving. Technical Report ISO 17488:2016(en), International (2016)
11.
Zurück zum Zitat Lim, C.L., et al.: Decomposing skin conductance into tonic and phasic components. Int. J. Psychophysiol. 25(2), 97–109 (1997)CrossRef Lim, C.L., et al.: Decomposing skin conductance into tonic and phasic components. Int. J. Psychophysiol. 25(2), 97–109 (1997)CrossRef
12.
Zurück zum Zitat Lochner, M., Duenser, A., Lutzhoft, M., Brooks, B., Rozado, D.: Analysis of maritime team workload and communication dynamics in standard and emergency scenarios. J. Shipp. Trade 3(1), 2 (2018)CrossRef Lochner, M., Duenser, A., Lutzhoft, M., Brooks, B., Rozado, D.: Analysis of maritime team workload and communication dynamics in standard and emergency scenarios. J. Shipp. Trade 3(1), 2 (2018)CrossRef
13.
Zurück zum Zitat Lochner, M.J., Trick, L.M.: Multiple-object tracking while driving: the multiple-vehicle tracking task. Atten. Percept. Psychophys. 76, 2326–2345 (2014)CrossRef Lochner, M.J., Trick, L.M.: Multiple-object tracking while driving: the multiple-vehicle tracking task. Atten. Percept. Psychophys. 76, 2326–2345 (2014)CrossRef
15.
Zurück zum Zitat Phinyomark, A., Thongpanja, S., Hu, H., Phukpattaranont, P., Limsakul, C.: The usefulness of mean and median frequencies in electromyography analysis. In: Naik, G.R. (ed.) Computational Intelligence in Electromyography Analysis - A Perspective on Current Applications and Future Challenges. INTECH Open Access Publisher (2012). https://doi.org/10.5772/50639 Phinyomark, A., Thongpanja, S., Hu, H., Phukpattaranont, P., Limsakul, C.: The usefulness of mean and median frequencies in electromyography analysis. In: Naik, G.R. (ed.) Computational Intelligence in Electromyography Analysis - A Perspective on Current Applications and Future Challenges. INTECH Open Access Publisher (2012). https://​doi.​org/​10.​5772/​50639
16.
Zurück zum Zitat Posada-Quintero, H.F., Chon, K.H.: Frequency-domain electrodermal activity index of sympathetic function. In: 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), pp. 497–500, Febraury 2016 Posada-Quintero, H.F., Chon, K.H.: Frequency-domain electrodermal activity index of sympathetic function. In: 2016 IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI), pp. 497–500, Febraury 2016
17.
Zurück zum Zitat Pylyshyn, Z.W., Storm, R.W.: Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spat. Vis. 3(3), 179–197 (1988)CrossRef Pylyshyn, Z.W., Storm, R.W.: Tracking multiple independent targets: evidence for a parallel tracking mechanism. Spat. Vis. 3(3), 179–197 (1988)CrossRef
18.
Zurück zum Zitat Rozado, D., Duenser, A.: Combining EEG with pupillometry to improve cognitive workload detection. IEEE Comput. 48(10), 18–25 (2015)CrossRef Rozado, D., Duenser, A.: Combining EEG with pupillometry to improve cognitive workload detection. IEEE Comput. 48(10), 18–25 (2015)CrossRef
19.
Zurück zum Zitat Rozado, D., Lochner, M., Engelke, U., Duenser, A.: Detecting intention through motor-imagery-triggered pupil dilations. Hum.-Comput. Inter., 1–31, Febraury 2017 Rozado, D., Lochner, M., Engelke, U., Duenser, A.: Detecting intention through motor-imagery-triggered pupil dilations. Hum.-Comput. Inter., 1–31, Febraury 2017
20.
Zurück zum Zitat Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic skin response (GSR) as an index of cognitive load. In: CHI 2007 Extended Abstracts, pp. 2651–2656. ACM, New York, April 2007 Shi, Y., Ruiz, N., Taib, R., Choi, E., Chen, F.: Galvanic skin response (GSR) as an index of cognitive load. In: CHI 2007 Extended Abstracts, pp. 2651–2656. ACM, New York, April 2007
21.
Zurück zum Zitat Uguz, H.: A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm. Knowl.-Based Syst. 24(7), 1024–1032 (2011)CrossRef Uguz, H.: A two-stage feature selection method for text categorization by using information gain, principal component analysis and genetic algorithm. Knowl.-Based Syst. 24(7), 1024–1032 (2011)CrossRef
22.
Zurück zum Zitat Welch, P.: The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15(2), 70–73 (1967)CrossRef Welch, P.: The use of fast Fourier transform for the estimation of power spectra: a method based on time averaging over short, modified periodograms. IEEE Trans. Audio Electroacoust. 15(2), 70–73 (1967)CrossRef
23.
Zurück zum Zitat Wilson, G.F., Fullenkamp, P., Davis, I.: Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. Aviat. Space Environ. Med. 65(2), 100–105 (1994) Wilson, G.F., Fullenkamp, P., Davis, I.: Evoked potential, cardiac, blink, and respiration measures of pilot workload in air-to-ground missions. Aviat. Space Environ. Med. 65(2), 100–105 (1994)
24.
Zurück zum Zitat Zhou, J., Sun, J., Chen, F., Wang, Y., Taib, R., Khawaji, A., Li, Z.: Measurable decision making with GSR and pupillary analysis for intelligent user interface. ACM Trans. Comput.-Hum. Interact. 21(6), 1–23 (2015)CrossRef Zhou, J., Sun, J., Chen, F., Wang, Y., Taib, R., Khawaji, A., Li, Z.: Measurable decision making with GSR and pupillary analysis for intelligent user interface. ACM Trans. Comput.-Hum. Interact. 21(6), 1–23 (2015)CrossRef
Metadaten
Titel
Exploring Novel Methodology for Classifying Cognitive Workload
verfasst von
Seth Siriya
Martin Lochner
Andreas Duenser
Ronnie Taib
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-16447-8_11

Premium Partner