Skip to main content

2020 | OriginalPaper | Buchkapitel

Machine Learning for Cognitive Load Classification – A Case Study on Contact-Free Approach

verfasst von : Mobyen Uddin Ahmed, Shahina Begum, Rikard Gestlöf, Hamidur Rahman, Johannes Sörman

Erschienen in: Artificial Intelligence Applications and Innovations

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The most common ways of measuring Cognitive Load (CL) is using physiological sensor signals e.g., Electroencephalography (EEG), or Electrocardiogram (ECG). However, these signals are problematic in situations e.g., in dynamic moving environments where the user cannot relax with all the sensors attached to the body and it provides significant noises in the signals. This paper presents a case study using a contact-free approach for CL classification based on Heart Rate Variability (HRV) collected from ECG signal. Here, a contact-free approach i.e., a camera-based system is compared with a contact-based approach i.e., Shimmer GSR+ system in detecting CL. To classify CL, two different Machine Learning (ML) algorithms, mainly, Support Vector Machine (SVM) and k-Nearest-Neighbor (k-NN) have been applied. Based on the gathered Inter-Beat-Interval (IBI) values from both the systems, 13 different HRV features were extracted in a controlled study to determine three levels of CL i.e., S0: low CL, S1: normal CL and S2: high CL. To get the best classification accuracy with the ML algorithms, different optimizations such as kernel functions were chosen with different feature matrices both for binary and combined class classifications. According to the results, the highest average classification accuracy was achieved as 84% on the binary classification i.e. S0 vs S2 using k-NN. The highest F1 score was achieved 88% using SVM for the combined class considering S0 vs (S1 and S2) for contact-free approach i.e. the camera system. Thus, all the ML algorithms achieved a higher classification accuracy while considering the contact-free approach than contact-based approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Kim, J.-P., Lee, S.-W.: Time domain EEG analysis for evaluating the effects of driver’s mental work load during simulated driving, pp. 79–80 (2017) Kim, J.-P., Lee, S.-W.: Time domain EEG analysis for evaluating the effects of driver’s mental work load during simulated driving, pp. 79–80 (2017)
2.
Zurück zum Zitat Miyaji, M., Kawanaka, H., Oguri, K.: Study on effect of adding pupil diameter as recognition features for driver’s cognitive distraction detection. In: 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010), pp. 406–411 (2010) Miyaji, M., Kawanaka, H., Oguri, K.: Study on effect of adding pupil diameter as recognition features for driver’s cognitive distraction detection. In: 2010 7th International Symposium on Communication Systems, Networks & Digital Signal Processing (CSNDSP 2010), pp. 406–411 (2010)
3.
Zurück zum Zitat Road Safety Annual Report 2019. OECD Publishing, Paris, OECD/ITF (2019) Road Safety Annual Report 2019. OECD Publishing, Paris, OECD/ITF (2019)
4.
Zurück zum Zitat Sena, P., d’Amore, M., Pappalardo, M., Pellegrino, A., Fiorentino, A., Villecco, F.: Studying the influence of cognitive load on driver’s performances by a Fuzzy analysis of Lane Keeping in a drive simulation. IFAC Proc. 46(21), 151–156 (2013)CrossRef Sena, P., d’Amore, M., Pappalardo, M., Pellegrino, A., Fiorentino, A., Villecco, F.: Studying the influence of cognitive load on driver’s performances by a Fuzzy analysis of Lane Keeping in a drive simulation. IFAC Proc. 46(21), 151–156 (2013)CrossRef
5.
Zurück zum Zitat Palinko, O., Kun, A.L., Shyrokov, A., Heeman, P.: Estimating cognitive load using remote eye tracking in a driving simulator. Presented at the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, Austin, Texas (2010). https://doi.org/10.1145/1743666.1743701 Palinko, O., Kun, A.L., Shyrokov, A., Heeman, P.: Estimating cognitive load using remote eye tracking in a driving simulator. Presented at the Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, Austin, Texas (2010). https://​doi.​org/​10.​1145/​1743666.​1743701
6.
Zurück zum Zitat Kumar, N., Kumar, J.: Measurement of cognitive load in HCI systems using EEG power spectrum: an experimental study. Procedia Comput. Sci. 84, 70–78 (2016)CrossRef Kumar, N., Kumar, J.: Measurement of cognitive load in HCI systems using EEG power spectrum: an experimental study. Procedia Comput. Sci. 84, 70–78 (2016)CrossRef
7.
Zurück zum Zitat Reimer, B., Mehler, B., Coughlin, J., Godfrey, K., Tan, C.: An on-road assessment of the impact of cognitive workload on physiological arousal in young adult drivers, pp. 115–118 (2009) Reimer, B., Mehler, B., Coughlin, J., Godfrey, K., Tan, C.: An on-road assessment of the impact of cognitive workload on physiological arousal in young adult drivers, pp. 115–118 (2009)
8.
Zurück zum Zitat Zander, T.O.: Evaluation of a dry eeg system for application of passive brain-computer interfaces in autonomous driving. Front. Hum. Neurosci. 11, 78 (2017). (in English)CrossRef Zander, T.O.: Evaluation of a dry eeg system for application of passive brain-computer interfaces in autonomous driving. Front. Hum. Neurosci. 11, 78 (2017). (in English)CrossRef
10.
Zurück zum Zitat McDuff, D., Gontarek, S., Picard, R.: Remote measurement of cognitive stress via heart rate variability. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014, vol. 2014, pp. 2957–2960 (2014) McDuff, D., Gontarek, S., Picard, R.: Remote measurement of cognitive stress via heart rate variability. In: 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBC 2014, vol. 2014, pp. 2957–2960 (2014)
11.
Zurück zum Zitat Sahadat, M.N., Consul-Pacareu, S., Morshed, B.I.: Wireless ambulatory ECG signal capture for HRV and cognitive load study using the NeuroMonitor platform. In: 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER), pp. 497–500 (2013) Sahadat, M.N., Consul-Pacareu, S., Morshed, B.I.: Wireless ambulatory ECG signal capture for HRV and cognitive load study using the NeuroMonitor platform. In: 2013 6th International IEEE/EMBS Conference on Neural Engineering (NER), pp. 497–500 (2013)
12.
Zurück zum Zitat Shaffer, F., Ginsberg, J.P.: An overview of heart rate variability metrics and norms. Front. Pub. Health 5, 258 (2017). (in English)CrossRef Shaffer, F., Ginsberg, J.P.: An overview of heart rate variability metrics and norms. Front. Pub. Health 5, 258 (2017). (in English)CrossRef
13.
Zurück zum Zitat Hussain, S., Chen, S., Calvo, R., Chen, F.: Classification of cognitive load from task performance & multichannel physiology during affective changes (2007) Hussain, S., Chen, S., Calvo, R., Chen, F.: Classification of cognitive load from task performance & multichannel physiology during affective changes (2007)
14.
Zurück zum Zitat Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Conference on Human Factors in Computing Systems – Proceedings (2014) Solovey, E.T., Zec, M., Garcia Perez, E.A., Reimer, B., Mehler, B.: Classifying driver workload using physiological and driving performance data: two field studies. In: Conference on Human Factors in Computing Systems – Proceedings (2014)
15.
Zurück zum Zitat Engström, J., Johansson, E., Östlund, J.: Effects of visual and cognitive load in real and simulated motorway driving. Transp. Res. Part F: Traffic Psychol. Behav. 8(2), 97–120 (2005)CrossRef Engström, J., Johansson, E., Östlund, J.: Effects of visual and cognitive load in real and simulated motorway driving. Transp. Res. Part F: Traffic Psychol. Behav. 8(2), 97–120 (2005)CrossRef
16.
Zurück zum Zitat Reimer, B., Mehler, B.: The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation. Ergonomics 54, 932–942 (2011)CrossRef Reimer, B., Mehler, B.: The impact of cognitive workload on physiological arousal in young adult drivers: a field study and simulation validation. Ergonomics 54, 932–942 (2011)CrossRef
17.
Zurück zum Zitat Liu, A., Chen, C.: Towards practical driver cognitive load detection based on visual attention information. Masters of Science, University of Toronto, Canada (2017) Liu, A., Chen, C.: Towards practical driver cognitive load detection based on visual attention information. Masters of Science, University of Toronto, Canada (2017)
18.
Zurück zum Zitat Wang, C., Guo, J.: A data-driven framework for learners’ cognitive load detection using ECG-PPG physiological feature fusion and XGBoost classification. Procedia Comput. Sci 147, 338–348 (2019)CrossRef Wang, C., Guo, J.: A data-driven framework for learners’ cognitive load detection using ECG-PPG physiological feature fusion and XGBoost classification. Procedia Comput. Sci 147, 338–348 (2019)CrossRef
19.
Zurück zum Zitat Sörman, J., Gestlöf, R.: Contact-free cognitive load classification based on psycho-physiological parameters. Bachelor of Science, Mälardalen University, Sweden (2019) Sörman, J., Gestlöf, R.: Contact-free cognitive load classification based on psycho-physiological parameters. Bachelor of Science, Mälardalen University, Sweden (2019)
20.
Zurück zum Zitat Rahman, H., Begum, S., Ahmed, M.U., Funk, P.: Real time heart rate monitoring from facial RGB color video using Webcam. In: 29th Annual Workshop of the Swedish Artificial Intelligence Society (SAIS) 2016, Malmö, Sweden (2016) Rahman, H., Begum, S., Ahmed, M.U., Funk, P.: Real time heart rate monitoring from facial RGB color video using Webcam. In: 29th Annual Workshop of the Swedish Artificial Intelligence Society (SAIS) 2016, Malmö, Sweden (2016)
21.
Zurück zum Zitat Buijs, H., Pomerleau, A., Fournier, M., Tam, W.: Implementation of a fast Fourier transform (FFT) for image processing applications. IEEE Trans. Acoust. Speech Signal Process. 22(6), 420–424 (1974)CrossRef Buijs, H., Pomerleau, A., Fournier, M., Tam, W.: Implementation of a fast Fourier transform (FFT) for image processing applications. IEEE Trans. Acoust. Speech Signal Process. 22(6), 420–424 (1974)CrossRef
22.
Zurück zum Zitat Comon, P.: Independent component analysis, a new concept. Signal Process. 36, 287–314 (1994)CrossRef Comon, P.: Independent component analysis, a new concept. Signal Process. 36, 287–314 (1994)CrossRef
23.
Zurück zum Zitat Kramer, M.A.: Nonlinear principal component analysis using autoassociative neural networks. AIChE J. 37(2), 233–243 (1991)CrossRef Kramer, M.A.: Nonlinear principal component analysis using autoassociative neural networks. AIChE J. 37(2), 233–243 (1991)CrossRef
24.
Zurück zum Zitat Rahman, H., Ahmed, M.U., Begum, S.: Non-contact heart rate monitoring using lab color space. In: 13th International Conference on Wearable, Micro & Nano Technologies for Personalized Health (PHealth 2016), Crete, Greece, 29–31 May 2016 (2016) Rahman, H., Ahmed, M.U., Begum, S.: Non-contact heart rate monitoring using lab color space. In: 13th International Conference on Wearable, Micro & Nano Technologies for Personalized Health (PHealth 2016), Crete, Greece, 29–31 May 2016 (2016)
25.
Zurück zum Zitat Alpaydin, E.: Introduction to Machine Learning. MIT Press (2010) Alpaydin, E.: Introduction to Machine Learning. MIT Press (2010)
26.
Zurück zum Zitat Cortes, C., Vapnik, V.N.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH Cortes, C., Vapnik, V.N.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)MATH
27.
Zurück zum Zitat Tamrakar, P., Roy, S.S., Satapathy, B. Ibrahim, S.P.S.: Integration of lazy learning associative classification with k-NN algorithm. In: 2019 International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN), pp. 1–4 (2019) Tamrakar, P., Roy, S.S., Satapathy, B. Ibrahim, S.P.S.: Integration of lazy learning associative classification with k-NN algorithm. In: 2019 International Conference on Vision Towards Emerging Trends in Communication and Networking (ViTECoN), pp. 1–4 (2019)
Metadaten
Titel
Machine Learning for Cognitive Load Classification – A Case Study on Contact-Free Approach
verfasst von
Mobyen Uddin Ahmed
Shahina Begum
Rikard Gestlöf
Hamidur Rahman
Johannes Sörman
Copyright-Jahr
2020
DOI
https://doi.org/10.1007/978-3-030-49161-1_3

Premium Partner