Skip to main content
Erschienen in: Cognitive Neurodynamics 2/2023

26.06.2022 | Research Article

Mental workload level assessment based on compounded hysteresis effect

verfasst von: Shabnam Samima, Monalisa Sarma

Erschienen in: Cognitive Neurodynamics | Ausgabe 2/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the domain of neuroergonomics, cognitive workload estimation has taken a significant concern among the researchers. This is because the knowledge gathered from its estimation is useful for distributing tasks among the operators, understanding human capability and intervening operators at times of havoc. Brain signals give a promising prospective for understanding cognitive workload. For this, electroencephalography (EEG) is by far the most efficient modality in interpreting the covert information arising in the brain. The present work explores the feasibility of EEG rhythms for monitoring continuous change occurring in a person’s cognitive workload. This continuous monitoring is achieved by graphicallyinterpreting the cumulative effect of changes in EEG rhythms observed in the current instance and the former instance based on the hysteresis effect. In this work, classification is done to predict the data class label using an artificial neural network (ANN) architecture. The proposed model gives a classification accuracy of 98.66%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aghajani H, Garbey M, Omurtag A (2017) Measuring mental workload with EEG+fNIRS. In: Front. Hum. Neurosci Aghajani H, Garbey M, Omurtag A (2017) Measuring mental workload with EEG+fNIRS. In: Front. Hum. Neurosci
Zurück zum Zitat Amin HU, Mumtaz W, Subhani AR, Saad MNM, Malik AS (2017) Classification of EEG signals based on pattern recognition approach. Front Comput Neurosci 11:103CrossRefPubMedPubMedCentral Amin HU, Mumtaz W, Subhani AR, Saad MNM, Malik AS (2017) Classification of EEG signals based on pattern recognition approach. Front Comput Neurosci 11:103CrossRefPubMedPubMedCentral
Zurück zum Zitat Ardian K, Taya F, Sun Y, Bezerianos A, Chen TK (2016) Optimization of workload level estimation using selection of EEG channel connectivity. Evolutionary Computation (CEC) IEEE Congress on, IEEE, pp 1985–1990 Ardian K, Taya F, Sun Y, Bezerianos A, Chen TK (2016) Optimization of workload level estimation using selection of EEG channel connectivity. Evolutionary Computation (CEC) IEEE Congress on, IEEE, pp 1985–1990
Zurück zum Zitat Aricò P, Borghini G, Graziani I, Taya F, Sun Y, Bezerianos A, Thakor NV, Cincotti F, Babiloni F (2014) Towards a multimodal bioelectrical framework for the online mental workload evaluation. In: Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, IEEE, pp 3001–3004 Aricò P, Borghini G, Graziani I, Taya F, Sun Y, Bezerianos A, Thakor NV, Cincotti F, Babiloni F (2014) Towards a multimodal bioelectrical framework for the online mental workload evaluation. In: Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, IEEE, pp 3001–3004
Zurück zum Zitat Babiloni C, Stella G, Buffo P, Vecchio F, Onorati P, Muratori C, Miano S, Gheller F, Antonaci L, Albertini G et al (2012) Cortical sources of resting state EEG rhythms are abnormal in dyslexic children. Clin Neurophysiol 123(12):2384–2391CrossRefPubMed Babiloni C, Stella G, Buffo P, Vecchio F, Onorati P, Muratori C, Miano S, Gheller F, Antonaci L, Albertini G et al (2012) Cortical sources of resting state EEG rhythms are abnormal in dyslexic children. Clin Neurophysiol 123(12):2384–2391CrossRefPubMed
Zurück zum Zitat Baldwin CL, Penaranda B (2012) Adaptive training using an artificial neural network and EEG metrics for within-and cross-task workload classification. NeuroImage 59(1):48–56CrossRefPubMed Baldwin CL, Penaranda B (2012) Adaptive training using an artificial neural network and EEG metrics for within-and cross-task workload classification. NeuroImage 59(1):48–56CrossRefPubMed
Zurück zum Zitat Bullmore E, Sporns O (2009) Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci 10(3):186CrossRefPubMed Bullmore E, Sporns O (2009) Complex brain networks: graph theoretical analysis of structural and functional systems. Nat Rev Neurosci 10(3):186CrossRefPubMed
Zurück zum Zitat Chakladar DD, Dey S, Roy PP, Dogra DP (2020) EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm. Biomed Signal Process Control 60:101989CrossRef Chakladar DD, Dey S, Roy PP, Dogra DP (2020) EEG-based mental workload estimation using deep BLSTM-LSTM network and evolutionary algorithm. Biomed Signal Process Control 60:101989CrossRef
Zurück zum Zitat Chakladar DD, Dey S, Roy PP, Iwamura M (2021) EEG-based cognitive state assessment using deep ensemble model and filter bank common spatial pattern. In: 2020 25th International Conference on Pattern Recognition (ICPR), IEEE, pp 4107–4114 Chakladar DD, Dey S, Roy PP, Iwamura M (2021) EEG-based cognitive state assessment using deep ensemble model and filter bank common spatial pattern. In: 2020 25th International Conference on Pattern Recognition (ICPR), IEEE, pp 4107–4114
Zurück zum Zitat Chen S, Epps J (2019) Atomic head movement analysis for wearable four-dimensional task load recognition. IEEE journal of biomedical and health informatics Chen S, Epps J (2019) Atomic head movement analysis for wearable four-dimensional task load recognition. IEEE journal of biomedical and health informatics
Zurück zum Zitat Daly I, Scherer R, Billinger M, Müller-Putz G (2015) Force: Fully online and automated artifact removal for brain-computer interfacing. IEEE Trans Neural Syst Rehabil Eng 23(5):725–736CrossRefPubMed Daly I, Scherer R, Billinger M, Müller-Putz G (2015) Force: Fully online and automated artifact removal for brain-computer interfacing. IEEE Trans Neural Syst Rehabil Eng 23(5):725–736CrossRefPubMed
Zurück zum Zitat Déli E, Kisvárday Z (2020) The thermodynamic brain and the evolution of intellect: the role of mental energy. Cogn Neurodynamics 14(6):743–756CrossRef Déli E, Kisvárday Z (2020) The thermodynamic brain and the evolution of intellect: the role of mental energy. Cogn Neurodynamics 14(6):743–756CrossRef
Zurück zum Zitat Dimitriadis SI, Sun Y, Kwok K, Laskaris NA, Thakor N, Bezerianos A (2015) Cognitive workload assessment based on the tensorial treatment of EEG estimates of cross-frequency phase interactions. Ann Biomed Eng 43(4):977–989CrossRefPubMed Dimitriadis SI, Sun Y, Kwok K, Laskaris NA, Thakor N, Bezerianos A (2015) Cognitive workload assessment based on the tensorial treatment of EEG estimates of cross-frequency phase interactions. Ann Biomed Eng 43(4):977–989CrossRefPubMed
Zurück zum Zitat Fritz T, Begel A, Müller SC, Yigit-Elliott S, Züger M (2014) Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th International Conference on Software Engineering, ACM, pp 402–413 Fritz T, Begel A, Müller SC, Yigit-Elliott S, Züger M (2014) Using psycho-physiological measures to assess task difficulty in software development. In: Proceedings of the 36th International Conference on Software Engineering, ACM, pp 402–413
Zurück zum Zitat Fu CH, McIntosh AR, Kim J, Chau W, Bullmore ET, Williams SC, Honey GD, McGuire PK (2006) Modulation of effective connectivity by cognitive demand in phonological verbal fluency. Neuroimage 30(1):266–271CrossRefPubMed Fu CH, McIntosh AR, Kim J, Chau W, Bullmore ET, Williams SC, Honey GD, McGuire PK (2006) Modulation of effective connectivity by cognitive demand in phonological verbal fluency. Neuroimage 30(1):266–271CrossRefPubMed
Zurück zum Zitat Ginestet CE, Nichols TE, Bullmore ET, Simmons A (2011) Brain network analysis: separating cost from topology using cost-integration. PloS one 6(7):e21570CrossRefPubMedPubMedCentral Ginestet CE, Nichols TE, Bullmore ET, Simmons A (2011) Brain network analysis: separating cost from topology using cost-integration. PloS one 6(7):e21570CrossRefPubMedPubMedCentral
Zurück zum Zitat Huang D, Ren A, Shang J, Lei Q, Zhang Y, Yin Z, Li J, von Deneen KM, Huang L (2016) Combining partial directed coherence and graph theory to analyse effective brain networks of different mental tasks. Front Hum Neurosci 10:235CrossRefPubMedPubMedCentral Huang D, Ren A, Shang J, Lei Q, Zhang Y, Yin Z, Li J, von Deneen KM, Huang L (2016) Combining partial directed coherence and graph theory to analyse effective brain networks of different mental tasks. Front Hum Neurosci 10:235CrossRefPubMedPubMedCentral
Zurück zum Zitat Çigdem N, Murat K, Yuriy M, (2019) Distinguishing mental attention states of humans via an EEG-based passive BCI using machine learning methods. Expert Syst Appl 134:153–166 Çigdem N, Murat K, Yuriy M, (2019) Distinguishing mental attention states of humans via an EEG-based passive BCI using machine learning methods. Expert Syst Appl 134:153–166
Zurück zum Zitat Ke Y, Qi H, He F, Liu S, Zhao X, Zhou P, Zhang L, Ming D (2014) An EEG-based mental workload estimator trained on working memory task can work well under simulated multi-attribute task. Front Hum Neurosci 8:703CrossRefPubMedPubMedCentral Ke Y, Qi H, He F, Liu S, Zhao X, Zhou P, Zhang L, Ming D (2014) An EEG-based mental workload estimator trained on working memory task can work well under simulated multi-attribute task. Front Hum Neurosci 8:703CrossRefPubMedPubMedCentral
Zurück zum Zitat Kim N, House R, Yun MH, Nam CS (2018) Neural correlates of workload transition in multitasking: an act-r model of hysteresis effect. Front Hum Neurosci 12:535CrossRefPubMed Kim N, House R, Yun MH, Nam CS (2018) Neural correlates of workload transition in multitasking: an act-r model of hysteresis effect. Front Hum Neurosci 12:535CrossRefPubMed
Zurück zum Zitat Kirchner WK (1958) Age differences in short-term retention of rapidly changing information. J Exp Psychol 55(4):352CrossRefPubMed Kirchner WK (1958) Age differences in short-term retention of rapidly changing information. J Exp Psychol 55(4):352CrossRefPubMed
Zurück zum Zitat Klaproth OW, Vernaleken C, Krol LR, Halbruegge M, Zander TO, Russwinkel N (2020) Tracing pilots’ situation assessment by neuroadaptive cognitive modeling. Front Neurosci 14:795CrossRefPubMedPubMedCentral Klaproth OW, Vernaleken C, Krol LR, Halbruegge M, Zander TO, Russwinkel N (2020) Tracing pilots’ situation assessment by neuroadaptive cognitive modeling. Front Neurosci 14:795CrossRefPubMedPubMedCentral
Zurück zum Zitat Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29(2–3):169–195CrossRefPubMed Klimesch W (1999) EEG alpha and theta oscillations reflect cognitive and memory performance: a review and analysis. Brain Res Rev 29(2–3):169–195CrossRefPubMed
Zurück zum Zitat Kohlmorgen J, Dornhege G, Braun M, Blankertz B (2007) Improving human performance in a real operating environment through real-time mental workload detection. Toward Brain Comput Interfacing 409422:409–422 Kohlmorgen J, Dornhege G, Braun M, Blankertz B (2007) Improving human performance in a real operating environment through real-time mental workload detection. Toward Brain Comput Interfacing 409422:409–422
Zurück zum Zitat Kothe CA, Makeig S (2011) Estimation of task workload from EEG data: new and current tools and perspectives. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE, IEEE, pp 6547–6551 Kothe CA, Makeig S (2011) Estimation of task workload from EEG data: new and current tools and perspectives. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE, IEEE, pp 6547–6551
Zurück zum Zitat Liu Y, Ayaz H, Shewokis PA (2017) Mental workload classification with concurrent electroencephalography and functional near-infrared spectroscopy. Brain Comput Interfaces 4(3):175–185CrossRef Liu Y, Ayaz H, Shewokis PA (2017) Mental workload classification with concurrent electroencephalography and functional near-infrared spectroscopy. Brain Comput Interfaces 4(3):175–185CrossRef
Zurück zum Zitat Mahmoud R, Shanableh T, Bodala IP, Thakor NV, Al-Nashash H (2017) Novel classification system for classifying cognitive workload levels under vague visual stimulation. IEEE Sens J 17(21):7019–7028CrossRef Mahmoud R, Shanableh T, Bodala IP, Thakor NV, Al-Nashash H (2017) Novel classification system for classifying cognitive workload levels under vague visual stimulation. IEEE Sens J 17(21):7019–7028CrossRef
Zurück zum Zitat Mijalkov M, Kakaei E, Pereira JB, Westman E, Volpe G, Initiative ADN (2017) Braph: a graph theory software for the analysis of brain connectivity. PloS one 12(8):e0178798CrossRefPubMedPubMedCentral Mijalkov M, Kakaei E, Pereira JB, Westman E, Volpe G, Initiative ADN (2017) Braph: a graph theory software for the analysis of brain connectivity. PloS one 12(8):e0178798CrossRefPubMedPubMedCentral
Zurück zum Zitat Orlandi L, Brooks B (2018) Measuring mental workload and physiological reactions in marine pilots: building bridges towards redlines of performance. Appl ergon 69:74–92CrossRefPubMed Orlandi L, Brooks B (2018) Measuring mental workload and physiological reactions in marine pilots: building bridges towards redlines of performance. Appl ergon 69:74–92CrossRefPubMed
Zurück zum Zitat Radüntz T (2017) Dual frequency head maps: a new method for indexing mental workload continuously during execution of cognitive tasks. Front physiol 8:1019CrossRefPubMedPubMedCentral Radüntz T (2017) Dual frequency head maps: a new method for indexing mental workload continuously during execution of cognitive tasks. Front physiol 8:1019CrossRefPubMedPubMedCentral
Zurück zum Zitat Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52(3):1059–1069CrossRefPubMed Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52(3):1059–1069CrossRefPubMed
Zurück zum Zitat Sahin I, Koyuncu I (2012) Design and implementation of neural networks neurons with radbas, logsig, and tansig activation functions on FPGA. Elektron ir elektrotech 120(4):51–54CrossRef Sahin I, Koyuncu I (2012) Design and implementation of neural networks neurons with radbas, logsig, and tansig activation functions on FPGA. Elektron ir elektrotech 120(4):51–54CrossRef
Zurück zum Zitat Sciaraffa N, Borghini G, Aricò P, Di Flumeri G, Colosimo A, Bezerianos A, Thakor NV, Babiloni F (2017) Brain interaction during cooperation: Evaluating local properties of multiple-brain network. Brain sci 7(7):90CrossRefPubMedPubMedCentral Sciaraffa N, Borghini G, Aricò P, Di Flumeri G, Colosimo A, Bezerianos A, Thakor NV, Babiloni F (2017) Brain interaction during cooperation: Evaluating local properties of multiple-brain network. Brain sci 7(7):90CrossRefPubMedPubMedCentral
Zurück zum Zitat Sen S, Daimi SN, Watanabe K, Takahashi K, Bhattacharya J, Saha G (2020) Switch or stay? automatic classification of internal mental states in bistable perception. Cogn Neurodynamics 14(1):95–113CrossRef Sen S, Daimi SN, Watanabe K, Takahashi K, Bhattacharya J, Saha G (2020) Switch or stay? automatic classification of internal mental states in bistable perception. Cogn Neurodynamics 14(1):95–113CrossRef
Zurück zum Zitat Sibi P, Jones SA, Siddarth P (2013) Analysis of different activation functions using back propagation neural networks. J Theor Appl Inf Technol 47(3):1264–1268 Sibi P, Jones SA, Siddarth P (2013) Analysis of different activation functions using back propagation neural networks. J Theor Appl Inf Technol 47(3):1264–1268
Zurück zum Zitat Yi W, Qiu S, Fan X, Zhang L (2019) Estimation of mental workload induced by different presentation rates in rapid serial visual presentation tasks. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, pp 5552–5555 Yi W, Qiu S, Fan X, Zhang L (2019) Estimation of mental workload induced by different presentation rates in rapid serial visual presentation tasks. In: 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), IEEE, pp 5552–5555
Zurück zum Zitat Yin Z, Zhao M, Zhang W, Wang Y, Wang Y, Zhang J (2019) Physiological-signal-based mental workload estimation via transfer dynamical autoencoders in a deep learning framework. Neurocomputing 347:212–229CrossRef Yin Z, Zhao M, Zhang W, Wang Y, Wang Y, Zhang J (2019) Physiological-signal-based mental workload estimation via transfer dynamical autoencoders in a deep learning framework. Neurocomputing 347:212–229CrossRef
Zurück zum Zitat Yu K, Prasad I, Mir H, Thakor N, Al-Nashash H (2015) Cognitive workload modulation through degraded visual stimuli: a single-trial EEG study. J neural Eng 12(4):046020CrossRefPubMed Yu K, Prasad I, Mir H, Thakor N, Al-Nashash H (2015) Cognitive workload modulation through degraded visual stimuli: a single-trial EEG study. J neural Eng 12(4):046020CrossRefPubMed
Zurück zum Zitat Zammouri A, Moussa AA, Mebrouk Y (2018) Brain-computer interface for workload estimation: assessment of mental efforts in learning processes. Expert Syst Appl 112:138–147CrossRef Zammouri A, Moussa AA, Mebrouk Y (2018) Brain-computer interface for workload estimation: assessment of mental efforts in learning processes. Expert Syst Appl 112:138–147CrossRef
Zurück zum Zitat Zarjam P, Epps J, Chen F, Lovell NH (2013) Estimating cognitive workload using wavelet entropy-based features during an arithmetic task. Comput biol med 43(12):2186–2195CrossRefPubMed Zarjam P, Epps J, Chen F, Lovell NH (2013) Estimating cognitive workload using wavelet entropy-based features during an arithmetic task. Comput biol med 43(12):2186–2195CrossRefPubMed
Zurück zum Zitat Zeng H, Yang C, Dai G, Qin F, Zhang J, Kong W (2018) EEG classification of driver mental states by deep learning. Cogn neurodynamics 12(6):597–606CrossRef Zeng H, Yang C, Dai G, Qin F, Zhang J, Kong W (2018) EEG classification of driver mental states by deep learning. Cogn neurodynamics 12(6):597–606CrossRef
Zurück zum Zitat Zhang J, Li S, Wang R (2017) Pattern recognition of momentary mental workload based on multi-channel electrophysiological data and ensemble convolutional neural networks. Front neurosci 11:310CrossRefPubMedPubMedCentral Zhang J, Li S, Wang R (2017) Pattern recognition of momentary mental workload based on multi-channel electrophysiological data and ensemble convolutional neural networks. Front neurosci 11:310CrossRefPubMedPubMedCentral
Zurück zum Zitat Zhang J, Li J, Wang R (2020) Instantaneous mental workload assessment using time-frequency analysis and semi-supervised learning. Cogn Neurodynamics 14(5):619–642CrossRef Zhang J, Li J, Wang R (2020) Instantaneous mental workload assessment using time-frequency analysis and semi-supervised learning. Cogn Neurodynamics 14(5):619–642CrossRef
Zurück zum Zitat Zhang P, Wang X, Chen J, You W (2017) Feature weight driven interactive mutual information modeling for heterogeneous bio-signal fusion to estimate mental workload. Sensors 17(10):2315CrossRefPubMedPubMedCentral Zhang P, Wang X, Chen J, You W (2017) Feature weight driven interactive mutual information modeling for heterogeneous bio-signal fusion to estimate mental workload. Sensors 17(10):2315CrossRefPubMedPubMedCentral
Zurück zum Zitat Zhang S, Zhang Y, Sun Y, Thakor N, Bezerianos A (2017c) Graph theoretical analysis of EEG functional network during multi-workload flight simulation experiment in virtual reality environment. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp 3957–3960, https://doi.org/10.1109/EMBC.2017.8037722 Zhang S, Zhang Y, Sun Y, Thakor N, Bezerianos A (2017c) Graph theoretical analysis of EEG functional network during multi-workload flight simulation experiment in virtual reality environment. In: 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), pp 3957–3960, https://​doi.​org/​10.​1109/​EMBC.​2017.​8037722
Zurück zum Zitat Zhao Y, Tang J, Cao Y, Jiao X, Xu M, Zhou P, Ming D, Qi H (2018) Effects of distracting task with different mental workload on steady-state visual evoked potential based brain computer interfaces-an offline study. Front Neurosci 12:79CrossRefPubMedPubMedCentral Zhao Y, Tang J, Cao Y, Jiao X, Xu M, Zhou P, Ming D, Qi H (2018) Effects of distracting task with different mental workload on steady-state visual evoked potential based brain computer interfaces-an offline study. Front Neurosci 12:79CrossRefPubMedPubMedCentral
Metadaten
Titel
Mental workload level assessment based on compounded hysteresis effect
verfasst von
Shabnam Samima
Monalisa Sarma
Publikationsdatum
26.06.2022
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 2/2023
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-022-09830-1

Weitere Artikel der Ausgabe 2/2023

Cognitive Neurodynamics 2/2023 Zur Ausgabe

Neuer Inhalt