Top

Cognitive Neurodynamics

Published in:

01-12-2013 | Research Article

Classifying human operator functional state based on electrophysiological and performance measures and fuzzy clustering method

Authors: Jian-Hua Zhang, Xiao-Di Peng, Hua Liu, Jörg Raisch, Ru-Bin Wang

Published in: Cognitive Neurodynamics | Issue 6/2013

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The human operator’s ability to perform their tasks can fluctuate over time. Because the cognitive demands of the task can also vary it is possible that the capabilities of the operator are not sufficient to satisfy the job demands. This can lead to serious errors when the operator is overwhelmed by the task demands. Psychophysiological measures, such as heart rate and brain activity, can be used to monitor operator cognitive workload. In this paper, the most influential psychophysiological measures are extracted to characterize Operator Functional State (OFS) in automated tasks under a complex form of human–automation interaction. The fuzzy c-mean (FCM) algorithm is used and tested for its OFS classification performance. The results obtained have shown the feasibility and effectiveness of the FCM algorithm as well as the utility of the selected input features for OFS classification. Besides being able to cope with nonlinearity and fuzzy uncertainty in the psychophysiological data it can provide information about the relative importance of the input features as well as the confidence estimate of the classification results. The OFS pattern classification method developed can be incorporated into an adaptive aiding system in order to enhance the overall performance of a large class of safety–critical human–machine cooperative systems.

previous article Perception of successive brief objects as a function of stimulus onset asynchrony: model experiments based on two-stage synchronization of neuronal oscillators

next article Coupling-induced population synchronization in an excitatory population of subthreshold Izhikevich neurons

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Bezdek JC (1981) Pattern recognition with fuzzy objective function algorithms. Plenum, New YorkCrossRef

Chen Z, Cao J, Cao Y et al (2008) An empirical EEG analysis in brain death diagnosis for adults. Cogn Neurodyn 2:257–271PubMedCrossRef

Comstock JR, Arnegard RJ (1992) The multi-attribute task battery for human operator workload and strategic behavior research. NASA Tech, Memo

Conway G (2005) Effects of workload, effort and fatigue on complex performance: application and tests of compensatory control theory, PhD dissertation, University of Leeds, UK

Conway G (2006) Noise and cyclic loading effects on performance and operator functional state. In: Proceedings of the HFES conference, San Francisco, CA, pp 1435–1438

De Waard D (1996) The measurement of driver’s mental workload, PhD dissertation, University of Groningen, The Netherlands

Fahrenberg J, Wientjes CWJ (2000) Recording Methods in Applied Environments. In: Backs RW, Boucsein W (eds) Engineering psychology: issues and applications. Erlbaum, Mahwah, pp 111–136

Freedman FG, Mikulka PJ, Prinzel LJ, Scerbo MW (1999) Evaluation of an adaptive automation system using three EEG indices with a visual tracking task. Biol Psychol 50:61–76CrossRef

Gao J, Hu J, Tung W–W (2011) Complexity measures of brain wave dynamics. Cogn Neurodyn 5:171–182PubMedCrossRef

Gevins A, Smith ME (1999) Detecting transient cognitive impairment with EEG pattern recognition methods. Aviat Space Environ Med 70:1018–1024PubMed

Gevins A, Smith ME (2003) Neurophysiological measures of cognitive workload during human-computer interactions. Theor Issues Ergon Sci 4:113–131CrossRef

Gevins A, Smith ME, McEvoy L, Yu D (1997) High-resolution EEG mapping of cortical activation related to working memory: effects of task difficulty, type of processing, and practice. Cereb Cortex 7:374–385PubMedCrossRef

Gevins A, Smith ME, Leong H, Mcevoy L, Whitfield S, Du R, Rush G (1998) Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum Factors 40:79–91PubMedCrossRef

Helton WS, Warm JS, Tripp LD, Matthews G, Parasuraman R, Hancock PA (2010) Cerebral lateralization of vigilance: a function of task difficulty. Neuropsychologia 48:1683–1688PubMedCrossRef

Hockey GRJ (2003) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS Press, US

Hockey GRJ (2005) Operator functional state: the prediction of breakdown in human performance. In: Duncan J, McLeod P, Phillips L (eds) Speed, control and age: in honor of Patrick rabbit. Oxford University Press, Oxford, pp 373–394CrossRef

Hockey GRJ, Wastell DG, Sauer J (1998) Effects of sleep deprivation and user-interface on complex performance: a multilevel analysis of compensatory control. Hum Factors 40:233–253PubMedCrossRef

Hockey GRJ, Nickel P, Roberts AC, Roberts MH (2009) Sensitivity of candidate markers of psychophysiological strain to cyclical changes in manual control load during simulated process control. Appl Ergon 40:1011–1018PubMedCrossRef

Izso L, Lang E (2000) Heart period variability as mental effort monitor in human computer interaction. Behav Inf Tech 19:297–306CrossRef

Jasper HH (1958) Report of the committee on methods of clinical examination in electroencephalography. Electroencephalogr Clin Neurophysiol 10:370–375CrossRef

Jung T-P, Makeig S, Stensmo M, Sejnowski TJ (1997) Estimating alertness from the EEG power spectrum. IEEE Trans Biomed Eng 44(1):60–69PubMedCrossRef

Kristjansson SD, Stern JA, Brown TB, Rohrbaugh JW (2009) Detecting phasic lapses in alertness using pupillometric measures. Appl Ergon 40:978–986PubMedCrossRef

Lin C-T, Ko L-W, Chung I-F, Huang T-Y, Chen Y-C, Jung T-P, Liang S-F (2006) Adaptive EEG-based alertness estimation system by using ICA-based fuzzy neural networks. IEEE Trans Circuits Syst I 53(11):2469–2475CrossRef

Lin C-T, Chung I-F, Ko L-W, Chen Y-C, Liang S-F, Duann J-R (2007) EEG-based assessment of driver cognitive responses in a dynamic virtual-reality driving environment. IEEE Trans Biomed Eng 54(7):1349–1352PubMedCrossRef

Lin C-T, Ko L-W, Shen T-K (2009) Computational intelligent brain computer interaction and its applications on driving cognition. IEEE Computational Intelligence Magazine pp 33–46

Lorenz B (2002) Detection and prediction of an automation-induced state of impaired operator competence. In: Proceedings of NATO ARW on Operator Functional State, II Ciocco

Lorenz B, Parasuraman R (2003) Human operator functional state in automated systems: the role of compensatory control strategies. In: Hockey GRJ, Gaillard AWK, Burov O (eds) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS, Amsterdam, pp 224–237

Miller EK, Cohen JD (2001) An integrative theory of prefrontal cortex function. Ann Rev Neurosci 24:167–202PubMedCrossRef

Mulder G, Mulder LJM, Meijman TF, Veldman JBP, van Roon AM (2000) Psychophysiological approach to working conditions. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Erlbaum, Mahwah, pp 139–159

Nickel P, Nachreiner F (2003) Sensitivity and diagnosticity of the 0.1 Hz component of heart rate variability as an indicator of mental workload. Hum Factors 45:575–590PubMedCrossRef

Nickel P, Roberts AC, Hockey GRJ (2005) Assessment of high risk operator functional state markers in dynamical systems-preliminary results and implications. In: Proceedings of human factors and ergonomics Society Europe chapter annual meeting 2005, Turin, Italy, Oct 26–28 2005

Nickel P, Hockey GRJ, Roberts AC, Roberts MH (2006) Markers of high risk operator functional state in adaptive control of process automation. In: Proceedings of IEA

Nikolaev AR, Ivanitskii GA, Ivanitskii AM (1998) Reproducible EEG alpha-patterns in psychological task solving. Hum Physiol 24:261–268

Onton J, Delorme A, Makeig S (2005) Frontal midline EEG dynamics during working memory. Neuroimage 27:341–356PubMedCrossRef

Parasuraman R, de Visser E, Clarke E, McGarry WR, Hussey E, Shaw T, Thompson JC (2009) Detecting threat-related intentional actions of others: effects of image quality, response mode and target cuing on vigilance. J Exp Psychol Appl 15(4):275–290PubMedCrossRef

Parsuraman R, Masalonis AJ, Hancock PA (2000) Fuzzy signal detection theory: basic postulates and formulas for analyzing human and machine performance. Hum Factors 42:636–659CrossRef

Pattyn N, Neyt X, Henderickx D, Soetens E (2008) Psychophysiological investigation of vigilance decrement: boredom or cognitive fatigue? Physiol Behav 93:369–378PubMedCrossRef

Pockett S, Whalen S, McPhail AVH, Freeman WJ (2007) Topography, independent component analysis and dipole source analysis of movement related potentials. Cogn Neurodyn 1:327–340PubMedCrossRef

Pope AT, Bogart EH, Bartolome DS (1995) Biocybernetic system evaluates indices of operator engagement in automated task. Biol Psychol 40:187–195PubMedCrossRef

Qin P-P, Zhang J-H (2012) Analysis of operator functional state in human-machine systems based on a LSSVM regression modeling approach (in Chinese). Space Med Med Eng 25(1):35–41

Royall DR, Lauterbach EC, Cummings JL, Reeve A, Rummans TA, Kaufer DI, LcFrance WC Jr, Coffey CE (2002) Executive control function: a review of its promise and challenges for clinical research. J Neuropsychiatry Clin Neurosci 14(4):377–405PubMedCrossRef

Russell CA, Wilson GF (1998) Air traffic controller functional state classification using neural networks. In: Proceedings of the artificial neural networks in engineering conference, vol 8, pp 649–654

Scerbo MW, Freeman FG, Mikulka P (2003) A brain-based system for adaptive automation. Theor Issues Ergon Sci 4:200–219CrossRef

Schacter DL (1977) EEG theta waves and psychological phenomena: a review and analysis. Biol Psychol 5:47–82PubMedCrossRef

Schiff SJ (2011) Neural control engineering: the emerging intersection between control theory and neuroscience. MIT Press, Cambridge

Smith ME, Gevins A, Brown H, Karnik A, Du R (2001) Monitoring task loading with multivariate EEG measures during complex forms of human-computer interaction. Hum Factors 43:366–380PubMedCrossRef

Tattersall AJ, Hockey GRJ (1995) Level of operator control and changes in heart rate variability during simulated flight maintenance. Hum Factors 37:682–698PubMedCrossRef

Werner G (2012) From brain states to mental phenomena via phase space transitions and renormalization group transformation: proposal of a theory. Cogn Neurodyn 6:199–202PubMedCrossRef

Wilson GF (1999) Operator functional state classification using neural networks with combined psychological and performance measures. In: Proceedings of the 43rd HFES annual meeting, pp 1099–1102

Wilson GF, Eggemerier FT (1991) Physiological measures of workload in multi-task environments. In Damos DL (ed) Multiple-task performance. Taylor and Francis, London, pp 329–360

Wilson GF, Fisher F (1991) The use of cardiac and eye blink measures to determine flight segment in F4 crews. Aviat Space Environ Med 62:959–961PubMed

Wilson GF, Fisher F (1995) Cognitive task classification based upon topographic EEG data. Biol Psychol 40:239–250PubMedCrossRef

Yang S, Zhang J (2012) An adaptive human-machine control system based on multiple fuzzy predictive models of operator functional state. Biol Signal Process Control (in press)

Zadeh LA (1973) An outline of a new approach to the analysis of complex systems and decision processes. IEEE Trans Syst Man Cybernetics 3:28–44CrossRef

Zhang Q, Lee M (2012) Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network. Cogn Neurodyn published online: 17 August 2012, doi: 10.1007/s11571-012-9216-y

Zhang J-H, Mahfouf M, Linkens DA (2007) Adaptive fuzzy model of operator functional state in human-machine system: a preliminary study. In: Proceedings of the IASTED international conference, 555-017

Zhang J-H, Wang X-Y, Mahfouf M, Linkens DA (2008a) Use of heart rate variability analysis for quantitatively assessing operator’s mental workload. In: Proceedings of the BMEI, pp 668–672

Zhang J-H, Wang X-Y, Mahfouf M, Linkens DA (2008b) Fuzzy Logic based identification of operator functional states using multiple physiological and performance measures. In: Proceedings of the BMEI, pp 570–574

Title: Classifying human operator functional state based on electrophysiological and performance measures and fuzzy clustering method
Authors: Jian-Hua Zhang
Xiao-Di Peng
Hua Liu
Jörg Raisch
Ru-Bin Wang
Publication date: 01-12-2013
Publisher: Springer Netherlands
Published in: Cognitive Neurodynamics / Issue 6/2013
Print ISSN: 1871-4080
Electronic ISSN: 1871-4099
DOI: https://doi.org/10.1007/s11571-013-9243-3

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 6/2013

Coupling-induced population synchronization in an excitatory population of subthreshold Izhikevich neurons

Thermodynamic view on decision-making process: emotions as a potential power vector of realization of the choice

Stability switches and double Hopf bifurcation in a two-neural network system with multiple delays

A comparison study of two P300 speller paradigms for brain–computer interface

Electronic evaluation for video commercials by impression index

Perception of successive brief objects as a function of stimulus onset asynchrony: model experiments based on two-stage synchronization of neuronal oscillators