Skip to main content
Erschienen in: Cognitive Neurodynamics 5/2013

01.10.2013 | Research Article

Predictive modeling of human operator cognitive state via sparse and robust support vector machines

verfasst von: Jian-Hua Zhang, Pan-Pan Qin, Jörg Raisch, Ru-Bin Wang

Erschienen in: Cognitive Neurodynamics | Ausgabe 5/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The accurate prediction of the temporal variations in human operator cognitive state (HCS) is of great practical importance in many real-world safety-critical situations. However, since the relationship between the HCS and electrophysiological responses of the operator is basically unknown, complicated and uncertain, only data-based modeling method can be employed. This paper is aimed at constructing a data-driven computationally intelligent model, based on multiple psychophysiological and performance measures, to accurately estimate the HCS in the context of a safety-critical human–machine system. The advanced least squares support vector machines (LS-SVM), whose parameters are optimized by grid search and cross-validation techniques, are adopted for the purpose of predictive modeling of the HCS. The sparse and weighted LS-SVM (WLS-SVM) were proposed by Suykens et al. to overcome the deficiency of the standard LS-SVM in lacking sparseness and robustness. This paper adopted those two improved LS-SVM algorithms to model the HCS based solely on a set of physiological and operator performance data. The results showed that the sparse LS-SVM can obtain HCS models with sparseness with almost no loss of modeling accuracy, while the WLS-SVM leads to models which are robust in case of noisy training data. Both intelligent system modeling approaches are shown to be capable of capturing the temporal fluctuation trends of the HCS because of their superior generalization performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bradshaw JM et al (2002) Adjustable autonomy and human-agent teamwork in practice: an interim report on space applications, Chapter 0, IEEE computer society foundation for intelligent physical agents (FIPA) Bradshaw JM et al (2002) Adjustable autonomy and human-agent teamwork in practice: an interim report on space applications, Chapter 0, IEEE computer society foundation for intelligent physical agents (FIPA)
Zurück zum Zitat Backs RW, Boucsein W (eds) (2000) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah Backs RW, Boucsein W (eds) (2000) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah
Zurück zum Zitat Bainbridge L (1983) Ironies of automation. Automatica 19(6):775–779CrossRef Bainbridge L (1983) Ironies of automation. Automatica 19(6):775–779CrossRef
Zurück zum Zitat Chen Z, Cao J, Cao Y et al (2008) An empirical EEG analysis in brain death diagnosis for aults. Cogn Neurodyn 2:257–271PubMedCrossRef Chen Z, Cao J, Cao Y et al (2008) An empirical EEG analysis in brain death diagnosis for aults. Cogn Neurodyn 2:257–271PubMedCrossRef
Zurück zum Zitat Colucci F (1995) Rotorcraft Pilot’s Associate update: the army’s largest science and technology program. Vertiflite, March/April 1995, 16–20 Colucci F (1995) Rotorcraft Pilot’s Associate update: the army’s largest science and technology program. Vertiflite, March/April 1995, 16–20
Zurück zum Zitat Fitts PM (1951) Some basic questions in designing an air-navigation and air-traffic control system. In: Moray N (ed) Ergonomics major writings, vol 4. Taylor & Francis, London, pp 367–383 Fitts PM (1951) Some basic questions in designing an air-navigation and air-traffic control system. In: Moray N (ed) Ergonomics major writings, vol 4. Taylor & Francis, London, pp 367–383
Zurück zum Zitat Gaillard AWK, Kramer AF (2000) Theoretical and methodological issues in psychophysiological research. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah, pp 31–58 Gaillard AWK, Kramer AF (2000) Theoretical and methodological issues in psychophysiological research. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah, pp 31–58
Zurück zum Zitat Gao J, Hu J, Tung W–W (2011) Complexity measures of brain wave dynamics. Cogn Neurodyn 5:171–182PubMedCrossRef Gao J, Hu J, Tung W–W (2011) Complexity measures of brain wave dynamics. Cogn Neurodyn 5:171–182PubMedCrossRef
Zurück zum Zitat Gevins A, Smith ME (1999) Detecting transient cognitive impairment with EEG pattern recognition methods. Aviat Space Environ Med 70:1018–1024PubMed Gevins A, Smith ME (1999) Detecting transient cognitive impairment with EEG pattern recognition methods. Aviat Space Environ Med 70:1018–1024PubMed
Zurück zum Zitat Gevins A, Smith ME, Leong H (1998) Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum Factors 40:79–91PubMedCrossRef Gevins A, Smith ME, Leong H (1998) Monitoring working memory load during computer-based tasks with EEG pattern recognition methods. Hum Factors 40:79–91PubMedCrossRef
Zurück zum Zitat Greene KA, Bauer KW, Wilson GF et al (2000) Selection of psychophysiological features for classifying air traffic controller workload in neural networks. Smart Eng Syst Des 2:315–330 Greene KA, Bauer KW, Wilson GF et al (2000) Selection of psychophysiological features for classifying air traffic controller workload in neural networks. Smart Eng Syst Des 2:315–330
Zurück zum Zitat Hammer JM, Small RL (1995) An intelligent interface in an associate system. In: Rouse WB (ed) Human/technology interaction in complex systems, vol 7. JAI Press, Greenwich, pp 1–44 Hammer JM, Small RL (1995) An intelligent interface in an associate system. In: Rouse WB (ed) Human/technology interaction in complex systems, vol 7. JAI Press, Greenwich, pp 1–44
Zurück zum Zitat Hampel FR, Rousseeuw PJ, Stahel WA (1986) Robust statistics—the approach based on influence functions. Wiley, New York Hampel FR, Rousseeuw PJ, Stahel WA (1986) Robust statistics—the approach based on influence functions. Wiley, New York
Zurück zum Zitat Hancock PA, Desmond PA (2001) Stress, workload and fatigue. Lawrence Erlbaum Associates, Mahwah Hancock PA, Desmond PA (2001) Stress, workload and fatigue. Lawrence Erlbaum Associates, Mahwah
Zurück zum Zitat Hockey GRJ (1997) Compensatory control in the regulation of human performance under stress and high workload: a cognitive-energetical framework. Biol Psychol 45:73–93PubMedCrossRef Hockey GRJ (1997) Compensatory control in the regulation of human performance under stress and high workload: a cognitive-energetical framework. Biol Psychol 45:73–93PubMedCrossRef
Zurück zum Zitat Hockey GRJ (2003) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS Press, Amsterdam Hockey GRJ (2003) Operator functional state: the assessment and prediction of human performance degradation in complex tasks. IOS Press, Amsterdam
Zurück zum Zitat Hockey GRJ, Wastell DG, Sauer J (1998) Effects of sleep deprivation and user-interface on complex performance: a multilevel analysis of compensatory control. Hum Factors 40:233–253PubMedCrossRef Hockey GRJ, Wastell DG, Sauer J (1998) Effects of sleep deprivation and user-interface on complex performance: a multilevel analysis of compensatory control. Hum Factors 40:233–253PubMedCrossRef
Zurück zum Zitat Hockey GRJ, Nickel P, Roberts AC, Roberts MH (2009) Sensitivity of candidate markers of psychophysiological strain to cyclical changes in manual control load during simulated process control. Appl Ergon 40:1011–1018PubMedCrossRef Hockey GRJ, Nickel P, Roberts AC, Roberts MH (2009) Sensitivity of candidate markers of psychophysiological strain to cyclical changes in manual control load during simulated process control. Appl Ergon 40:1011–1018PubMedCrossRef
Zurück zum Zitat Hoyt R (ed) (2010) Real-time physiological and psycho-physiological status monitoring. NATO RTO publication RTO-TR-HFM-132, NATO Research and Technology Organization, Neuilly sur Seine, July 2010 Hoyt R (ed) (2010) Real-time physiological and psycho-physiological status monitoring. NATO RTO publication RTO-TR-HFM-132, NATO Research and Technology Organization, Neuilly sur Seine, July 2010
Zurück zum Zitat Jorna PGAM (1993) Heart rate and workload variations in actual and simulated flight. Ergonomics 36(9):1043–1054PubMedCrossRef Jorna PGAM (1993) Heart rate and workload variations in actual and simulated flight. Ergonomics 36(9):1043–1054PubMedCrossRef
Zurück zum Zitat Kuriyagawa Y, Kageyama I (1999) A modeling of heart rate variability to estimate mental work load. In: Proceedings of IEEE international conference on systems, man, and cybernetics (SMC’99), vol 2, pp 294–299 Kuriyagawa Y, Kageyama I (1999) A modeling of heart rate variability to estimate mental work load. In: Proceedings of IEEE international conference on systems, man, and cybernetics (SMC’99), vol 2, pp 294–299
Zurück zum Zitat Lee S-Y, Song H-A, Amari S-I (2012) A new discriminant NMF algorithm and its application to the extraction of subtle emotional differences in speech. Cogn Neurodyn 6:525–535CrossRef Lee S-Y, Song H-A, Amari S-I (2012) A new discriminant NMF algorithm and its application to the extraction of subtle emotional differences in speech. Cogn Neurodyn 6:525–535CrossRef
Zurück zum Zitat Nickel P, Roberts AC, Hockey GRJ (2005) Assessment of high risk operator functional state markers in dynamical systems–preliminary results and implications. In: Proceedings of human factors and ergonomics society Europe chapter annual meeting, Turin, 26–28 Oct 2005 Nickel P, Roberts AC, Hockey GRJ (2005) Assessment of high risk operator functional state markers in dynamical systems–preliminary results and implications. In: Proceedings of human factors and ergonomics society Europe chapter annual meeting, Turin, 26–28 Oct 2005
Zurück zum Zitat Parasuraman R (2000) Designing automation for human use: empirical studies and quantitative models. Ergonomics 43:931–951PubMedCrossRef Parasuraman R (2000) Designing automation for human use: empirical studies and quantitative models. Ergonomics 43:931–951PubMedCrossRef
Zurück zum Zitat Parasuraman R, Sheridan TB, Wickens CD (2000) A model for types and levels of human interaction with automation. IEEE Trans SMC Part A 30(3):286–297 Parasuraman R, Sheridan TB, Wickens CD (2000) A model for types and levels of human interaction with automation. IEEE Trans SMC Part A 30(3):286–297
Zurück zum Zitat Pockett S, Whalen S, McPhail AVH, Freeman WJ (2007) Topography, independent component analysis and dipole source analysis of movement related potentials. Cogn Neurodyn 1:327–340PubMedCrossRef Pockett S, Whalen S, McPhail AVH, Freeman WJ (2007) Topography, independent component analysis and dipole source analysis of movement related potentials. Cogn Neurodyn 1:327–340PubMedCrossRef
Zurück zum Zitat Prinzel LJ, Freeman FG, Scerbo MW, Mikulka PJ, Pope AT (2000) A closed-loop system for examining psychophysiological measures for adaptive task allocation. Int J Aviat Psychol 10:393–410PubMedCrossRef Prinzel LJ, Freeman FG, Scerbo MW, Mikulka PJ, Pope AT (2000) A closed-loop system for examining psychophysiological measures for adaptive task allocation. Int J Aviat Psychol 10:393–410PubMedCrossRef
Zurück zum Zitat Qin P–P, Zhang J-H (2012) LSSVM regressive model based analysis of operator functional state in a human-machine system (in Chinese). Space Med Med Eng 25(1):35–41 Qin P–P, Zhang J-H (2012) LSSVM regressive model based analysis of operator functional state in a human-machine system (in Chinese). Space Med Med Eng 25(1):35–41
Zurück zum Zitat Rouse WB (1976) Adaptive allocation of decision making responsibility between supervisor and computer. In: Sheridan TB, Johannsen G (eds) Monitoring behavior and supervisory control. Plenum Press, New York, pp 295–306CrossRef Rouse WB (1976) Adaptive allocation of decision making responsibility between supervisor and computer. In: Sheridan TB, Johannsen G (eds) Monitoring behavior and supervisory control. Plenum Press, New York, pp 295–306CrossRef
Zurück zum Zitat Rouse WB (1977) Human-computer interaction in multi-task situations. IEEE Trans SMC 7:384–392 Rouse WB (1977) Human-computer interaction in multi-task situations. IEEE Trans SMC 7:384–392
Zurück zum Zitat Rousseeuw PJ, Leroy A (1987) Robust regression and outlier detection. Wiley, New YorkCrossRef Rousseeuw PJ, Leroy A (1987) Robust regression and outlier detection. Wiley, New YorkCrossRef
Zurück zum Zitat Russell CA, Wilson GF (1998) Air traffic controller functional state classification using neural networks. In: Proceedings of the artificial neural networks in engineering conference, vol 8, pp 649–654 Russell CA, Wilson GF (1998) Air traffic controller functional state classification using neural networks. In: Proceedings of the artificial neural networks in engineering conference, vol 8, pp 649–654
Zurück zum Zitat Scerbo MW, Freeman FG, Mikulka PJ (2000) A biocybernetic system for adaptive automation. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah, pp 241–254 Scerbo MW, Freeman FG, Mikulka PJ (2000) A biocybernetic system for adaptive automation. In: Backs RW, Boucsein W (eds) Engineering psychophysiology: issues and applications. Lawrence Erlbaum Associates, Mahwah, pp 241–254
Zurück zum Zitat Scerbo MW, Freeman FG, Mikulka PJ, Parasurmann R, Di Nocero F, Prinzel LJ III (2001) The efficacy of psychophysiological measures for implementing adaptive technology, NASA/TP-2001-211018, June Scerbo MW, Freeman FG, Mikulka PJ, Parasurmann R, Di Nocero F, Prinzel LJ III (2001) The efficacy of psychophysiological measures for implementing adaptive technology, NASA/TP-2001-211018, June
Zurück zum Zitat Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRef Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300CrossRef
Zurück zum Zitat Suykens JAK, Lukas L, Vandewalle J (2000) Sparse least squares support vector machines classifiers. In: Proceedings of the European symposium on artificial neural networks (ESANN’2000), vol 4, Bruges, pp 37–42 Suykens JAK, Lukas L, Vandewalle J (2000) Sparse least squares support vector machines classifiers. In: Proceedings of the European symposium on artificial neural networks (ESANN’2000), vol 4, Bruges, pp 37–42
Zurück zum Zitat Suykens JAK, De Brabanter J, Lukas L, Vandewalle J (2002) Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing 48(1–4):85–105CrossRef Suykens JAK, De Brabanter J, Lukas L, Vandewalle J (2002) Weighted least squares support vector machines: robustness and sparse approximation. Neurocomputing 48(1–4):85–105CrossRef
Zurück zum Zitat Trejo LJ, Wheeler KR, Jorgensen CC et al (2003) Multi-modal neuroelectric interface development. IEEE Trans Neural Syst Rehabil Eng 11(2):199–204PubMedCrossRef Trejo LJ, Wheeler KR, Jorgensen CC et al (2003) Multi-modal neuroelectric interface development. IEEE Trans Neural Syst Rehabil Eng 11(2):199–204PubMedCrossRef
Zurück zum Zitat Vapnik VN (1995) The nature of statistical learning theory. Springer, New YorkCrossRef Vapnik VN (1995) The nature of statistical learning theory. Springer, New YorkCrossRef
Zurück zum Zitat Wang R, Zhang J, Zhang Y, Wang X (2012) Assessment of human operator functional state using a novel differential evolution optimization based adaptive fuzzy model. Biomed Signal Process Control 7:490–498CrossRef Wang R, Zhang J, Zhang Y, Wang X (2012) Assessment of human operator functional state using a novel differential evolution optimization based adaptive fuzzy model. Biomed Signal Process Control 7:490–498CrossRef
Zurück zum Zitat Werner G (2012) From brain states to mental phenomena via phase space transitions and renormalization group transformation: proposal of a theory. Cogn Neurodyn 6:199–202PubMedCrossRef Werner G (2012) From brain states to mental phenomena via phase space transitions and renormalization group transformation: proposal of a theory. Cogn Neurodyn 6:199–202PubMedCrossRef
Zurück zum Zitat Wilson GF (2001) In-flight psychophysiological monitoring. In: Fahrenberg F, Myrtek M (eds) Progress in ambulatory monitoring. Hogrefe and Huber Publishers, Seattle, pp 435–454 Wilson GF (2001) In-flight psychophysiological monitoring. In: Fahrenberg F, Myrtek M (eds) Progress in ambulatory monitoring. Hogrefe and Huber Publishers, Seattle, pp 435–454
Zurück zum Zitat Wilson GF (2002a) Psychophysiological test methods and procedures. In: Charlton SG, O’Brien TG (eds) Handbook of human factors testing and evaluation. Lawrence Erlbaum Associates, Inc, Mahwah, pp 157–180 Wilson GF (2002a) Psychophysiological test methods and procedures. In: Charlton SG, O’Brien TG (eds) Handbook of human factors testing and evaluation. Lawrence Erlbaum Associates, Inc, Mahwah, pp 157–180
Zurück zum Zitat Wilson GF (2002b) An analysis of mental workload in pilots during flight using multiple psychophysiological measures. Int J Aviat Psychol 12:3–18CrossRef Wilson GF (2002b) An analysis of mental workload in pilots during flight using multiple psychophysiological measures. Int J Aviat Psychol 12:3–18CrossRef
Zurück zum Zitat Wilson GF (2002c) Adaptive aiding implemented by psychophysiologically determined operator functional state. In: Proceedings of the NATO RTO-HFM symposium on the roles of humans in intelligent and automated systems, Warsaw, 7–9 Oct 2002; Also published in NATO RTO-MP-088, pp 18-1–18-8, Oct 2003 Wilson GF (2002c) Adaptive aiding implemented by psychophysiologically determined operator functional state. In: Proceedings of the NATO RTO-HFM symposium on the roles of humans in intelligent and automated systems, Warsaw, 7–9 Oct 2002; Also published in NATO RTO-MP-088, pp 18-1–18-8, Oct 2003
Zurück zum Zitat Wilson GF, Eggemerier FT (1991) Physiological measures of workload in multi-task environments. In: Damos D (ed) Multiple-task performance, pp 329–360 Wilson GF, Eggemerier FT (1991) Physiological measures of workload in multi-task environments. In: Damos D (ed) Multiple-task performance, pp 329–360
Zurück zum Zitat Wilson GF, Fisher F (1991) The use of cardiac and eye blink measures to determine flight segment in F4 crews. Aviat Space Environ Med 62:959–961PubMed Wilson GF, Fisher F (1991) The use of cardiac and eye blink measures to determine flight segment in F4 crews. Aviat Space Environ Med 62:959–961PubMed
Zurück zum Zitat Wilson GF, Fisher F (1995) Cognitive task classification based upon topographic EEG data. Biol Psychol 40:239–250PubMedCrossRef Wilson GF, Fisher F (1995) Cognitive task classification based upon topographic EEG data. Biol Psychol 40:239–250PubMedCrossRef
Zurück zum Zitat Wilson GF, Schlegel RE (eds) (2004) Operator functional state assessment, NATO RTO Publication RTO-TR-HFM-104, NATO Research and Technology Organization, Neuilly sur Seine, Feb 2004 Wilson GF, Schlegel RE (eds) (2004) Operator functional state assessment, NATO RTO Publication RTO-TR-HFM-104, NATO Research and Technology Organization, Neuilly sur Seine, Feb 2004
Zurück zum Zitat Wilson GF, Lambert JD, Russell CA (2000) Performance enhancement with real-time physiologically controlled adaptive aiding. In: Proceedings of the IEA 2000/HFES 2000 congress, vol 3, pp 61–64 Wilson GF, Lambert JD, Russell CA (2000) Performance enhancement with real-time physiologically controlled adaptive aiding. In: Proceedings of the IEA 2000/HFES 2000 congress, vol 3, pp 61–64
Zurück zum Zitat Zhang Q, Lee M (2012) Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network. Cogn Neurodyn, published online: 17 Aug 2012. doi: 10.1007/s11571-012-9216-y Zhang Q, Lee M (2012) Analyzing the dynamics of emotional scene sequence using recurrent neuro-fuzzy network. Cogn Neurodyn, published online: 17 Aug 2012. doi: 10.​1007/​s11571-012-9216-y
Zurück zum Zitat Zhang J-H, Nassef A, Mahfouf M et al (2006) Modeling and analysis of HRV under physical and mental workloads. In: Proceedings of the 6th IFAC symposium on modeling and control in biomedical systems, Reims, pp 189–194, 20–22 Sept 2006 Zhang J-H, Nassef A, Mahfouf M et al (2006) Modeling and analysis of HRV under physical and mental workloads. In: Proceedings of the 6th IFAC symposium on modeling and control in biomedical systems, Reims, pp 189–194, 20–22 Sept 2006
Zurück zum Zitat Zhang J-H, Wang X-Y, Mahfouf M et al (2008) Use of heart rate variability analysis for quantitatively assessing operator’s mental workload. In: Proceedings of the international conference on biomedical engineering and informatics (BMEI), vol 1, Sanya, pp 668–672 Zhang J-H, Wang X-Y, Mahfouf M et al (2008) Use of heart rate variability analysis for quantitatively assessing operator’s mental workload. In: Proceedings of the international conference on biomedical engineering and informatics (BMEI), vol 1, Sanya, pp 668–672
Metadaten
Titel
Predictive modeling of human operator cognitive state via sparse and robust support vector machines
verfasst von
Jian-Hua Zhang
Pan-Pan Qin
Jörg Raisch
Ru-Bin Wang
Publikationsdatum
01.10.2013
Verlag
Springer Netherlands
Erschienen in
Cognitive Neurodynamics / Ausgabe 5/2013
Print ISSN: 1871-4080
Elektronische ISSN: 1871-4099
DOI
https://doi.org/10.1007/s11571-013-9242-4

Weitere Artikel der Ausgabe 5/2013

Cognitive Neurodynamics 5/2013 Zur Ausgabe

Neuer Inhalt