Skip to main content

2016 | OriginalPaper | Buchkapitel

CogniMeter: EEG-Based Brain States Monitoring

verfasst von : Xiyuan Hou, Yisi Liu, Wei Lun Lim, Zirui Lan, Olga Sourina, Wolfgang Mueller-Wittig, Lipo Wang

Erschienen in: Transactions on Computational Science XXVIII

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Electroencephalogram (EEG) techniques are traditionally used in the medical field. Recent research work focuses on applying these techniques to daily life with wireless and relatively low-price EEG devices available in the market. As a result, applications such as neurofeedback training, neuromarketing, emotion, stress, mental workload recognition, etc. using EEG techniques on healthy adults have been developed. Since the EEG measures and records electrical activity in the brain, it is possible for it to reflect a person’s brain states. In this paper, we describe a novel brain computer interface called CogniMeter integrated with proposed real-time emotion, mental workload, and stress recognition algorithms. With this system, we can assess human emotions, mental workload, and stress in real time. This work can be applied as a human study tool in many fields. For example, the wellbeing of users within a system or workers in industry can be monitored to improve their protection from overly stressful workload conditions. In research, brain state monitoring can be applied in simulation scenarios during human factor study experiments. In marketing, a person’s emotional response toward products or advertisements can be studied using EEG-based brain states monitoring.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Lim, C.-K.A., Chia, W.C.: Analysis of single-electrode EEG rhythms using MATLAB to elicit correlation with cognitive stress. Int. J. Comput. Theor. Eng. 7, 149–155 (2015)CrossRef Lim, C.-K.A., Chia, W.C.: Analysis of single-electrode EEG rhythms using MATLAB to elicit correlation with cognitive stress. Int. J. Comput. Theor. Eng. 7, 149–155 (2015)CrossRef
2.
Zurück zum Zitat Hosseini, S.A., Khalilzadeh, M.A., Naghibi-Sistani, M.B., Niazmand, V.: Higher order spectra analysis of EEG signals in emotional stress states. In: 2010 Second International Conference on Information Technology and Computer Science (ITCS), pp. 60–63 (2010) Hosseini, S.A., Khalilzadeh, M.A., Naghibi-Sistani, M.B., Niazmand, V.: Higher order spectra analysis of EEG signals in emotional stress states. In: 2010 Second International Conference on Information Technology and Computer Science (ITCS), pp. 60–63 (2010)
3.
Zurück zum Zitat Yuan-Pin, L., Chi-Hong, W., Tien-Lin, W., Shyh-Kang, J., Jyh-Horng, C.: EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 489–492 (2009) Yuan-Pin, L., Chi-Hong, W., Tien-Lin, W., Shyh-Kang, J., Jyh-Horng, C.: EEG-based emotion recognition in music listening: a comparison of schemes for multiclass support vector machine. In: IEEE International Conference on Acoustics, Speech and Signal Processing, pp. 489–492 (2009)
4.
Zurück zum Zitat Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004)CrossRef Delorme, A., Makeig, S.: EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004)CrossRef
5.
Zurück zum Zitat Tadel, F., Baillet, S., Mosher, J.C., Pantazis, D., Leahy, R.M.: Brainstorm: a user-friendly application for MEG/EEG analysis. Comput. Intell. Neurosci. 2011, 13 (2011)CrossRef Tadel, F., Baillet, S., Mosher, J.C., Pantazis, D., Leahy, R.M.: Brainstorm: a user-friendly application for MEG/EEG analysis. Comput. Intell. Neurosci. 2011, 13 (2011)CrossRef
6.
Zurück zum Zitat Aguera, P.-E., Jerbi, K., Caclin, A., Bertrand, O.: ELAN: a software package for analysis and visualization of MEG, EEG, and LFP signals. Comput. Intell. Neurosci. 2011, 5 (2011)CrossRef Aguera, P.-E., Jerbi, K., Caclin, A., Bertrand, O.: ELAN: a software package for analysis and visualization of MEG, EEG, and LFP signals. Comput. Intell. Neurosci. 2011, 5 (2011)CrossRef
7.
Zurück zum Zitat Sourina, O., Wang, Q., Liu, Y., Nguyen, M.: Fractal-based brain state recognition from EEG in human computer interaction. Biomed. Eng. Syst. Technol. 273, 258–272 (2013)CrossRef Sourina, O., Wang, Q., Liu, Y., Nguyen, M.: Fractal-based brain state recognition from EEG in human computer interaction. Biomed. Eng. Syst. Technol. 273, 258–272 (2013)CrossRef
8.
Zurück zum Zitat Muller, K.-R., Tangermann, M., Dornhege, G., Krauledat, M., Curio, G., Blankertz, B.: Machine learning for real-time single-trial EEG-analysis: from brain-computer interfacing to mental state monitoring. J. Neurosci. Methods 167, 82–90 (2008)CrossRef Muller, K.-R., Tangermann, M., Dornhege, G., Krauledat, M., Curio, G., Blankertz, B.: Machine learning for real-time single-trial EEG-analysis: from brain-computer interfacing to mental state monitoring. J. Neurosci. Methods 167, 82–90 (2008)CrossRef
9.
Zurück zum Zitat Weiland, M.Z., Roberts, D.M., Fine, M.S., Caywood, M.S.: Real time research methods: monitoring air traffic controller workload during simulation studies using electroencephalography (EEG). In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 1615–1619 (2013) Weiland, M.Z., Roberts, D.M., Fine, M.S., Caywood, M.S.: Real time research methods: monitoring air traffic controller workload during simulation studies using electroencephalography (EEG). In: Proceedings of the Human Factors and Ergonomics Society Annual Meeting, pp. 1615–1619 (2013)
10.
Zurück zum Zitat Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)MathSciNetCrossRef Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Curr. Psychol. 14(4), 261–292 (1996)MathSciNetCrossRef
11.
Zurück zum Zitat Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23, 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23, 209–237 (2009)CrossRef
12.
Zurück zum Zitat Takahashi, K.: Remarks on emotion recognition from multi-modal bio-potential signals. In: IEEE International Conference on Industrial Technology (IEEE ICIT 2004), vol. 3, pp. 1138–1143 (2004) Takahashi, K.: Remarks on emotion recognition from multi-modal bio-potential signals. In: IEEE International Conference on Industrial Technology (IEEE ICIT 2004), vol. 3, pp. 1138–1143 (2004)
13.
Zurück zum Zitat Schaaff, K.: EEG-based emotion recognition. Diplomarbeit am Institut fur Algorithmen und Kognitive Systeme, Universitat Karlsruhe (TH) (2008) Schaaff, K.: EEG-based emotion recognition. Diplomarbeit am Institut fur Algorithmen und Kognitive Systeme, Universitat Karlsruhe (TH) (2008)
14.
Zurück zum Zitat Pradhan, N., Dutt, D.N.: Use of running fractal dimension for the analysis of changing patterns in electroencephalograms. Comput. Biol. Med. 23, 381–388 (1993)CrossRef Pradhan, N., Dutt, D.N.: Use of running fractal dimension for the analysis of changing patterns in electroencephalograms. Comput. Biol. Med. 23, 381–388 (1993)CrossRef
15.
Zurück zum Zitat Lutzenberger, W., Elbert, T., Birbaumer, N., Ray, W.J., Schupp, H.: The scalp distribution of the fractal dimension of the EEG and its variation with mental tasks. Brain Topogr. 5, 27–34 (1992)CrossRef Lutzenberger, W., Elbert, T., Birbaumer, N., Ray, W.J., Schupp, H.: The scalp distribution of the fractal dimension of the EEG and its variation with mental tasks. Brain Topogr. 5, 27–34 (1992)CrossRef
16.
Zurück zum Zitat Liu, Y., Sourina, O.: Real-time subject-dependent EEG-based emotion recognition algorithm. In: Gavrilova, M.L., Tan, C.J.K., Mao, X., Hong, L. (eds.) Transactions on Computational Science XXIII. LNCS, vol. 8490, pp. 199–223. Springer, Heidelberg (2014) Liu, Y., Sourina, O.: Real-time subject-dependent EEG-based emotion recognition algorithm. In: Gavrilova, M.L., Tan, C.J.K., Mao, X., Hong, L. (eds.) Transactions on Computational Science XXIII. LNCS, vol. 8490, pp. 199–223. Springer, Heidelberg (2014)
17.
Zurück zum Zitat Hart, S., Staveland, L.: Development of a multi-dimensional workload rating scale: results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload (1988) Hart, S., Staveland, L.: Development of a multi-dimensional workload rating scale: results of empirical and theoretical research. In: Hancock, P.A., Meshkati, N. (eds.) Human Mental Workload (1988)
18.
Zurück zum Zitat Waard, D., Studiecentrum, V.: The measurement of drivers’ mental workload. Groningen University, Traffic Research Center (1996) Waard, D., Studiecentrum, V.: The measurement of drivers’ mental workload. Groningen University, Traffic Research Center (1996)
19.
Zurück zum Zitat Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12, 257–285 (1988)CrossRef Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12, 257–285 (1988)CrossRef
20.
Zurück zum Zitat Sammer, G., Blecker, C., Gebhardt, H., Bischoff, M., Stark, R., Morgen, K., Vaitl, D.: Relationship between regional hemodynamic activity and simultaneously recorded EEG-theta associated with mental arithmetic-induced workload. Hum. Brain Mapp. 28, 793–803 (2007)CrossRef Sammer, G., Blecker, C., Gebhardt, H., Bischoff, M., Stark, R., Morgen, K., Vaitl, D.: Relationship between regional hemodynamic activity and simultaneously recorded EEG-theta associated with mental arithmetic-induced workload. Hum. Brain Mapp. 28, 793–803 (2007)CrossRef
21.
Zurück zum Zitat Lei, S., Roetting, M.: Influence of task combination on EEG spectrum modulation for driver workload estimation. Hum. Factors J. Hum. Factors Ergon. Soc. 53, 168–179 (2011)CrossRef Lei, S., Roetting, M.: Influence of task combination on EEG spectrum modulation for driver workload estimation. Hum. Factors J. Hum. Factors Ergon. Soc. 53, 168–179 (2011)CrossRef
22.
Zurück zum Zitat Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (2014)CrossRef Borghini, G., Astolfi, L., Vecchiato, G., Mattia, D., Babiloni, F.: Measuring neurophysiological signals in aircraft pilots and car drivers for the assessment of mental workload, fatigue and drowsiness. Neurosci. Biobehav. Rev. 44, 58–75 (2014)CrossRef
23.
Zurück zum Zitat Khosrowabadi, R., Chai, Q., Kai Keng, A., Sau Wai, T., Heijnen, M.: A brain-computer interface for classifying EEG correlates of chronic mental stress. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 757–762 (2011) Khosrowabadi, R., Chai, Q., Kai Keng, A., Sau Wai, T., Heijnen, M.: A brain-computer interface for classifying EEG correlates of chronic mental stress. In: The 2011 International Joint Conference on Neural Networks (IJCNN), pp. 757–762 (2011)
24.
Zurück zum Zitat Calibo, T.K., Blanco, J.A., Firebaugh, S.L.: Cognitive stress recognition. In: 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1471–1475 (2013) Calibo, T.K., Blanco, J.A., Firebaugh, S.L.: Cognitive stress recognition. In: 2013 IEEE International Instrumentation and Measurement Technology Conference (I2MTC), pp. 1471–1475 (2013)
25.
Zurück zum Zitat Hassellund, S.S., Flaa, A., Sandvik, L., Kjeldsen, S.E., Rostrup, M.: Long-term stability of cardiovascular and catecholamine responses to stress tests: an 18-year follow-up study. Hypertension 55, 131–136 (2010)CrossRef Hassellund, S.S., Flaa, A., Sandvik, L., Kjeldsen, S.E., Rostrup, M.: Long-term stability of cardiovascular and catecholamine responses to stress tests: an 18-year follow-up study. Hypertension 55, 131–136 (2010)CrossRef
26.
Zurück zum Zitat Ssanghee, S., Yeongjun, G., Jungtae, L.: The relation between affective style of stressor on EEG asymmetry and stress scale during multimodal task. In: Third International Conference on Convergence and Hybrid Information Technology, ICCIT 2008, pp. 461–466 (2008) Ssanghee, S., Yeongjun, G., Jungtae, L.: The relation between affective style of stressor on EEG asymmetry and stress scale during multimodal task. In: Third International Conference on Convergence and Hybrid Information Technology, ICCIT 2008, pp. 461–466 (2008)
27.
Zurück zum Zitat Jacobs, S.C., Friedman, R., Parker, J.D., Tofler, G.H., Jimenez, A.H., Muller, J.E., Benson, H., Stone, P.H.: Use of skin conductance changes during mental stress testing as an index of autonomic arousal in cardiovascular research. Am. Heart J. 128, 1170–1177 (1994)CrossRef Jacobs, S.C., Friedman, R., Parker, J.D., Tofler, G.H., Jimenez, A.H., Muller, J.E., Benson, H., Stone, P.H.: Use of skin conductance changes during mental stress testing as an index of autonomic arousal in cardiovascular research. Am. Heart J. 128, 1170–1177 (1994)CrossRef
29.
Zurück zum Zitat Higuchi, T.: Approach to an irregular time series on the basis of the fractal theory. Phys. D Nonlinear Phenom. 31, 277–283 (1988)MathSciNetCrossRefMATH Higuchi, T.: Approach to an irregular time series on the basis of the fractal theory. Phys. D Nonlinear Phenom. 31, 277–283 (1988)MathSciNetCrossRefMATH
30.
Zurück zum Zitat Wang, Q., Sourina, O.: Real-time mental arithmetic task recognition from EEG signals. IEEE Trans. Neural Syst. Rehabil. Eng. 21, 225–232 (2013)CrossRef Wang, Q., Sourina, O.: Real-time mental arithmetic task recognition from EEG signals. IEEE Trans. Neural Syst. Rehabil. Eng. 21, 225–232 (2013)CrossRef
31.
Zurück zum Zitat Wang, Q., Sourina, O., Nguyen, M.: Fractal dimension based neurofeedback in serious games. Vis. Comput. 27, 299–309 (2011)CrossRef Wang, Q., Sourina, O., Nguyen, M.: Fractal dimension based neurofeedback in serious games. Vis. Comput. 27, 299–309 (2011)CrossRef
32.
Zurück zum Zitat Liu, Y., Sourina, O.: EEG databases for emotion recognition. In: 2013 International Conference on Cyberworlds (CW2013), pp. 302–309 (2013) Liu, Y., Sourina, O.: EEG databases for emotion recognition. In: 2013 International Conference on Cyberworlds (CW2013), pp. 302–309 (2013)
33.
Zurück zum Zitat Lan, Z., Sourina, O., Wang, L., Liu, Y.: Real-time EEG-based emotion monitoring using stable features. Vis. Comput. 32, 347–358 (2016)CrossRef Lan, Z., Sourina, O., Wang, L., Liu, Y.: Real-time EEG-based emotion monitoring using stable features. Vis. Comput. 32, 347–358 (2016)CrossRef
34.
Zurück zum Zitat Bradley, M.M., Lang, P.J.: The International Affective Digitized Sounds (IADS-2): affective ratings of sounds and instruction manual. University of Florida, Gainesville, FL, Technical report B-3 (2007) Bradley, M.M., Lang, P.J.: The International Affective Digitized Sounds (IADS-2): affective ratings of sounds and instruction manual. University of Florida, Gainesville, FL, Technical report B-3 (2007)
35.
Zurück zum Zitat Lang, P., Bradley, M.M.: The International Affective Picture System (IAPS) in the study of emotion and attention. In: Handbook of Emotion Elicitation and Assessment, vol. 29 (2007) Lang, P., Bradley, M.M.: The International Affective Picture System (IAPS) in the study of emotion and attention. In: Handbook of Emotion Elicitation and Assessment, vol. 29 (2007)
36.
Zurück zum Zitat Tulen, J., Moleman, P., van Steenis, H., Boomsma, F.: Characterization of stress reactions to the Stroop color word test. Pharmacol. Biochem. Behav. 32, 9–15 (1989)CrossRef Tulen, J., Moleman, P., van Steenis, H., Boomsma, F.: Characterization of stress reactions to the Stroop color word test. Pharmacol. Biochem. Behav. 32, 9–15 (1989)CrossRef
37.
Zurück zum Zitat Hou, X., Liu, Y., Sourina, O., Tan, E., Wang, L., Mueller-Wittig, W.: EEG based stress monitoring. In: IEEE International Conference on in Systems, Man and Cybernetics (SMC), pp. 3110–3115 (2015) Hou, X., Liu, Y., Sourina, O., Tan, E., Wang, L., Mueller-Wittig, W.: EEG based stress monitoring. In: IEEE International Conference on in Systems, Man and Cybernetics (SMC), pp. 3110–3115 (2015)
38.
Zurück zum Zitat Lim, W.L., Sourina, O., Wang, L., Liu, Y.: EEG-based mental workload recognition related to multitasking. In: 10th International Conference on Information, Communications and Signal Processing (ICICS), (2015, in press) Lim, W.L., Sourina, O., Wang, L., Liu, Y.: EEG-based mental workload recognition related to multitasking. In: 10th International Conference on Information, Communications and Signal Processing (ICICS), (2015, in press)
39.
Zurück zum Zitat Lan, Z., Liu, Y., Sourina, O., Wang, L.: Real-time EEG-based user’s valence monitoring. In: Internation Conference on Information, Communications and Signal Processing (ICICS), pp. 1–5, 2–4 December 2015 Lan, Z., Liu, Y., Sourina, O., Wang, L.: Real-time EEG-based user’s valence monitoring. In: Internation Conference on Information, Communications and Signal Processing (ICICS), pp. 1–5, 2–4 December 2015
40.
Zurück zum Zitat Hou, X., Liu, Y., Sourina, O., Mueller-Wittig, W.: CogniMeter: EEG-based emotion, mental workload and stress visual monitoring. In: International Conference on Cyberworlds (CW), pp. 153–160 (2015) Hou, X., Liu, Y., Sourina, O., Mueller-Wittig, W.: CogniMeter: EEG-based emotion, mental workload and stress visual monitoring. In: International Conference on Cyberworlds (CW), pp. 153–160 (2015)
Metadaten
Titel
CogniMeter: EEG-Based Brain States Monitoring
verfasst von
Xiyuan Hou
Yisi Liu
Wei Lun Lim
Zirui Lan
Olga Sourina
Wolfgang Mueller-Wittig
Lipo Wang
Copyright-Jahr
2016
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-662-53090-0_6