Skip to main content

2017 | OriginalPaper | Buchkapitel

Study of Electroencephalographic Signal Regularity for Automatic Emotion Recognition

verfasst von : Arturo Martínez-Rodrigo, Beatriz García-Martínez, Raúl Alcaraz, Antonio Fernández-Caballero, Pascual González

Erschienen in: Ubiquitous Computing and Ambient Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nowadays, emotional intelligence plays a key role in improving human-machine interaction (HMI). The main objective of HMI is to fill the gap between human emotional states and the reaction of a computer in accordance with this feeling. However, there is a lack of mathematical emotional models to implement affective computing systems into real applications. Consequently, this paper explores the properties of the nonlinear methodology based on Quadratic Sample Entropy (QSE) for the recognition of different emotional subspaces. Precisely, 665 segments of 32-channel electroencephalographic recordings from 32 subjects elicited with different emotional stimuli have been analyzed to validate the proposed model. Results conclude that QSE is a promising feature to be taken into account. Indeed, this metric has reported a discriminant ability around 72% using a support vector machine classifier. This result is comparable with the outcomes reported by other more complex methodologies which use multi-parametric analysis.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abásolo, D., Hornero, R., Gómez, C., García, M., López, M.: Analysis of EEG background activity in alzheimer’s disease patients with lempel-ziv complexity and central tendency measure. Med. Eng. Phys. 28(4), 315–322 (2006)CrossRef Abásolo, D., Hornero, R., Gómez, C., García, M., López, M.: Analysis of EEG background activity in alzheimer’s disease patients with lempel-ziv complexity and central tendency measure. Med. Eng. Phys. 28(4), 315–322 (2006)CrossRef
2.
Zurück zum Zitat Acharya, U.R., Joseph, K.P., Kannathal, N., Lim, C.M., Suri, J.S.: Heart rate variability: a review. Med. Biol. Eng. Comput. 44(12), 1031–1051 (2006)CrossRef Acharya, U.R., Joseph, K.P., Kannathal, N., Lim, C.M., Suri, J.S.: Heart rate variability: a review. Med. Biol. Eng. Comput. 44(12), 1031–1051 (2006)CrossRef
3.
Zurück zum Zitat Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., Ayyash, M.: Internet of things: a survey on enabling technologies, protocols, and applications. IEEE Commun. Surv. Tutorials 17(4), 2347–2376 (2015)CrossRef Al-Fuqaha, A., Guizani, M., Mohammadi, M., Aledhari, M., Ayyash, M.: Internet of things: a survey on enabling technologies, protocols, and applications. IEEE Commun. Surv. Tutorials 17(4), 2347–2376 (2015)CrossRef
4.
Zurück zum Zitat Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)CrossRef Calvo, R.A., D’Mello, S.: Affect detection: an interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1(1), 18–37 (2010)CrossRef
5.
Zurück zum Zitat Cao, Y., Cai, L., Wang, J., Wang, R., Yu, H., Cao, Y., Liu, J.: Characterization of complexity in the electroencephalograph activity of alzheimer’s disease based on fuzzy entropy. Chaos 25(8), 083116 (2015)MathSciNetCrossRef Cao, Y., Cai, L., Wang, J., Wang, R., Yu, H., Cao, Y., Liu, J.: Characterization of complexity in the electroencephalograph activity of alzheimer’s disease based on fuzzy entropy. Chaos 25(8), 083116 (2015)MathSciNetCrossRef
6.
Zurück zum Zitat Castillo, J.C., Castro-González, Á., Fernández-Caballero, A., Latorre, J.M., Pastor, J.M., Fernández-Sotos, A., Salichs, M.A.: Software architecture for smart emotion recognition and regulation of the ageing adult. Cogn. Comput. 8(2), 357–367 (2016)CrossRef Castillo, J.C., Castro-González, Á., Fernández-Caballero, A., Latorre, J.M., Pastor, J.M., Fernández-Sotos, A., Salichs, M.A.: Software architecture for smart emotion recognition and regulation of the ageing adult. Cogn. Comput. 8(2), 357–367 (2016)CrossRef
7.
Zurück zum Zitat Castillo, J.C., Fernández-Caballero, A., Castro-González, Á., Salichs, M.A., López, M.T.: A framework for recognizing and regulating emotions in the elderly. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds.) IWAAL 2014. LNCS, vol. 8868, pp. 320–327. Springer, Cham (2014). doi:10.1007/978-3-319-13105-4_46 Castillo, J.C., Fernández-Caballero, A., Castro-González, Á., Salichs, M.A., López, M.T.: A framework for recognizing and regulating emotions in the elderly. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds.) IWAAL 2014. LNCS, vol. 8868, pp. 320–327. Springer, Cham (2014). doi:10.​1007/​978-3-319-13105-4_​46
8.
Zurück zum Zitat Colibazzi, T., Posner, J., Wang, Z., Gorman, D., Gerber, A., Yu, S., Zhu, H., Kangarlu, A., Duan, Y., Russell, J.A., et al.: Neural systems subserving valence and arousal during the experience of induced emotions. Emotion 10(3), 377 (2010)CrossRef Colibazzi, T., Posner, J., Wang, Z., Gorman, D., Gerber, A., Yu, S., Zhu, H., Kangarlu, A., Duan, Y., Russell, J.A., et al.: Neural systems subserving valence and arousal during the experience of induced emotions. Emotion 10(3), 377 (2010)CrossRef
9.
Zurück zum Zitat Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992)CrossRef Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992)CrossRef
10.
Zurück zum Zitat Castillo, J.C., Fernández-Caballero, A., Castro-González, Á., Salichs, M.A., López, M.T.: A framework for recognizing and regulating emotions in the elderly. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds.) IWAAL 2014. LNCS, vol. 8868, pp. 320–327. Springer, Cham (2014). doi:10.1007/978-3-319-13105-4_46 Castillo, J.C., Fernández-Caballero, A., Castro-González, Á., Salichs, M.A., López, M.T.: A framework for recognizing and regulating emotions in the elderly. In: Pecchia, L., Chen, L.L., Nugent, C., Bravo, J. (eds.) IWAAL 2014. LNCS, vol. 8868, pp. 320–327. Springer, Cham (2014). doi:10.​1007/​978-3-319-13105-4_​46
11.
Zurück zum Zitat Fernández-Caballero, A., Martínez-Rodrigo, A., Pastor, J.M., Castillo, J.C., Lozano-Monasor, E., López, M.T., Zangróniz, R., Latorre, J.M., Fernández-Sotos, A.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inform. 64, 55–73 (2016)CrossRef Fernández-Caballero, A., Martínez-Rodrigo, A., Pastor, J.M., Castillo, J.C., Lozano-Monasor, E., López, M.T., Zangróniz, R., Latorre, J.M., Fernández-Sotos, A.: Smart environment architecture for emotion detection and regulation. J. Biomed. Inform. 64, 55–73 (2016)CrossRef
12.
Zurück zum Zitat García-Martínez, B., Martínez-Rodrigo, A., Zangróniz Cantabrana, R., Pastor García, J., Alcaraz, R.: Application of entropy-based metrics to identify emotional distress from electroencephalographic recordings. Entropy 18(6), 221 (2016)MathSciNetCrossRef García-Martínez, B., Martínez-Rodrigo, A., Zangróniz Cantabrana, R., Pastor García, J., Alcaraz, R.: Application of entropy-based metrics to identify emotional distress from electroencephalographic recordings. Entropy 18(6), 221 (2016)MathSciNetCrossRef
13.
Zurück zum Zitat Gomes, M., Oliveira, T., Silva, F., Carneiro, D., Novais, P.: Establishing the relationship between personality traits and stress in an intelligent environment. In: Ali, M., Pan, J.-S., Chen, S.-M., Horng, M.-F. (eds.) IEA/AIE 2014. LNCS, vol. 8482, pp. 378–387. Springer, Cham (2014). doi:10.1007/978-3-319-07467-2_40 CrossRef Gomes, M., Oliveira, T., Silva, F., Carneiro, D., Novais, P.: Establishing the relationship between personality traits and stress in an intelligent environment. In: Ali, M., Pan, J.-S., Chen, S.-M., Horng, M.-F. (eds.) IEA/AIE 2014. LNCS, vol. 8482, pp. 378–387. Springer, Cham (2014). doi:10.​1007/​978-3-319-07467-2_​40 CrossRef
14.
Zurück zum Zitat Hatamikia, S., Nasrabadi, A.: Recognition of emotional states induced by music videos based on nonlinear feature extraction and som classification. In: 21th Iranian Conference on Biomedical Engineering (ICBME), pp. 333–337. IEEE (2014) Hatamikia, S., Nasrabadi, A.: Recognition of emotional states induced by music videos based on nonlinear feature extraction and som classification. In: 21th Iranian Conference on Biomedical Engineering (ICBME), pp. 333–337. IEEE (2014)
15.
Zurück zum Zitat Jadhav, P., Shanamugan, D., Chourasia, A., Ghole, A., Acharyya, A., Naik, G.: Automated detection and correction of eye blink and muscular artefacts in EEG signal for analysis of autism spectrum disorder. In: Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, pp. 1881–1884. IEEE (2014) Jadhav, P., Shanamugan, D., Chourasia, A., Ghole, A., Acharyya, A., Naik, G.: Automated detection and correction of eye blink and muscular artefacts in EEG signal for analysis of autism spectrum disorder. In: Engineering in Medicine and Biology Society (EMBC), 2014 36th Annual International Conference of the IEEE, pp. 1881–1884. IEEE (2014)
16.
Zurück zum Zitat Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
17.
Zurück zum Zitat Kim, M.K., Kim, M., Oh, E., Kim, S.P.: A review on the computational methods for emotional state estimation from the human EEG. Comput. Math. Methods Med. 2013, 573734 (2013)MathSciNetMATH Kim, M.K., Kim, M., Oh, E., Kim, S.P.: A review on the computational methods for emotional state estimation from the human EEG. Comput. Math. Methods Med. 2013, 573734 (2013)MathSciNetMATH
18.
Zurück zum Zitat Koelstra, S., Muhl, C., Soleymani, M., Lee, J.S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., Patras, I.: Deap: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRef Koelstra, S., Muhl, C., Soleymani, M., Lee, J.S., Yazdani, A., Ebrahimi, T., Pun, T., Nijholt, A., Patras, I.: Deap: a database for emotion analysis using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRef
19.
Zurück zum Zitat Lake, D.E., Moorman, J.R.: Accurate estimation of entropy in very short physiological time series: the problem of atrial fibrillation detection in implanted ventricular devices. Am. J. Physiol. Heart Circ. Physiol. 300(1), H319–H325 (2011)CrossRef Lake, D.E., Moorman, J.R.: Accurate estimation of entropy in very short physiological time series: the problem of atrial fibrillation detection in implanted ventricular devices. Am. J. Physiol. Heart Circ. Physiol. 300(1), H319–H325 (2011)CrossRef
20.
Zurück zum Zitat Liu, Y.H., Wu, C.T., Kao, Y.H., Chen, Y.T.: Single-trial EEG-based emotion recognition using kernel eigen-emotion pattern and adaptive support vector machine. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEEm, pp. 4306–4309. IEEE (2013) Liu, Y.H., Wu, C.T., Kao, Y.H., Chen, Y.T.: Single-trial EEG-based emotion recognition using kernel eigen-emotion pattern and adaptive support vector machine. In: Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEEm, pp. 4306–4309. IEEE (2013)
21.
Zurück zum Zitat Lozano-Monasor, E., López, M.T., Vigo-Bustos, F., Fernández-Caballero, A.: Facial expression recognition in ageing adults: from lab to ambient assisted living. J. Ambient Intell. Humanized Comput. 8, 1–12 (2017)CrossRef Lozano-Monasor, E., López, M.T., Vigo-Bustos, F., Fernández-Caballero, A.: Facial expression recognition in ageing adults: from lab to ambient assisted living. J. Ambient Intell. Humanized Comput. 8, 1–12 (2017)CrossRef
22.
Zurück zum Zitat Martínez-Rodrigo, A., Zangróniz, R., Pastor, J.M., Fernández-Caballero, A.: Arousal level classification in the ageing adult by measuring electrodermal skin conductivity. In: Bravo, J., Hervás, R., Villarreal, V. (eds.) AmIHEALTH 2015. LNCS, vol. 9456, pp. 213–223. Springer, Cham (2015). doi:10.1007/978-3-319-26508-7_21 CrossRef Martínez-Rodrigo, A., Zangróniz, R., Pastor, J.M., Fernández-Caballero, A.: Arousal level classification in the ageing adult by measuring electrodermal skin conductivity. In: Bravo, J., Hervás, R., Villarreal, V. (eds.) AmIHEALTH 2015. LNCS, vol. 9456, pp. 213–223. Springer, Cham (2015). doi:10.​1007/​978-3-319-26508-7_​21 CrossRef
23.
Zurück zum Zitat Martínez-Rodrigo, A., Zangróniz, R., Pastor, J.M., Sokolova, M.V.: Arousal level classification of the aging adult from electro-dermal activity: from hardware development to software architecture. Pervasive Mob. Comput. 34, 46–59 (2017)CrossRef Martínez-Rodrigo, A., Zangróniz, R., Pastor, J.M., Sokolova, M.V.: Arousal level classification of the aging adult from electro-dermal activity: from hardware development to software architecture. Pervasive Mob. Comput. 34, 46–59 (2017)CrossRef
24.
Zurück zum Zitat Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23(2), 209–237 (2009)CrossRef
25.
Zurück zum Zitat Mert, A., Akan, A.: Emotion recognition from EEG signals by using multivariate empirical mode decomposition. Pattern Anal. Appl (2016) Mert, A., Akan, A.: Emotion recognition from EEG signals by using multivariate empirical mode decomposition. Pattern Anal. Appl (2016)
26.
Zurück zum Zitat Morris, J.D.: Observations SAM: the Self-Assessment Manikin - An efficient cross-cultural measurement of emotional response. J. Advertising Res. 35(6), 63–68 (1995) Morris, J.D.: Observations SAM: the Self-Assessment Manikin - An efficient cross-cultural measurement of emotional response. J. Advertising Res. 35(6), 63–68 (1995)
27.
Zurück zum Zitat Nasoz, F., Lisetti, C.L., Alvarez, K., Finkelstein, N.: Emotion recognition from physiological signals for user modeling of affect. In: Proceedings of the 3rd Workshop on Affective and Attitude User Modelling, Pittsburgh, PA, USA (2003) Nasoz, F., Lisetti, C.L., Alvarez, K., Finkelstein, N.: Emotion recognition from physiological signals for user modeling of affect. In: Proceedings of the 3rd Workshop on Affective and Attitude User Modelling, Pittsburgh, PA, USA (2003)
28.
29.
Zurück zum Zitat Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)CrossRef Poria, S., Cambria, E., Bajpai, R., Hussain, A.: A review of affective computing: from unimodal analysis to multimodal fusion. Inf. Fusion 37, 98–125 (2017)CrossRef
30.
Zurück zum Zitat Reis, P.M., Hebenstreit, F., Gabsteiger, F., von Tscharner, V., Lochmann, M.: Methodological aspects of EEG and body dynamics measurements during motion. In: Towards a New Cognitive Neuroscience: Modeling Natural Brain Dynamics, p. 9 (2014) Reis, P.M., Hebenstreit, F., Gabsteiger, F., von Tscharner, V., Lochmann, M.: Methodological aspects of EEG and body dynamics measurements during motion. In: Towards a New Cognitive Neuroscience: Modeling Natural Brain Dynamics, p. 9 (2014)
31.
Zurück zum Zitat Richman, J.S., Moorman, J.R.: Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 278(6), H2039–H2049 (2000) Richman, J.S., Moorman, J.R.: Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 278(6), H2039–H2049 (2000)
32.
Zurück zum Zitat Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)CrossRef Russell, J.A.: A circumplex model of affect. J. Pers. Soc. Psychol. 39(6), 1161–1178 (1980)CrossRef
33.
Zurück zum Zitat Sanei, S.: Adaptive Processing of Brain Signals. Wiley, Oxford (2013)CrossRef Sanei, S.: Adaptive Processing of Brain Signals. Wiley, Oxford (2013)CrossRef
34.
Zurück zum Zitat Schröder, M., Cowie, R.: Towards emotion-sensitive multimodal interfaces: The challenge of the european network of excellence humaine. In: Adapting the Interaction Style to Affective Factors Workshop in Conjunction with User Modeling (2005) Schröder, M., Cowie, R.: Towards emotion-sensitive multimodal interfaces: The challenge of the european network of excellence humaine. In: Adapting the Interaction Style to Affective Factors Workshop in Conjunction with User Modeling (2005)
35.
Zurück zum Zitat Tao, J., Tan, T.: Affective computing: a review. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 981–995. Springer, Heidelberg (2005). doi:10.1007/11573548_125 CrossRef Tao, J., Tan, T.: Affective computing: a review. In: Tao, J., Tan, T., Picard, R.W. (eds.) ACII 2005. LNCS, vol. 3784, pp. 981–995. Springer, Heidelberg (2005). doi:10.​1007/​11573548_​125 CrossRef
36.
Zurück zum Zitat Valenza, G., Lanata, A., Scilingo, E.P.: The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans. Affect. Comput. 3(2), 237–249 (2012)CrossRef Valenza, G., Lanata, A., Scilingo, E.P.: The role of nonlinear dynamics in affective valence and arousal recognition. IEEE Trans. Affect. Comput. 3(2), 237–249 (2012)CrossRef
37.
Zurück zum Zitat Ververidis, D., Kotropoulos, C.: Emotional speech recognition: Resources, features, and methods. Speech Commun. 48(9), 1162–1181 (2006)CrossRef Ververidis, D., Kotropoulos, C.: Emotional speech recognition: Resources, features, and methods. Speech Commun. 48(9), 1162–1181 (2006)CrossRef
38.
Zurück zum Zitat Wagner, J., Kim, J., André, E.: From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: IEEE International Conference on Multimedia and Expo, ICME 2005, pp. 940–943. IEEE (2005) Wagner, J., Kim, J., André, E.: From physiological signals to emotions: implementing and comparing selected methods for feature extraction and classification. In: IEEE International Conference on Multimedia and Expo, ICME 2005, pp. 940–943. IEEE (2005)
Metadaten
Titel
Study of Electroencephalographic Signal Regularity for Automatic Emotion Recognition
verfasst von
Arturo Martínez-Rodrigo
Beatriz García-Martínez
Raúl Alcaraz
Antonio Fernández-Caballero
Pascual González
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-67585-5_74