Skip to main content
Top

2020 | OriginalPaper | Chapter

EEG-Based Emotion Estimate Using Shallow Fully Convolutional Neural Network with Boost Training Strategy

Authors : Yuehan Yao, Chunmei Qing, Xiangmin Xu, Yang Wang

Published in: Advances in Brain Inspired Cognitive Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Emotion recognition using Electroencephalogram (EEG) has drawn the attention of many scholars. However, there are few studies looking into regressive approach. Actually, human affective states are continuous rather than discrete. This paper focuses on how to estimate continuous affective status from EEG recordings. A Shallow Fully Convolutional Network (SFCN) with Boost Training Strategy is proposed to estimate affective status, including Valence, Arousal, Dominance, and Liking. SFCN is presented to extract the emotional relative features automatically from preprocessed EEG instead of using handcrafted features. With Global Average Pooling (GAP) layer, SFCN can solve the effect of unreliability of label introduced by segmented-augmentation method. Moreover, Boost Training Strategy is designed to train model with low memory cost and further improves the performance of SFCN. Experiments on DEAP dataset demonstrate the effectiveness of proposed approaches. Results show that Mean Square Error (MSE) for Valence, Arousal, Dominance, Liking are 3.9181, 3.6009, 3.4441 and 4.806, respectively.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Koelstra, S., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRef Koelstra, S., et al.: DEAP: a database for emotion analysis; using physiological signals. IEEE Trans. Affect. Comput. 3(1), 18–31 (2012)CrossRef
2.
go back to reference Kumar, N., Khaund, K., Hazarika, S.M.: Bispectral analysis of EEG for emotion recognition. Procedia Comput. Sci. 84, 31–35 (2016)CrossRef Kumar, N., Khaund, K., Hazarika, S.M.: Bispectral analysis of EEG for emotion recognition. Procedia Comput. Sci. 84, 31–35 (2016)CrossRef
3.
go back to reference Lan, Z., et al.: Using support vector regression to estimate valence level from EEG. In: IEEE International Conference on Systems, Man, & Cybernetics (2017) Lan, Z., et al.: Using support vector regression to estimate valence level from EEG. In: IEEE International Conference on Systems, Man, & Cybernetics (2017)
4.
go back to reference Soleymani, M., et al.: Continuous emotion detection in response to music videos. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (2011) Soleymani, M., et al.: Continuous emotion detection in response to music videos. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011) (2011)
5.
go back to reference Al-Fahad, R., Yeasin, M.: Robust modeling of continuous 4-D affective space from EEG recording. In: 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA) (2016) Al-Fahad, R., Yeasin, M.: Robust modeling of continuous 4-D affective space from EEG recording. In: 2016 15th IEEE International Conference on Machine Learning and Applications (ICMLA) (2016)
6.
go back to reference Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of the 3rd International Conference on Learning Representations (2015) Bahdanau, D., Cho, K., Bengio, Y.: Neural machine translation by jointly learning to align and translate. In: Proceedings of the 3rd International Conference on Learning Representations (2015)
7.
go back to reference Tripathi, S., Acharya, S., Sharma, R.D., Mittal, S., Bhattacharya, S.: Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset. In: Twenty-Ninth IAAI Conference (2017) Tripathi, S., Acharya, S., Sharma, R.D., Mittal, S., Bhattacharya, S.: Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset. In: Twenty-Ninth IAAI Conference (2017)
8.
go back to reference Qiao, R., et al.: A novel deep-learning based framework for multi-subject emotion recognition. In: International Conference on Information (2017) Qiao, R., et al.: A novel deep-learning based framework for multi-subject emotion recognition. In: International Conference on Information (2017)
9.
go back to reference Vernon, L., Amelia, S., Nicholas, W., et al.: EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces. J. Neural Eng. (2018) Vernon, L., Amelia, S., Nicholas, W., et al.: EEGNet: a compact convolutional neural network for EEG-based brain–computer interfaces. J. Neural Eng. (2018)
10.
go back to reference Schirrmeister, R.T., Gemein, L., Eggensperger, K., et al.: Deep learning with convolutional neural networks for decoding and visualization of EEG pathology. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef Schirrmeister, R.T., Gemein, L., Eggensperger, K., et al.: Deep learning with convolutional neural networks for decoding and visualization of EEG pathology. Hum. Brain Mapp. 38(11), 5391–5420 (2017)CrossRef
11.
go back to reference Gunes, H., Schuller, B.: Categorical and dimensional affect analysis in continuous input: current trends and future directions. Image Vis. Comput. 31(2), 120–136 (2013)CrossRef Gunes, H., Schuller, B.: Categorical and dimensional affect analysis in continuous input: current trends and future directions. Image Vis. Comput. 31(2), 120–136 (2013)CrossRef
12.
go back to reference Morris, J.D.: SAM: the self-assessment manikin; an efficient cross-cultural measurement of emotional response. J. Adv. Res. 35(8), 63–68 (1995) Morris, J.D.: SAM: the self-assessment manikin; an efficient cross-cultural measurement of emotional response. J. Adv. Res. 35(8), 63–68 (1995)
13.
go back to reference Lin, M., Chen, Q., Yan, S.: Network in network. Comput. Sci. (2013) Lin, M., Chen, Q., Yan, S.: Network in network. Comput. Sci. (2013)
14.
go back to reference Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning. JMLR.org (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning. JMLR.org (2015)
15.
go back to reference Shi, L.C., Jiao, Y.Y., Lu, B.L.: Differential entropy feature for EEG-based vigilance estimation. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6627–6630 (2013) Shi, L.C., Jiao, Y.Y., Lu, B.L.: Differential entropy feature for EEG-based vigilance estimation. In: Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, pp. 6627–6630 (2013)
16.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: International Conference on Neural Information Processing Systems (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: International Conference on Neural Information Processing Systems (2012)
17.
go back to reference Candra, H., et al.: Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine. In: 2015 37th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), pp. 7250–7253 (2015) Candra, H., et al.: Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine. In: 2015 37th Annual International Conference of the IEEE on Engineering in Medicine and Biology Society (EMBC), pp. 7250–7253 (2015)
18.
go back to reference Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of 3rd International Conference on Learning Representations (2015) Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. In: Proceedings of 3rd International Conference on Learning Representations (2015)
19.
go back to reference Padfield, N., Zabalza, J., Zhao, H., Masero, V., Ren, J.: EEG-based brain-computer interfaces using motor-imagery: techniques and challenges. Sensors 19(6), 1423 (2019)CrossRef Padfield, N., Zabalza, J., Zhao, H., Masero, V., Ren, J.: EEG-based brain-computer interfaces using motor-imagery: techniques and challenges. Sensors 19(6), 1423 (2019)CrossRef
20.
go back to reference Ren, J.: ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl.-Based Syst. 26, 144–153 (2012)CrossRef Ren, J.: ANN vs. SVM: which one performs better in classification of MCCs in mammogram imaging. Knowl.-Based Syst. 26, 144–153 (2012)CrossRef
21.
go back to reference Zabalza, J., Clemente, C., Di Caterina, G., Ren, J., Soraghan, J.J., Marshall, S.: Robust PCA micro-doppler classification using SVM on embedded systems. IEEE Trans. Aerosp. Electron. Syst. 50(3), 2304–2310 (2014)CrossRef Zabalza, J., Clemente, C., Di Caterina, G., Ren, J., Soraghan, J.J., Marshall, S.: Robust PCA micro-doppler classification using SVM on embedded systems. IEEE Trans. Aerosp. Electron. Syst. 50(3), 2304–2310 (2014)CrossRef
Metadata
Title
EEG-Based Emotion Estimate Using Shallow Fully Convolutional Neural Network with Boost Training Strategy
Authors
Yuehan Yao
Chunmei Qing
Xiangmin Xu
Yang Wang
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-39431-8_6

Premium Partner