Skip to main content
Top

2021 | OriginalPaper | Chapter

Multi-class Emotion Classification Using EEG Signals

Authors : Divya Acharya, Riddhi Jain, Siba Smarak Panigrahi, Rahul Sahni, Siddhi Jain, Sanika Prashant Deshmukh, Arpit Bhardwaj

Published in: Advanced Computing

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recently, the availability of large EEG datasets, advancements in Brain-Computer interface (BCI) systems and Machine Learning have led to the implementation of deep learning architectures, especially in the analysis of emotions using EEG signals. These signals can be generated by the user while performing various mental, emotional and physical tasks thus, reflecting the brain functionality. Extracting the important feature values from these unprocessed signals remain a vital step in the deployment. Fast Fourier Transformation proves to be better than the traditional feature extraction techniques. In this paper we have compared the deep learning models namely Long Short-term Memory (LSTM) and Convolutional Neural Network (CNN) on 80–20 and 75–25 Train-Test splits. The best result was obtained from LSTM classifier with an accuracy of 88.6% on the liking emotion. CNN also gave a good accuracy of 87.72% due to its capability to extract spatial feature from the input signals. Thus, both these models are quite beneficial in this context.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Acharya, D., et al.: An enhanced fitness function to recognize unbalanced human emotions data. Expert Syst. Appl. 166, 114011 (2020)CrossRef Acharya, D., et al.: An enhanced fitness function to recognize unbalanced human emotions data. Expert Syst. Appl. 166, 114011 (2020)CrossRef
2.
go back to reference Acharya, D., Billimoria, A., Srivastava, N., Goel, S., Bhardwaj, A.: Emotion recognition using fourier transform and genetic programming. Appl. Acoust. 164, 107260 (2020)CrossRef Acharya, D., Billimoria, A., Srivastava, N., Goel, S., Bhardwaj, A.: Emotion recognition using fourier transform and genetic programming. Appl. Acoust. 164, 107260 (2020)CrossRef
3.
go back to reference Bairavi, K., Sundhara, K.K.: EEG based emotion recognition system for special children. In: Proceedings of the 2018 International Conference on Communication Engineering and Technology, pp. 1–4, February 2018 Bairavi, K., Sundhara, K.K.: EEG based emotion recognition system for special children. In: Proceedings of the 2018 International Conference on Communication Engineering and Technology, pp. 1–4, February 2018
4.
go back to reference Dabas, H., Sethi, C., Dua, C., Dalawat, M., Sethia, D.: Emotion classification using EEG signals. In: Proceedings of the 2018 2nd International Conference on Computer Science and Artificial Intelligence, pp. 380–384, December 2018 Dabas, H., Sethi, C., Dua, C., Dalawat, M., Sethia, D.: Emotion classification using EEG signals. In: Proceedings of the 2018 2nd International Conference on Computer Science and Artificial Intelligence, pp. 380–384, December 2018
5.
go back to reference Li, Y., Hu, B., Zheng, X., Li, X.: EEG-based mild depressive detection using differential evolution. IEEE Access 7, 7814–7822 (2018)CrossRef Li, Y., Hu, B., Zheng, X., Li, X.: EEG-based mild depressive detection using differential evolution. IEEE Access 7, 7814–7822 (2018)CrossRef
6.
go back to reference Li, X., Yan, J.Z., Chen, J.H.: Channel division based multiple classifiers fusion for emotion recognition using EEG signals. In: ITM Web of Conferences, vol. 11, p. 07006. EDP Sciences (2017) Li, X., Yan, J.Z., Chen, J.H.: Channel division based multiple classifiers fusion for emotion recognition using EEG signals. In: ITM Web of Conferences, vol. 11, p. 07006. EDP Sciences (2017)
7.
go back to reference Donmez, H., Ozkurt, N.: Emotion classification from EEG signals in convolutional neural networks. In: 2019 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1–6. IEEE (2019) Donmez, H., Ozkurt, N.: Emotion classification from EEG signals in convolutional neural networks. In: 2019 Innovations in Intelligent Systems and Applications Conference (ASYU), pp. 1–6. IEEE (2019)
8.
go back to reference Yang, Y., Wu, Q., Qiu, M., Wang, Y., Chen, X.: Emotion recognition from multi-channel EEG through parallel convolutional recurrent neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE, July 2018 Yang, Y., Wu, Q., Qiu, M., Wang, Y., Chen, X.: Emotion recognition from multi-channel EEG through parallel convolutional recurrent neural network. In: 2018 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE, July 2018
9.
go back to reference Tripathi, S., Acharya, S., Sharma, R.D., Mittal, S., Bhattacharya, S.: Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 4746–4752, February 2017 Tripathi, S., Acharya, S., Sharma, R.D., Mittal, S., Bhattacharya, S.: Using deep and convolutional neural networks for accurate emotion classification on DEAP dataset. In: Proceedings of the Thirty-First AAAI Conference on Artificial Intelligence, pp. 4746–4752, February 2017
10.
go back to reference Dunne, R.A., Campbell, N.A.: On the pairing of the softmax activation and cross-entropy penalty functions and the derivation of the softmax activation function. In: Proceedings of 8th Australian Conference on the Neural Networks, Melbourne, vol. 181, p. 185. Citeseer, June 1997 Dunne, R.A., Campbell, N.A.: On the pairing of the softmax activation and cross-entropy penalty functions and the derivation of the softmax activation function. In: Proceedings of 8th Australian Conference on the Neural Networks, Melbourne, vol. 181, p. 185. Citeseer, June 1997
12.
go back to reference Alhagry, S., Fahmy, A.A., El-Khoribi, R.A.: Emotion recognition based on EEG using LSTM recurrent neural network. Emotion 8(10), 355–358 (2017) Alhagry, S., Fahmy, A.A., El-Khoribi, R.A.: Emotion recognition based on EEG using LSTM recurrent neural network. Emotion 8(10), 355–358 (2017)
13.
go back to reference Zhang, J., Chen, M., Hu, S., Cao, Y., Kozma, R.: PNN for EEG-based emotion recognition. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 002319–002323. IEEE, October 2016 Zhang, J., Chen, M., Hu, S., Cao, Y., Kozma, R.: PNN for EEG-based emotion recognition. In: 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 002319–002323. IEEE, October 2016
14.
go back to reference Zhong, P., Wang, D., Miao, C.: EEG-based emotion recognition using regularized graph neural networks. IEEE Trans. Affect. Comput. (2020) Zhong, P., Wang, D., Miao, C.: EEG-based emotion recognition using regularized graph neural networks. IEEE Trans. Affect. Comput. (2020)
15.
go back to reference Li, Y., et al.: A novel bi-hemispheric discrepancy model for EEG emotion recognition. IEEE Trans. Cogn. Dev. Syst. (2020) Li, Y., et al.: A novel bi-hemispheric discrepancy model for EEG emotion recognition. IEEE Trans. Cogn. Dev. Syst. (2020)
16.
go back to reference Acharya, D., Goel, S., Bhardwaj, H., Sakalle, A., Bhardwaj, A.: A long short term memory deep learning network for the classification of negative emotions using EEG signals. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, United Kingdom, pp. 1–8 (2020). https://doi.org/10.1109/IJCNN48605.2020.9207280 Acharya, D., Goel, S., Bhardwaj, H., Sakalle, A., Bhardwaj, A.: A long short term memory deep learning network for the classification of negative emotions using EEG signals. In: 2020 International Joint Conference on Neural Networks (IJCNN), Glasgow, United Kingdom, pp. 1–8 (2020). https://​doi.​org/​10.​1109/​IJCNN48605.​2020.​9207280
17.
go back to reference Bhardwaj, A., Tiwari, A., Varma, M.V., Krishna, M.R.: Classification of EEG signals using a novel genetic programming approach. In: Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO Comp 2014), pp. 1297–1304. Association for Computing Machinery, New York (2014). https://doi.org/10.1145/2598394.2609851 Bhardwaj, A., Tiwari, A., Varma, M.V., Krishna, M.R.: Classification of EEG signals using a novel genetic programming approach. In: Proceedings of the Companion Publication of the 2014 Annual Conference on Genetic and Evolutionary Computation (GECCO Comp 2014), pp. 1297–1304. Association for Computing Machinery, New York (2014). https://​doi.​org/​10.​1145/​2598394.​2609851
21.
go back to reference Abhang, P.A., Mehrotra, S.C.: Introduction to EEG- and Speech-Based Emotion Recognition. Chapter 2 - Technological Basics of EEG Recording and Operation of Apparatus (2016) Abhang, P.A., Mehrotra, S.C.: Introduction to EEG- and Speech-Based Emotion Recognition. Chapter 2 - Technological Basics of EEG Recording and Operation of Apparatus (2016)
22.
23.
go back to reference Hochreiter, S., Schmidhuber, J.: LSTM can solve hard long time lag problems. In: Advances in Neural Information Processing Systems, pp. 473–479 (1997) Hochreiter, S., Schmidhuber, J.: LSTM can solve hard long time lag problems. In: Advances in Neural Information Processing Systems, pp. 473–479 (1997)
24.
go back to reference Choi, E.J., Kim, D.K.: Arousal and valence classification model based on long short-term memory and deap data for mental healthcare management. Healthc. Inf. Res. 24(4), 309–316 (2018)CrossRef Choi, E.J., Kim, D.K.: Arousal and valence classification model based on long short-term memory and deap data for mental healthcare management. Healthc. Inf. Res. 24(4), 309–316 (2018)CrossRef
Metadata
Title
Multi-class Emotion Classification Using EEG Signals
Authors
Divya Acharya
Riddhi Jain
Siba Smarak Panigrahi
Rahul Sahni
Siddhi Jain
Sanika Prashant Deshmukh
Arpit Bhardwaj
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-16-0401-0_38

Premium Partner