Skip to main content

2017 | OriginalPaper | Buchkapitel

Optimized Echo State Network with Intrinsic Plasticity for EEG-Based Emotion Recognition

verfasst von : Rahma Fourati, Boudour Ammar, Chaouki Aouiti, Javier Sanchez-Medina, Adel M. Alimi

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Reservoir Computing (RC) is a paradigm for efficient training of Recurrent Neural Networks (RNNs). The Echo State Network (ESN), a type of RC paradigm, has been widely used for time series forecasting. Whereas, few works exist on classification with ESN. In this paper, we shed light on the use of ESN for pattern recognition problem, i.e. emotion recognition from Electroencephalogram (EEG). We show that the reservoir with its recurrence is able to perform the feature extraction step directly from the EEG raw. Such kind of recurrence rich of nonlinearities allows the projection of the input data into a high dimensional state space. It is well known that the ESN fails due to the poor choices of its initialization. Nevertheless, we show that pretraining the ESN with the Intrinsic Plasticity (IP) rule remedies the shortcoming of randomly initialization. To validate our approach, we tested our system on the benchmark DEAP containing EEG signals of 32 subjects and the results were promising.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23, 209–237 (2009)CrossRef Mauss, I.B., Robinson, M.D.: Measures of emotion: a review. Cogn. Emot. 23, 209–237 (2009)CrossRef
2.
Zurück zum Zitat Ekman, P.: Basic Emotions in Handbook of Cognition and Emotion. Wiley, New York (1999) Ekman, P.: Basic Emotions in Handbook of Cognition and Emotion. Wiley, New York (1999)
3.
Zurück zum Zitat Russell, J.A.: Affective space is bipolar. J. Pers. Soc. Psychol. 37, 345–356 (1979)CrossRef Russell, J.A.: Affective space is bipolar. J. Pers. Soc. Psychol. 37, 345–356 (1979)CrossRef
4.
Zurück zum Zitat Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Current Psychol. 14, 261–292 (1996)CrossRefMathSciNet Mehrabian, A.: Pleasure-arousal-dominance: a general framework for describing and measuring individual differences in temperament. Current Psychol. 14, 261–292 (1996)CrossRefMathSciNet
5.
Zurück zum Zitat Bezine, H., Alimi, A.M., Derbel, N.: Handwriting trajectory movements controlled by a bêta-elliptic model. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 1228 (2003) Bezine, H., Alimi, A.M., Derbel, N.: Handwriting trajectory movements controlled by a bêta-elliptic model. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 1228 (2003)
6.
Zurück zum Zitat Ben Moussa, S., Zahour, A., Benabdelhafid, A., Alimi, A.M.: New features using fractal multi-dimensions for generalized Arabic font recognition. Pattern Recognition Letters, vol. 31 (5), pp. 361–371 (2010) Ben Moussa, S., Zahour, A., Benabdelhafid, A., Alimi, A.M.: New features using fractal multi-dimensions for generalized Arabic font recognition. Pattern Recognition Letters, vol. 31 (5), pp. 361–371 (2010)
7.
Zurück zum Zitat Alimi, A.M.: Evolutionary computation for the recognition of on-line cursive handwriting. IETE J. Res. 48(5), 385–396 (2002). SPECCrossRef Alimi, A.M.: Evolutionary computation for the recognition of on-line cursive handwriting. IETE J. Res. 48(5), 385–396 (2002). SPECCrossRef
8.
Zurück zum Zitat Boubaker, H., Kherallah, M., Alimi, A.M.: New algorithm of straight or curved baseline detection for short arabic handwritten writing. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 778 (2009) Boubaker, H., Kherallah, M., Alimi, A.M.: New algorithm of straight or curved baseline detection for short arabic handwritten writing. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 778 (2009)
9.
Zurück zum Zitat Elbaati, A., Boubaker, H., Kherallah, M., Alimi, A.M., Ennaji, A., Abed, H.E.: Arabic handwriting recognition using restored stroke chronology. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 411 (2009) Elbaati, A., Boubaker, H., Kherallah, M., Alimi, A.M., Ennaji, A., Abed, H.E.: Arabic handwriting recognition using restored stroke chronology. In: Proceedings of the International Conference on Document Analysis and Recognition, ICDAR, p. 411 (2009)
10.
Zurück zum Zitat Slimane, F., Kanoun, S., Hennebert, J., Alimi, A.M., Ingold, R.: A study on font-family and font-size recognition applied to Arabic word images at ultra-low resolution. Pattern Recogn. Lett. 34(2), 209–218 (2013)CrossRef Slimane, F., Kanoun, S., Hennebert, J., Alimi, A.M., Ingold, R.: A study on font-family and font-size recognition applied to Arabic word images at ultra-low resolution. Pattern Recogn. Lett. 34(2), 209–218 (2013)CrossRef
11.
Zurück zum Zitat Jaeger, H.: A tutorial on training recurrent neural networks, covering bppt, rtrl, ekf and the echo state network approach. Technical report, German National Research Center for Information Technology (2013) Jaeger, H.: A tutorial on training recurrent neural networks, covering bppt, rtrl, ekf and the echo state network approach. Technical report, German National Research Center for Information Technology (2013)
12.
Zurück zum Zitat Triesch, J.: A gradient rule for the plasticity of a neuron’s intrinsic excitability. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3696, pp. 65–70. Springer, Heidelberg (2005). doi:10.1007/11550822_11 CrossRef Triesch, J.: A gradient rule for the plasticity of a neuron’s intrinsic excitability. In: Duch, W., Kacprzyk, J., Oja, E., Zadrożny, S. (eds.) ICANN 2005. LNCS, vol. 3696, pp. 65–70. Springer, Heidelberg (2005). doi:10.​1007/​11550822_​11 CrossRef
13.
Zurück zum Zitat Koelstra, S., et al.: DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affective Comput. 3, 18–31 (2012)CrossRef Koelstra, S., et al.: DEAP: a database for emotion analysis using physiological signals. IEEE Trans. Affective Comput. 3, 18–31 (2012)CrossRef
14.
Zurück zum Zitat Liu, Y., Sourina, O.: Real-time fractal-based valence level recognition from EEG. In: Gavrilova, Marina L., Tan, C.J.Kenneth, Kuijper, A. (eds.) Transactions on Computational Science XVIII. LNCS, vol. 7848, pp. 101–120. Springer, Heidelberg (2013). doi:10.1007/978-3-642-38803-3_6 CrossRef Liu, Y., Sourina, O.: Real-time fractal-based valence level recognition from EEG. In: Gavrilova, Marina L., Tan, C.J.Kenneth, Kuijper, A. (eds.) Transactions on Computational Science XVIII. LNCS, vol. 7848, pp. 101–120. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-38803-3_​6 CrossRef
15.
Zurück zum Zitat Bahari, F., Janghorbani, A.: EEG-based emotion recognition using recurrence plot analysis and k nearest neighbor classifier. In 20th Iranian Conference on Biomedical Engineering (ICBME), pp. 228–233 (2013) Bahari, F., Janghorbani, A.: EEG-based emotion recognition using recurrence plot analysis and k nearest neighbor classifier. In 20th Iranian Conference on Biomedical Engineering (ICBME), pp. 228–233 (2013)
16.
Zurück zum Zitat Zhang, X., Hu, B., Chen, J., Moore, P.: Ontology-based context modeling for emotion recognition in an intelligent web. World Wide Web 16(4), 497–513 (2013)CrossRef Zhang, X., Hu, B., Chen, J., Moore, P.: Ontology-based context modeling for emotion recognition in an intelligent web. World Wide Web 16(4), 497–513 (2013)CrossRef
17.
Zurück zum Zitat Zhuang, X., Rozgic, V., Crystal, M.: Compact unsupervised EEG response representation for emotion recognition. In: International Conference on Biomedical and Health Informatics (BHI), pp. 736–739 (2014) Zhuang, X., Rozgic, V., Crystal, M.: Compact unsupervised EEG response representation for emotion recognition. In: International Conference on Biomedical and Health Informatics (BHI), pp. 736–739 (2014)
18.
Zurück zum Zitat Torres-Valencia, C., Garcia-Arias, H., Alvarez Lopez, M., Orozco-Gutierrez, A.: Comparative analysis of physiological signals and electroencephalogram (EEG) for multimodal emotion recognition using generative models. In: XIX Symposium on Image, Signal Processing and Artificial Vision (STSIVA), pp. 1–5 (2014) Torres-Valencia, C., Garcia-Arias, H., Alvarez Lopez, M., Orozco-Gutierrez, A.: Comparative analysis of physiological signals and electroencephalogram (EEG) for multimodal emotion recognition using generative models. In: XIX Symposium on Image, Signal Processing and Artificial Vision (STSIVA), pp. 1–5 (2014)
19.
Zurück zum Zitat Li, X., Zhang, P., Song, D., Yu, G., Hou, Y., Hu, B.: EEG based emotion identification using unsupervised deep feature learning. In: SIGIR2015 Workshop on Neuro-Physiological Methods in IR Research (2015) Li, X., Zhang, P., Song, D., Yu, G., Hou, Y., Hu, B.: EEG based emotion identification using unsupervised deep feature learning. In: SIGIR2015 Workshop on Neuro-Physiological Methods in IR Research (2015)
20.
Zurück zum Zitat Zheng, W.-L., Zhu, J.-Y., Lu, B.-L.: Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans. Affective Comput. 8 (2017) Zheng, W.-L., Zhu, J.-Y., Lu, B.-L.: Identifying stable patterns over time for emotion recognition from EEG. IEEE Trans. Affective Comput. 8 (2017)
21.
Zurück zum Zitat Bozhkov, L., Koprinkova-Hristova, P., Georgieva, P.: Reservoir computing for emotion valence discrimination from EEG signals. Neurocomputing 231, 28–40 (2017)CrossRef Bozhkov, L., Koprinkova-Hristova, P., Georgieva, P.: Reservoir computing for emotion valence discrimination from EEG signals. Neurocomputing 231, 28–40 (2017)CrossRef
22.
Zurück zum Zitat Dhahri, H., Alimi, A.M.: The modified differential evolution and the RBF (MDE-RBF) neural network for time series prediction. In: Proceedings of IEEE International Conference on Neural Networks, p. 2938 (2006) Dhahri, H., Alimi, A.M.: The modified differential evolution and the RBF (MDE-RBF) neural network for time series prediction. In: Proceedings of IEEE International Conference on Neural Networks, p. 2938 (2006)
23.
Zurück zum Zitat Bouaziz, S., Dhahri, H., Alimi, A.M., Abraham, A.: A hybrid learning algorithm for evolving flexible beta basis function neural tree model. Neurocomputing 117, 107–117 (2013)CrossRef Bouaziz, S., Dhahri, H., Alimi, A.M., Abraham, A.: A hybrid learning algorithm for evolving flexible beta basis function neural tree model. Neurocomputing 117, 107–117 (2013)CrossRef
24.
Zurück zum Zitat Chouikhi, N., Ammar, B., Rokabni, N., Alimi, A.M., Abraham, A.: PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef Chouikhi, N., Ammar, B., Rokabni, N., Alimi, A.M., Abraham, A.: PSO-based analysis of Echo State Network parameters for time series forecasting. Appl. Soft Comput. 55, 211–225 (2017)CrossRef
25.
Zurück zum Zitat Chouikhi, N., Fdhila, R., Ammar, B., Rokbani, N., Alimi, A.M.: Single- and multi-objective particle swarm optimization of reservoir structure in echo state network. In: IEEE International Joint Conference on Neural Networks, Vancouver, Canada (2016) Chouikhi, N., Fdhila, R., Ammar, B., Rokbani, N., Alimi, A.M.: Single- and multi-objective particle swarm optimization of reservoir structure in echo state network. In: IEEE International Joint Conference on Neural Networks, Vancouver, Canada (2016)
26.
Zurück zum Zitat Steil, J.J.: Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning. IEEE Trans. Neural Netw. 20(3), 353–364 (2007)CrossRefMATH Steil, J.J.: Online reservoir adaptation by intrinsic plasticity for backpropagation-decorrelation and echo state learning. IEEE Trans. Neural Netw. 20(3), 353–364 (2007)CrossRefMATH
27.
Zurück zum Zitat Wardermann, M., Steil, J.J.: Intrinsic plasticity for reservoir learning algorithms. In: Verleysen, M. (ed.) Advances in Computational Intelligence and Learning (ESANN 2007), pp. 513–518 (2007) Wardermann, M., Steil, J.J.: Intrinsic plasticity for reservoir learning algorithms. In: Verleysen, M. (ed.) Advances in Computational Intelligence and Learning (ESANN 2007), pp. 513–518 (2007)
28.
Zurück zum Zitat Schrauwen, B., Wandermann, M., Verstraeten, M., Steil, J.J., Stroobandt, D.: Improving reservoirs using intrinsic plasticity. Neurocomputing 71, 1159–1171 (2008)CrossRef Schrauwen, B., Wandermann, M., Verstraeten, M., Steil, J.J., Stroobandt, D.: Improving reservoirs using intrinsic plasticity. Neurocomputing 71, 1159–1171 (2008)CrossRef
29.
Zurück zum Zitat Koprinkova-Hristova, P.: On effects of IP improvement of ESN reservoirs for reflecting of data structure. In: IEEE International Joint Conference on Neural Networks (2015) Koprinkova-Hristova, P.: On effects of IP improvement of ESN reservoirs for reflecting of data structure. In: IEEE International Joint Conference on Neural Networks (2015)
30.
Zurück zum Zitat Liu, Y., Sourina, O.: EEG databases for emotion recognition. In: International Conference on Cyberworlds (2013) Liu, Y., Sourina, O.: EEG databases for emotion recognition. In: International Conference on Cyberworlds (2013)
Metadaten
Titel
Optimized Echo State Network with Intrinsic Plasticity for EEG-Based Emotion Recognition
verfasst von
Rahma Fourati
Boudour Ammar
Chaouki Aouiti
Javier Sanchez-Medina
Adel M. Alimi
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-70096-0_73