Skip to main content

2015 | OriginalPaper | Buchkapitel

Emotion Recognition from EEG Signals by Leveraging Stimulus Videos

verfasst von : Zhen Gao, Shangfei Wang

Erschienen in: Advances in Multimedia Information Processing -- PCM 2015

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper proposes a new emotion recognition method from electroencephalogram (EEG) signals by leveraging video stimulus as privileged information, which is only required during training. A Restricted Boltzmann Machine (RBM) is adopted to model the intrinsic relations between stimulus videos and users’ EEG response, and to generate new EEG features. Then, the support vector machine is used to recognize users’ emotion states from the generated EEG features. Experiments on two benchmark databases demonstrate that stimulus videos as the privileged information can help EEG signals construct better feature space, and RBM can model the high-order dependencies between stimulus videos and users’ EEG response successfully. Our proposed emotion recognition method leveraging video stimulus as privileged information outperforms the recognition method only from EEG signals.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hinton, G.: A practical guide to training restricted boltzmann machines. Momentum 9(1), 926 (2010) Hinton, G.: A practical guide to training restricted boltzmann machines. Momentum 9(1), 926 (2010)
2.
Zurück zum Zitat Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH Hinton, G.E., Salakhutdinov, R.R.: Reducing the dimensionality of data with neural networks. Science 313(5786), 504–507 (2006)MathSciNetCrossRefMATH
3.
Zurück zum Zitat Soleymani, M., Koelstra, S., Patras, I., Pun, T.: Continuous emotion detection in response to music videos. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 803–808. IEEE (2011) Soleymani, M., Koelstra, S., Patras, I., Pun, T.: Continuous emotion detection in response to music videos. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 803–808. IEEE (2011)
4.
Zurück zum Zitat Soleymani, M., Lichtenauer, J., Pun, T., Pantic, M.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3(1), 42–55 (2012)CrossRef Soleymani, M., Lichtenauer, J., Pun, T., Pantic, M.: A multimodal database for affect recognition and implicit tagging. IEEE Trans. Affect. Comput. 3(1), 42–55 (2012)CrossRef
5.
Zurück zum Zitat Subasi, A.: Eeg signal classification using wavelet feature extraction and a mixture of expert model. Expert Syst. Appl. 32(4), 1084–1093 (2007)CrossRef Subasi, A.: Eeg signal classification using wavelet feature extraction and a mixture of expert model. Expert Syst. Appl. 32(4), 1084–1093 (2007)CrossRef
6.
Zurück zum Zitat Torres-Valencia, C.A., Garcia-Arias, H.F., López, M.A.A., Orozco-Gutiérrez, A.A.: Comparative analysis of physiological signals and electroencephalogram (eeg) for multimodal emotion recognition using generative models. In: 2014 XIX Symposium on Image, Signal Processing and Artificial Vision (STSIVA), pp. 1–5. IEEE (2014) Torres-Valencia, C.A., Garcia-Arias, H.F., López, M.A.A., Orozco-Gutiérrez, A.A.: Comparative analysis of physiological signals and electroencephalogram (eeg) for multimodal emotion recognition using generative models. In: 2014 XIX Symposium on Image, Signal Processing and Artificial Vision (STSIVA), pp. 1–5. IEEE (2014)
7.
Zurück zum Zitat Tseng, K.C., Lin, B.S., Han, C.M., Wang, P.S.: Emotion recognition of eeg underlying favourite music by support vector machine. In: 2013 International Conference on Orange Technologies (ICOT), pp. 155–158. IEEE (2013) Tseng, K.C., Lin, B.S., Han, C.M., Wang, P.S.: Emotion recognition of eeg underlying favourite music by support vector machine. In: 2013 International Conference on Orange Technologies (ICOT), pp. 155–158. IEEE (2013)
8.
Zurück zum Zitat Vapnik, V., Vashist, A.: A new learning paradigm: learning using privileged information. Neural Netw. 22(5), 544–557 (2009)CrossRefMATH Vapnik, V., Vashist, A.: A new learning paradigm: learning using privileged information. Neural Netw. 22(5), 544–557 (2009)CrossRefMATH
9.
Zurück zum Zitat Wang, H.L., Cheong, L.F.: Affective understanding in film. IEEE Trans. Circuits Syst. Video Technol. 16(6), 689–704 (2006)CrossRef Wang, H.L., Cheong, L.F.: Affective understanding in film. IEEE Trans. Circuits Syst. Video Technol. 16(6), 689–704 (2006)CrossRef
10.
Zurück zum Zitat Wang, S., Zhu, Y., Wu, G., Ji, Q.: Hybrid video emotional tagging using users eeg and video content. Multimedia Tools Appl. 72(2), 1257–1283 (2014)CrossRef Wang, S., Zhu, Y., Wu, G., Ji, Q.: Hybrid video emotional tagging using users eeg and video content. Multimedia Tools Appl. 72(2), 1257–1283 (2014)CrossRef
11.
Zurück zum Zitat Zhu, Y., Wang, S., Ji, Q.: Emotion recognition from users’ eeg signals with the help of stimulus videos. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2014) Zhu, Y., Wang, S., Ji, Q.: Emotion recognition from users’ eeg signals with the help of stimulus videos. In: 2014 IEEE International Conference on Multimedia and Expo (ICME), pp. 1–6. IEEE (2014)
Metadaten
Titel
Emotion Recognition from EEG Signals by Leveraging Stimulus Videos
verfasst von
Zhen Gao
Shangfei Wang
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-24078-7_12

Neuer Inhalt