Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 3/2017

06.06.2017 | Regular Paper

Computational framework for emotional VAD prediction using regularized Extreme Learning Machine

verfasst von: Zied Guendil, Zied Lachiri, Choubeila Maaoui

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the advancement of Human Computer interaction and affective computing, emotion estimation becomes a very interesting area of research. In literature, the majority of emotion recognition systems presents an insufficiency due to the complexity of processing a huge number of physiological data and analyzing various kind of emotions in one framework. The aim of this paper is to present a rigorous and effective computational framework for humans affect recognition and classification through arousal valence and dominance dimensions. In the proposed algorithm, physiological instances from the multimodal emotion DEAP dataset has been used for the analysis and characterization of emotional pattern. Physiological features were employed to predict VAD levels via Extreme Learning Machine. We adopted a feature-level fusion to exploit the complementary information of some physiological sensors in order to improve the classification performance. The proposed framework was also evaluated in a VA quadrant by predicting four emotional classes. The obtained results proves the robustness and correctness of our proposed framework compared to other recent studies. We can also confirm the sufficiency of the R-ELM when it was applied for the estimation and recognition of emotional responses.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Picard RW, Vyzas E, Healey J (2001) Machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23:1175–1191CrossRef Picard RW, Vyzas E, Healey J (2001) Machine emotional intelligence: analysis of affective physiological state. IEEE Trans Pattern Anal Mach Intell 23:1175–1191CrossRef
2.
Zurück zum Zitat Zeng Z, Pantic M, Roisman GI, Huang TS (2009) Survey of affect recognition methods audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31:39–58CrossRef Zeng Z, Pantic M, Roisman GI, Huang TS (2009) Survey of affect recognition methods audio, visual, and spontaneous expressions. IEEE Trans Pattern Anal Mach Intell 31:39–58CrossRef
3.
Zurück zum Zitat International Affective Picture System, IAPS (1997) International Affective Picture System, IAPS (1997)
4.
Zurück zum Zitat Kim J, Andre E (2008) Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 30:2067–2083CrossRef Kim J, Andre E (2008) Emotion recognition based on physiological changes in music listening. IEEE Trans Pattern Anal Mach Intell 30:2067–2083CrossRef
5.
Zurück zum Zitat Schuller B (2011) Recognizing affect from linguistic information in 3D continuous space. IEEE Trans Affect Comput 2(4):192–205CrossRef Schuller B (2011) Recognizing affect from linguistic information in 3D continuous space. IEEE Trans Affect Comput 2(4):192–205CrossRef
6.
Zurück zum Zitat Soleymani M, Chanel G, Kierkels JJM, Pun T (2009) Affective characterization of movie scenes based on content analysis and physiological changes. Int J Semant Comput 30(2):235–254CrossRef Soleymani M, Chanel G, Kierkels JJM, Pun T (2009) Affective characterization of movie scenes based on content analysis and physiological changes. Int J Semant Comput 30(2):235–254CrossRef
7.
Zurück zum Zitat Rottenberg J, Ray RD, Gross JJ (1976) Emotion elicitation using films series in affective science. Oxford University, Oxford, pp 9–28 Rottenberg J, Ray RD, Gross JJ (1976) Emotion elicitation using films series in affective science. Oxford University, Oxford, pp 9–28
8.
Zurück zum Zitat Mauss IB, Robinson MD (2009) Measures of emotion: a review. Cognit Emot 23(2):209–237CrossRef Mauss IB, Robinson MD (2009) Measures of emotion: a review. Cognit Emot 23(2):209–237CrossRef
9.
Zurück zum Zitat Healey JM, Picard RW (2005) Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans Intell Transp Syst 6(2):156–166CrossRef Healey JM, Picard RW (2005) Detecting stress during real-world driving tasks using physiological sensors. IEEE Trans Intell Transp Syst 6(2):156–166CrossRef
10.
Zurück zum Zitat Chanel G, Rbetez C, Betancourt M, Pun T (2008) Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. The 12th international conference on Entertainment and media in the ubiquitous era, Finland, pp 13–17 Chanel G, Rbetez C, Betancourt M, Pun T (2008) Boredom, engagement and anxiety as indicators for adaptation to difficulty in games. The 12th international conference on Entertainment and media in the ubiquitous era, Finland, pp 13–17
11.
Zurück zum Zitat Ekman P (1982) Emotions in the human faces. 2nd ed studies in emotion and social interaction. Cambridge University Press, Cambridge Ekman P (1982) Emotions in the human faces. 2nd ed studies in emotion and social interaction. Cambridge University Press, Cambridge
12.
Zurück zum Zitat Russell JA (1982) A circumplex model of affect. J Personal Soc Psychol 39:1161–1178CrossRef Russell JA (1982) A circumplex model of affect. J Personal Soc Psychol 39:1161–1178CrossRef
13.
Zurück zum Zitat Jerritta S, Murugappan M, Nagarajan R, Kahrunizam W (2011) Signals based human emotion recognition: a review. 7th international colloquium on signal processing and its application Jerritta S, Murugappan M, Nagarajan R, Kahrunizam W (2011) Signals based human emotion recognition: a review. 7th international colloquium on signal processing and its application
14.
Zurück zum Zitat Rani P, Liu C, Sarkar N, Vanman E (2006) An empirical study of machine learning techniques for affect recognition in Human–robot interaction. Pattern Anal Appl 9:58–69CrossRef Rani P, Liu C, Sarkar N, Vanman E (2006) An empirical study of machine learning techniques for affect recognition in Human–robot interaction. Pattern Anal Appl 9:58–69CrossRef
15.
Zurück zum Zitat Long Z, Liu G, Dai X (2010) Extracting emotional features from ECG by using wavelet transform, International conference on biomedical engineering and computer sciences (ICBECS), Wuhan, pp 1–4 Long Z, Liu G, Dai X (2010) Extracting emotional features from ECG by using wavelet transform, International conference on biomedical engineering and computer sciences (ICBECS), Wuhan, pp 1–4
16.
Zurück zum Zitat Cong Z, Chetouani M (2010) Hilbert–Huang transform based physiological signals analysis for emotion recognition, International symposium on in signal processing and information technology (ISSPIT), pp 1–7 Cong Z, Chetouani M (2010) Hilbert–Huang transform based physiological signals analysis for emotion recognition, International symposium on in signal processing and information technology (ISSPIT), pp 1–7
17.
Zurück zum Zitat Schlkopf B, Smola AJ (2001) Learning with Kernels: support vector machines, regularization, optimization, and beyond (adaptive computation and machine learning). 1st edition Schlkopf B, Smola AJ (2001) Learning with Kernels: support vector machines, regularization, optimization, and beyond (adaptive computation and machine learning). 1st edition
18.
Zurück zum Zitat Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH Cortes C, Vapnik V (1995) Support vector networks. Mach Learn 20(3):273–297MATH
19.
Zurück zum Zitat Shi L, Lu BL (2013) EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102:135–143 Shi L, Lu BL (2013) EEG-based vigilance estimation using extreme learning machines. Neurocomputing 102:135–143
20.
Zurück zum Zitat He B, Xu D, Nian R, van Heeswijk M, Yu Q, Miche Y, Amaury L (2014) Fast face recognition via sparse coding and extreme learning machine. Cognit Comput 6:264–277 He B, Xu D, Nian R, van Heeswijk M, Yu Q, Miche Y, Amaury L (2014) Fast face recognition via sparse coding and extreme learning machine. Cognit Comput 6:264–277
21.
Zurück zum Zitat Bazi Y, Alajlan N, Melgani F, AlHichri H, Malek S, Yager RR (2014) Differential evolution extreme learning machine for the classification of hyperspectral images. IEEE Geosci Remote Sens Lett 6:1066–1070CrossRef Bazi Y, Alajlan N, Melgani F, AlHichri H, Malek S, Yager RR (2014) Differential evolution extreme learning machine for the classification of hyperspectral images. IEEE Geosci Remote Sens Lett 6:1066–1070CrossRef
22.
Zurück zum Zitat Huang G-B, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern 42:513–529CrossRef Huang G-B, Zhou H, Ding X, Zhang R (2012) Extreme learning machine for regression and multiclass classification. IEEE Trans Syst Man Cybern 42:513–529CrossRef
23.
Zurück zum Zitat Chanel G, Ansari-Asl K, Pun T (2007) Valence–arousal evaluation using physiological signals in an emotion recall paradigm systems. ISIC. IEEE international conference on man and cybernetics, pp 2662–2667 Chanel G, Ansari-Asl K, Pun T (2007) Valence–arousal evaluation using physiological signals in an emotion recall paradigm systems. ISIC. IEEE international conference on man and cybernetics, pp 2662–2667
24.
Zurück zum Zitat Koelstra S, Yazdani A, Soleymani M, Muhl C, Lee JS, Nijholt A, Pun T, Ebrahimi T, Patras I (2010) Single trial classification of EEG and peripheral physiological signals for recognition of emotions induced by music videos. In Brain informatics, ser. Lecture Notes in Computer Science 6334(9):89–100 Koelstra S, Yazdani A, Soleymani M, Muhl C, Lee JS, Nijholt A, Pun T, Ebrahimi T, Patras I (2010) Single trial classification of EEG and peripheral physiological signals for recognition of emotions induced by music videos. In Brain informatics, ser. Lecture Notes in Computer Science 6334(9):89–100
25.
Zurück zum Zitat Soleymani M, Pantic M, Pun T (2012) Multimodal emotion recognition in response to videos. IEEE Trans Affect Comput 3:211–223CrossRef Soleymani M, Pantic M, Pun T (2012) Multimodal emotion recognition in response to videos. IEEE Trans Affect Comput 3:211–223CrossRef
26.
Zurück zum Zitat Koelstra S, Muhl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2012) DEAP: a database for emotion analysis using physiological signals. Trans Affect Comput 3(1):18–31CrossRef Koelstra S, Muhl C, Soleymani M, Lee JS, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2012) DEAP: a database for emotion analysis using physiological signals. Trans Affect Comput 3(1):18–31CrossRef
27.
Zurück zum Zitat Godin CH, Compagne A (2015) Selection of the best physiological features for classifying emotion. The 3th International conference on physiological computing systems Godin CH, Compagne A (2015) Selection of the best physiological features for classifying emotion. The 3th International conference on physiological computing systems
28.
Zurück zum Zitat Soleymani M, Lichtinauer J, Pantic M, Pun T (2012) A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 3(1):42–55CrossRef Soleymani M, Lichtinauer J, Pantic M, Pun T (2012) A multimodal database for affect recognition and implicit tagging. IEEE Trans Affect Comput 3(1):42–55CrossRef
29.
Zurück zum Zitat Russell JA, Mehrabian A (1977) Evidence for a three-factor theory of emotions. J Res Personal 11(3):273–294CrossRef Russell JA, Mehrabian A (1977) Evidence for a three-factor theory of emotions. J Res Personal 11(3):273–294CrossRef
30.
Zurück zum Zitat Verma GK, Tiwary US (2014) Multimodal fusion frame-work: A multiresolution approach for classification and recognition from physiological signals. Neuroimage 102:162–172CrossRef Verma GK, Tiwary US (2014) Multimodal fusion frame-work: A multiresolution approach for classification and recognition from physiological signals. Neuroimage 102:162–172CrossRef
31.
Zurück zum Zitat Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef Huang GB, Zhu QY, Siew CK (2006) Extreme learning machine: theory and applications. Neurocomputing 70(1–3):489–501CrossRef
32.
Zurück zum Zitat Huanga G, Huang GB, Songa S, Youa K (2014) Trends in extreme learning machines: a review. Neural Netw 61:32–48CrossRef Huanga G, Huang GB, Songa S, Youa K (2014) Trends in extreme learning machines: a review. Neural Netw 61:32–48CrossRef
33.
Zurück zum Zitat Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef Huang GB, Wang DH, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2(2):107–122CrossRef
34.
Zurück zum Zitat Chung SY, Yoon HJ (2012) Affective classification using Bayesian classifier and supervised learning. IEEE 12th international conference on control, automation and systems (ICCAS) Chung SY, Yoon HJ (2012) Affective classification using Bayesian classifier and supervised learning. IEEE 12th international conference on control, automation and systems (ICCAS)
35.
Zurück zum Zitat Zhang X, Hu B, Chen J, Moore P (2013) Ontology-based context modeling for emotion recognition in an intelligent web. World Wide Web 16(4):497–513CrossRef Zhang X, Hu B, Chen J, Moore P (2013) Ontology-based context modeling for emotion recognition in an intelligent web. World Wide Web 16(4):497–513CrossRef
36.
Zurück zum Zitat Zheng W, Zhu JY, Lu BL (2016) Identifying stable patterns over time for emotion recognition from EEG. In Human–Computer Interaction. arXiv:1601.02197 Zheng W, Zhu JY, Lu BL (2016) Identifying stable patterns over time for emotion recognition from EEG. In Human–Computer Interaction. arXiv:​1601.​02197
37.
Zurück zum Zitat Filix A, Daniela H, Puica M (2015) Neural network approaches for children’s emotion recognition in intelligent learning applications. 7th international conference on education and new learning technologies (1) doi:10.13140/RG.2.1.3413.2969 Filix A, Daniela H, Puica M (2015) Neural network approaches for children’s emotion recognition in intelligent learning applications. 7th international conference on education and new learning technologies (1) doi:10.​13140/​RG.​2.​1.​3413.​2969
38.
Zurück zum Zitat Muthusamy H, Polat K, Yaacob S (2015) Improved emotion recognition using Gaussian mixture model and extreme learning machine in speech and glottal signals. Math Probl Eng. doi:10.1155/2015/394083 Muthusamy H, Polat K, Yaacob S (2015) Improved emotion recognition using Gaussian mixture model and extreme learning machine in speech and glottal signals. Math Probl Eng. doi:10.​1155/​2015/​394083
39.
Zurück zum Zitat Kaya H, Salah AA (2016) Combining modality-specific extreme learning machines for emotion recognition in the wild. J Multimodal User Interfaces 2(10):139–149CrossRef Kaya H, Salah AA (2016) Combining modality-specific extreme learning machines for emotion recognition in the wild. J Multimodal User Interfaces 2(10):139–149CrossRef
Metadaten
Titel
Computational framework for emotional VAD prediction using regularized Extreme Learning Machine
verfasst von
Zied Guendil
Zied Lachiri
Choubeila Maaoui
Publikationsdatum
06.06.2017
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 3/2017
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-017-0128-9

Weitere Artikel der Ausgabe 3/2017

International Journal of Multimedia Information Retrieval 3/2017 Zur Ausgabe