Skip to main content
Top

2019 | OriginalPaper | Chapter

Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users

Authors : Luobing Dong, Yueshen Xu, Ping Wang, Shijun He

Published in: Broadband Communications, Networks, and Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the development of modern society, people are paying more and more attention to their mental situation. An emotion is an external reaction of people’s psychological state. Therefore, emotion recognition has attached widespread attention and become a hot research topic. Currently, researchers identify people’s emotion mainly based on their facial expression, human behavior, physiological signals, etc. These traditional methods usually require some additional ancillary equipment to obtain information. This always inevitably makes trouble for users. At the same time, ordinary smart-phones are equipped with a lot of sensor devices nowadays. This enables researchers to collect emotion-related information of mobile users just using their mobile phones. In this paper, we track daily behavior data of 50 student volunteers using sensors on their smart-phones. Then a machine learning based classifier pool is constructed with considering diversity and complementary. Base classifiers with high inconsistent are combined using a dynamic adaptive fusion strategy. The weights of base classifiers are learned based on their prior probabilities and class-conditional probabilities. Finally, the emotion status of mobile phone users are predicted.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol.: Sci. Pract. 2(2), 151–164 (1995) Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol.: Sci. Pract. 2(2), 151–164 (1995)
2.
go back to reference Valstar, M., et al.: Avec 2016: depression, mood, and emotion recognition workshop and challenge. In: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, pp. 3–10. ACM (2016) Valstar, M., et al.: Avec 2016: depression, mood, and emotion recognition workshop and challenge. In: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, pp. 3–10. ACM (2016)
3.
go back to reference Trigeorgis, G., et al.: Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204. IEEE (2016) Trigeorgis, G., et al.: Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204. IEEE (2016)
4.
go back to reference Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108. ACM (2016) Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108. ACM (2016)
5.
go back to reference Ko, B.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)CrossRef Ko, B.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)CrossRef
7.
go back to reference Li, M., et al.: Facial expression recognition with identity and emotion joint learning. IEEE Trans. Affect. Comput. (2018) Li, M., et al.: Facial expression recognition with identity and emotion joint learning. IEEE Trans. Affect. Comput. (2018)
8.
go back to reference Greco, A., et al.: Skin admittance measurement for emotion recognition: a study over frequency sweep. Electronics 5(3), 46 (2016)CrossRef Greco, A., et al.: Skin admittance measurement for emotion recognition: a study over frequency sweep. Electronics 5(3), 46 (2016)CrossRef
9.
go back to reference Zhao, B., et al.: EmotionSense: emotion recognition based on wearable wristband. In: 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 346–355. IEEE (2018) Zhao, B., et al.: EmotionSense: emotion recognition based on wearable wristband. In: 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 346–355. IEEE (2018)
10.
go back to reference Vijayan, A.E., Sen, D., Sudheer, A.P.: EEG-based emotion recognition using statistical measures and auto-regressive modeling. In: 2015 IEEE International Conference on Computational Intelligence & Communication Technology, pp. 587–591. IEEE (2015) Vijayan, A.E., Sen, D., Sudheer, A.P.: EEG-based emotion recognition using statistical measures and auto-regressive modeling. In: 2015 IEEE International Conference on Computational Intelligence & Communication Technology, pp. 587–591. IEEE (2015)
11.
go back to reference Farhan, A.A.: Modeling Human Behavior using Machine Learning Algorithms (2016) Farhan, A.A.: Modeling Human Behavior using Machine Learning Algorithms (2016)
12.
go back to reference Deng, Z.-H., Luo, K.-H., Yu, H.-L.: A study of supervised term weighting scheme for sentiment analysis. Expert Syst. Appl. 41(7), 3506–3513 (2014)CrossRef Deng, Z.-H., Luo, K.-H., Yu, H.-L.: A study of supervised term weighting scheme for sentiment analysis. Expert Syst. Appl. 41(7), 3506–3513 (2014)CrossRef
13.
go back to reference Khan, F.H., Qamar, U., Bashir, S.: Lexicon based semantic detection of sentiments using expected likelihood estimate smoothed odds ratio. Artif. Intell. Rev. 48(1), 113–138 (2017)CrossRef Khan, F.H., Qamar, U., Bashir, S.: Lexicon based semantic detection of sentiments using expected likelihood estimate smoothed odds ratio. Artif. Intell. Rev. 48(1), 113–138 (2017)CrossRef
14.
go back to reference Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol. 10, pp. 2200–2204 (2010) Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol. 10, pp. 2200–2204 (2010)
15.
go back to reference Cambria, E., et al.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28(2), 15–21 (2013)CrossRef Cambria, E., et al.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28(2), 15–21 (2013)CrossRef
16.
go back to reference McDu, D., et al.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 881–888 (2013) McDu, D., et al.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 881–888 (2013)
17.
go back to reference Martini, N., et al.: The dynamics of EEG gamma responses to unpleasant visual stimuli: from local activity to functional connectivity. NeuroImage 60(2), 922–932 (2012)CrossRef Martini, N., et al.: The dynamics of EEG gamma responses to unpleasant visual stimuli: from local activity to functional connectivity. NeuroImage 60(2), 922–932 (2012)CrossRef
18.
go back to reference Frantzidis, C.A., et al.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)CrossRef Frantzidis, C.A., et al.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)CrossRef
19.
go back to reference Balconi, M., Mazza, G.: Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74(2), 158–165 (2009)CrossRef Balconi, M., Mazza, G.: Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74(2), 158–165 (2009)CrossRef
20.
go back to reference Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
21.
go back to reference Khezri, M., Firoozabadi, M., Sharafat, A.R.: Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Programs Biomed. 122(2), 149–164 (2015)CrossRef Khezri, M., Firoozabadi, M., Sharafat, A.R.: Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Programs Biomed. 122(2), 149–164 (2015)CrossRef
22.
go back to reference Liu, Y.-J., et al.: Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput. 9(4), 550–562 (2017)MathSciNetCrossRef Liu, Y.-J., et al.: Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput. 9(4), 550–562 (2017)MathSciNetCrossRef
23.
go back to reference Wang, X.-W., Nie, D., Lu, B.-L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129, 94–106 (2014)CrossRef Wang, X.-W., Nie, D., Lu, B.-L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129, 94–106 (2014)CrossRef
24.
go back to reference Balconi, M., Lucchiari, C.: EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci. Lett. 392(1–2), 118–123 (2006)CrossRef Balconi, M., Lucchiari, C.: EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci. Lett. 392(1–2), 118–123 (2006)CrossRef
25.
go back to reference Iacoviello, D., et al.: A real-time classification algorithm for EEGbased BCI driven by self-induced emotions. Comput. Methods Programs Biomed. 122(3), 293–303 (2015)CrossRef Iacoviello, D., et al.: A real-time classification algorithm for EEGbased BCI driven by self-induced emotions. Comput. Methods Programs Biomed. 122(3), 293–303 (2015)CrossRef
26.
go back to reference Yang, R., Xi, C., Xi, S.: J. Front. Comput. Sci. Technol. 10(6), 751–760 (2016) Yang, R., Xi, C., Xi, S.: J. Front. Comput. Sci. Technol. 10(6), 751–760 (2016)
27.
go back to reference Breiman, L.: Bias, variance, and arcing classifiers. Technical report, 460, Statistics Department, University of California, Berkeley (1996) Breiman, L.: Bias, variance, and arcing classifiers. Technical report, 460, Statistics Department, University of California, Berkeley (1996)
28.
go back to reference Bowes, D., Randall, D., Hall, T.: The inconsistent measurement of message chains. In: 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM), pp. 62–68. IEEE (2013) Bowes, D., Randall, D., Hall, T.: The inconsistent measurement of message chains. In: 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM), pp. 62–68. IEEE (2013)
Metadata
Title
Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users
Authors
Luobing Dong
Yueshen Xu
Ping Wang
Shijun He
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-36442-7_14

Premium Partner