Skip to main content

2019 | OriginalPaper | Buchkapitel

Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users

verfasst von : Luobing Dong, Yueshen Xu, Ping Wang, Shijun He

Erschienen in: Broadband Communications, Networks, and Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

With the development of modern society, people are paying more and more attention to their mental situation. An emotion is an external reaction of people’s psychological state. Therefore, emotion recognition has attached widespread attention and become a hot research topic. Currently, researchers identify people’s emotion mainly based on their facial expression, human behavior, physiological signals, etc. These traditional methods usually require some additional ancillary equipment to obtain information. This always inevitably makes trouble for users. At the same time, ordinary smart-phones are equipped with a lot of sensor devices nowadays. This enables researchers to collect emotion-related information of mobile users just using their mobile phones. In this paper, we track daily behavior data of 50 student volunteers using sensors on their smart-phones. Then a machine learning based classifier pool is constructed with considering diversity and complementary. Base classifiers with high inconsistent are combined using a dynamic adaptive fusion strategy. The weights of base classifiers are learned based on their prior probabilities and class-conditional probabilities. Finally, the emotion status of mobile phone users are predicted.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol.: Sci. Pract. 2(2), 151–164 (1995) Gross, J.J., Muñoz, R.F.: Emotion regulation and mental health. Clin. Psychol.: Sci. Pract. 2(2), 151–164 (1995)
2.
Zurück zum Zitat Valstar, M., et al.: Avec 2016: depression, mood, and emotion recognition workshop and challenge. In: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, pp. 3–10. ACM (2016) Valstar, M., et al.: Avec 2016: depression, mood, and emotion recognition workshop and challenge. In: Proceedings of the 6th International Workshop on Audio/Visual Emotion Challenge, pp. 3–10. ACM (2016)
3.
Zurück zum Zitat Trigeorgis, G., et al.: Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204. IEEE (2016) Trigeorgis, G., et al.: Adieu features? End-to-end speech emotion recognition using a deep convolutional recurrent network. In: 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 5200–5204. IEEE (2016)
4.
Zurück zum Zitat Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108. ACM (2016) Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108. ACM (2016)
5.
Zurück zum Zitat Ko, B.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)CrossRef Ko, B.: A brief review of facial emotion recognition based on visual information. Sensors 18(2), 401 (2018)CrossRef
7.
Zurück zum Zitat Li, M., et al.: Facial expression recognition with identity and emotion joint learning. IEEE Trans. Affect. Comput. (2018) Li, M., et al.: Facial expression recognition with identity and emotion joint learning. IEEE Trans. Affect. Comput. (2018)
8.
Zurück zum Zitat Greco, A., et al.: Skin admittance measurement for emotion recognition: a study over frequency sweep. Electronics 5(3), 46 (2016)CrossRef Greco, A., et al.: Skin admittance measurement for emotion recognition: a study over frequency sweep. Electronics 5(3), 46 (2016)CrossRef
9.
Zurück zum Zitat Zhao, B., et al.: EmotionSense: emotion recognition based on wearable wristband. In: 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 346–355. IEEE (2018) Zhao, B., et al.: EmotionSense: emotion recognition based on wearable wristband. In: 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI), pp. 346–355. IEEE (2018)
10.
Zurück zum Zitat Vijayan, A.E., Sen, D., Sudheer, A.P.: EEG-based emotion recognition using statistical measures and auto-regressive modeling. In: 2015 IEEE International Conference on Computational Intelligence & Communication Technology, pp. 587–591. IEEE (2015) Vijayan, A.E., Sen, D., Sudheer, A.P.: EEG-based emotion recognition using statistical measures and auto-regressive modeling. In: 2015 IEEE International Conference on Computational Intelligence & Communication Technology, pp. 587–591. IEEE (2015)
11.
Zurück zum Zitat Farhan, A.A.: Modeling Human Behavior using Machine Learning Algorithms (2016) Farhan, A.A.: Modeling Human Behavior using Machine Learning Algorithms (2016)
12.
Zurück zum Zitat Deng, Z.-H., Luo, K.-H., Yu, H.-L.: A study of supervised term weighting scheme for sentiment analysis. Expert Syst. Appl. 41(7), 3506–3513 (2014)CrossRef Deng, Z.-H., Luo, K.-H., Yu, H.-L.: A study of supervised term weighting scheme for sentiment analysis. Expert Syst. Appl. 41(7), 3506–3513 (2014)CrossRef
13.
Zurück zum Zitat Khan, F.H., Qamar, U., Bashir, S.: Lexicon based semantic detection of sentiments using expected likelihood estimate smoothed odds ratio. Artif. Intell. Rev. 48(1), 113–138 (2017)CrossRef Khan, F.H., Qamar, U., Bashir, S.: Lexicon based semantic detection of sentiments using expected likelihood estimate smoothed odds ratio. Artif. Intell. Rev. 48(1), 113–138 (2017)CrossRef
14.
Zurück zum Zitat Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol. 10, pp. 2200–2204 (2010) Baccianella, S., Esuli, A., Sebastiani, F.: SentiWordNet 3.0: an enhanced lexical resource for sentiment analysis and opinion mining. In: Lrec, vol. 10, pp. 2200–2204 (2010)
15.
Zurück zum Zitat Cambria, E., et al.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28(2), 15–21 (2013)CrossRef Cambria, E., et al.: New avenues in opinion mining and sentiment analysis. IEEE Intell. Syst. 28(2), 15–21 (2013)CrossRef
16.
Zurück zum Zitat McDu, D., et al.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 881–888 (2013) McDu, D., et al.: Affectiva-mit facial expression dataset (AM-FED): naturalistic and spontaneous facial expressions collected. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 881–888 (2013)
17.
Zurück zum Zitat Martini, N., et al.: The dynamics of EEG gamma responses to unpleasant visual stimuli: from local activity to functional connectivity. NeuroImage 60(2), 922–932 (2012)CrossRef Martini, N., et al.: The dynamics of EEG gamma responses to unpleasant visual stimuli: from local activity to functional connectivity. NeuroImage 60(2), 922–932 (2012)CrossRef
18.
Zurück zum Zitat Frantzidis, C.A., et al.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)CrossRef Frantzidis, C.A., et al.: Toward emotion aware computing: an integrated approach using multichannel neurophysiological recordings and affective visual stimuli. IEEE Trans. Inf. Technol. Biomed. 14(3), 589–597 (2010)CrossRef
19.
Zurück zum Zitat Balconi, M., Mazza, G.: Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74(2), 158–165 (2009)CrossRef Balconi, M., Mazza, G.: Brain oscillations and BIS/BAS (behavioral inhibition/activation system) effects on processing masked emotional cues: ERS/ERD and coherence measures of alpha band. Int. J. Psychophysiol. 74(2), 158–165 (2009)CrossRef
20.
Zurück zum Zitat Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef Jenke, R., Peer, A., Buss, M.: Feature extraction and selection for emotion recognition from EEG. IEEE Trans. Affect. Comput. 5(3), 327–339 (2014)CrossRef
21.
Zurück zum Zitat Khezri, M., Firoozabadi, M., Sharafat, A.R.: Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Programs Biomed. 122(2), 149–164 (2015)CrossRef Khezri, M., Firoozabadi, M., Sharafat, A.R.: Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput. Methods Programs Biomed. 122(2), 149–164 (2015)CrossRef
22.
Zurück zum Zitat Liu, Y.-J., et al.: Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput. 9(4), 550–562 (2017)MathSciNetCrossRef Liu, Y.-J., et al.: Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Trans. Affect. Comput. 9(4), 550–562 (2017)MathSciNetCrossRef
23.
Zurück zum Zitat Wang, X.-W., Nie, D., Lu, B.-L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129, 94–106 (2014)CrossRef Wang, X.-W., Nie, D., Lu, B.-L.: Emotional state classification from EEG data using machine learning approach. Neurocomputing 129, 94–106 (2014)CrossRef
24.
Zurück zum Zitat Balconi, M., Lucchiari, C.: EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci. Lett. 392(1–2), 118–123 (2006)CrossRef Balconi, M., Lucchiari, C.: EEG correlates (event-related desynchronization) of emotional face elaboration: a temporal analysis. Neurosci. Lett. 392(1–2), 118–123 (2006)CrossRef
25.
Zurück zum Zitat Iacoviello, D., et al.: A real-time classification algorithm for EEGbased BCI driven by self-induced emotions. Comput. Methods Programs Biomed. 122(3), 293–303 (2015)CrossRef Iacoviello, D., et al.: A real-time classification algorithm for EEGbased BCI driven by self-induced emotions. Comput. Methods Programs Biomed. 122(3), 293–303 (2015)CrossRef
26.
Zurück zum Zitat Yang, R., Xi, C., Xi, S.: J. Front. Comput. Sci. Technol. 10(6), 751–760 (2016) Yang, R., Xi, C., Xi, S.: J. Front. Comput. Sci. Technol. 10(6), 751–760 (2016)
27.
Zurück zum Zitat Breiman, L.: Bias, variance, and arcing classifiers. Technical report, 460, Statistics Department, University of California, Berkeley (1996) Breiman, L.: Bias, variance, and arcing classifiers. Technical report, 460, Statistics Department, University of California, Berkeley (1996)
28.
Zurück zum Zitat Bowes, D., Randall, D., Hall, T.: The inconsistent measurement of message chains. In: 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM), pp. 62–68. IEEE (2013) Bowes, D., Randall, D., Hall, T.: The inconsistent measurement of message chains. In: 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM), pp. 62–68. IEEE (2013)
Metadaten
Titel
Classifier Fusion Method Based Emotion Recognition for Mobile Phone Users
verfasst von
Luobing Dong
Yueshen Xu
Ping Wang
Shijun He
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-36442-7_14