Skip to main content

2017 | OriginalPaper | Buchkapitel

User Mood Detection in a Social Network Messenger Based on Facial Cues

verfasst von : Payam Jome Yazdian, Hadi Moradi

Erschienen in: Ubiquitous Computing and Ambient Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a mood detection approach which is crucial for human-computer and human-human interaction. In the proposed method, the facial emotional changes are observed through a camera while users use a social network messenger. The advantage of this approach, over the previously proposed approaches, is in its natural setup in which people facially express their feelings, while they read and interact in the social network. This setup eliminates the need for artificial stimulus since social networks are normally filled with different stimulus. The proposed approach is implemented on the Telegram social media messenger. The results show good performance in determining the mood of users. A very promising usage of the proposed approach is in helping human-human relation by providing the mood of one person to another person before an encounter.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sebe, N., Cohen, I., Gevers, T., Huang, T.S.: Emotion recognition based on joint visual and audio cues. In: 18th International Conference on Pattern Recognition (ICPR 2006), pp. 1136–1139 (2006) Sebe, N., Cohen, I., Gevers, T., Huang, T.S.: Emotion recognition based on joint visual and audio cues. In: 18th International Conference on Pattern Recognition (ICPR 2006), pp. 1136–1139 (2006)
2.
Zurück zum Zitat Hashemian, M., Nikoukaran, A., Moradi, H., Mirian, M.S., Tehrani-Doost, M.: Determining mood using emotional features Hashemian, M., Nikoukaran, A., Moradi, H., Mirian, M.S., Tehrani-Doost, M.: Determining mood using emotional features
3.
Zurück zum Zitat Katsimerou, C., Heynderickx, I., Redi, J.A.: Predicting mood from punctual emotion annotations on videos. IEEE Trans. Affect. Comput. 6(2), 179–192 (2015)CrossRef Katsimerou, C., Heynderickx, I., Redi, J.A.: Predicting mood from punctual emotion annotations on videos. IEEE Trans. Affect. Comput. 6(2), 179–192 (2015)CrossRef
4.
Zurück zum Zitat Jaimes, A., Sebe, N.: Multimodal human–computer interaction: a survey. Comput. Vis. Image Underst. 108, 116–134 (2007)CrossRef Jaimes, A., Sebe, N.: Multimodal human–computer interaction: a survey. Comput. Vis. Image Underst. 108, 116–134 (2007)CrossRef
5.
Zurück zum Zitat Zecca, M., Mizoguchi, Y., Endo, K., Iida, F., Kawabata, Y., Endo, N., Itoh, K., Takanishi, A.: Whole body emotion expressions for KOBIAN humanoid robot—preliminary experiments with different emotional patterns. In: RO-MAN 2009—The 18th IEEE International Symposium on Robot and Human Interactive Communication, pp. 381–386. IEEE (2009) Zecca, M., Mizoguchi, Y., Endo, K., Iida, F., Kawabata, Y., Endo, N., Itoh, K., Takanishi, A.: Whole body emotion expressions for KOBIAN humanoid robot—preliminary experiments with different emotional patterns. In: RO-MAN 2009—The 18th IEEE International Symposium on Robot and Human Interactive Communication, pp. 381–386. IEEE (2009)
6.
Zurück zum Zitat Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Stud. 59, 119–155 (2003)CrossRef Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Stud. 59, 119–155 (2003)CrossRef
7.
Zurück zum Zitat Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110, 145–172 (2003)CrossRef Russell, J.A.: Core affect and the psychological construction of emotion. Psychol. Rev. 110, 145–172 (2003)CrossRef
8.
Zurück zum Zitat Kelley, S.W., Hoffman, K.D.: An investigation of positive affect, prosocial behaviors and service quality. J. Retail. 73, 407–427 (1997)CrossRef Kelley, S.W., Hoffman, K.D.: An investigation of positive affect, prosocial behaviors and service quality. J. Retail. 73, 407–427 (1997)CrossRef
9.
Zurück zum Zitat Forgas, J.P., Bower, G.H.: Mood effects on person-perception judgments. J. Pers. Soc. Psychol. 53, 53–60 (1987)CrossRef Forgas, J.P., Bower, G.H.: Mood effects on person-perception judgments. J. Pers. Soc. Psychol. 53, 53–60 (1987)CrossRef
10.
Zurück zum Zitat Hanjalic, A., Xu, L.-Q.: Affective video content representation and modeling. IEEE Trans. Multimed. 7, 143–154 (2005)CrossRef Hanjalic, A., Xu, L.-Q.: Affective video content representation and modeling. IEEE Trans. Multimed. 7, 143–154 (2005)CrossRef
11.
Zurück zum Zitat Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: temporal and static modeling. Comput. Vis. Image Underst. 91, 160–187 (2003)CrossRef Cohen, I., Sebe, N., Garg, A., Chen, L.S., Huang, T.S.: Facial expression recognition from video sequences: temporal and static modeling. Comput. Vis. Image Underst. 91, 160–187 (2003)CrossRef
12.
Zurück zum Zitat Kleinsmith, A., Bianchi-Berthouze, N.: Affective body expression perception and recognition: a survey. IEEE Trans. Affect. Comput. 4, 15–33 (2013)CrossRef Kleinsmith, A., Bianchi-Berthouze, N.: Affective body expression perception and recognition: a survey. IEEE Trans. Affect. Comput. 4, 15–33 (2013)CrossRef
13.
Zurück zum Zitat El Ayadi, M., Kamel, M.S., Karray, F.: Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recognit. 44, 572–587 (2011)CrossRefMATH El Ayadi, M., Kamel, M.S., Karray, F.: Survey on speech emotion recognition: features, classification schemes, and databases. Pattern Recognit. 44, 572–587 (2011)CrossRefMATH
14.
Zurück zum Zitat Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108 (2016) Zhao, M., Adib, F., Katabi, D.: Emotion recognition using wireless signals. In: Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking, pp. 95–108 (2016)
15.
Zurück zum Zitat Kolakowska, A.: A review of emotion recognition methods based on keystroke dynamics and mouse movements. In: 2013 6th International Conference on Human System Interactions (HSI), IEEE, pp. 548–555 (2013) Kolakowska, A.: A review of emotion recognition methods based on keystroke dynamics and mouse movements. In: 2013 6th International Conference on Human System Interactions (HSI), IEEE, pp. 548–555 (2013)
16.
Zurück zum Zitat Zimmermann, P., Guttormsen, S., Danuser, B., Gomez, P.: Affective computing—a rationale for measuring mood with mouse and keyboard. Int. J. Occup. Saf. Ergon. 9, 539–551 (2003)CrossRef Zimmermann, P., Guttormsen, S., Danuser, B., Gomez, P.: Affective computing—a rationale for measuring mood with mouse and keyboard. Int. J. Occup. Saf. Ergon. 9, 539–551 (2003)CrossRef
17.
Zurück zum Zitat Thayer, R.E.: Measurement of activation through self-report. Psychol. Rep. 20, 663–678 (1967)CrossRef Thayer, R.E.: Measurement of activation through self-report. Psychol. Rep. 20, 663–678 (1967)CrossRef
18.
Zurück zum Zitat Picard, R.W., Scheirer, J.: The galvactivator: a glove that senses and communicates skin conductivity. In: 9th International Conference on Human-Computer Interaction (2001) Picard, R.W., Scheirer, J.: The galvactivator: a glove that senses and communicates skin conductivity. In: 9th International Conference on Human-Computer Interaction (2001)
19.
Zurück zum Zitat Ekman, P., Davidson, R.J.: The Nature of Emotion: Fundamental Questions. Oxford University Press, New York (1994) Ekman, P., Davidson, R.J.: The Nature of Emotion: Fundamental Questions. Oxford University Press, New York (1994)
20.
Zurück zum Zitat Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-Doost, M.: Determining mood via emotions observed in face by induction. In: 2014 2nd RSI/ISM International Conference on Robotics and Mechatronics (ICRoM 2014), pp. 717–722 (2014) Hashemian, M., Moradi, H., Mirian, M.S., Tehrani-Doost, M.: Determining mood via emotions observed in face by induction. In: 2014 2nd RSI/ISM International Conference on Robotics and Mechatronics (ICRoM 2014), pp. 717722 (2014)
21.
Zurück zum Zitat Beedie, C., Terry, P., Lane, A.: Distinctions between emotion and mood. Cognit. Emot. 19, 847–878 (2005)CrossRef Beedie, C., Terry, P., Lane, A.: Distinctions between emotion and mood. Cognit. Emot. 19, 847–878 (2005)CrossRef
22.
Zurück zum Zitat Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989) Thayer, R.E.: The Biopsychology of Mood and Arousal. Oxford University Press, New York (1989)
23.
Zurück zum Zitat Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25, 49–59 (1994)CrossRef Bradley, M.M., Lang, P.J.: Measuring emotion: the self-assessment manikin and the semantic differential. J. Behav. Ther. Exp. Psychiatry 25, 49–59 (1994)CrossRef
24.
Zurück zum Zitat Thrasher, M., Van der Zwaag, M.D., Bianchi-Berthouze, N., Westerink, J.H.D.M.: Mood recognition based on upper body posture and movement features. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011. LNCS, vol. 6974, pp. 377–386. Springer, Heidelberg (2011). doi:10.1007/978-3-642-24600-5_41 CrossRef Thrasher, M., Van der Zwaag, M.D., Bianchi-Berthouze, N., Westerink, J.H.D.M.: Mood recognition based on upper body posture and movement features. In: D’Mello, S., Graesser, A., Schuller, B., Martin, J.-C. (eds.) ACII 2011. LNCS, vol. 6974, pp. 377–386. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-24600-5_​41 CrossRef
25.
Zurück zum Zitat Katsimerou, C., Redi, J.A., Heynderickx, I.: A Computational Model for Mood Recognition, pp. 122–133. Blackwell, Oxford (2014) Katsimerou, C., Redi, J.A., Heynderickx, I.: A Computational Model for Mood Recognition, pp. 122–133. Blackwell, Oxford (2014)
26.
Zurück zum Zitat Katsimerou, C., Redi, J.A.: Neural Prediction of the User’ S Mood from Visual Input (2013) Katsimerou, C., Redi, J.A.: Neural Prediction of the User’ S Mood from Visual Input (2013)
27.
Zurück zum Zitat Thayer, R.: The Origin of Everyday Moods. Oxford University Press, Oxford (1996) Thayer, R.: The Origin of Everyday Moods. Oxford University Press, Oxford (1996)
28.
Zurück zum Zitat Sirota, A.D., Schwartz, G.E., Kristeller, J.L.: Facial muscle activity during induced mood stales: differential growth and carry-over of elated versus depressed patterns. Psychophysiology 24, 691–699 (1987)CrossRef Sirota, A.D., Schwartz, G.E., Kristeller, J.L.: Facial muscle activity during induced mood stales: differential growth and carry-over of elated versus depressed patterns. Psychophysiology 24, 691–699 (1987)CrossRef
29.
Zurück zum Zitat Ekman, P., Friesen, W.V.: Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. Ishk, Los Altos (2003) Ekman, P., Friesen, W.V.: Unmasking the Face: A Guide to Recognizing Emotions from Facial Clues. Ishk, Los Altos (2003)
30.
Zurück zum Zitat Parkinson, B.: Changing Moods: The Psychology of Mood and Mood Regulation. Addison-Wesley Longman Limited, Boston (1996) Parkinson, B.: Changing Moods: The Psychology of Mood and Mood Regulation. Addison-Wesley Longman Limited, Boston (1996)
31.
Zurück zum Zitat Ekman, P., Friesen, W.: V: measuring facial movement with the facial action coding system. Emot. Hum. Face 2, 178–211 (1982) Ekman, P., Friesen, W.: V: measuring facial movement with the facial action coding system. Emot. Hum. Face 2, 178–211 (1982)
32.
Zurück zum Zitat Durov, N., Durov, P.: Telegram messenger (2013) Durov, N., Durov, P.: Telegram messenger (2013)
33.
Zurück zum Zitat Mcduff, D.: AFFDEX SDK : a cross-platform real- time multi-face expression recognition toolkit. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3723–3726 (2016) Mcduff, D.: AFFDEX SDK : a cross-platform real- time multi-face expression recognition toolkit. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 3723–3726 (2016)
34.
Zurück zum Zitat Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. ACM SIGKDD Explor. Newsl. 11, 10–18 (2009)CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., Witten, I.H.: The WEKA data mining software: an update. ACM SIGKDD Explor. Newsl. 11, 10–18 (2009)CrossRef
35.
Zurück zum Zitat Morris, J.A., Feldman, D.C.: The dimensions, antecedents, and consequences of emotional labor. Acad. Manag. Rev. 21, 986–1010 (1996) Morris, J.A., Feldman, D.C.: The dimensions, antecedents, and consequences of emotional labor. Acad. Manag. Rev. 21, 986–1010 (1996)
36.
Zurück zum Zitat Salzberg, S.L.: C4. 5: Programs for machine learning by J. Ross Quinlan. Morgan Kaufmann Publishers, Inc., 1993. Mach. Learn. 16, 235–240 (1994) Salzberg, S.L.: C4. 5: Programs for machine learning by J. Ross Quinlan. Morgan Kaufmann Publishers, Inc., 1993. Mach. Learn. 16, 235–240 (1994)
Metadaten
Titel
User Mood Detection in a Social Network Messenger Based on Facial Cues
verfasst von
Payam Jome Yazdian
Hadi Moradi
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-67585-5_75