Skip to main content

2016 | OriginalPaper | Buchkapitel

Micro-Expression Recognition for Detecting Human Emotional Changes

verfasst von : Kazuhiko Sumi, Tomomi Ueda

Erschienen in: Human-Computer Interaction. Novel User Experiences

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We propose a method estimating human emotional state in communication from four micro-expressions; mouth motion, head pose, eye sight direction, and blinking interval. Those micro-expressions are picked up by a questionnaire survey of human observers watching on video recorded human conversation. Then we implemented a recognition system for those micro-expressions. We detect facial parts from a RGB-Depth camera, measure those four expressions. Then we apply decision-tree style classifier to detect some emotional state and state changes. In our experiment, we gathered 30 videos of human communicating with his/her friend. Then we trained and validated our algorithm with two-fold cross-validation. We compared the classifier output with human examiners’ observation and confirmed over 70 % precision.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
We define friendly is a mental attitude attracted by the partner’s talk or the partner him/herself.
 
Literatur
1.
Zurück zum Zitat Ekman, P., Friesen, M.V.: The Facial Action Coding System: A Technique for The Measurement of Facial Movement. Consulting Psychologist, Palo Alto (1978) Ekman, P., Friesen, M.V.: The Facial Action Coding System: A Technique for The Measurement of Facial Movement. Consulting Psychologist, Palo Alto (1978)
2.
Zurück zum Zitat Mase, K.: Recognition of facial expression from optical flow. IEICE Trans. E74(10), 3474–3483 (1991) Mase, K.: Recognition of facial expression from optical flow. IEICE Trans. E74(10), 3474–3483 (1991)
3.
Zurück zum Zitat Black, M., J., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: International Conference on Computer Vision, pp. 374–381 (1995) Black, M., J., Yacoob, Y.: Tracking and recognizing rigid and non-rigid facial motions using local parametric models of image motion. In: International Conference on Computer Vision, pp. 374–381 (1995)
4.
Zurück zum Zitat Essa, I., Pentland, A.: Coding, analysis, interpretation and recognition of facial expressions. IEEE Trans. PAMI 19(7), 757–763 (1997)CrossRef Essa, I., Pentland, A.: Coding, analysis, interpretation and recognition of facial expressions. IEEE Trans. PAMI 19(7), 757–763 (1997)CrossRef
5.
Zurück zum Zitat Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. PAMI 21(10), 974–989 (1999)CrossRef Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying facial actions. IEEE Trans. PAMI 21(10), 974–989 (1999)CrossRef
6.
Zurück zum Zitat Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Trans. PAMI 23(2), 1–19 (2001)CrossRef Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Trans. PAMI 23(2), 1–19 (2001)CrossRef
7.
Zurück zum Zitat Bartlett, M.S., Littlewort, G., Frank, M.G., Lainscsek, C., Fasel, I., Movellan, J.: Recognizing facial expression: machine learning and application to spontaneous behavior. In: IEEE Conference on CVPR, pp. 568–573 (2005) Bartlett, M.S., Littlewort, G., Frank, M.G., Lainscsek, C., Fasel, I., Movellan, J.: Recognizing facial expression: machine learning and application to spontaneous behavior. In: IEEE Conference on CVPR, pp. 568–573 (2005)
8.
Zurück zum Zitat Chang, Y., Hu, C., Feris, R., Turk, M.: Manifold based analysis of facial expression. J. Image Vis. Comput. 24(6), 605–614 (2006)CrossRef Chang, Y., Hu, C., Feris, R., Turk, M.: Manifold based analysis of facial expression. J. Image Vis. Comput. 24(6), 605–614 (2006)CrossRef
9.
Zurück zum Zitat Pantic, M., Patras, I.: Dynamics of facial expression: recognition of facial actionsnand their temporal segments from face profile image sequence. IEEE Trans. SMCB 36(2), 433–449 (2006) Pantic, M., Patras, I.: Dynamics of facial expression: recognition of facial actionsnand their temporal segments from face profile image sequence. IEEE Trans. SMCB 36(2), 433–449 (2006)
10.
Zurück zum Zitat Asteriadis, S., Tzouveli, P., Karpouzis, K., Kollias, S.: Estimation of behavioral user state based on eye gaze and head pose – application in an e-learning environment. Multimedia Tools Appl. 41(3), 469–493 (2008)CrossRef Asteriadis, S., Tzouveli, P., Karpouzis, K., Kollias, S.: Estimation of behavioral user state based on eye gaze and head pose – application in an e-learning environment. Multimedia Tools Appl. 41(3), 469–493 (2008)CrossRef
11.
Zurück zum Zitat Gunes, H., Piccardi, M.: Automatic temporal segment detection and affect recognition from face and body display. IEEE Trans. SMC. Part B, Cybern. 39(1), 64–84 (2009)CrossRef Gunes, H., Piccardi, M.: Automatic temporal segment detection and affect recognition from face and body display. IEEE Trans. SMC. Part B, Cybern. 39(1), 64–84 (2009)CrossRef
12.
Zurück zum Zitat Gunes, H., Pantic, M.: Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 371–377. Springer, Heidelberg (2010)CrossRef Gunes, H., Pantic, M.: Dimensional emotion prediction from spontaneous head gestures for interaction with sensitive artificial listeners. In: Safonova, A. (ed.) IVA 2010. LNCS, vol. 6356, pp. 371–377. Springer, Heidelberg (2010)CrossRef
13.
Zurück zum Zitat Bartlett, M.S., Whitehill, J.: Automated facial expression measurement: recent applications to basic research in human behavior, learning, and education. In: Calder, A., et al. (eds.) Handbook of Face Perception. Oxford University Press, New York (2010) Bartlett, M.S., Whitehill, J.: Automated facial expression measurement: recent applications to basic research in human behavior, learning, and education. In: Calder, A., et al. (eds.) Handbook of Face Perception. Oxford University Press, New York (2010)
14.
Zurück zum Zitat Tian, Y., Kanade, T., Cohn, J.F.: Facial expression recognition. In: Li, S.Z., Jain, A.K. (eds.) Handbook of Face Recognition, pp. 487–520. Springer-Verlag, Berlin (2011). Chap. 11CrossRef Tian, Y., Kanade, T., Cohn, J.F.: Facial expression recognition. In: Li, S.Z., Jain, A.K. (eds.) Handbook of Face Recognition, pp. 487–520. Springer-Verlag, Berlin (2011). Chap. 11CrossRef
15.
Zurück zum Zitat Lemaire, P., Ardabilian, M., Chen, L., Daoudi, M.: Fully automatic 3D facial expression recognition using differential mean curvature maps and histograms of oriented gradients. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2013) Lemaire, P., Ardabilian, M., Chen, L., Daoudi, M.: Fully automatic 3D facial expression recognition using differential mean curvature maps and histograms of oriented gradients. In: International Conference on Automatic Face and Gesture Recognition, pp. 1–7 (2013)
Metadaten
Titel
Micro-Expression Recognition for Detecting Human Emotional Changes
verfasst von
Kazuhiko Sumi
Tomomi Ueda
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-39513-5_6

Neuer Inhalt