Skip to main content
Top

2016 | OriginalPaper | Chapter

Real-World Facial Expression Recognition Using Metric Learning Method

Authors : Zhiwen Liu, Shan Li, Weihong Deng

Published in: Biometric Recognition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Real-world human facial expressions recognition has great value in Human-Computer Interaction. Currently facial expression recognition methods perform quite poor in real-world compared with in traditional laboratory conditions. A key factor is the lack of reliable large real-world facial expression database. In this paper, a large and reliable real-world facial expression database and a Modified Metric Learning Method based on NCM classifier (PR-NCMML) to regress the probability distribution of emotional labels will be introduced. According to experiments, the six-dimension emotion probability vector derived by PR-NCMML is closer to human perception, which leads to better accuracy than the state-of-the-art methods, such as the SVM based algorithms, both dominant emotion prediction and multi-label emotion recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: 2000 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000) Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: 2000 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000)
2.
go back to reference Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (PIE) database. In: 2002 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–51. IEEE (2002) Sim, T., Baker, S., Bsat, M.: The CMU pose, illumination, and expression (PIE) database. In: 2002 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–51. IEEE (2002)
3.
go back to reference Dhall, A., Goecke, R., Lucey, S., Gedeon, T.: Acted facial expressions in the wild database. Australian National University, Canberra, Australia, Technical report TR-CS-11-02 (2011) Dhall, A., Goecke, R., Lucey, S., Gedeon, T.: Acted facial expressions in the wild database. Australian National University, Canberra, Australia, Technical report TR-CS-11-02 (2011)
4.
go back to reference Ekman, P., Scherer, K.: Expression and the nature of emotion. Approaches to emotion 3, 19–344 (1984) Ekman, P., Scherer, K.: Expression and the nature of emotion. Approaches to emotion 3, 19–344 (1984)
5.
go back to reference Kotsia, I., Pitas, I.: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Process. 16(1), 172–187 (2007)MathSciNetCrossRef Kotsia, I., Pitas, I.: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Process. 16(1), 172–187 (2007)MathSciNetCrossRef
6.
go back to reference Anderson, K., McOwan, P.W.: A real-time automated system for the recognition of human facial expressions. IEEE Trans. Syst. Man Cybern. Part B Cybern. 36(1), 96–105 (2006)CrossRef Anderson, K., McOwan, P.W.: A real-time automated system for the recognition of human facial expressions. IEEE Trans. Syst. Man Cybern. Part B Cybern. 36(1), 96–105 (2006)CrossRef
7.
go back to reference Buciu, I., Pitas, I.: Application of non-negative and local non negative matrix factorization to facial expression recognition. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR2004, vol. 1, pp. 288–291. IEEE (2004) Buciu, I., Pitas, I.: Application of non-negative and local non negative matrix factorization to facial expression recognition. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR2004, vol. 1, pp. 288–291. IEEE (2004)
8.
go back to reference Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vis. Image Underst. 108(1), 19–34 (2007)CrossRef Wang, J., Yin, L.: Static topographic modeling for facial expression recognition and analysis. Comput. Vis. Image Underst. 108(1), 19–34 (2007)CrossRef
9.
go back to reference Sebe, N., Lew, M.S., Sun, Y., Cohen, I., Gevers, T., Huang, T.S.: Authentic facial expression analysis. Image Vis. Comput. 25(12), 1856–1863 (2007)CrossRef Sebe, N., Lew, M.S., Sun, Y., Cohen, I., Gevers, T., Huang, T.S.: Authentic facial expression analysis. Image Vis. Comput. 25(12), 1856–1863 (2007)CrossRef
10.
go back to reference Mensink, T., Verbeek, J., Perronnin, F., Csurka, G.: Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2624–2637 (2013)CrossRef Mensink, T., Verbeek, J., Perronnin, F., Csurka, G.: Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2624–2637 (2013)CrossRef
11.
go back to reference Moore, S., Bowden, R.: Local binary patterns for multi-view facial expression recognition. Comput. Vis. Image Underst. 115(4), 541–558 (2011)CrossRef Moore, S., Bowden, R.: Local binary patterns for multi-view facial expression recognition. Comput. Vis. Image Underst. 115(4), 541–558 (2011)CrossRef
12.
go back to reference Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based hog features. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 884–888. IEEE (2011) Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based hog features. In: 2011 IEEE International Conference on Automatic Face & Gesture Recognition and Workshops (FG 2011), pp. 884–888. IEEE (2011)
14.
go back to reference Duin, R.: PRtools version 3.0: a matlab toolbox for pattern recognition. In: Proceedings of SPIE, Citeseer (2000) Duin, R.: PRtools version 3.0: a matlab toolbox for pattern recognition. In: Proceedings of SPIE, Citeseer (2000)
15.
go back to reference Deng, H.B., Jin, L.W., Zhen, L.X., Huang, J.C.: A new facial expression recognition method based on local Gabor filter bank and PCA plus LDA. Int. J. Inf. Technol. 11(11), 86–96 (2005) Deng, H.B., Jin, L.W., Zhen, L.X., Huang, J.C.: A new facial expression recognition method based on local Gabor filter bank and PCA plus LDA. Int. J. Inf. Technol. 11(11), 86–96 (2005)
16.
go back to reference Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef Boutell, M.R., Luo, J., Shen, X., Brown, C.M.: Learning multi-label scene classification. Pattern Recogn. 37(9), 1757–1771 (2004)CrossRef
17.
go back to reference Zhang, M-L., Zhou, Z-H.: Multi-instance multi-label learning with application to scene classification Zhang, M-L., Zhou, Z-H.: Multi-instance multi-label learning with application to scene classification
Metadata
Title
Real-World Facial Expression Recognition Using Metric Learning Method
Authors
Zhiwen Liu
Shan Li
Weihong Deng
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46654-5_57

Premium Partner