Skip to main content
Top

2016 | OriginalPaper | Chapter

Recognizing Compound Emotional Expression in Real-World Using Metric Learning Method

Authors : Zhiwen Liu, Shan Li, Weihong Deng

Published in: Biometric Recognition

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Understanding human facial expressions plays an important role in Human-Computer-Interaction (HCI). Recent achievements on automatically recognizing facial expressions are mostly based on lab-controlled databases, in which facial images are a far cry from those in the real world. The main contribution of this paper is listed in the following three points. First, a large real-world facial expression database (RAF-DB), with nearly 30,000 images collected from Flickr and labeled by 300 volunteers will be introduced. Second, for the reason that human emotions are much more complexed than the six-basic-emotion defined by Ekman et al., we re-categories real-world facial expressions as compound emotional expressions, which can explain human emotions better. Finally, a metric learning method as well as several state-of-the-art facial expression classifying methods including SVM, are used to recognize our compound expression dataset. And we found that metric learning method performed better than other classifications.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000) Kanade, T., Cohn, J.F., Tian, Y.: Comprehensive database for facial expression analysis. In: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition, pp. 46–53. IEEE (2000)
2.
go back to reference Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE (1998) Lyons, M., Akamatsu, S., Kamachi, M., Gyoba, J.: Coding facial expressions with gabor wavelets. In: Proceedings of the Third IEEE International Conference on Automatic Face and Gesture Recognition, pp. 200–205. IEEE (1998)
3.
go back to reference Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992)CrossRef Ekman, P.: An argument for basic emotions. Cogn. Emot. 6(3–4), 169–200 (1992)CrossRef
4.
go back to reference Du, S., Tao, Y., Martinez, A.M.: Compound facial expressions of emotion. Proc. Nat. Acad. Sci. 111(15), E1454–E1462 (2014)CrossRef Du, S., Tao, Y., Martinez, A.M.: Compound facial expressions of emotion. Proc. Nat. Acad. Sci. 111(15), E1454–E1462 (2014)CrossRef
5.
go back to reference Kotsia, I., Pitas, I.: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Process. 16(1), 172–187 (2007)MathSciNetCrossRef Kotsia, I., Pitas, I.: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Trans. Image Process. 16(1), 172–187 (2007)MathSciNetCrossRef
6.
go back to reference Luo, Y., Wu, C.M., Zhang, Y.: Facial expression recognition based on fusion feature of PCA and LBP with SVM. Optik - Int. J. Light Electron Opt. 124(17), 2767–2770 (2013)CrossRef Luo, Y., Wu, C.M., Zhang, Y.: Facial expression recognition based on fusion feature of PCA and LBP with SVM. Optik - Int. J. Light Electron Opt. 124(17), 2767–2770 (2013)CrossRef
7.
go back to reference Deng, H.B., Jin, L.W., Zhen, L.X., Huang, J.C.: A new facial expression recognition method based on local gabor filter bank and PCA plus LDA. Int. J. Inf. Technol. 11(11), 86–96 (2005) Deng, H.B., Jin, L.W., Zhen, L.X., Huang, J.C.: A new facial expression recognition method based on local gabor filter bank and PCA plus LDA. Int. J. Inf. Technol. 11(11), 86–96 (2005)
8.
go back to reference George, T., Potty, S.P., Jose, S.: Smile detection from still images using KNN algorithm. In: International Conference on Control, Instrumentation, Communication and Computational Technologies, pp. 461–465 (2014) George, T., Potty, S.P., Jose, S.: Smile detection from still images using KNN algorithm. In: International Conference on Control, Instrumentation, Communication and Computational Technologies, pp. 461–465 (2014)
9.
go back to reference Mensink, T., Verbeek, J., Perronnin, F., Csurka, G.: Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2624–2637 (2013)CrossRef Mensink, T., Verbeek, J., Perronnin, F., Csurka, G.: Distance-based image classification: generalizing to new classes at near-zero cost. IEEE Trans. Pattern Anal. Mach. Intell. 35(11), 2624–2637 (2013)CrossRef
11.
go back to reference Buciu, I., Pitas, I.: Application of non-negative and local non negative matrixfactorization to facial expression recognition. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 1, pp. 288–291. IEEE (2004) Buciu, I., Pitas, I.: Application of non-negative and local non negative matrixfactorization to facial expression recognition. In: Proceedings of the 17th International Conference on Pattern Recognition, ICPR 2004, vol. 1, pp. 288–291. IEEE (2004)
12.
go back to reference Sebe, N., Lew, M.S., Sun, Y., Cohen, I., Gevers, T., Huang, T.S.: Authentic facial expression analysis. Image Vis. Comput. 25(12), 1856–1863 (2007)CrossRef Sebe, N., Lew, M.S., Sun, Y., Cohen, I., Gevers, T., Huang, T.S.: Authentic facial expression analysis. Image Vis. Comput. 25(12), 1856–1863 (2007)CrossRef
13.
go back to reference Yun, W.H., Kim, D.H., Park, C., Kim, J.: Hybrid facial representations for emotion recognition. ETRI J. 35(6), 1021–1028 (2013)CrossRef Yun, W.H., Kim, D.H., Park, C., Kim, J.: Hybrid facial representations for emotion recognition. ETRI J. 35(6), 1021–1028 (2013)CrossRef
14.
go back to reference Duin, R.: Prtools version 3.0: a matlab toolbox for pattern recognition. In: Proceedings of SPIE. Citeseer (2000) Duin, R.: Prtools version 3.0: a matlab toolbox for pattern recognition. In: Proceedings of SPIE. Citeseer (2000)
Metadata
Title
Recognizing Compound Emotional Expression in Real-World Using Metric Learning Method
Authors
Zhiwen Liu
Shan Li
Weihong Deng
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-46654-5_58

Premium Partner