Skip to main content
Top

2016 | OriginalPaper | Chapter

Facial Expression Recognition Adaptive to Face Pose Using RGB-D Camera

Authors : Yuta Inoue, Shun Nishide, Fuji Ren

Published in: Trends in Applied Knowledge-Based Systems and Data Science

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we propose a facial expression recognition method for non-frontal faces using RGB-D camera. The method uses the depth information of the RGB-D camera to calculate the face pose, modeled using a cylinder. Feature points obtained by the RGB-D camera, modified by the face pose, are compared with Action Units of the Facial Action Coding System for recognition of facial expression. Experiments were conducted using facial images in three types of angles and four expressions: anger, sadness, happiness, and surprise. Results of the experiments have shown that the method is rather robust to roll rotations than yaw and pitch rotations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chibelushi, C.C., Bourel, F.: Facial expression recognition: a brief tutorial overview. In: CVonline: On-Line Compendium of Computer Vision (2003) Chibelushi, C.C., Bourel, F.: Facial expression recognition: a brief tutorial overview. In: CVonline: On-Line Compendium of Computer Vision (2003)
2.
go back to reference Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27, 803–816 (2009)CrossRef Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27, 803–816 (2009)CrossRef
3.
go back to reference Ren, F., Huang, Z.: Facial expression recognition based on AAM-SIFT and adaptive regional weighting. IEEJ Trans. Electr. Electron. Eng. 10(6), 713–722 (2015). doi:10.1002/tee.22151 CrossRef Ren, F., Huang, Z.: Facial expression recognition based on AAM-SIFT and adaptive regional weighting. IEEJ Trans. Electr. Electron. Eng. 10(6), 713–722 (2015). doi:10.​1002/​tee.​22151 CrossRef
4.
go back to reference Tian, Y.L., Kanade, T., Cohn, J.: Facial expression analysis. In: Moeslund, T.B., Hilton, A., Krüger, V., Sigal, L. (eds.) Handbook of Face Recognition, pp. 247–275. Springer, New York (2005)CrossRef Tian, Y.L., Kanade, T., Cohn, J.: Facial expression analysis. In: Moeslund, T.B., Hilton, A., Krüger, V., Sigal, L. (eds.) Handbook of Face Recognition, pp. 247–275. Springer, New York (2005)CrossRef
5.
go back to reference Kumano, S., Otsuka, K., Yamato, J., Maeda, E., Sato, Y.: Pose-Invariant facial expression recognition using variable-intensity templates. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 324–334. Springer, Heidelberg (2007)CrossRef Kumano, S., Otsuka, K., Yamato, J., Maeda, E., Sato, Y.: Pose-Invariant facial expression recognition using variable-intensity templates. In: Yagi, Y., Kang, S.B., Kweon, I.S., Zha, H. (eds.) ACCV 2007, Part I. LNCS, vol. 4843, pp. 324–334. Springer, Heidelberg (2007)CrossRef
6.
go back to reference Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Alto (1978) Ekman, P., Friesen, W.V.: Facial Action Coding System: Investigator’s Guide. Consulting Psychologists Press, Palo Alto (1978)
Metadata
Title
Facial Expression Recognition Adaptive to Face Pose Using RGB-D Camera
Authors
Yuta Inoue
Shun Nishide
Fuji Ren
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-42007-3_36

Premium Partner