Skip to main content
Top

2018 | OriginalPaper | Chapter

Affective Computing: Using Covariance Descriptors for Facial Expression Recognition

Authors : Ashaylin Naidoo, Jules Raymond Tapamo, Rethabile Khutlang

Published in: Image and Signal Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Facial expression contains a rich variety of affective information. Facial Expression Recognition (FER) is an emerging field that has broad applications in the fields of human-computer interaction, psychological behaviour analysis and image understanding. However, FER presently is not fully realized due to the lack of an effective facial feature descriptor. This paper will examine the performance of a novel facial image descriptor referred to as Local Directional Covariance Matrices (LDCM). The descriptor will consist of fusing features, such as location, intensity, filter responses and incorporate local texture patterns. Tests were done on both posed and spontaneous facial expression datasets to evaluate the performance of the proposed model on real-world applications. Results demonstrate the effectiveness of the covariance feature descriptors compared to standard methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Marian Stewart Bartlett, Javier R Movellan, and Terrence J Sejnowski. Face recognition by independent component analysis. IEEE transactions on neural networks / a publication of the IEEE Neural Networks Council, 13(6):1450–64, 2002CrossRef Marian Stewart Bartlett, Javier R Movellan, and Terrence J Sejnowski. Face recognition by independent component analysis. IEEE transactions on neural networks / a publication of the IEEE Neural Networks Council, 13(6):1450–64, 2002CrossRef
2.
go back to reference Forstner, W., Moonen, B.: A Metric for Covariance Matrices. Quo vadis geodesia 66, 113–128 (1999) Forstner, W., Moonen, B.: A Metric for Covariance Matrices. Quo vadis geodesia 66, 113–128 (1999)
3.
go back to reference Happy, S.L., Patnaik, P., Routray, A., Guha, R.: The indian spontaneous expression database for emotion recognition. IEEE Transactions on Affective Computing 8(1), 131–142 (2017)CrossRef Happy, S.L., Patnaik, P., Routray, A., Guha, R.: The indian spontaneous expression database for emotion recognition. IEEE Transactions on Affective Computing 8(1), 131–142 (2017)CrossRef
4.
go back to reference Taskeed Jabid, Md. Hasanul Kabir, and Oksam Chae. Local Directional Pattern (LDP); A Robust Image Descriptor for Object Recognition. 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, pages 482–487, 2010 Taskeed Jabid, Md. Hasanul Kabir, and Oksam Chae. Local Directional Pattern (LDP); A Robust Image Descriptor for Object Recognition. 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance, pages 482–487, 2010
5.
go back to reference Jabid, Taskeed: Md Hasanul Kabir, and Oksam Chae. Local directional pattern (ldp) for face recognition. International Journal of Innovative Computing, Information and Control 8(4), 2423–2437 (2012) Jabid, Taskeed: Md Hasanul Kabir, and Oksam Chae. Local directional pattern (ldp) for face recognition. International Journal of Innovative Computing, Information and Control 8(4), 2423–2437 (2012)
6.
go back to reference Akhilesh K Jaunjale and Vijay B Baru. Local Directional Number Pattern: An Efficient Descriptor for Face Analysis. International Journal of Innovative Research in Computer and Communication Engineering, 3297(6), 2016 Akhilesh K Jaunjale and Vijay B Baru. Local Directional Number Pattern: An Efficient Descriptor for Face Analysis. International Journal of Innovative Research in Computer and Communication Engineering, 3297(6), 2016
7.
go back to reference Kotsia, Irene, Pitas, Ioannis: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Transactions on Image Processing 16(1), 172–187 (2007)MathSciNetCrossRef Kotsia, Irene, Pitas, Ioannis: Facial expression recognition in image sequences using geometric deformation features and support vector machines. IEEE Transactions on Image Processing 16(1), 172–187 (2007)MathSciNetCrossRef
8.
go back to reference André Teixeira Lopes: Edilson de Aguiar, Alberto F. De Souza, and Thiago Oliveira-Santos. Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order. Pattern Recognition 61, 610–628 (2017)CrossRef André Teixeira Lopes: Edilson de Aguiar, Alberto F. De Souza, and Thiago Oliveira-Santos. Facial expression recognition with Convolutional Neural Networks: Coping with few data and the training sample order. Pattern Recognition 61, 610–628 (2017)CrossRef
9.
go back to reference P. Lucey, Jeffrey F. Cohn, Takeo Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The extended cohn-kande dataset (CK+): A complete facial expression dataset for action unit and emotion specied expression. Cvprw, (July):94–101, 2010 P. Lucey, Jeffrey F. Cohn, Takeo Kanade, J. Saragih, Z. Ambadar, and I. Matthews. The extended cohn-kande dataset (CK+): A complete facial expression dataset for action unit and emotion specied expression. Cvprw, (July):94–101, 2010
10.
go back to reference Michael Lyons and Shigeru Akamatsu. Coding Facial Expressions with GaborWavelets. third IEEE Conference on Automatic Face and Gesture Recognition, pages 200–205, 1998 Michael Lyons and Shigeru Akamatsu. Coding Facial Expressions with GaborWavelets. third IEEE Conference on Automatic Face and Gesture Recognition, pages 200–205, 1998
11.
go back to reference Shan, Caifeng, Gong, Shaogang, McOwan, Peter W.: Facial expression recognition based on Local Binary Patterns: A comprehensive study. Image and Vision Computing 27(6), 803–816 (2009)CrossRef Shan, Caifeng, Gong, Shaogang, McOwan, Peter W.: Facial expression recognition based on Local Binary Patterns: A comprehensive study. Image and Vision Computing 27(6), 803–816 (2009)CrossRef
12.
13.
go back to reference Wang, Zhiliang, Xie, Lun, Ting, Lu: Research progress of artificial psychology and artificial emotion in china. CAAI Transactions on Intelligence Technology 1(4), 355–365 (2016)CrossRef Wang, Zhiliang, Xie, Lun, Ting, Lu: Research progress of artificial psychology and artificial emotion in china. CAAI Transactions on Intelligence Technology 1(4), 355–365 (2016)CrossRef
14.
go back to reference Ying-li Tian. Computer Vision and Pattern Recognition Workshop, 2004. CVPRW ’04. Conference on. Computer Vision and Pattern Recognition Workshop, 2004. CVPRW ’04. Conference on, page 82, 2004 Ying-li Tian. Computer Vision and Pattern Recognition Workshop, 2004. CVPRW ’04. Conference on. Computer Vision and Pattern Recognition Workshop, 2004. CVPRW ’04. Conference on, page 82, 2004
Metadata
Title
Affective Computing: Using Covariance Descriptors for Facial Expression Recognition
Authors
Ashaylin Naidoo
Jules Raymond Tapamo
Rethabile Khutlang
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-94211-7_47

Premium Partner