Skip to main content

2017 | OriginalPaper | Buchkapitel

Emotion Recognition: The Influence of Texture’s Descriptors on Classification Accuracy

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This work describes experiments dedicated to analysis of the descriptive properties of several, most widely applied, texture operators in emotion recognition domain. Many researchers apply Gabor filters, histogram of oriented gradients, or local binary patterns in complex set-ups with different classification approaches and image processing methodologies, but nowhere it was verified, how each part of the system influences the resulting performance. Therefore, several experiments with Cohn-Kanade AU-Coded Facial Expression and Karolinska Directed Emotional Faces Databases were performed. These experiments reviled, that exploiting the histogram of oriented gradients overcomes other texture operators in most cases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abdat, F., Maaoui, C., Pruski, A.: Human-computer interaction using emotion recognition from facial expression. In: 2011 Fifth UKSim European Symposium on Computer Modeling and Simulation (EMS), pp. 196–201, November 2011 Abdat, F., Maaoui, C., Pruski, A.: Human-computer interaction using emotion recognition from facial expression. In: 2011 Fifth UKSim European Symposium on Computer Modeling and Simulation (EMS), pp. 196–201, November 2011
2.
Zurück zum Zitat Carcagni, P., del Coco, M., Leo, M., Distante, C.: Facial expression recognition and histograms of oriented gradients: a comprehensive study. SpringerPlus 4, 645 (2015)CrossRef Carcagni, P., del Coco, M., Leo, M., Distante, C.: Facial expression recognition and histograms of oriented gradients: a comprehensive study. SpringerPlus 4, 645 (2015)CrossRef
4.
Zurück zum Zitat Cohn, J., Zlochower, A., Lien, J., Kanade, T.: Automated face analysis by feature point tracking has high concurrent validity with manual facs coding. Psychophysiology 36(2), 35–43 (1999)CrossRef Cohn, J., Zlochower, A., Lien, J., Kanade, T.: Automated face analysis by feature point tracking has high concurrent validity with manual facs coding. Psychophysiology 36(2), 35–43 (1999)CrossRef
5.
Zurück zum Zitat Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based HoG features. In: 2011 Face and Gesture, pp. 884–888, March 2011 Dahmane, M., Meunier, J.: Emotion recognition using dynamic grid-based HoG features. In: 2011 Face and Gesture, pp. 884–888, March 2011
6.
Zurück zum Zitat Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR 2005 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005) - Volume 1 - Volume 01, pp. 886–893. IEEE Computer Society, Washington, DC, USA (2005). http://dx.doi.org/10.1109/CVPR.2005.177 Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: CVPR 2005 Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005) - Volume 1 - Volume 01, pp. 886–893. IEEE Computer Society, Washington, DC, USA (2005). http://​dx.​doi.​org/​10.​1109/​CVPR.​2005.​177
7.
Zurück zum Zitat Darwin, C.: The Expression of the Emotions in Man and Animals. John Murray, London (1872). freeman #1141CrossRef Darwin, C.: The Expression of the Emotions in Man and Animals. John Murray, London (1872). freeman #1141CrossRef
9.
Zurück zum Zitat Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)CrossRef Ekman, P., Friesen, W.V.: Constants across cultures in the face and emotion. J. Pers. Soc. Psychol. 17(2), 124–129 (1971)CrossRef
10.
Zurück zum Zitat Ekman, P., Friesen, W.V.: Pictures of Facial Affect. Consulting Psychologists Press, Palo Alto (1976) Ekman, P., Friesen, W.V.: Pictures of Facial Affect. Consulting Psychologists Press, Palo Alto (1976)
11.
Zurück zum Zitat Gu, W., Xiang, C., Venkatesh, Y.V., Huang, D., Lin, H.: Facial expression recognition using radial encoding of local gabor features and classifier synthesis. Pattern Recogn. 45(1), 80–91 (2012)CrossRef Gu, W., Xiang, C., Venkatesh, Y.V., Huang, D., Lin, H.: Facial expression recognition using radial encoding of local gabor features and classifier synthesis. Pattern Recogn. 45(1), 80–91 (2012)CrossRef
12.
14.
Zurück zum Zitat Kasprowski, P.: Mining of eye movement data to discover people intentions. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 355–363. Springer, Cham (2014). doi:10.1007/978-3-319-06932-6_34 CrossRef Kasprowski, P.: Mining of eye movement data to discover people intentions. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 355–363. Springer, Cham (2014). doi:10.​1007/​978-3-319-06932-6_​34 CrossRef
15.
Zurück zum Zitat Kołakowska, A., Landowska, A., Szwoch, M., Szwoch, W., Wróbel, M.R.: Emotion recognition and its applications. In: Hippe, Z.S., Kulikowski, J.L., Mroczek, T., Wtorek, J. (eds.) Human-Computer Systems Interaction: Backgrounds and Applications 3. AISC, vol. 300, pp. 51–62. Springer, Cham (2014). doi:10.1007/978-3-319-08491-6_5 Kołakowska, A., Landowska, A., Szwoch, M., Szwoch, W., Wróbel, M.R.: Emotion recognition and its applications. In: Hippe, Z.S., Kulikowski, J.L., Mroczek, T., Wtorek, J. (eds.) Human-Computer Systems Interaction: Backgrounds and Applications 3. AISC, vol. 300, pp. 51–62. Springer, Cham (2014). doi:10.​1007/​978-3-319-08491-6_​5
16.
Zurück zum Zitat Li, J., Lam, E.Y.: Facial expression recognition using deep neural networks. In: IEEE International Conference on Imaging Systems and Techniques (IST), pp. 1–6, September 2015 Li, J., Lam, E.Y.: Facial expression recognition using deep neural networks. In: IEEE International Conference on Imaging Systems and Techniques (IST), pp. 1–6, September 2015
17.
Zurück zum Zitat Lundqvist, D., Flykt, A., Öhman, A.: The Karolinska Directed Emotional Faces - KDEF. CD ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet (1998) Lundqvist, D., Flykt, A., Öhman, A.: The Karolinska Directed Emotional Faces - KDEF. CD ROM from Department of Clinical Neuroscience, Psychology section, Karolinska Institutet (1998)
18.
Zurück zum Zitat Luoh, L., Huang, C.C., Liu, H.Y.: Image processing based emotion recognition. In: 2010 International Conference on System Science and Engineering, pp. 491–494, July 2010 Luoh, L., Huang, C.C., Liu, H.Y.: Image processing based emotion recognition. In: 2010 International Conference on System Science and Engineering, pp. 491–494, July 2010
19.
Zurück zum Zitat Nurzynska, K., Smolka, B.: Smiling and neutral facial display recognition with the local binary patterns operator. J. Med. Imaging Health Inf. 5(6), 1374–1382 (2015)CrossRef Nurzynska, K., Smolka, B.: Smiling and neutral facial display recognition with the local binary patterns operator. J. Med. Imaging Health Inf. 5(6), 1374–1382 (2015)CrossRef
20.
Zurück zum Zitat Nurzynska, K., Smolka, B.: PCA application in classification of smiling and neutral facial displays. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2015. CCIS, vol. 521, pp. 398–407. Springer, Cham (2015). doi:10.1007/978-3-319-18422-7_35 Nurzynska, K., Smolka, B.: PCA application in classification of smiling and neutral facial displays. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2015. CCIS, vol. 521, pp. 398–407. Springer, Cham (2015). doi:10.​1007/​978-3-319-18422-7_​35
21.
Zurück zum Zitat Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 29(1), 51–59 (1996)CrossRef Ojala, T., Pietikäinen, M., Harwood, D.: A comparative study of texture measures with classification based on featured distributions. Pattern Recognit. 29(1), 51–59 (1996)CrossRef
22.
Zurück zum Zitat Ojala, T., Pietikäinen, M., Mäenpää, T.: A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. In: Singh, S., Murshed, N., Kropatsch, W. (eds.) ICAPR 2001. LNCS, vol. 2013, pp. 399–408. Springer, Heidelberg (2001). doi:10.1007/3-540-44732-6_41 CrossRef Ojala, T., Pietikäinen, M., Mäenpää, T.: A generalized local binary pattern operator for multiresolution gray scale and rotation invariant texture classification. In: Singh, S., Murshed, N., Kropatsch, W. (eds.) ICAPR 2001. LNCS, vol. 2013, pp. 399–408. Springer, Heidelberg (2001). doi:10.​1007/​3-540-44732-6_​41 CrossRef
23.
Zurück zum Zitat Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH Ojala, T., Pietikäinen, M., Mäenpää, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH
24.
Zurück zum Zitat Pietikäinen, M., Hadid, A., Zhao, G., Ahonen, T.: Computer Vision Using Local Binary Patterns. Computational Imaging and Vision, vol. 40. Springer, Heidelberg (2011) Pietikäinen, M., Hadid, A., Zhao, G., Ahonen, T.: Computer Vision Using Local Binary Patterns. Computational Imaging and Vision, vol. 40. Springer, Heidelberg (2011)
25.
Zurück zum Zitat Sadeghi, H., Raie, A.A., Mohammadi, M.R.: Facial expression recognition using geometric normalization and appearance representation. In: 8th Iranian Conference on Machine Vision and Image Processing (MVIP), pp. 159–163, September 2013 Sadeghi, H., Raie, A.A., Mohammadi, M.R.: Facial expression recognition using geometric normalization and appearance representation. In: 8th Iranian Conference on Machine Vision and Image Processing (MVIP), pp. 159–163, September 2013
26.
Zurück zum Zitat Salmam, F.Z., Madani, A., Kissi, M.: Facial expression recognition using decision trees. In: 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV), pp. 125–130, March 2016 Salmam, F.Z., Madani, A., Kissi, M.: Facial expression recognition using decision trees. In: 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV), pp. 125–130, March 2016
27.
Zurück zum Zitat Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)CrossRef Shan, C., Gong, S., McOwan, P.W.: Facial expression recognition based on local binary patterns: a comprehensive study. Image Vis. Comput. 27(6), 803–816 (2009)CrossRef
28.
Zurück zum Zitat Szwoch, M.: On facial expressions and emotions RGB-D database. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 384–394. Springer, Cham (2014). doi:10.1007/978-3-319-06932-6_37 CrossRef Szwoch, M.: On facial expressions and emotions RGB-D database. In: Kozielski, S., Mrozek, D., Kasprowski, P., Małysiak-Mrozek, B., Kostrzewa, D. (eds.) BDAS 2014. CCIS, vol. 424, pp. 384–394. Springer, Cham (2014). doi:10.​1007/​978-3-319-06932-6_​37 CrossRef
29.
Zurück zum Zitat Tsai, H.H., Lai, Y.S., Zhang, A.Y.C.: Using SVM to design facial expression recognition for shape and texture features. In: 2010 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2697–2704, July 2010 Tsai, H.H., Lai, Y.S., Zhang, A.Y.C.: Using SVM to design facial expression recognition for shape and texture features. In: 2010 International Conference on Machine Learning and Cybernetics, vol. 5, pp. 2697–2704, July 2010
31.
Zurück zum Zitat Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef
Metadaten
Titel
Emotion Recognition: The Influence of Texture’s Descriptors on Classification Accuracy
verfasst von
Karolina Nurzynska
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58274-0_34

Premium Partner