Skip to main content
Top

2017 | OriginalPaper | Chapter

Dictionary Based Approach for Facial Expression Recognition from Static Images

Authors : Krishan Sharma, Renu Rameshan

Published in: Computer Vision, Graphics, and Image Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

We present a simple approach for facial expression recognition from images using the principle of sparse representation using a learned dictionary. Visual appearance based feature descriptors like histogram of oriented gradients (HOG), local binary patterns (LBP) and eigenfaces are used. We use Fisher discrimination dictionary which has discrimination capability in addition to being reconstructive. The classification is based on the fact that each expression class with in the dictionary spans a subspace and these subspaces have non-overlapping directions so that they are widely separated. Each test feature point has a sparse representation in the union of subspaces of dictionary formed by labeled training points. To check recognition performance of the proposed approach, extensive experimentation is done over Jaffee and CK databases. Results show that the proposed approach has better classification accuracy than state-of-the-art techniques.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Mehrabian, A.: Nonverbal Communication. Transaction Publishers, Piscataway (1972) Mehrabian, A.: Nonverbal Communication. Transaction Publishers, Piscataway (1972)
2.
go back to reference Ekman, P., Rolls, E., Perrett, D., Ellis, H.: Facial expressions of emotion: an old controversy and new findings [and discussion]. Philos. Trans. R. Soc. B: Biol. Sci. 335(1273), 63–69 (1992)CrossRef Ekman, P., Rolls, E., Perrett, D., Ellis, H.: Facial expressions of emotion: an old controversy and new findings [and discussion]. Philos. Trans. R. Soc. B: Biol. Sci. 335(1273), 63–69 (1992)CrossRef
3.
go back to reference Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Discriminative learned dictionaries for local image analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE, pp. 1–8 (2008) Mairal, J., Bach, F., Ponce, J., Sapiro, G., Zisserman, A.: Discriminative learned dictionaries for local image analysis. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE, pp. 1–8 (2008)
4.
go back to reference Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Sig. Process. 54(11), 4311 (2006)CrossRefMATH Aharon, M., Elad, M., Bruckstein, A.: K-SVD: an algorithm for designing overcomplete dictionaries for sparse representation. IEEE Trans. Sig. Process. 54(11), 4311 (2006)CrossRefMATH
5.
go back to reference Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 2691–2698 (2010) Zhang, Q., Li, B.: Discriminative K-SVD for dictionary learning in face recognition. In: 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, pp. 2691–2698 (2010)
6.
go back to reference Liu, W., Song, C., Wang, Y.: Facial expression recognition based on discriminative dictionary learning. In: 2012 21st International Conference on Pattern Recognition (ICPR). IEEE, pp. 1839–1842 (2012) Liu, W., Song, C., Wang, Y.: Facial expression recognition based on discriminative dictionary learning. In: 2012 21st International Conference on Pattern Recognition (ICPR). IEEE, pp. 1839–1842 (2012)
7.
go back to reference Chen, H.C., Comiter, M.Z., Kung, H.T., McDanel, B.: Sparse coding trees with application to emotion classification. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 77–86, June 2015 Chen, H.C., Comiter, M.Z., Kung, H.T., McDanel, B.: Sparse coding trees with application to emotion classification. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), pp. 77–86, June 2015
8.
go back to reference Guo, L.: Smile expression classification using the improved BIF feature. In: 2011 Sixth International Conference on Image and Graphics (ICIG), pp. 783–788, August 2011 Guo, L.: Smile expression classification using the improved BIF feature. In: 2011 Sixth International Conference on Image and Graphics (ICIG), pp. 783–788, August 2011
9.
go back to reference Cotter, S.F.: Weighted voting of sparse representation classifiers for facial expression recognition. In: 2010 18th European Signal Processing Conference. IEEE, pp. 1164–1168 (2010) Cotter, S.F.: Weighted voting of sparse representation classifiers for facial expression recognition. In: 2010 18th European Signal Processing Conference. IEEE, pp. 1164–1168 (2010)
10.
go back to reference Yang, M., Zhang, L., Feng, X., Zhang, D.: Fisher discrimination dictionary learning for sparse representation. In: 2011 International Conference on Computer Vision. IEEE, pp. 543–550 (2011) Yang, M., Zhang, L., Feng, X., Zhang, D.: Fisher discrimination dictionary learning for sparse representation. In: 2011 International Conference on Computer Vision. IEEE, pp. 543–550 (2011)
11.
go back to reference Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893. IEEE (2005) Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR 2005), vol. 1, pp. 886–893. IEEE (2005)
12.
go back to reference Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH Ojala, T., Pietikainen, M., Maenpaa, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)CrossRefMATH
13.
go back to reference Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings CVPR 1991. IEEE, pp. 586–591 (1991) Turk, M.A., Pentland, A.P.: Face recognition using eigenfaces. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Proceedings CVPR 1991. IEEE, pp. 586–591 (1991)
14.
go back to reference Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRef
15.
go back to reference Harandi, M., Sanderson, C., Shen, C., Lovell, B.C.: Dictionary learning and sparse coding on Grassmann manifolds: an extrinsic solution. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3120–3127 (2013) Harandi, M., Sanderson, C., Shen, C., Lovell, B.C.: Dictionary learning and sparse coding on Grassmann manifolds: an extrinsic solution. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 3120–3127 (2013)
16.
go back to reference Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J., Budynek, J.: The Japanese Female Facial Expression (JAFFE) Database (1998) Lyons, M.J., Akamatsu, S., Kamachi, M., Gyoba, J., Budynek, J.: The Japanese Female Facial Expression (JAFFE) Database (1998)
17.
go back to reference Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, pp. 94–101 (2010) Lucey, P., Cohn, J.F., Kanade, T., Saragih, J., Ambadar, Z., Matthews, I.: The extended Cohn-Kanade dataset (CK+): a complete dataset for action unit and emotion-specified expression. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, pp. 94–101 (2010)
18.
go back to reference Liao, C.-T., Chuang, H.-J., Duan, C.-H., Lai, S.-H.: Learning spatial weighting via quadratic programming for facial expression analysis. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, pp. 86–93 (2010) Liao, C.-T., Chuang, H.-J., Duan, C.-H., Lai, S.-H.: Learning spatial weighting via quadratic programming for facial expression analysis. In: 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition-Workshops. IEEE, pp. 86–93 (2010)
19.
go back to reference Oliveira, L., Mansano, M., Koerich, A., de Souza Britto Jr., A.: 2D principal component analysis for face and facial-expression recognition. Comput. Sci. Eng. 13(3), 9–13 (2011)CrossRef Oliveira, L., Mansano, M., Koerich, A., de Souza Britto Jr., A.: 2D principal component analysis for face and facial-expression recognition. Comput. Sci. Eng. 13(3), 9–13 (2011)CrossRef
20.
go back to reference Cheng, F., Yu, J., Xiong, H.: Facial expression recognition in Jaffe dataset based on Gaussian process classification. IEEE Trans. Neural Netw. 21(10), 1685–1690 (2010)CrossRef Cheng, F., Yu, J., Xiong, H.: Facial expression recognition in Jaffe dataset based on Gaussian process classification. IEEE Trans. Neural Netw. 21(10), 1685–1690 (2010)CrossRef
21.
go back to reference Lubing, Z., Han, W.: Local gradient increasing pattern for facial expression recognition. In: 19th IEEE International Conference on Image Processing (ICIP) (2012) Lubing, Z., Han, W.: Local gradient increasing pattern for facial expression recognition. In: 19th IEEE International Conference on Image Processing (ICIP) (2012)
22.
go back to reference Benli, K.S., Eskil, M.T.: Extraction and selection of muscle based features for facial expression recognition. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 1651–1656, August 2014 Benli, K.S., Eskil, M.T.: Extraction and selection of muscle based features for facial expression recognition. In: 2014 22nd International Conference on Pattern Recognition (ICPR), pp. 1651–1656, August 2014
23.
go back to reference Cheon, Y., Kim, D.: Natural facial expression recognition using differential-aam and manifold learning. Pattern Recogn. 42(7), 1340–1350 (2009)CrossRefMATH Cheon, Y., Kim, D.: Natural facial expression recognition using differential-aam and manifold learning. Pattern Recogn. 42(7), 1340–1350 (2009)CrossRefMATH
24.
go back to reference Yang, P., Liu, Q., Metaxas, D.N.: Rankboost with L1 regularization for facial expression recognition and intensity estimation (2009) Yang, P., Liu, Q., Metaxas, D.N.: Rankboost with L1 regularization for facial expression recognition and intensity estimation (2009)
25.
go back to reference Taheri, S., Qiu, Q., Chellappa, R.: Structure-preserving sparse decomposition for facial expression analysis. IEEE Trans. Image Process. 23(8), 3590–3603 (2014)CrossRefMathSciNetMATH Taheri, S., Qiu, Q., Chellappa, R.: Structure-preserving sparse decomposition for facial expression analysis. IEEE Trans. Image Process. 23(8), 3590–3603 (2014)CrossRefMathSciNetMATH
Metadata
Title
Dictionary Based Approach for Facial Expression Recognition from Static Images
Authors
Krishan Sharma
Renu Rameshan
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-68124-5_4

Premium Partner