Skip to main content
Top

2019 | OriginalPaper | Chapter

Facial Expression Recognition by Considering Nonuniform Local Binary Patterns

Authors : K. Srinivasa Reddy, E. Sunil Reddy, N. Baswanth

Published in: Emerging Research in Computing, Information, Communication and Applications

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Recognizing a face with an expression has paying attention due to its well-known applications in a broad range of fields like data-driven animation, human–machine interaction, robotics, and driver fatigue detection. People can vary significantly their facial expression; hence, facial expression recognition is not an easy problem. This paper presents a significant contribution for facial expression recognition by deriving a new set of stable transitions of local binary pattern by selecting the significant nonuniform local binary patterns. The proposed patterns are stable, because of the transitions from two or more consecutive ones to two or more consecutive zeros. For better recognition rate, the new set of patterns are combined with uniform patterns of local binary pattern. A distance function is used on proposed texture features for effective facial expression recognition. Preprocessing method is also used to get rid of the effects of illumination changes in facial expression by preserving the significant appearance details that are needed for facial expression recognition. The investigational analysis was done on the popular JAFFE facial expression database and has shown good performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Guo, G., & Dyer, C. (2005). Learning from examples in the small sample case: Face expression recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 35(3), 477–488.CrossRef Guo, G., & Dyer, C. (2005). Learning from examples in the small sample case: Face expression recognition. IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, 35(3), 477–488.CrossRef
2.
go back to reference Zhang, Q., Liu, Z., Quo, G., Terzopoulos, D., & Shum, H. Y. (2006). Geometry-driven photorealistic facial expression synthesis. IEEE Transactions on Visualization and Computer Graphics, 12(1), 48–60.CrossRef Zhang, Q., Liu, Z., Quo, G., Terzopoulos, D., & Shum, H. Y. (2006). Geometry-driven photorealistic facial expression synthesis. IEEE Transactions on Visualization and Computer Graphics, 12(1), 48–60.CrossRef
3.
go back to reference Feng, X. Facial expression recognition based on local binary patterns and coarse-to-fine classification. In Proceedings of the Fourth International Conference on Computer and Information Technology (CIT’04). Feng, X. Facial expression recognition based on local binary patterns and coarse-to-fine classification. In Proceedings of the Fourth International Conference on Computer and Information Technology (CIT’04).
4.
go back to reference Shan, C., Gong, S., & McOwan, P. W. (2009). Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27, 803–816.CrossRef Shan, C., Gong, S., & McOwan, P. W. (2009). Facial expression recognition based on local binary patterns: A comprehensive study. Image and Vision Computing, 27, 803–816.CrossRef
5.
go back to reference Huang, D., Shan, C., Ardabilian, M., Wang, Y., & Chen, L. (2011). Local binary patterns and its application to facial image analysis: A survey. IEEE Transaction on Systems, Man and Cybernetics-Part C: Applications and Reviews, 41(6), 765–781.CrossRef Huang, D., Shan, C., Ardabilian, M., Wang, Y., & Chen, L. (2011). Local binary patterns and its application to facial image analysis: A survey. IEEE Transaction on Systems, Man and Cybernetics-Part C: Applications and Reviews, 41(6), 765–781.CrossRef
6.
go back to reference Ye, J. F., Zhan, Y. Z., & Song, S. L. (2004). Facial expression features extraction based on Gabor wavelet transformation. IEEE International Conference on System, Man and Cybernetics, 3, 2215–2219. Ye, J. F., Zhan, Y. Z., & Song, S. L. (2004). Facial expression features extraction based on Gabor wavelet transformation. IEEE International Conference on System, Man and Cybernetics, 3, 2215–2219.
7.
go back to reference Kaur, M., Vashisht, R., & Neeru, N. (2010). Recognition of facial expressions with principal component analysis and singular value decomposition. International Journal of Computer Applications, 9(12), 36–40.CrossRef Kaur, M., Vashisht, R., & Neeru, N. (2010). Recognition of facial expressions with principal component analysis and singular value decomposition. International Journal of Computer Applications, 9(12), 36–40.CrossRef
8.
go back to reference Feng, X., Pietikainen, M., & Hadid, A. (2005). Facial expression recognition with local binary patterns and linear programming. Pattern Recognition and Image Analysis, 15(2), 546–548. Feng, X., Pietikainen, M., & Hadid, A. (2005). Facial expression recognition with local binary patterns and linear programming. Pattern Recognition and Image Analysis, 15(2), 546–548.
9.
go back to reference Fellenz, W., Taylor, J., Tsapatsoulis, N., & Kollias, S. (1999). Comparing template-based, feature based and supervised classification of facial expression from static images. Computational Intelligence and Applications, 19, 9. Fellenz, W., Taylor, J., Tsapatsoulis, N., & Kollias, S. (1999). Comparing template-based, feature based and supervised classification of facial expression from static images. Computational Intelligence and Applications, 19, 9.
10.
go back to reference Ahonen, T., Hadid, A., & Pietikinen, M. (2004). Face recognition with local binary patterns. In ECCV (pp. 469–481). Ahonen, T., Hadid, A., & Pietikinen, M. (2004). Face recognition with local binary patterns. In ECCV (pp. 469–481).
11.
go back to reference Ojala, T., Pietikainen, M., & Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 971–987.CrossRef Ojala, T., Pietikainen, M., & Maenpaa, T. (2002). Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(7), 971–987.CrossRef
12.
go back to reference Liao, S., Fan, W., Chung, A. C. S., & Yeung, D.-Y. (2006). Facial expression recognition using advanced local binary patterns, Tsallis entropies and global appearance features. In ICIP (pp. 665–668). Liao, S., Fan, W., Chung, A. C. S., & Yeung, D.-Y. (2006). Facial expression recognition using advanced local binary patterns, Tsallis entropies and global appearance features. In ICIP (pp. 665–668).
13.
go back to reference Tan X., & Triggs B. (2007). Enhanced local texture feature sets for face recognition under difficult lighting conditions. In Proceedings of the 2007 IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG’07), Rio de Janeiro, Brazil (pp. 168–182). Tan X., & Triggs B. (2007). Enhanced local texture feature sets for face recognition under difficult lighting conditions. In Proceedings of the 2007 IEEE International Workshop on Analysis and Modeling of Faces and Gestures (AMFG’07), Rio de Janeiro, Brazil (pp. 168–182).
15.
go back to reference Vijaya Kumar, V., Srinivasa Reddy, K., & Krishna, V. V. (2015). Face recognition using prominent LBP model. International Journal of Applied Engineering Research (IJAER), 10(2), 4373–4384. Vijaya Kumar, V., Srinivasa Reddy, K., & Krishna, V. V. (2015). Face recognition using prominent LBP model. International Journal of Applied Engineering Research (IJAER), 10(2), 4373–4384.
16.
go back to reference Fathi, A., & Naghsh-Nilchi, A. R. (2012). Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recognition Letters, 33(9), 1093–1100.CrossRef Fathi, A., & Naghsh-Nilchi, A. R. (2012). Noise tolerant local binary pattern operator for efficient texture analysis. Pattern Recognition Letters, 33(9), 1093–1100.CrossRef
17.
go back to reference Liu, L., Zhao, L., Long, Y., Kuang, G., & Fieguth, P. (2012). Extended local binary patterns for texture classification. Image and Vision Computing, 30(2), 86–99.CrossRef Liu, L., Zhao, L., Long, Y., Kuang, G., & Fieguth, P. (2012). Extended local binary patterns for texture classification. Image and Vision Computing, 30(2), 86–99.CrossRef
18.
go back to reference Nguyen, H. V., Bai, L., Shen, L. (2009). Local gabor binary pattern whitened pca: A novel approach for face recognition from single image per person. In Advances in biometrics (pp. 269–278). Berlin, Heidelberg, Springer.CrossRef Nguyen, H. V., Bai, L., Shen, L. (2009). Local gabor binary pattern whitened pca: A novel approach for face recognition from single image per person. In Advances in biometrics (pp. 269–278). Berlin, Heidelberg, Springer.CrossRef
19.
go back to reference Srinivasa Reddy, K., Venkata Krishna, V., & Vijaya Kumar, V. (2016). A method for facial recognition based on local features. International Journal of Mathematics and Computation (IJMC), 27(03), 98–112.MathSciNet Srinivasa Reddy, K., Venkata Krishna, V., & Vijaya Kumar, V. (2016). A method for facial recognition based on local features. International Journal of Mathematics and Computation (IJMC), 27(03), 98–112.MathSciNet
20.
go back to reference Lowe, D. G. (2004). Distinctive image features from scale-invariant key points. International Journal of Computer Vision, 60(2), 91–110.CrossRef Lowe, D. G. (2004). Distinctive image features from scale-invariant key points. International Journal of Computer Vision, 60(2), 91–110.CrossRef
Metadata
Title
Facial Expression Recognition by Considering Nonuniform Local Binary Patterns
Authors
K. Srinivasa Reddy
E. Sunil Reddy
N. Baswanth
Copyright Year
2019
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-13-6001-5_55