Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2014

01-12-2014 | Original Article

Human facial expression analysis based on image granule LPP

Authors: Xiuxiu Xu, Jiuzhen Liang, Sisi Lv, Qin Wu

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2014

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper proposes a synthetic technique for human facial expression analysis based on locality preserving projections (LPP) and granular computing. The proposed method decreases the computational complexity of LPP and preserves the performance of LPP algorithm. In image processing, an image can be divided into various sizes of blocks, which are defined as image granules in this paper. The LPP algorithm is implemented to images with various image granules. By this strategy, the image dimension reduces quickly, which decreases the computational complexity. The experiments on three face databases are presented to show the performance of image granule LPP. Distribution of the facial pose and expression is shown and the computational complexities with different image granules are compared. Meanwhile, the order-preserving property of images is investigated by tracking the sequence of designated images. And the loss of image information is analyzed by image roughness, entropy and histogram. Furthermore, the parameter setting in LPP is discussed because of its non-ignorable affect on the experiment results. Finally, the method is applied to facial expression recognition.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Li SZ, Jain AK (2005) Handbook of face recognition. Springer, New YorkMATH Li SZ, Jain AK (2005) Handbook of face recognition. Springer, New YorkMATH
2.
go back to reference Turk MA, Pentland AP (1991) Face recognition using eigenfaces. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Maui, HI, USA, pp 586–591 Turk MA, Pentland AP (1991) Face recognition using eigenfaces. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Maui, HI, USA, pp 586–591
3.
go back to reference Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
4.
go back to reference Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464CrossRef Bartlett MS, Movellan JR, Sejnowski TJ (2002) Face recognition by independent component analysis. IEEE Trans Neural Netw 13(6):1450–1464CrossRef
7.
go back to reference Poon B, Amin MA, Yan H (2011) Performance evaluation and comparison of PCA based human face recognition methods for distorted images. Int J Mach Learn Cybern 2(4):245–259CrossRef Poon B, Amin MA, Yan H (2011) Performance evaluation and comparison of PCA based human face recognition methods for distorted images. Int J Mach Learn Cybern 2(4):245–259CrossRef
8.
9.
go back to reference Xu X, Liu W, Venkatesh S (2012) An innovative face image enhancement based on principle component analysis[J]. Int J Mach Learn Cybern 3(4):259–267CrossRef Xu X, Liu W, Venkatesh S (2012) An innovative face image enhancement based on principle component analysis[J]. Int J Mach Learn Cybern 3(4):259–267CrossRef
10.
go back to reference Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
11.
go back to reference Sam Roweis LS, Hinton G (2001) Global coordination of local linear models. Adv Neural Inf Process Syst 14:889–896 Sam Roweis LS, Hinton G (2001) Global coordination of local linear models. Adv Neural Inf Process Syst 14:889–896
12.
go back to reference Tenenbaum J, de Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(12):2319–2323CrossRef Tenenbaum J, de Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(12):2319–2323CrossRef
13.
go back to reference Chang Y, Hu C, Turk M (2003) Manifold of facial expression. In: Proceedings of IEEE International Workshop on Analysis and Modeling of Faces and Gestures, Nice, France Chang Y, Hu C, Turk M (2003) Manifold of facial expression. In: Proceedings of IEEE International Workshop on Analysis and Modeling of Faces and Gestures, Nice, France
14.
go back to reference Lee K-C, Ho J, Yang M-H, Kriegman D (2003) Video-based face recognition using probabilistic appearance manifolds. In: IEEE Conference on Computer Vision and Pattern Recognition Lee K-C, Ho J, Yang M-H, Kriegman D (2003) Video-based face recognition using probabilistic appearance manifolds. In: IEEE Conference on Computer Vision and Pattern Recognition
15.
go back to reference Seung HS, Lee DD (2000) The manifold ways of perception. Science 290:2268–2269 Seung HS, Lee DD (2000) The manifold ways of perception. Science 290:2268–2269
16.
go back to reference Shashua A, Levin A, Avidan S (2002) Manifold pursuit: a new approach to appearance based recognition. In: Proceedings of 16th International Conference on Pattern Recognition 3, pp 590–594 Shashua A, Levin A, Avidan S (2002) Manifold pursuit: a new approach to appearance based recognition. In: Proceedings of 16th International Conference on Pattern Recognition 3, pp 590–594
17.
go back to reference Bernstein M, De Silva V, Langford JC, Tenenbaum JB (2000) Graph approximations to geodesics on embedded manifolds, Technical report, Department of Psychology, Stanford University Bernstein M, De Silva V, Langford JC, Tenenbaum JB (2000) Graph approximations to geodesics on embedded manifolds, Technical report, Department of Psychology, Stanford University
18.
go back to reference Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH
19.
go back to reference Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in Neural Information Processing Systems, vol 14, pp 589–591 Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in Neural Information Processing Systems, vol 14, pp 589–591
20.
go back to reference He X, Niyogi P (2003) Locality preserving projections. In: Proceedings of the Conference on Neural Information Processing Systems. Vancouver, Canada, pp 153–160 He X, Niyogi P (2003) Locality preserving projections. In: Proceedings of the Conference on Neural Information Processing Systems. Vancouver, Canada, pp 153–160
21.
go back to reference He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef He X, Yan S, Hu Y, Niyogi P, Zhang HJ (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef
22.
go back to reference Chung FRK (1997) Spectral graph theory. Regional conference series in mathematics, vol 92 Chung FRK (1997) Spectral graph theory. Regional conference series in mathematics, vol 92
23.
go back to reference Yan S, Xu D, Zhang B, Zhang H (2005) Graph embedding: a general framework for dimensionality reduction. CVPR 2:830–837 Yan S, Xu D, Zhang B, Zhang H (2005) Graph embedding: a general framework for dimensionality reduction. CVPR 2:830–837
24.
go back to reference Yang J, Zhang D, Yang JY, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):650–664CrossRef Yang J, Zhang D, Yang JY, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):650–664CrossRef
25.
go back to reference He X, Yan S, Hu Y, Zhang H (2003) Learning a locality preserving subspace for visual recognition. In: ICCV 2003, pp 385–393 He X, Yan S, Hu Y, Zhang H (2003) Learning a locality preserving subspace for visual recognition. In: ICCV 2003, pp 385–393
26.
go back to reference Lin TY (1997) Granular computing: from rough sets and neighborhood system to information granulation and computing in words. In: European Congress on Intelligent Techniques and Soft Computing Lin TY (1997) Granular computing: from rough sets and neighborhood system to information granulation and computing in words. In: European Congress on Intelligent Techniques and Soft Computing
27.
go back to reference Butenkov SA (2004) Granular computing in image processing and understanding. In: Proceedings of IASTED International Conference on Artificial Intelligence and Applications. Innsbruck, Austria Butenkov SA (2004) Granular computing in image processing and understanding. In: Proceedings of IASTED International Conference on Artificial Intelligence and Applications. Innsbruck, Austria
28.
go back to reference Pal SK, Uma Shankar B, Mitra P (2005) Granular computing, rough entropy and object extraction. Pattern Recogn Lett 26(16):2509–2517CrossRef Pal SK, Uma Shankar B, Mitra P (2005) Granular computing, rough entropy and object extraction. Pattern Recogn Lett 26(16):2509–2517CrossRef
29.
go back to reference Butenkov SA, Krivsha VV, Saud AD (2006) Granular computing in computer image perception: basic issues and glass box models. In: Proceedings of the 24th IASTED International Conference on Artificial Intelligence and Applications, pp 462–467 Butenkov SA, Krivsha VV, Saud AD (2006) Granular computing in computer image perception: basic issues and glass box models. In: Proceedings of the 24th IASTED International Conference on Artificial Intelligence and Applications, pp 462–467
30.
go back to reference Bargiela A, Pedrycz W (2008) Toward a theory of granular computing for human-centered information processing. IEEE Trans Fuzzy Syst 16:320–330CrossRef Bargiela A, Pedrycz W (2008) Toward a theory of granular computing for human-centered information processing. IEEE Trans Fuzzy Syst 16:320–330CrossRef
31.
go back to reference Bhatt HS, Samarth B, Singh R, Vatsa M, Noore A (2011) Evolutionary granular approach for recognizing faces altered due to plastic surgery. In ‘FG’, IEEE, pp 720–725 Bhatt HS, Samarth B, Singh R, Vatsa M, Noore A (2011) Evolutionary granular approach for recognizing faces altered due to plastic surgery. In ‘FG’, IEEE, pp 720–725
32.
go back to reference Chung FRK (1997) Spectral graph theory, volume 92 of Regional Conference Series in Mathematics Chung FRK (1997) Spectral graph theory, volume 92 of Regional Conference Series in Mathematics
33.
go back to reference Skočal D, Bischof H, Leonardis A (2002) A robust PCA algorithm for building representations from panoramic images. European Conference on Computer Vision, vol IV. Springer, New York, pp 761–775 Skočal D, Bischof H, Leonardis A (2002) A robust PCA algorithm for building representations from panoramic images. European Conference on Computer Vision, vol IV. Springer, New York, pp 761–775
34.
go back to reference Zadeh LA (1997) Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127CrossRefMATHMathSciNet Zadeh LA (1997) Towards a theory of fuzzy information granulation and its centrality in human reasoning and fuzzy logic. Fuzzy Sets Syst 90(2):111–127CrossRefMATHMathSciNet
35.
go back to reference Zadeh LA (1998) Some reflections on soft computing, granular computing and their roles in the conception, design and utilization of information/intelligent systems. Soft Comput 2(1):23–25CrossRef Zadeh LA (1998) Some reflections on soft computing, granular computing and their roles in the conception, design and utilization of information/intelligent systems. Soft Comput 2(1):23–25CrossRef
36.
go back to reference Lin TY (1998) Granular computing on binary relations in data mining and neighborhood systems. In: Proceedings of Rough Sets in Knowledge Discovery, Physica-Verlag, Heidelberg, pp 107–120 Lin TY (1998) Granular computing on binary relations in data mining and neighborhood systems. In: Proceedings of Rough Sets in Knowledge Discovery, Physica-Verlag, Heidelberg, pp 107–120
37.
go back to reference Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 99:1–13 Yao JT, Vasilakos AV, Pedrycz W (2013) Granular computing: perspectives and challenges. IEEE Trans Cybern 99:1–13
38.
go back to reference Zhang B, Zhang L (2010) Discuss on future development of granular computing. J Chongqing Univ Posts Telecommun (Natural Science Edition) 22(5):538–540 Zhang B, Zhang L (2010) Discuss on future development of granular computing. J Chongqing Univ Posts Telecommun (Natural Science Edition) 22(5):538–540
39.
go back to reference Zhou G (2006) Granular computing model and its application. Master Degree Dissertation, Zhejiang Normal University Zhou G (2006) Granular computing model and its application. Master Degree Dissertation, Zhejiang Normal University
40.
go back to reference Tian Y, Kanade T, Cohn JF (2005) Facial expression recognition. In: Li SZ, Jain AK (eds) Handbook of face recognition. Springer, New York Tian Y, Kanade T, Cohn JF (2005) Facial expression recognition. In: Li SZ, Jain AK (eds) Handbook of face recognition. Springer, New York
41.
go back to reference Shan C, Gong S, McOwan PW (2006) A comprehensive empirical study on linear subspace methods for facial expression analysis. In: Conference on Vision and Pattern Recognition Workshop (CVPRW ’06) Shan C, Gong S, McOwan PW (2006) A comprehensive empirical study on linear subspace methods for facial expression analysis. In: Conference on Vision and Pattern Recognition Workshop (CVPRW ’06)
Metadata
Title
Human facial expression analysis based on image granule LPP
Authors
Xiuxiu Xu
Jiuzhen Liang
Sisi Lv
Qin Wu
Publication date
01-12-2014
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2014
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-014-0228-2

Other articles of this Issue 6/2014

International Journal of Machine Learning and Cybernetics 6/2014 Go to the issue