Skip to main content
Top
Published in: Soft Computing 10/2016

21-06-2015 | Methodologies and Application

Recursive locality preserving projection for feature extraction

Authors: Jie Xu, Shengli Xie

Published in: Soft Computing | Issue 10/2016

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper, we develop a novel feature extractor called recursive locality preserving projection (RLPP). RLPP inherits the advantages of LPP and at the same time makes some improvements. In RLPP, two local weight graphs are constructed. By combining the ideas of LPP and FLDA, a discriminative maximum criterion is proposed to make the local within-class data pairs close and between-class data pairs apart. To further improve the algorithm performance, a simple but effective method is presented to find the statistically uncorrelated discriminative vectors one by one. In this way, each new obtained discriminative vector not only maximizes the discriminative criterion but also contains minimum redundancy. Our experimental results on five databases demonstrate that RLPP is more powerful than the related methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (1997) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
go back to reference Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH
go back to reference Cai D, He X, Han J, Zhang HJ (2006) Orthogonal laplacianfaces for face recognition. IEEE Trans Image Process 15(11):3608–3614CrossRef Cai D, He X, Han J, Zhang HJ (2006) Orthogonal laplacianfaces for face recognition. IEEE Trans Image Process 15(11):3608–3614CrossRef
go back to reference Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inform Theory 13(1):21–27CrossRefMATH Cover TM, Hart PE (1967) Nearest neighbor pattern classification. IEEE Trans Inform Theory 13(1):21–27CrossRefMATH
go back to reference Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH Duda RO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH
go back to reference Foley DH, Sammon JW Jr (1975) An optimal set of discriminant vectors. IEEE Trans Comput 24(3):281–289CrossRefMATH Foley DH, Sammon JW Jr (1975) An optimal set of discriminant vectors. IEEE Trans Comput 24(3):281–289CrossRefMATH
go back to reference Guo J, Qi L, Li Y (2015) Fault detection of batch process using dynamic multi-way orthogonal locality preserving projections. J Comput Inf Syst 11(2):577–586 Guo J, Qi L, Li Y (2015) Fault detection of batch process using dynamic multi-way orthogonal locality preserving projections. J Comput Inf Syst 11(2):577–586
go back to reference He X, Niyogi P (2003) Locality preserving projections. in NIPS He X, Niyogi P (2003) Locality preserving projections. in NIPS
go back to reference He X, Yan S, Hu Y, Niyogi P, Zhang H (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef He X, Yan S, Hu Y, Niyogi P, Zhang H (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef
go back to reference Jin Z, Yang JY, Hu ZS, Lou Z (2001a) Face recognition based on the uncorrelated discriminant transformation. Pattern Recognit 34(7):1405–1416 Jin Z, Yang JY, Hu ZS, Lou Z (2001a) Face recognition based on the uncorrelated discriminant transformation. Pattern Recognit 34(7):1405–1416
go back to reference Jin Z, Yang JY, Tang ZM, Hu ZS (2001b) A theorem on the uncorrelated optimal discriminant vectors. Pattern Recognit 34(10):2041–2047 Jin Z, Yang JY, Tang ZM, Hu ZS (2001b) A theorem on the uncorrelated optimal discriminant vectors. Pattern Recognit 34(10):2041–2047
go back to reference Jing XY, Zhang D, Jin Z (2003) Improvements on the uncorrelated optimal discriminant vectors. Pattern Recognit 36(8):1921–1923CrossRefMATH Jing XY, Zhang D, Jin Z (2003) Improvements on the uncorrelated optimal discriminant vectors. Pattern Recognit 36(8):1921–1923CrossRefMATH
go back to reference Landgrebe DA (2003) Signal theory methods in multispectral remote sensing. Wiley, ChichesterCrossRef Landgrebe DA (2003) Signal theory methods in multispectral remote sensing. Wiley, ChichesterCrossRef
go back to reference Liang Z, Shi P (2005) Uncorrelated discriminant vectors using a kernel method. Pattern Recognit 38(2):307–310CrossRefMATH Liang Z, Shi P (2005) Uncorrelated discriminant vectors using a kernel method. Pattern Recognit 38(2):307–310CrossRefMATH
go back to reference Liang Y, Gong W, Pan Y, Li W (2005) Face recognition using uncorrelated, weighted linear discriminant analysis. Pattern recognition and image analysis. Springer, Berlin Liang Y, Gong W, Pan Y, Li W (2005) Face recognition using uncorrelated, weighted linear discriminant analysis. Pattern recognition and image analysis. Springer, Berlin
go back to reference Li F, Wang J, Tang B, Tian D (2014) Life grade recognition method based on supervised uncorrelated orthogonal locality preserving projection and K-nearest neighbor classifier. Neurocomputing 138:271–282CrossRef Li F, Wang J, Tang B, Tian D (2014) Life grade recognition method based on supervised uncorrelated orthogonal locality preserving projection and K-nearest neighbor classifier. Neurocomputing 138:271–282CrossRef
go back to reference Martinez AM, Benavente R (1998) The AR face database. CVC technical report #24, June Martinez AM, Benavente R (1998) The AR face database. CVC technical report #24, June
go back to reference Murphy PM, Aha DW (1994) UCI repository of machine learning databases. technical report, Department of Information and Computer Science, University of California, Irvine, Calif Murphy PM, Aha DW (1994) UCI repository of machine learning databases. technical report, Department of Information and Computer Science, University of California, Irvine, Calif
go back to reference Nie F, Xiang S, Liu Y, Hou C, Zhang C (2012) Orthogonal vs. uncorrelated least squares discriminant analysis for feature extraction. Pattern Recognit Lett 33(5):485–491CrossRef Nie F, Xiang S, Liu Y, Hou C, Zhang C (2012) Orthogonal vs. uncorrelated least squares discriminant analysis for feature extraction. Pattern Recognit Lett 33(5):485–491CrossRef
go back to reference Tang B, Li F, Qin Y (2011) Fault diagnosis model based on feature compression with orthogonal locality preserving projection. Chin J Mech Eng 24(5):891–898CrossRef Tang B, Li F, Qin Y (2011) Fault diagnosis model based on feature compression with orthogonal locality preserving projection. Chin J Mech Eng 24(5):891–898CrossRef
go back to reference Wong WK, Zhao HT (2012) Supervised optimal locality preserving projection. Pattern Recognit 45(1):186–197CrossRefMATH Wong WK, Zhao HT (2012) Supervised optimal locality preserving projection. Pattern Recognit 45(1):186–197CrossRefMATH
go back to reference Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef Xiang C, Fan XA, Lee TH (2006) Face recognition using recursive fisher linear discriminant. IEEE Trans Image Process 15(8):2097–2105CrossRef
go back to reference Xu Y, Yang JY, Jin Z (2003) Theory analysis on FSLDA and ULDA. Pattern Recognit 36(12):3031–3033CrossRefMATH Xu Y, Yang JY, Jin Z (2003) Theory analysis on FSLDA and ULDA. Pattern Recognit 36(12):3031–3033CrossRefMATH
go back to reference Yang J, Yang JY, Frangi AF, Zhang D (2003) Uncorrelated projection discriminant analysis and its application to face image feature extraction. Int J Patt Recogn Artif Intell 17(8):1325–1347CrossRef Yang J, Yang JY, Frangi AF, Zhang D (2003) Uncorrelated projection discriminant analysis and its application to face image feature extraction. Int J Patt Recogn Artif Intell 17(8):1325–1347CrossRef
go back to reference Yen S, Wu CM, Wang H (2012) A block-based orthogonal locality preserving projection method for face super-resolution. Intell Inf Datab Syst, Springer, Berlin Heidelberg, pp 253–262 Yen S, Wu CM, Wang H (2012) A block-based orthogonal locality preserving projection method for face super-resolution. Intell Inf Datab Syst, Springer, Berlin Heidelberg, pp 253–262
go back to reference Yu YL, Zhang LM (2008) Orthogonal MFA and uncorrelated MFA. Pattern Recognit Artif Intell 21(5):603–608 (in Chinese) Yu YL, Zhang LM (2008) Orthogonal MFA and uncorrelated MFA. Pattern Recognit Artif Intell 21(5):603–608 (in Chinese)
go back to reference Zhang X, Chu D (2013) Sparse uncorrelated linear discriminant analysis. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 45–52 Zhang X, Chu D (2013) Sparse uncorrelated linear discriminant analysis. In: Proceedings of the 30th international conference on machine learning (ICML-13), pp 45–52
go back to reference Zhao H, Sun S (2010) Optimal locality preserving projection. Image Processing (ICIP), 2010 17th IEEE international conference on. IEEE, pp 1861–1864 Zhao H, Sun S (2010) Optimal locality preserving projection. Image Processing (ICIP), 2010 17th IEEE international conference on. IEEE, pp 1861–1864
go back to reference Zhao HT, Yuen PC, Yang JY (2005) Optimal subspace analysis for face recognition. Int J Pattern Recogn Artif Intell 19(3):375–393CrossRef Zhao HT, Yuen PC, Yang JY (2005) Optimal subspace analysis for face recognition. Int J Pattern Recogn Artif Intell 19(3):375–393CrossRef
go back to reference Zhao H, Sun S, Jing Z (2006) Local information based uncorrelated feature extraction. Opt Eng 45(2):020505CrossRef Zhao H, Sun S, Jing Z (2006) Local information based uncorrelated feature extraction. Opt Eng 45(2):020505CrossRef
go back to reference Zheng WM, Zhao L, Zou CR (2004) An efficient algorithm to solve the small sample size problem for LDA. Pattern Recognit 37(5):1077–1079CrossRefMATH Zheng WM, Zhao L, Zou CR (2004) An efficient algorithm to solve the small sample size problem for LDA. Pattern Recognit 37(5):1077–1079CrossRefMATH
go back to reference Zheng ZL, Yang F, Tan WA, Jia J, Yang J (2007) Gabor feature-based face recognition using supervised locality preserving projections. J Signal Proc 87(10):2473–2483CrossRefMATH Zheng ZL, Yang F, Tan WA, Jia J, Yang J (2007) Gabor feature-based face recognition using supervised locality preserving projections. J Signal Proc 87(10):2473–2483CrossRefMATH
Metadata
Title
Recursive locality preserving projection for feature extraction
Authors
Jie Xu
Shengli Xie
Publication date
21-06-2015
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 10/2016
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-015-1745-y

Other articles of this Issue 10/2016

Soft Computing 10/2016 Go to the issue

Premium Partner