Skip to main content
Erschienen in: Neural Processing Letters 1/2018

05.05.2017

Discriminant Analysis with Local Gaussian Similarity Preserving for Feature Extraction

verfasst von: Xi Liu, Zhengming Ma

Erschienen in: Neural Processing Letters | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a novel discriminant analysis with local Gaussian similarity preserving (DA-LGSP) method for feature extraction. DA-LGSP can be viewed as a linear approximation of manifold learning based approach which seeks to find a linear projection that maximizes the between-class dissimilarities under the constraint of locality preserving. The local geometry of each point is preserved by the Gaussian coefficients of its neighbors, meanwhile the between-class dissimilarities are represented by Euclidean distances. Experiments are conducted on USPA data, COIL-20 dataset, ORL dataset and FERET dataset. The performance of the proposed method demonstrates that DA-LGSP is effective in feature extraction.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Dalton L, Saurabh P, Melba MC, Okan E (2014) Manifold-learning-based feature extraction for classification of hyperspectral data: a review of advances in manifold learning. IEEE Signal Proc Mag 31(1):55–66CrossRef Dalton L, Saurabh P, Melba MC, Okan E (2014) Manifold-learning-based feature extraction for classification of hyperspectral data: a review of advances in manifold learning. IEEE Signal Proc Mag 31(1):55–66CrossRef
2.
Zurück zum Zitat He X, Yan S, Hu Y, Niyogi P (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef He X, Yan S, Hu Y, Niyogi P (2005) Face recognition using laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef
3.
Zurück zum Zitat Yu J, Tao D, Wang M, Rui Y (2015) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans on Cybern 45(4):767–779CrossRef Yu J, Tao D, Wang M, Rui Y (2015) Learning to rank using user clicks and visual features for image retrieval. IEEE Trans on Cybern 45(4):767–779CrossRef
4.
Zurück zum Zitat Yu J, Tao D, Wang M (2012) Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process 21(7):3262–3272MathSciNetCrossRefMATH Yu J, Tao D, Wang M (2012) Adaptive hypergraph learning and its application in image classification. IEEE Trans Image Process 21(7):3262–3272MathSciNetCrossRefMATH
5.
Zurück zum Zitat Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRefMATH Yu J, Rui Y, Tao D (2014) Click prediction for web image reranking using multimodal sparse coding. IEEE Trans Image Process 23(5):2019–2032MathSciNetCrossRefMATH
6.
Zurück zum Zitat Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 15(6):1299–1319CrossRef Schölkopf B, Smola A, Müller KR (1998) Nonlinear component analysis as a kernel eigenvalue problem. Neural Comput 15(6):1299–1319CrossRef
7.
Zurück zum Zitat Liu T, Tao D, Song M, Maybank S (2017) Algorithm-dependent generalization bounds for multi-task learning. IEEE Trans Pattern Anal Mach Intell 39(2):227–241CrossRef Liu T, Tao D, Song M, Maybank S (2017) Algorithm-dependent generalization bounds for multi-task learning. IEEE Trans Pattern Anal Mach Intell 39(2):227–241CrossRef
8.
Zurück zum Zitat Liu T, Tao D (2015) On the performance of manhattan nonnegative matrix factorization. IEEE Trans Neural Netw Learn Syst 27(9):1851–1863MathSciNetCrossRef Liu T, Tao D (2015) On the performance of manhattan nonnegative matrix factorization. IEEE Trans Neural Netw Learn Syst 27(9):1851–1863MathSciNetCrossRef
9.
Zurück zum Zitat Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH
10.
Zurück zum Zitat Liu T, Tao D, Xu D (2016) Dimensionality-dependent generalization bounds for k-dimensional coding schemes. Neural Comput 28(10):2213CrossRef Liu T, Tao D, Xu D (2016) Dimensionality-dependent generalization bounds for k-dimensional coding schemes. Neural Comput 28(10):2213CrossRef
12.
Zurück zum Zitat Sam R, Lawrence S (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Sam R, Lawrence S (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
13.
Zurück zum Zitat Tenenbaum J, Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum J, Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
14.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRefMATH
15.
Zurück zum Zitat Zhang Z, Zha H (2004) Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J Sci Comput 26(1):313–338MathSciNetCrossRefMATH Zhang Z, Zha H (2004) Principal manifolds and nonlinear dimensionality reduction via tangent space alignment. SIAM J Sci Comput 26(1):313–338MathSciNetCrossRefMATH
16.
Zurück zum Zitat Donoho D, Grimes C (2003) Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. Proc Natl Acad Arts Sci 100(10):5591–5596MathSciNetCrossRefMATH Donoho D, Grimes C (2003) Hessian eigenmaps: locally linear embedding techniques for high-dimensional data. Proc Natl Acad Arts Sci 100(10):5591–5596MathSciNetCrossRefMATH
17.
Zurück zum Zitat Chen J, Ma Z, Liu Y (2013) Local coordinates alignment with global preservation for dimensionality reduction. IEEE Trans Neural Netw Learn Syst 24(1):106–117CrossRef Chen J, Ma Z, Liu Y (2013) Local coordinates alignment with global preservation for dimensionality reduction. IEEE Trans Neural Netw Learn Syst 24(1):106–117CrossRef
18.
Zurück zum Zitat Niu G, Ma Z, Lv S (2017) Ensemble multiple-kernel based manifold regularization. Neural Process Lett 45:539–552CrossRef Niu G, Ma Z, Lv S (2017) Ensemble multiple-kernel based manifold regularization. Neural Process Lett 45:539–552CrossRef
19.
Zurück zum Zitat Dollar P, Rabaud V, Belongie S (2007) Non-isometric manifold learning: analysis and an algorithm. In: Proceedings of international conference on machine learning, pp 241–248 Dollar P, Rabaud V, Belongie S (2007) Non-isometric manifold learning: analysis and an algorithm. In: Proceedings of international conference on machine learning, pp 241–248
20.
Zurück zum Zitat Farahmand A, Szepesvari C, Audibert J (2007) Manifold-adaptive dimension estimation. In: Proceedings of international conference on Machine learning, pp 265–272 Farahmand A, Szepesvari C, Audibert J (2007) Manifold-adaptive dimension estimation. In: Proceedings of international conference on Machine learning, pp 265–272
21.
Zurück zum Zitat Gerber S, Tasdizen T, Whitaker R (2007) Robust non-linear dimensionality reduction using successive 1-dimensional Laplacian eigenmaps. In: Proceedings of international conference on machine learning, pp 281–288 Gerber S, Tasdizen T, Whitaker R (2007) Robust non-linear dimensionality reduction using successive 1-dimensional Laplacian eigenmaps. In: Proceedings of international conference on machine learning, pp 281–288
22.
Zurück zum Zitat Huang D, Yi Z, Pu X (2009) Manifold-based learning and synthesis. IEEE Trans Syst Man Cybern B Cybern 39(3):592–606CrossRef Huang D, Yi Z, Pu X (2009) Manifold-based learning and synthesis. IEEE Trans Syst Man Cybern B Cybern 39(3):592–606CrossRef
23.
Zurück zum Zitat Mordohai P, Medioni G (2010) Dimensionality estimation, manifold learning and function approximation using tensor voting. J Mach Learn Res 11(1):411–450MathSciNetMATH Mordohai P, Medioni G (2010) Dimensionality estimation, manifold learning and function approximation using tensor voting. J Mach Learn Res 11(1):411–450MathSciNetMATH
24.
Zurück zum Zitat Zhang C, Xiang S, Nie F, Song Y (2009) Nonlinear dimensionality reduction with relative distance comparison. Neurocomputing 72(7–9):1719–1731CrossRef Zhang C, Xiang S, Nie F, Song Y (2009) Nonlinear dimensionality reduction with relative distance comparison. Neurocomputing 72(7–9):1719–1731CrossRef
25.
Zurück zum Zitat Yang Y, Nie F, Xiang S, Zhuang Y, Wang W (2010) Local and global regressive mapping for manifold learning with out-of-sample extrapolation. Proc AAAI Conf Artif Intell 1:649–654 Yang Y, Nie F, Xiang S, Zhuang Y, Wang W (2010) Local and global regressive mapping for manifold learning with out-of-sample extrapolation. Proc AAAI Conf Artif Intell 1:649–654
26.
Zurück zum Zitat Xiang S, Nie F, Pan C, Zhang C (2011) Regression reformulations of LLE and LTSA with locally linear transformation. IEEE Trans Syst Man Cybern B 41(5):1250–1262CrossRef Xiang S, Nie F, Pan C, Zhang C (2011) Regression reformulations of LLE and LTSA with locally linear transformation. IEEE Trans Syst Man Cybern B 41(5):1250–1262CrossRef
27.
Zurück zum Zitat Xiang S, Nie F, Zhang C, Zhang C (2009) Nonlinear dimensionality reduction with local spline embedding. IEEE Trans Knowl Data Eng 21(9):1285–1298CrossRef Xiang S, Nie F, Zhang C, Zhang C (2009) Nonlinear dimensionality reduction with local spline embedding. IEEE Trans Knowl Data Eng 21(9):1285–1298CrossRef
28.
Zurück zum Zitat He X, Niyogi P (2005) Locality preserving projections. Adv Neural Inf Process Syst 16(1):186–197 He X, Niyogi P (2005) Locality preserving projections. Adv Neural Inf Process Syst 16(1):186–197
29.
Zurück zum Zitat Yang J, Zhang D, Yang J, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with application to face and palm biometrics. IEEE Trans Pattern Anal 29(4):650–664CrossRef Yang J, Zhang D, Yang J, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with application to face and palm biometrics. IEEE Trans Pattern Anal 29(4):650–664CrossRef
30.
Zurück zum Zitat Yu J, Wang M, Tao D (2012) Semi-supervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21(11):4636–4648MathSciNetCrossRefMATH Yu J, Wang M, Tao D (2012) Semi-supervised multiview distance metric learning for cartoon synthesis. IEEE Trans Image Process 21(11):4636–4648MathSciNetCrossRefMATH
31.
Zurück zum Zitat Xu C, Tao D, Rui Y (2014) Large-margin weakly supervised dimensionality reduction. International Conference on Machine Learning, ICML 3:2472–2482 Xu C, Tao D, Rui Y (2014) Large-margin weakly supervised dimensionality reduction. International Conference on Machine Learning, ICML 3:2472–2482
32.
33.
Zurück zum Zitat Li B, Huang D, Wang C, Liu K (2008) Feature extraction using constrained maximum variance mapping. Pattern Recognit 41(11):287–3294CrossRefMATH Li B, Huang D, Wang C, Liu K (2008) Feature extraction using constrained maximum variance mapping. Pattern Recognit 41(11):287–3294CrossRefMATH
34.
Zurück zum Zitat Yang W, Sun C, Zhang L (2011) A multi-manifold discriminant analysis method for image feature extraction. Pattern Recognit 44(8):1649–1657CrossRefMATH Yang W, Sun C, Zhang L (2011) A multi-manifold discriminant analysis method for image feature extraction. Pattern Recognit 44(8):1649–1657CrossRefMATH
35.
Zurück zum Zitat Bian W, Tao D (2011) Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans Pattern Anal Mach Intell 33(5):1037–1050CrossRef Bian W, Tao D (2011) Max-min distance analysis by using sequential SDP relaxation for dimension reduction. IEEE Trans Pattern Anal Mach Intell 33(5):1037–1050CrossRef
36.
Zurück zum Zitat Lu J, Tan Y, Wang G (2013) Discriminative multimanifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal 35(1):39–51CrossRef Lu J, Tan Y, Wang G (2013) Discriminative multimanifold analysis for face recognition from a single training sample per person. IEEE Trans Pattern Anal 35(1):39–51CrossRef
37.
Zurück zum Zitat Li B, Li J, Zhang X (2015) Nonparametric discriminant multi-manifold learning for dimensionality reduction. Neurocomputing 152(25):121–126CrossRef Li B, Li J, Zhang X (2015) Nonparametric discriminant multi-manifold learning for dimensionality reduction. Neurocomputing 152(25):121–126CrossRef
39.
Zurück zum Zitat Nene S, Nayar S, Murase H, et al. (1996) Columbia object image library (coil-20), Technical Report CUCS-005-96 Nene S, Nayar S, Murase H, et al. (1996) Columbia object image library (coil-20), Technical Report CUCS-005-96
Metadaten
Titel
Discriminant Analysis with Local Gaussian Similarity Preserving for Feature Extraction
verfasst von
Xi Liu
Zhengming Ma
Publikationsdatum
05.05.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 1/2018
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9630-6

Weitere Artikel der Ausgabe 1/2018

Neural Processing Letters 1/2018 Zur Ausgabe

Neuer Inhalt