Skip to main content
Erschienen in: Neural Processing Letters 3/2020

04.09.2020

Low-Rank Discriminative Adaptive Graph Preserving Subspace Learning

verfasst von: Haishun Du, Yuxi Wang, Fan Zhang, Yi Zhou

Erschienen in: Neural Processing Letters | Ausgabe 3/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The global and local geometric structures of data play a key role in subspace learning. Although many manifold-based subspace learning methods have been proposed for preserving the local geometric structure of data, they usually use a predefined neighbor graph to characterize it. However, the predefined neighbor graph might be not optimal since it keeps fixed during the subsequent subspace learning process. Moreover, most manifold-based subspace learning methods ignore the global structure of data. To address these issues, we propose a low-rank discriminative adaptive graph preserving (LRDAGP) subspace learning method for image feature extraction and recognition by integrating the low-rank representation , adaptive manifold learning, and supervised regularizer into a unified framework. To capture the optimal local geometric structure of data for subspace learning, LRDAGP adopts an adaptive manifold learning strategy that the neighbor graph is adaptively updated during the subspace learning process. To capture the optimal global structure of data for subspace learning, LRDAGP also seeks the low-rank representations of data in a low-dimensional subspace during the subspace learning process. Moreover, for improving the discrimination ability of the learned subspace, a supervised regularizer is designed and incorporated into the LRDAGP model. Experimental results on several image datasets show that LRDAGP is effective for image feature extraction and recognition.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef Turk M, Pentland A (1991) Eigenfaces for recognition. J Cogn Neurosci 3(1):71–86CrossRef
2.
Zurück zum Zitat Belhumeur PN, Hespanha JP, Kriegman DJ (2013) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef Belhumeur PN, Hespanha JP, Kriegman DJ (2013) Eigenfaces vs. fisherfaces: recognition using class specific linear projection. IEEE Trans Pattern Anal Mach Intell 19(7):711–720CrossRef
3.
Zurück zum Zitat Zhong F, Zhang J (2013) Linear discriminant analysis based on L1-norm maximization. IEEE Trans Image Process 22(8):3018–3027MathSciNetCrossRef Zhong F, Zhang J (2013) Linear discriminant analysis based on L1-norm maximization. IEEE Trans Image Process 22(8):3018–3027MathSciNetCrossRef
4.
Zurück zum Zitat Li X, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–165CrossRef Li X, Jiang T, Zhang K (2006) Efficient and robust feature extraction by maximum margin criterion. IEEE Trans Neural Netw 17(1):157–165CrossRef
5.
Zurück zum Zitat Yang J, Zhang D, Frangi AF, Yang J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRef Yang J, Zhang D, Frangi AF, Yang J (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRef
6.
Zurück zum Zitat Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recogn Lett 26(5):527–532CrossRef Li M, Yuan B (2005) 2D-LDA: a statistical linear discriminant analysis for image matrix. Pattern Recogn Lett 26(5):527–532CrossRef
7.
Zurück zum Zitat Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
8.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
9.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef
10.
Zurück zum Zitat He X, Yan S, Hu Y, Niyogi P, Zhang H (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef He X, Yan S, Hu Y, Niyogi P, Zhang H (2005) Face recognition using Laplacianfaces. IEEE Trans Pattern Anal Mach Intell 27(3):328–340CrossRef
11.
Zurück zum Zitat Yu W, Teng X, Liu C (2006) Face recognition using discriminant locality preserving projections. Image Vis Comput 24(3):239–248CrossRef Yu W, Teng X, Liu C (2006) Face recognition using discriminant locality preserving projections. Image Vis Comput 24(3):239–248CrossRef
12.
Zurück zum Zitat He X, Cai D, Yan S, Zhang H (2005) Neighborhood preserving embedding. In: Proceedings of 20th IEEE international conference on computer vision, pp 1208–1213 He X, Cai D, Yan S, Zhang H (2005) Neighborhood preserving embedding. In: Proceedings of 20th IEEE international conference on computer vision, pp 1208–1213
13.
Zurück zum Zitat Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell 29(1):40–51CrossRef Yan S, Xu D, Zhang B, Zhang H, Yang Q, Lin S (2007) Graph embedding and extensions: a general framework for dimensionality reduction. IEEE Trans Pattern Anal Mach Intell 29(1):40–51CrossRef
14.
Zurück zum Zitat Zhu X, Li X, Zhang S (2016) Block-row sparse multiview multilabel learning for image classification. IEEE Trans Cybern 46(2):450–461CrossRef Zhu X, Li X, Zhang S (2016) Block-row sparse multiview multilabel learning for image classification. IEEE Trans Cybern 46(2):450–461CrossRef
15.
Zurück zum Zitat Lai Z, Xu Y, Yang J, Shen L, Zhang D (2017) Rotational invariant dimensionality reduction algorithms. IEEE Trans Cybern 47(11):3733–3746CrossRef Lai Z, Xu Y, Yang J, Shen L, Zhang D (2017) Rotational invariant dimensionality reduction algorithms. IEEE Trans Cybern 47(11):3733–3746CrossRef
16.
Zurück zum Zitat Zhu X, Zhang S, He W, Hu R, Lei C, Zhu P (2019) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022–2034CrossRef Zhu X, Zhang S, He W, Hu R, Lei C, Zhu P (2019) One-step multi-view spectral clustering. IEEE Trans Knowl Data Eng 31(10):2022–2034CrossRef
17.
Zurück zum Zitat Du H, Li G, Wang S, Zhang F (2019) Discriminant locality preserving projections based on \(l_{2, p}\)-norm for image feature extraction and recognition. J Vis Commun Image Represent 58:166–177CrossRef Du H, Li G, Wang S, Zhang F (2019) Discriminant locality preserving projections based on \(l_{2, p}\)-norm for image feature extraction and recognition. J Vis Commun Image Represent 58:166–177CrossRef
18.
Zurück zum Zitat Zhang L, Qiao L, Chen S (2010) Graph-optimized locality preserving projections. Pattern Recogn 43(6):1993–2002CrossRef Zhang L, Qiao L, Chen S (2010) Graph-optimized locality preserving projections. Pattern Recogn 43(6):1993–2002CrossRef
19.
Zurück zum Zitat Zhang L, Chen S, Qiao L (2012) Graph optimization for dimensionality reduction with sparsity constraints. Pattern Recogn 45(3):1205–1210CrossRef Zhang L, Chen S, Qiao L (2012) Graph optimization for dimensionality reduction with sparsity constraints. Pattern Recogn 45(3):1205–1210CrossRef
20.
Zurück zum Zitat Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 977–986 Nie F, Wang X, Huang H (2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 977–986
21.
Zurück zum Zitat Meng Y, Shang R, Jiao L, Zhang W, Yuan Y, Yang S (2018) Feature selection based dual-graph sparse non-negative matrix factorization for local discriminative clustering. Neurocomputing 290:87–99CrossRef Meng Y, Shang R, Jiao L, Zhang W, Yuan Y, Yang S (2018) Feature selection based dual-graph sparse non-negative matrix factorization for local discriminative clustering. Neurocomputing 290:87–99CrossRef
22.
Zurück zum Zitat Shang R, Meng Y, Wang W, Shang F, Jiao L (2019) Local discriminative based sparse subspace learning for feature selection. Pattern Recogn 92:219–230CrossRef Shang R, Meng Y, Wang W, Shang F, Jiao L (2019) Local discriminative based sparse subspace learning for feature selection. Pattern Recogn 92:219–230CrossRef
23.
Zurück zum Zitat Shang R, Meng Y, Liu C, Jiao L, Esfahani AMG, Stokin R (2019) Unsupervised feature selection based on kernel fisher discriminant analysis and regression learning. Mach Learn 290:659–686MathSciNetCrossRef Shang R, Meng Y, Liu C, Jiao L, Esfahani AMG, Stokin R (2019) Unsupervised feature selection based on kernel fisher discriminant analysis and regression learning. Mach Learn 290:659–686MathSciNetCrossRef
24.
Zurück zum Zitat Meng Y, Shang R, Shang F, Jiao L, Yang S, Stolkin R (2020) Semi-supervised graph regularized deep NMF with bi-orthogonal constraints for data representation. IEEE Trans Neural Netw Learn Syst 31(9):3245–3258MathSciNetCrossRef Meng Y, Shang R, Shang F, Jiao L, Yang S, Stolkin R (2020) Semi-supervised graph regularized deep NMF with bi-orthogonal constraints for data representation. IEEE Trans Neural Netw Learn Syst 31(9):3245–3258MathSciNetCrossRef
25.
Zurück zum Zitat Zhu X, Li X, Zhang S, Ju C, Wu X (2017) Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans Neural Netw Learn Syst 28(6):1263–1275MathSciNetCrossRef Zhu X, Li X, Zhang S, Ju C, Wu X (2017) Robust joint graph sparse coding for unsupervised spectral feature selection. IEEE Trans Neural Netw Learn Syst 28(6):1263–1275MathSciNetCrossRef
26.
Zurück zum Zitat Zhu X, Zhang S, Hu R, Zhu R, Song J (2018) Local and global structure preservation for robust unsupervised spectral feature selection. IEEE Trans Knowl Data Eng 30(3):517–529CrossRef Zhu X, Zhang S, Hu R, Zhu R, Song J (2018) Local and global structure preservation for robust unsupervised spectral feature selection. IEEE Trans Knowl Data Eng 30(3):517–529CrossRef
27.
Zurück zum Zitat Wright J, Ganesh A, Rao S, Peng Y, Ma Y (2009) Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Proceedings of advances in neural information processing systems (NIPS), pp 2080–2088 Wright J, Ganesh A, Rao S, Peng Y, Ma Y (2009) Robust principal component analysis: exact recovery of corrupted low-rank matrices via convex optimization. In: Proceedings of advances in neural information processing systems (NIPS), pp 2080–2088
28.
Zurück zum Zitat Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef
29.
Zurück zum Zitat Chen J, Mao H, Sang Y, Yi Z (2017) Subspace clustering using a symmetric low-rank representation. Knowl-Based Syst 127:46–57CrossRef Chen J, Mao H, Sang Y, Yi Z (2017) Subspace clustering using a symmetric low-rank representation. Knowl-Based Syst 127:46–57CrossRef
30.
Zurück zum Zitat Wang J, Wang X, Tian F, Liu C, Yu H (2017) Constrained low-rank representation for robust subspace clustering. IEEE Trans Cybern 47(12):4534–4546CrossRef Wang J, Wang X, Tian F, Liu C, Yu H (2017) Constrained low-rank representation for robust subspace clustering. IEEE Trans Cybern 47(12):4534–4546CrossRef
31.
Zurück zum Zitat Wong W, Lai Z, Wen J, Fang X, Lu Y (2017) Low rank embedding for robust image feature extraction. IEEE Trans Image Process 26(6):2905–2917MathSciNetCrossRef Wong W, Lai Z, Wen J, Fang X, Lu Y (2017) Low rank embedding for robust image feature extraction. IEEE Trans Image Process 26(6):2905–2917MathSciNetCrossRef
32.
Zurück zum Zitat Zhang Y, Xiang M, Yang B (2017) Low-rank preserving embedding. Pattern Recogn 70:112–125CrossRef Zhang Y, Xiang M, Yang B (2017) Low-rank preserving embedding. Pattern Recogn 70:112–125CrossRef
33.
Zurück zum Zitat Chen Y, Lai Z, Wong WK, Shen L, Hu Q (2018) Low-rank linear embedding for image recognition. IEEE Trans Multimed 20(12):3212–3222CrossRef Chen Y, Lai Z, Wong WK, Shen L, Hu Q (2018) Low-rank linear embedding for image recognition. IEEE Trans Multimed 20(12):3212–3222CrossRef
34.
Zurück zum Zitat Lu Y, Lai Z, Xu Y, Li X, Zhang D, Yuan C (2016) Low-rank preserving projections. IEEE Trans Cybern 46(8):1900–1913CrossRef Lu Y, Lai Z, Xu Y, Li X, Zhang D, Yuan C (2016) Low-rank preserving projections. IEEE Trans Cybern 46(8):1900–1913CrossRef
35.
Zurück zum Zitat Li S, Fu Y (2016) Learning robust and discriminative subspace with low-rank constraints. IEEE Trans Neural Netw Learn Syst 27(11):2160–2173MathSciNetCrossRef Li S, Fu Y (2016) Learning robust and discriminative subspace with low-rank constraints. IEEE Trans Neural Netw Learn Syst 27(11):2160–2173MathSciNetCrossRef
36.
Zurück zum Zitat Ding Z, Suh S, Han J, Choi C, Fu Y (2015) Discriminative low-rank metric learning for face recognition. In: Proceedings of 11th IEEE international conference and workshops on automatic face and gesture recognition (FG), pp 1–6 Ding Z, Suh S, Han J, Choi C, Fu Y (2015) Discriminative low-rank metric learning for face recognition. In: Proceedings of 11th IEEE international conference and workshops on automatic face and gesture recognition (FG), pp 1–6
37.
Zurück zum Zitat Lu Y, Yuan C, Lai Z, Li X, Zhang D (2017) Nuclear norm-based 2DLPP for image classification. IEEE Trans Multimed 19(11):2391–2403CrossRef Lu Y, Yuan C, Lai Z, Li X, Zhang D (2017) Nuclear norm-based 2DLPP for image classification. IEEE Trans Multimed 19(11):2391–2403CrossRef
38.
Zurück zum Zitat Xie L, Yin M, Yin X, Liu Y, Yin G (2018) Low-rank sparse preserving projections for dimensionality reduction. IEEE Trans Image Process 27(11):5261–5274MathSciNetCrossRef Xie L, Yin M, Yin X, Liu Y, Yin G (2018) Low-rank sparse preserving projections for dimensionality reduction. IEEE Trans Image Process 27(11):5261–5274MathSciNetCrossRef
39.
Zurück zum Zitat Han N, Wu J, Liang Y, Fang X, Wong W, Teng S (2018) Low-rank and sparse embedding for dimensionality reduction. Neural Netw 108:202–216CrossRef Han N, Wu J, Liang Y, Fang X, Wong W, Teng S (2018) Low-rank and sparse embedding for dimensionality reduction. Neural Netw 108:202–216CrossRef
40.
Zurück zum Zitat Zhu X, Zhang S, Li Y, Zhang J, Yang L, Fang Y (2019) Low-rank sparse subspace for spectral clustering. IEEE Trans Knowl Data Eng 31(8):1532–1543CrossRef Zhu X, Zhang S, Li Y, Zhang J, Yang L, Fang Y (2019) Low-rank sparse subspace for spectral clustering. IEEE Trans Knowl Data Eng 31(8):1532–1543CrossRef
41.
Zurück zum Zitat Lin Z, Chen M, Wu L, Ma Y (2009) The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. Technical report, UIUC Technical Report UILU-ENG-09-2215 Lin Z, Chen M, Wu L, Ma Y (2009) The augmented Lagrange multiplier method for exact recovery of corrupted low-rank matrices. Technical report, UIUC Technical Report UILU-ENG-09-2215
42.
Zurück zum Zitat Cai J, Candés EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef Cai J, Candés EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim 20(4):1956–1982MathSciNetCrossRef
43.
Zurück zum Zitat Nie F, Huang H, Cai X, Ding C (2010) Efficient and robust feature selection via joint \({\ell }_{2,1}\)-norms minimization. In: Advances in neural information processing systems, pp 1813–1821 Nie F, Huang H, Cai X, Ding C (2010) Efficient and robust feature selection via joint \({\ell }_{2,1}\)-norms minimization. In: Advances in neural information processing systems, pp 1813–1821
44.
Zurück zum Zitat Nie F, Wang X, Jordan MI, Huang H (2016) The constrained laplacian rank algorithm for graph-based clustering. In: The 30th AAAI conference on artificial intelligence (AAAI) Nie F, Wang X, Jordan MI, Huang H (2016) The constrained laplacian rank algorithm for graph-based clustering. In: The 30th AAAI conference on artificial intelligence (AAAI)
45.
Zurück zum Zitat Samaria FS, Harter AC (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of the 2nd IEEE workshop on applications of computer vision. IEEE, pp 138–142 Samaria FS, Harter AC (1994) Parameterisation of a stochastic model for human face identification. In: Proceedings of the 2nd IEEE workshop on applications of computer vision. IEEE, pp 138–142
46.
Zurück zum Zitat Sim T, Baker S, Bsat M (2010) The CMU pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25(12):1615–1618 Sim T, Baker S, Bsat M (2010) The CMU pose, illumination, and expression database. IEEE Trans Pattern Anal Mach Intell 25(12):1615–1618
47.
Zurück zum Zitat Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef Georghiades AS, Belhumeur PN, Kriegman DJ (2001) From few to many: illumination cone models for face recognition under variable lighting and pose. IEEE Trans Pattern Anal Mach Intell 23(6):643–660CrossRef
48.
Zurück zum Zitat Huang GB, Ramesh R, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report, Dept. Comput. Sci., Univ. Massachusetts, Amherst, MA, USA Huang GB, Ramesh R, Berg T, Learned-Miller E (2007) Labeled faces in the wild: a database for studying face recognition in unconstrained environments. Technical report, Dept. Comput. Sci., Univ. Massachusetts, Amherst, MA, USA
Metadaten
Titel
Low-Rank Discriminative Adaptive Graph Preserving Subspace Learning
verfasst von
Haishun Du
Yuxi Wang
Fan Zhang
Yi Zhou
Publikationsdatum
04.09.2020
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 3/2020
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-020-10340-6

Weitere Artikel der Ausgabe 3/2020

Neural Processing Letters 3/2020 Zur Ausgabe

Neuer Inhalt