Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2023

11.01.2023 | Original Article

Robust non-negative supervised low-rank discriminant embedding (NSLRDE) for feature extraction

verfasst von: Minghua Wan, Chengxu Yan, Tianming Zhan, Hai Tan, Guowei Yang

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Among many feature extraction technologies, non-negative matrix factorization (NMF) technology ignores the global representation of data and focuses on the local structure information of data. However, the global representation is often more robust than data noise. Therefore, aiming at solving the above problems, combined with the characteristics of local information data, global representation and low-rank representation, a non-negative supervised low-rank discriminant embedding model (NSLRDE) is proposed to improve the robustness of the algorithm. The algorithm decomposes the data \(X\) into clean data \(A\) and noise data \(E\), and sparsely constrains \(E\) through \(L_{1}\)-norm to enhance the robustness to noise. In addition, the algorithm uses low-rank representation learning and non-negative decomposition to further enhance the robustness of the algorithm. Finally, combined with graph embedding algorithm, local and global data are retained. We also apply the method to various noise databases to test the effectiveness.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
8.
Zurück zum Zitat Wright J, Ganesh A, Rao S, Ma Y (2009) Robust principal component analysis: exact recovery of corrupted low-rank matrices. IEEE Wright J, Ganesh A, Rao S, Ma Y (2009) Robust principal component analysis: exact recovery of corrupted low-rank matrices. IEEE
9.
Zurück zum Zitat Fengxi S et al (2007) A multiple maximum scatter difference discriminant criterion for facial feature extraction. IEEE Trans Syst Man Cybern 37(6):1599–1606. Fengxi S et al (2007) A multiple maximum scatter difference discriminant criterion for facial feature extraction. IEEE Trans Syst Man Cybern 37(6):1599–1606.
10.
Zurück zum Zitat Liu Q, Hanqing L, Ma S (2004) Improving kernel Fisher discriminant analysis for face recognition. IEEE Trans Circ Syst Video Techn 14(1):42–49CrossRef Liu Q, Hanqing L, Ma S (2004) Improving kernel Fisher discriminant analysis for face recognition. IEEE Trans Circ Syst Video Techn 14(1):42–49CrossRef
11.
Zurück zum Zitat Fraley C, Raftery AE (2002) Model-based clustering, discriminant analysis, and density estimation. J Am Stat Assoc 97(458):611–631MathSciNetCrossRefMATH Fraley C, Raftery AE (2002) Model-based clustering, discriminant analysis, and density estimation. J Am Stat Assoc 97(458):611–631MathSciNetCrossRefMATH
12.
Zurück zum Zitat Wangmeng Z et al (2006) BDPCA plus LDA: a novel fast feature extraction technique for face recognition. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Syst Man Cybern Soc 36(4):946–953 Wangmeng Z et al (2006) BDPCA plus LDA: a novel fast feature extraction technique for face recognition. IEEE transactions on systems, man, and cybernetics. Part B, Cybernetics : a publication of the IEEE Syst Man Cybern Soc 36(4):946–953
13.
Zurück zum Zitat Yanwei P, Shuang W, Yuan Y (2014) Learning regularized LDA by clustering. IEEE Trans Neural Netw Learn Syst 25(12):2191–2201CrossRef Yanwei P, Shuang W, Yuan Y (2014) Learning regularized LDA by clustering. IEEE Trans Neural Netw Learn Syst 25(12):2191–2201CrossRef
14.
Zurück zum Zitat Chang T et al (2019) Feature selective projection with low-rank embedding and dual Laplacian regularization. IEEE Trans Knowl Data Eng 1–1 Chang T et al (2019) Feature selective projection with low-rank embedding and dual Laplacian regularization. IEEE Trans Knowl Data Eng 1–1
15.
Zurück zum Zitat Jianglin L et al (2020) Low-rank adaptive graph embedding for unsupervised feature extraction. Pattern Recognit 107758 Jianglin L et al (2020) Low-rank adaptive graph embedding for unsupervised feature extraction. Pattern Recognit 107758
16.
Zurück zum Zitat Mingna Wu et al (2021) Joint latent low-rank and non-negative induced sparse representation for face recognition. Appl Intell 51(11):1–16 Mingna Wu et al (2021) Joint latent low-rank and non-negative induced sparse representation for face recognition. Appl Intell 51(11):1–16
18.
Zurück zum Zitat Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv Neural Inf Process Syst 14(6):585–591 Belkin M, Niyogi P (2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. Adv Neural Inf Process Syst 14(6):585–591
21.
Zurück zum Zitat He X, Niyogi P (2002) Locality preserving projections (lpp). In: Advances in neural information processing systems 16 He X, Niyogi P (2002) Locality preserving projections (lpp). In: Advances in neural information processing systems 16
22.
Zurück zum Zitat Zheng Z et al (2007) Gabor feature-based face recognition using supervised locality preserving projection. Signal Process 87(10):2473–2483CrossRefMATH Zheng Z et al (2007) Gabor feature-based face recognition using supervised locality preserving projection. Signal Process 87(10):2473–2483CrossRefMATH
23.
Zurück zum Zitat He X, Deng C, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Tenth IEEE international conference on computer vision. IEEE He X, Deng C, Yan S, Zhang HJ (2005) Neighborhood preserving embedding. In: Tenth IEEE international conference on computer vision. IEEE
24.
Zurück zum Zitat Qiao L, Chen S, Tan X (2009) Sparsity preserving projections with applications to face recognition. Pattern Recogn 43(1):331–341CrossRefMATH Qiao L, Chen S, Tan X (2009) Sparsity preserving projections with applications to face recognition. Pattern Recogn 43(1):331–341CrossRefMATH
25.
Zurück zum Zitat Deng C, He X, Han J (2006) Isometric projection Deng C, He X, Han J (2006) Isometric projection
26.
Zurück zum Zitat Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH
27.
Zurück zum Zitat Wang Y-X, Zhang Y-J (2013) Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng 25(6):1336–1353CrossRef Wang Y-X, Zhang Y-J (2013) Nonnegative matrix factorization: a comprehensive review. IEEE Trans Knowl Data Eng 25(6):1336–1353CrossRef
28.
Zurück zum Zitat Hoyer PO (2002) Non-negative sparse coding. In: Proceedings of the 2002 12th IEEE Workshop on neural networks for signal processing, 2002 Hoyer PO (2002) Non-negative sparse coding. In: Proceedings of the 2002 12th IEEE Workshop on neural networks for signal processing, 2002
29.
Zurück zum Zitat Deng C et al (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef Deng C et al (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef
30.
Zurück zum Zitat Peng S, Ser W, Chen B, Lin Z (2020) Robust orthogonal nonnegative matrix tri-factorization for data representation. Knowl-Based Syst 201–202:106054CrossRef Peng S, Ser W, Chen B, Lin Z (2020) Robust orthogonal nonnegative matrix tri-factorization for data representation. Knowl-Based Syst 201–202:106054CrossRef
31.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2011) Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans Image Process 20(7):2030–2048MathSciNetCrossRefMATH Guan N, Tao D, Luo Z, Yuan B (2011) Manifold regularized discriminative nonnegative matrix factorization with fast gradient descent. IEEE Trans Image Process 20(7):2030–2048MathSciNetCrossRefMATH
32.
Zurück zum Zitat Yang Z, Liang N, Yan W, Li Z, Xie S (2020) Uniform distribution non-negative matrix factorization for multiview clustering. IEEE Trans Cybern 99:1–14 Yang Z, Liang N, Yan W, Li Z, Xie S (2020) Uniform distribution non-negative matrix factorization for multiview clustering. IEEE Trans Cybern 99:1–14
33.
Zurück zum Zitat Liang N et al (2020) Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl Based Syst 194:105582–105582 Liang N et al (2020) Multi-view clustering by non-negative matrix factorization with co-orthogonal constraints. Knowl Based Syst 194:105582–105582
34.
Zurück zum Zitat Naiyao L et al (2021) Semi-supervised multi-view learning by using label propagation based non-negative matrix factorization. Knowl Based Syst 228 Naiyao L et al (2021) Semi-supervised multi-view learning by using label propagation based non-negative matrix factorization. Knowl Based Syst 228
35.
Zurück zum Zitat Kong D, Ding C, Huang H (2011) Robust nonnegative matrix factorization using L21-norm. In: Acm Conference on Information & Knowledge Management. ACM, pp 673 Kong D, Ding C, Huang H (2011) Robust nonnegative matrix factorization using L21-norm. In: Acm Conference on Information & Knowledge Management. ACM, pp 673
36.
Zurück zum Zitat Wu B, Wang E, Zhu Z, Chen W, Xiao P (2017) Manifold nmf with l 21 norm for clustering. Neurocomputing 273:78–88CrossRef Wu B, Wang E, Zhu Z, Chen W, Xiao P (2017) Manifold nmf with l 21 norm for clustering. Neurocomputing 273:78–88CrossRef
37.
Zurück zum Zitat Li R, Wang X, Quan W, Song Y, Lei L (2020) Robust and structural sparsity auto-encoder with l21-norm minimization. Neurocomputing 1:1CrossRef Li R, Wang X, Quan W, Song Y, Lei L (2020) Robust and structural sparsity auto-encoder with l21-norm minimization. Neurocomputing 1:1CrossRef
38.
Zurück zum Zitat Wang Y (2004) Fisher non-negative matrix factorization for learning local features. Accv Jan, 27–30 Wang Y (2004) Fisher non-negative matrix factorization for learning local features. Accv Jan, 27–30
39.
Zurück zum Zitat Zafeiriou S, Tefas A, Buciu I, Pitas I (2006) Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification. IEEE Trans Neural Networks 17(3):683–695CrossRef Zafeiriou S, Tefas A, Buciu I, Pitas I (2006) Exploiting discriminant information in nonnegative matrix factorization with application to frontal face verification. IEEE Trans Neural Networks 17(3):683–695CrossRef
40.
Zurück zum Zitat Liu G, Lin Z, Yong Y (2010) Robust subspace segmentation by low-rank representation. In: International Conference on Machine Learning. DBLP Liu G, Lin Z, Yong Y (2010) Robust subspace segmentation by low-rank representation. In: International Conference on Machine Learning. DBLP
41.
Zurück zum Zitat Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef Liu G, Lin Z, Yan S, Sun J, Yu Y, Ma Y (2013) Robust recovery of subspace structures by low-rank representation. IEEE Trans Pattern Anal Mach Intell 35(1):171–184CrossRef
42.
Zurück zum Zitat Wang Q, He X, Li X (2019) Locality and structure regularized low rank representation for hyperspectral image classification. IEEE Trans Geosci Remote Sens 57(2):911–923CrossRef Wang Q, He X, Li X (2019) Locality and structure regularized low rank representation for hyperspectral image classification. IEEE Trans Geosci Remote Sens 57(2):911–923CrossRef
43.
Zurück zum Zitat Wen J, Fang X, Yong X, Tian C, Fei L (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH Wen J, Fang X, Yong X, Tian C, Fei L (2018) Low-rank representation with adaptive graph regularization. Neural Netw 108:83–96CrossRefMATH
44.
Zurück zum Zitat Zhang X (2012) Non-negative low rank and sparse graph for semi-supervised learning. Comput Vis Pattern Recognit IEEE Zhang X (2012) Non-negative low rank and sparse graph for semi-supervised learning. Comput Vis Pattern Recognit IEEE
45.
Zurück zum Zitat Lu Y, Lai Z, Li X, Zhang D, Wong WK, Yuan C (2017) Learning parts-based and global representation for image classification. IEEE Trans Circ Syst Video Technol 1–1 Lu Y, Lai Z, Li X, Zhang D, Wong WK, Yuan C (2017) Learning parts-based and global representation for image classification. IEEE Trans Circ Syst Video Technol 1–1
46.
Zurück zum Zitat Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2010) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRefMATH Boyd S, Parikh N, Chu E, Peleato B, Eckstein J (2010) Distributed optimization and statistical learning via the alternating direction method of multipliers. Found Trends Mach Learn 3(1):1–122CrossRefMATH
47.
Zurück zum Zitat Cai J, Cand EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim Cai J, Cand EJ, Shen Z (2010) A singular value thresholding algorithm for matrix completion. SIAM J Optim
48.
Zurück zum Zitat Mazumder R, Hastie T, Tibshirani R (2010) Spectral regularization algorithms for learning large incomplete matrices. J Mach Learn Res JMLR 11(11):2287–2322MathSciNetMATH Mazumder R, Hastie T, Tibshirani R (2010) Spectral regularization algorithms for learning large incomplete matrices. J Mach Learn Res JMLR 11(11):2287–2322MathSciNetMATH
49.
Zurück zum Zitat Wan M, Lai Z, Zhong J (2011) Feature extraction using two-dimensional local graph embedding based on maximum margin criterion. Appl Math Comput 217(23):9659–9668MathSciNetMATH Wan M, Lai Z, Zhong J (2011) Feature extraction using two-dimensional local graph embedding based on maximum margin criterion. Appl Math Comput 217(23):9659–9668MathSciNetMATH
50.
Zurück zum Zitat Lu J, Wang H, Zhou J, Chen Y, Hu Q (2020) Low-rank adaptive graph embedding for unsupervised feature extraction. Pattern Recognit 107758 Lu J, Wang H, Zhou J, Chen Y, Hu Q (2020) Low-rank adaptive graph embedding for unsupervised feature extraction. Pattern Recognit 107758
51.
Zurück zum Zitat Yang J, Zhang D, Yang J, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):650–664CrossRef Yang J, Zhang D, Yang J, Niu B (2007) Globally maximizing, locally minimizing: unsupervised discriminant projection with applications to face and palm biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):650–664CrossRef
Metadaten
Titel
Robust non-negative supervised low-rank discriminant embedding (NSLRDE) for feature extraction
verfasst von
Minghua Wan
Chengxu Yan
Tianming Zhan
Hai Tan
Guowei Yang
Publikationsdatum
11.01.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2023
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-022-01752-y

Weitere Artikel der Ausgabe 6/2023

International Journal of Machine Learning and Cybernetics 6/2023 Zur Ausgabe