Skip to main content
Erschienen in: Neural Computing and Applications 11/2021

04.10.2020 | Original Article

Dual local learning regularized nonnegative matrix factorization and its semi-supervised extension for clustering

verfasst von: Zhenqiu Shu, Yunmeng Zhang, Peng Li, Congzhe You, Zhen Liu, Honghui Fan, Xiao-jun Wu

Erschienen in: Neural Computing and Applications | Ausgabe 11/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Nonnegative matrix factorization (NMF) has received considerable attention in data representation due to its strong interpretability. However, traditional NMF methods neglect the discriminative information and geometric structure of both the data space and the feature space, simultaneously. In this paper, we propose a dual local learning regularized nonnegative matrix factorization (DLLNMF) method, which not only considers the geometric structure of both the data manifold and the feature manifold, simultaneously, but also takes advantage of the discriminative information of both the data space and the feature space. To make full use of the partial label information among samples, we further propose its semi-supervised extension, called dual local learning regularized nonnegative matrix factorization with label constraint (DLLNMF-LC), which imposes the label information as a hard constraint without additional parameters. Experimental results on some benchmark datasets have demonstrated the effectiveness of our proposed methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Li Z, Jiang W, Meng H (2010) Fishervioce: a discriminant subspace framework for speaker recognition. In: IEEE International Conference on Acoustics Speech & Signal Processing (ICASSP), pp 4522–4525 Li Z, Jiang W, Meng H (2010) Fishervioce: a discriminant subspace framework for speaker recognition. In: IEEE International Conference on Acoustics Speech & Signal Processing (ICASSP), pp 4522–4525
2.
Zurück zum Zitat Wen X, Shao L, Xue Y et al (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295(1):395–406CrossRef Wen X, Shao L, Xue Y et al (2015) A rapid learning algorithm for vehicle classification. Inf Sci 295(1):395–406CrossRef
3.
Zurück zum Zitat Pan Z, Zhang Y, Wong K (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef Pan Z, Zhang Y, Wong K (2015) Efficient motion and disparity estimation optimization for low complexity multiview video coding. IEEE Trans Broadcast 61(2):166–176CrossRef
4.
Zurück zum Zitat Shu Z, Fan H et al (2017) Multiple Laplacian graph regularized low-rank representation with application to image representation. IET Image Proc 6:370–378CrossRef Shu Z, Fan H et al (2017) Multiple Laplacian graph regularized low-rank representation with application to image representation. IET Image Proc 6:370–378CrossRef
5.
Zurück zum Zitat Chen Y, Zhou J, Cai D et al (2013) Nonnegative local coordinate factorization for image representation. IEEE Trans Image Process 22(3):969–976MathSciNetCrossRef Chen Y, Zhou J, Cai D et al (2013) Nonnegative local coordinate factorization for image representation. IEEE Trans Image Process 22(3):969–976MathSciNetCrossRef
6.
Zurück zum Zitat Shu Z, Wu X et al (2019) The optimal graph regularized sparse coding with application to image representation. PRCV 2:91–101 Shu Z, Wu X et al (2019) The optimal graph regularized sparse coding with application to image representation. PRCV 2:91–101
7.
Zurück zum Zitat Wang J, Tian F, Liu C et al (2015) Robust semi-supervised nonnegative matrix factorization. In: International Joint Conference on Neural Networks (IJCNN) Wang J, Tian F, Liu C et al (2015) Robust semi-supervised nonnegative matrix factorization. In: International Joint Conference on Neural Networks (IJCNN)
8.
Zurück zum Zitat Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791CrossRef Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791CrossRef
9.
Zurück zum Zitat Jian S, Pang G, Cao L et al (2019) CURE: flexible categorical data representation by hierarchical coupling learning. IEEE Trans Knowl Data Eng 31(5):853–866CrossRef Jian S, Pang G, Cao L et al (2019) CURE: flexible categorical data representation by hierarchical coupling learning. IEEE Trans Knowl Data Eng 31(5):853–866CrossRef
10.
Zurück zum Zitat Li H, Zhang J, Hu J et al (2016) Graph-based discriminative concept factorization for data representation. Knowl Based Syst 118:70–79CrossRef Li H, Zhang J, Hu J et al (2016) Graph-based discriminative concept factorization for data representation. Knowl Based Syst 118:70–79CrossRef
11.
Zurück zum Zitat Peng S, Ser W, Lin Z et al (2019) Dual graph regularized sparse nonnegative matrix factorization for data representation. In: IEEE (ISCAS) Peng S, Ser W, Lin Z et al (2019) Dual graph regularized sparse nonnegative matrix factorization for data representation. In: IEEE (ISCAS)
12.
Zurück zum Zitat Cai D, He X, Wu X et al (2008) Non-negative matrix factorization on manifold. In: International Conference on Data Mining (ICDM’08) Cai D, He X, Wu X et al (2008) Non-negative matrix factorization on manifold. In: International Conference on Data Mining (ICDM’08)
13.
Zurück zum Zitat Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum JB, de Silva V, Langford JC (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
14.
Zurück zum Zitat Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis ST, Saul LK (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
15.
Zurück zum Zitat Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef Belkin M, Niyogi P (2003) Laplacian eigenmaps for dimensionality reduction and data representation. Neural Comput 15(6):1373–1396CrossRef
16.
Zurück zum Zitat Yang J, Zhang D, Frangi A et al (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRef Yang J, Zhang D, Frangi A et al (2004) Two-dimensional PCA: a new approach to appearance-based face representation and recognition. IEEE Trans Pattern Anal Mach Intell 26(1):131–137CrossRef
17.
Zurück zum Zitat Zhang H, Wu Q, Chow T et al (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45(5):1866–1876CrossRef Zhang H, Wu Q, Chow T et al (2012) A two-dimensional neighborhood preserving projection for appearance-based face recognition. Pattern Recognit 45(5):1866–1876CrossRef
18.
Zurück zum Zitat Cai D, He X, Han J et al (2011) Graph regularized non-negative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef Cai D, He X, Han J et al (2011) Graph regularized non-negative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef
19.
Zurück zum Zitat Liu H, Wu Z, Cai D et al (2011) Constrained non-negative matrix factorization for image representation. IEEE Trans Softw Eng 217:0162–8828 Liu H, Wu Z, Cai D et al (2011) Constrained non-negative matrix factorization for image representation. IEEE Trans Softw Eng 217:0162–8828
20.
Zurück zum Zitat Gu Q, Zhou J (2009) Local learning regularized nonnegative matrix factorization. In: The Twenty-first international joint conference on artificial intelligence, pp 1044–1051 Gu Q, Zhou J (2009) Local learning regularized nonnegative matrix factorization. In: The Twenty-first international joint conference on artificial intelligence, pp 1044–1051
21.
Zurück zum Zitat Ye J, Jin Z (2014) Dual-graph regularized concept factorization for clustering. Neurocomputing 138:120–130CrossRef Ye J, Jin Z (2014) Dual-graph regularized concept factorization for clustering. Neurocomputing 138:120–130CrossRef
22.
Zurück zum Zitat Gu Q, Zhou J (2009) Co-clustering on manifolds. In: The 15th ACM SIGKDD international conference on Knowledge Discovery and Data Mining (KDD), pp 359–368 Gu Q, Zhou J (2009) Co-clustering on manifolds. In: The 15th ACM SIGKDD international conference on Knowledge Discovery and Data Mining (KDD), pp 359–368
23.
Zurück zum Zitat Shang F, Jiao LC, Wang F (2012) Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recognit 45:2237–2250CrossRef Shang F, Jiao LC, Wang F (2012) Graph dual regularization non-negative matrix factorization for co-clustering. Pattern Recognit 45:2237–2250CrossRef
24.
Zurück zum Zitat Scholkopf B, Smola AJ (2002) Learning with kernels. MIT Press, CambridgeMATH Scholkopf B, Smola AJ (2002) Learning with kernels. MIT Press, CambridgeMATH
25.
Zurück zum Zitat Trigeorgis G, Bousmalis K, Zafeiriou S et al (2015) A deep matrix factorization method for learning attribute representations. IEEE Trans Pattern Anal Mach Intell 39(3):417–429CrossRef Trigeorgis G, Bousmalis K, Zafeiriou S et al (2015) A deep matrix factorization method for learning attribute representations. IEEE Trans Pattern Anal Mach Intell 39(3):417–429CrossRef
Metadaten
Titel
Dual local learning regularized nonnegative matrix factorization and its semi-supervised extension for clustering
verfasst von
Zhenqiu Shu
Yunmeng Zhang
Peng Li
Congzhe You
Zhen Liu
Honghui Fan
Xiao-jun Wu
Publikationsdatum
04.10.2020
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 11/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-020-05392-7

Weitere Artikel der Ausgabe 11/2021

Neural Computing and Applications 11/2021 Zur Ausgabe