Skip to main content
Erschienen in: Neural Processing Letters 2/2017

08.02.2017

Graph-Regularized Local Coordinate Concept Factorization for Image Representation

verfasst von: Jun Ye, Zhong Jin

Erschienen in: Neural Processing Letters | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Existing matrix factorization based techniques, such as nonnegative matrix factorization and concept factorization, have been widely applied for data representation. In order to make the obtained concepts to be as close to the original data points as possible, one state-of-the-art method called locality constraint concept factorization is put forward, which represent the data by a linear combination of only a few nearby basis concepts. But its locality constraint does not well reveal the intrinsic data structure since it only requires the concept to be as close to the original data points as possible. To address these problems, by considering the manifold geometrical structure in local concept factorization via graph-based learning, we propose a novel algorithm, called graph-regularized local coordinate concept factorization (GRLCF). By constructing a parameter-free graph using constrained Laplacian rank (CLR) algorithm, we also present an extension of GRLCF algorithm as \(\hbox {GRLCF}_{\mathrm{CLR}}\). Moreover, we develop the iterative updating optimization schemes, and provide the convergence proof of our optimization scheme. Since GRLCF simultaneously considers the geometric structures of the data manifold and the locality conditions as additional constraints, it can obtain more compact and better structured data representation. Experimental results on ORL, Yale and Mnist image datasets demonstrate the effectiveness of our proposed algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
1.
Zurück zum Zitat Zhao M, Chow TWS, Zhang Z, Wu Z (2015) Learning from normalized local and global discriminative information for semi-supervised regression and dimensionality reduction. Inf Sci 324(10):286–309CrossRef Zhao M, Chow TWS, Zhang Z, Wu Z (2015) Learning from normalized local and global discriminative information for semi-supervised regression and dimensionality reduction. Inf Sci 324(10):286–309CrossRef
2.
Zurück zum Zitat Zhao M, Zhang Z, Chow TWS (2012) Trace ratio criterion based generalized discriminative learning for semi-supervised dimension reduction. Pattern Recognit 45(4):1482–1499CrossRefMATH Zhao M, Zhang Z, Chow TWS (2012) Trace ratio criterion based generalized discriminative learning for semi-supervised dimension reduction. Pattern Recognit 45(4):1482–1499CrossRefMATH
3.
Zurück zum Zitat Zhao M, Zhang Z, Chow TWS, Li B (2014) A general soft label based linear discriminant analysis for semi-supervised dimension reduction. Neural Netw 55:83–97CrossRefMATH Zhao M, Zhang Z, Chow TWS, Li B (2014) A general soft label based linear discriminant analysis for semi-supervised dimension reduction. Neural Netw 55:83–97CrossRefMATH
4.
Zurück zum Zitat Li P, Chun C, Bu J (2012) Clustering analysis using manifold kernel concept factorization. Neurocomputing 87:120–131CrossRef Li P, Chun C, Bu J (2012) Clustering analysis using manifold kernel concept factorization. Neurocomputing 87:120–131CrossRef
5.
Zurück zum Zitat Jain A, Murty M, Flynn P (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef Jain A, Murty M, Flynn P (1999) Data clustering: a review. ACM Comput Surv 31(3):264–323CrossRef
6.
Zurück zum Zitat MacQueen JB (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability, University of California Press, Berkeley, pp 281–297 MacQueen JB (1967) Some methods for classification and analysis of multivariate observations. In: Proceedings of 5th Berkeley symposium on mathematical statistics and probability, University of California Press, Berkeley, pp 281–297
7.
Zurück zum Zitat Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst (NIPS) 14:849–856 Ng AY, Jordan MI, Weiss Y (2002) On spectral clustering: analysis and an algorithm. Adv Neural Inf Process Syst (NIPS) 14:849–856
8.
Zurück zum Zitat Nie F, Zeng Z, Tsang IW, Xu D, Zhang C (2011) Spectral embedded clustering: a framework for in-sample and out-of-sample spectral clustering. IEEE Trans Neural Netw 22(11):1796–1808CrossRef Nie F, Zeng Z, Tsang IW, Xu D, Zhang C (2011) Spectral embedded clustering: a framework for in-sample and out-of-sample spectral clustering. IEEE Trans Neural Netw 22(11):1796–1808CrossRef
9.
Zurück zum Zitat Yang Y, Shen H, Nie F et al (2011) Nonnegative spectral clustering with discriminative regularization. In: Proceedings of the 25th AAAI conference on artificial intelligence (AAAI’ 11), pp 555–560 Yang Y, Shen H, Nie F et al (2011) Nonnegative spectral clustering with discriminative regularization. In: Proceedings of the 25th AAAI conference on artificial intelligence (AAAI’ 11), pp 555–560
10.
Zurück zum Zitat Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791CrossRefMATH Lee DD, Seung HS (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401:788–791CrossRefMATH
11.
Zurück zum Zitat Xu W, Gong Y (2004) Document clustering by concept factorization. In: Proceedings of the 2004 international conference on research and development in information retrieval (SIGIR’04), Sheffield, UK, pp 202–209 Xu W, Gong Y (2004) Document clustering by concept factorization. In: Proceedings of the 2004 international conference on research and development in information retrieval (SIGIR’04), Sheffield, UK, pp 202–209
12.
Zurück zum Zitat Nie F, Ding CHQ, Luo D, Huang H(2010) Improved minmax cut graph clustering with nonnegative relaxation. In: ECML/PKDD, pp 451–466 Nie F, Ding CHQ, Luo D, Huang H(2010) Improved minmax cut graph clustering with nonnegative relaxation. In: ECML/PKDD, pp 451–466
13.
Zurück zum Zitat Huang J, Nie F, Huang H, Ding C (2014) Robust manifold nonnegative matrix factorization. ACM Trans Knowl Discov Data 8(3):21, Article 11 Huang J, Nie F, Huang H, Ding C (2014) Robust manifold nonnegative matrix factorization. ACM Trans Knowl Discov Data 8(3):21, Article 11
14.
Zurück zum Zitat Lu M, Zhao X, Zhang L, Li F (2016) Semi-supervised concept factorization for document clustering. Inf Sci 331:86–98MathSciNetCrossRef Lu M, Zhao X, Zhang L, Li F (2016) Semi-supervised concept factorization for document clustering. Inf Sci 331:86–98MathSciNetCrossRef
15.
Zurück zum Zitat Belkin and M, Niyogi P(2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in neural information processing systems 14. MIT Press, Cambridge, MA, pp 585–591 Belkin and M, Niyogi P(2001) Laplacian eigenmaps and spectral techniques for embedding and clustering. In: Advances in neural information processing systems 14. MIT Press, Cambridge, MA, pp 585–591
16.
Zurück zum Zitat Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
17.
Zurück zum Zitat Tenenbaum J, de Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum J, de Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
18.
Zurück zum Zitat Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from examples. J Mach Learn Res 7:2399–2434MathSciNetMATH Belkin M, Niyogi P, Sindhwani V (2006) Manifold regularization: a geometric framework for learning from examples. J Mach Learn Res 7:2399–2434MathSciNetMATH
19.
Zurück zum Zitat Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
20.
Zurück zum Zitat Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33:1548–1560CrossRef Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33:1548–1560CrossRef
21.
Zurück zum Zitat Cai D, He X, Han J (2011) Locally consistent concept factorization for document clustering. IEEE Trans Knowl Data Eng 23(6):902–913CrossRef Cai D, He X, Han J (2011) Locally consistent concept factorization for document clustering. IEEE Trans Knowl Data Eng 23(6):902–913CrossRef
22.
Zurück zum Zitat Nie F, Wang X, Jordan MI, Huang H(2016) The constrained Laplacian rank algorithm for graph-based clustering. In: The 30th AAAI conference on artificial intelligence (AAAI), Phoenix, USA Nie F, Wang X, Jordan MI, Huang H(2016) The constrained Laplacian rank algorithm for graph-based clustering. In: The 30th AAAI conference on artificial intelligence (AAAI), Phoenix, USA
23.
Zurück zum Zitat Nie F, Wang X, Huang H(2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 977–986 Nie F, Wang X, Huang H(2014) Clustering and projected clustering with adaptive neighbors. In: Proceedings of the 20th ACM SIGKDD international conference on knowledge discovery and data mining, pp 977–986
24.
Zurück zum Zitat Yu K, Zhang T, Gong Y (2009) Nonlinear learning using local coordinate coding. In: Proceedings of the advances in neural information processing systems, pp 2223–2231 Yu K, Zhang T, Gong Y (2009) Nonlinear learning using local coordinate coding. In: Proceedings of the advances in neural information processing systems, pp 2223–2231
25.
Zurück zum Zitat Chen Y, Zhang J, Cai D, Liu W, He X (2013) Nonnegative local coordinate factorization for image representation. IEEE Trans Image Process 22(3):969–979MathSciNetCrossRef Chen Y, Zhang J, Cai D, Liu W, He X (2013) Nonnegative local coordinate factorization for image representation. IEEE Trans Image Process 22(3):969–979MathSciNetCrossRef
26.
Zurück zum Zitat Liu H, Yang Z, Yang J, Wu Z, Li X (2014) Local coordinate concept factorization for image representation. IEEE Trans Neural Netw Learn Syst 25(6):1071–1081CrossRef Liu H, Yang Z, Yang J, Wu Z, Li X (2014) Local coordinate concept factorization for image representation. IEEE Trans Neural Netw Learn Syst 25(6):1071–1081CrossRef
27.
Zurück zum Zitat Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. Adv Neural Inf Process Syst (NIPS) 13:556–562 Lee DD, Seung HS (2001) Algorithms for non-negative matrix factorization. Adv Neural Inf Process Syst (NIPS) 13:556–562
28.
Zurück zum Zitat Zhao M, Chow TWS, Zhang Z, Li B (2015) Automatic image annotation via compact graph based semi-supervised learning. Knowl Based Syst 76:148–165CrossRef Zhao M, Chow TWS, Zhang Z, Li B (2015) Automatic image annotation via compact graph based semi-supervised learning. Knowl Based Syst 76:148–165CrossRef
29.
30.
Zurück zum Zitat Lovasz L, Plummer M (1986) Matching theory. Akad’emiai Kiad’o, BudapestMATH Lovasz L, Plummer M (1986) Matching theory. Akad’emiai Kiad’o, BudapestMATH
31.
Zurück zum Zitat Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the em algorithm. J R Stat Soc Series B (Methodol) 39(1):1–38MathSciNetMATH Dempster AP, Laird NM, Rubin DB (1977) Maximum likelihood from incomplete data via the em algorithm. J R Stat Soc Series B (Methodol) 39(1):1–38MathSciNetMATH
Metadaten
Titel
Graph-Regularized Local Coordinate Concept Factorization for Image Representation
verfasst von
Jun Ye
Zhong Jin
Publikationsdatum
08.02.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9598-2

Weitere Artikel der Ausgabe 2/2017

Neural Processing Letters 2/2017 Zur Ausgabe

Neuer Inhalt