Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 6/2019

15.03.2018 | Original Article

Incremental nonnegative matrix factorization based on correlation and graph regularization for matrix completion

verfasst von: Xiaoxia Zhang, Degang Chen, Kesheng Wu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Matrix factorization is widely used in recommendation systems, text mining, face recognition and computer vision. As one of the most popular methods, nonnegative matrix factorization and its incremental variants have attracted much attention. The existing incremental algorithms are established based on the assumption of samples are independent and only update the new latent variable of weighting coefficient matrix when the new sample comes, which may lead to inferior solutions. To address this issue, we investigate a novel incremental nonnegative matrix factorization algorithm based on correlation and graph regularizer (ICGNMF). The correlation is mainly used for finding out those correlated rows to be updated, that is, we assume that samples are dependent on each other. We derive the updating rules for ICGNMF by considering the correlation. We also present tests on widely used image datasets, and show ICGNMF reduces the error by comparing other methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: local low-rank matrix approximation. J Mach Learn Res 17(15):1–24MathSciNetMATH Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: local low-rank matrix approximation. J Mach Learn Res 17(15):1–24MathSciNetMATH
2.
Zurück zum Zitat Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl Based Syst 97:188–202CrossRef Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl Based Syst 97:188–202CrossRef
3.
Zurück zum Zitat Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH
4.
Zurück zum Zitat Paatero P, Tapper U (1994) Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5(2):111–126CrossRef Paatero P, Tapper U (1994) Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5(2):111–126CrossRef
5.
Zurück zum Zitat Guillamet D, Vitria J (2002) Non-negative matrix factorization for face recognition. In: Escrig MT, Toledo F, Golobardes E (eds) Topics in Artificial Intelligence. Lecture notes in computer science, vol 2504. Springer, Berlin, Heidelberg, pp 336–344CrossRef Guillamet D, Vitria J (2002) Non-negative matrix factorization for face recognition. In: Escrig MT, Toledo F, Golobardes E (eds) Topics in Artificial Intelligence. Lecture notes in computer science, vol 2504. Springer, Berlin, Heidelberg, pp 336–344CrossRef
6.
Zurück zum Zitat Fogel P, Young S, Hawkins D, Ledirac N (2007) Inferential, robust non-negative matrix factorization analysis of microarray data. Bioinformatics 23(1):44–49CrossRef Fogel P, Young S, Hawkins D, Ledirac N (2007) Inferential, robust non-negative matrix factorization analysis of microarray data. Bioinformatics 23(1):44–49CrossRef
7.
Zurück zum Zitat Chen Y, Bhojanapalli S, Sanghavi S et al (2015) Completing any low-rank matrix, provably. J Mach Learn Res 16:2999–3034MathSciNetMATH Chen Y, Bhojanapalli S, Sanghavi S et al (2015) Completing any low-rank matrix, provably. J Mach Learn Res 16:2999–3034MathSciNetMATH
8.
Zurück zum Zitat Wang R, Shan S, Chen X, Gao W (2008) Manifold–manifold distance with application to face recognition based on image set. In: IEEE conference on computer vision and pattern recognition. Anchorage, Alaska, pp 1–8 Wang R, Shan S, Chen X, Gao W (2008) Manifold–manifold distance with application to face recognition based on image set. In: IEEE conference on computer vision and pattern recognition. Anchorage, Alaska, pp 1–8
9.
Zurück zum Zitat Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef
10.
Zurück zum Zitat Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef
11.
Zurück zum Zitat Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef
13.
Zurück zum Zitat Hastie T, Mazumder R, Lee J, Zadeh R (2015) Matrix completion and low-rank svd via fast alternating least squares. J Mach Learn Res 16(1):3367–3402MathSciNetMATH Hastie T, Mazumder R, Lee J, Zadeh R (2015) Matrix completion and low-rank svd via fast alternating least squares. J Mach Learn Res 16(1):3367–3402MathSciNetMATH
14.
Zurück zum Zitat Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284CrossRef Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284CrossRef
15.
Zurück zum Zitat Wu J, Chen L, Feng Y et al (2013) Predicting quality of service for selection by neighborhood-based collaborative filtering. IEEE Trans Syst Man Cybern Syst 43(2):428–439CrossRef Wu J, Chen L, Feng Y et al (2013) Predicting quality of service for selection by neighborhood-based collaborative filtering. IEEE Trans Syst Man Cybern Syst 43(2):428–439CrossRef
16.
Zurück zum Zitat Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:1–6 Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:1–6
17.
Zurück zum Zitat Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: International ACM SIGIR conference on Research and development in information retrieval. Toronto, pp 267–273 Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: International ACM SIGIR conference on Research and development in information retrieval. Toronto, pp 267–273
18.
Zurück zum Zitat Bucak S, Gunsel B (2009) Incremental subspace learning via non-negative matrix factorization. Pattern Recognit 42(5):788–797CrossRefMATH Bucak S, Gunsel B (2009) Incremental subspace learning via non-negative matrix factorization. Pattern Recognit 42(5):788–797CrossRefMATH
19.
Zurück zum Zitat Yu Z, Liu Y, Li B et al (2014) Incremental graph regulated nonnegative matrix factorization for face recognition. J Appl Math 2014(1):1–10 Yu Z, Liu Y, Li B et al (2014) Incremental graph regulated nonnegative matrix factorization for face recognition. J Appl Math 2014(1):1–10
20.
Zurück zum Zitat Wang F, Li P, Konig AC (2011) Efficient document clustering via online nonnegative matrix factorizations. In: Eleventh Siam international conference on data mining, Arizona, pp 908–919 Wang F, Li P, Konig AC (2011) Efficient document clustering via online nonnegative matrix factorizations. In: Eleventh Siam international conference on data mining, Arizona, pp 908–919
21.
Zurück zum Zitat Lefèvre A, Bach F, Févotte C (2011) Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence. In Proceedings of IEEE workshop on applications of signal processing to audio and acoustics, vol 53. pp 313–316 Lefèvre A, Bach F, Févotte C (2011) Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence. In Proceedings of IEEE workshop on applications of signal processing to audio and acoustics, vol 53. pp 313–316
22.
Zurück zum Zitat Zhou G, Yang Z, Xie S, Yang J (2011) Online blind source separation using incremental nonnegative matrix factorization with volume constraint. IEEE Trans Neural Netw 22(4):550–60CrossRef Zhou G, Yang Z, Xie S, Yang J (2011) Online blind source separation using incremental nonnegative matrix factorization with volume constraint. IEEE Trans Neural Netw 22(4):550–60CrossRef
23.
Zurück zum Zitat Chen W, Pan B, Fang B et al (2008) Incremental nonnegative matrix factorization for face recognition. Math Prob Eng 2008:1–17MathSciNetMATH Chen W, Pan B, Fang B et al (2008) Incremental nonnegative matrix factorization for face recognition. Math Prob Eng 2008:1–17MathSciNetMATH
24.
Zurück zum Zitat Tenenbaum J, De Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum J, De Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
25.
Zurück zum Zitat Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
26.
Zurück zum Zitat Mao Y, Saul L (2004) Modeling distances in large-scale networks by matrix factorization. In: Proceedings of the 4th ACM SIGCOMM conference on internet measurement. Taormina, Sicily, pp 278–287 Mao Y, Saul L (2004) Modeling distances in large-scale networks by matrix factorization. In: Proceedings of the 4th ACM SIGCOMM conference on internet measurement. Taormina, Sicily, pp 278–287
27.
Zurück zum Zitat Chung F (1997) Spectral graph theory. CBMS Regional Conference Series in Mathematics, 92. American Mathematical Society, Providence, RI Chung F (1997) Spectral graph theory. CBMS Regional Conference Series in Mathematics, 92. American Mathematical Society, Providence, RI
28.
Zurück zum Zitat Cai D, He X, Hu Y et al (2007) Learning a spatially smooth subspace for face recognition. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 1–7 Cai D, He X, Hu Y et al (2007) Learning a spatially smooth subspace for face recognition. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 1–7
Metadaten
Titel
Incremental nonnegative matrix factorization based on correlation and graph regularization for matrix completion
verfasst von
Xiaoxia Zhang
Degang Chen
Kesheng Wu
Publikationsdatum
15.03.2018
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 6/2019
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0808-7

Weitere Artikel der Ausgabe 6/2019

International Journal of Machine Learning and Cybernetics 6/2019 Zur Ausgabe