Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 6/2019

15-03-2018 | Original Article

Incremental nonnegative matrix factorization based on correlation and graph regularization for matrix completion

Authors: Xiaoxia Zhang, Degang Chen, Kesheng Wu

Published in: International Journal of Machine Learning and Cybernetics | Issue 6/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Matrix factorization is widely used in recommendation systems, text mining, face recognition and computer vision. As one of the most popular methods, nonnegative matrix factorization and its incremental variants have attracted much attention. The existing incremental algorithms are established based on the assumption of samples are independent and only update the new latent variable of weighting coefficient matrix when the new sample comes, which may lead to inferior solutions. To address this issue, we investigate a novel incremental nonnegative matrix factorization algorithm based on correlation and graph regularizer (ICGNMF). The correlation is mainly used for finding out those correlated rows to be updated, that is, we assume that samples are dependent on each other. We derive the updating rules for ICGNMF by considering the correlation. We also present tests on widely used image datasets, and show ICGNMF reduces the error by comparing other methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: local low-rank matrix approximation. J Mach Learn Res 17(15):1–24MathSciNetMATH Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) LLORMA: local low-rank matrix approximation. J Mach Learn Res 17(15):1–24MathSciNetMATH
2.
go back to reference Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl Based Syst 97:188–202CrossRef Hernando A, Bobadilla J, Ortega F (2016) A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model. Knowl Based Syst 97:188–202CrossRef
3.
go back to reference Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH Lee D, Seung H (1999) Learning the parts of objects by non-negative matrix factorization. Nature 401(6755):788–791CrossRefMATH
4.
go back to reference Paatero P, Tapper U (1994) Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5(2):111–126CrossRef Paatero P, Tapper U (1994) Positive matrix factorization: a non-negative factor model with optimal utilization of error estimates of data values. Environmetrics 5(2):111–126CrossRef
5.
go back to reference Guillamet D, Vitria J (2002) Non-negative matrix factorization for face recognition. In: Escrig MT, Toledo F, Golobardes E (eds) Topics in Artificial Intelligence. Lecture notes in computer science, vol 2504. Springer, Berlin, Heidelberg, pp 336–344CrossRef Guillamet D, Vitria J (2002) Non-negative matrix factorization for face recognition. In: Escrig MT, Toledo F, Golobardes E (eds) Topics in Artificial Intelligence. Lecture notes in computer science, vol 2504. Springer, Berlin, Heidelberg, pp 336–344CrossRef
6.
go back to reference Fogel P, Young S, Hawkins D, Ledirac N (2007) Inferential, robust non-negative matrix factorization analysis of microarray data. Bioinformatics 23(1):44–49CrossRef Fogel P, Young S, Hawkins D, Ledirac N (2007) Inferential, robust non-negative matrix factorization analysis of microarray data. Bioinformatics 23(1):44–49CrossRef
7.
go back to reference Chen Y, Bhojanapalli S, Sanghavi S et al (2015) Completing any low-rank matrix, provably. J Mach Learn Res 16:2999–3034MathSciNetMATH Chen Y, Bhojanapalli S, Sanghavi S et al (2015) Completing any low-rank matrix, provably. J Mach Learn Res 16:2999–3034MathSciNetMATH
8.
go back to reference Wang R, Shan S, Chen X, Gao W (2008) Manifold–manifold distance with application to face recognition based on image set. In: IEEE conference on computer vision and pattern recognition. Anchorage, Alaska, pp 1–8 Wang R, Shan S, Chen X, Gao W (2008) Manifold–manifold distance with application to face recognition based on image set. In: IEEE conference on computer vision and pattern recognition. Anchorage, Alaska, pp 1–8
9.
go back to reference Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef Cai D, He X, Han J, Huang T (2011) Graph regularized nonnegative matrix factorization for data representation. IEEE Trans Pattern Anal Mach Intell 33(8):1548–1560CrossRef
10.
go back to reference Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef Ding C, Li T, Jordan M (2010) Convex and semi-nonnegative matrix factorizations. IEEE Trans Pattern Anal Mach Intell 32(1):45–55CrossRef
11.
go back to reference Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef Guan N, Tao D, Luo Z, Yuan B (2012) Online nonnegative matrix factorization with robust stochastic approximation. IEEE Trans Neural Netw Learn Syst 23(7):1087–1099CrossRef
13.
go back to reference Hastie T, Mazumder R, Lee J, Zadeh R (2015) Matrix completion and low-rank svd via fast alternating least squares. J Mach Learn Res 16(1):3367–3402MathSciNetMATH Hastie T, Mazumder R, Lee J, Zadeh R (2015) Matrix completion and low-rank svd via fast alternating least squares. J Mach Learn Res 16(1):3367–3402MathSciNetMATH
14.
go back to reference Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284CrossRef Luo X, Zhou M, Xia Y, Zhu Q (2014) An efficient non-negative matrix-factorization-based approach to collaborative filtering for recommender systems. IEEE Trans Ind Inf 10(2):1273–1284CrossRef
15.
go back to reference Wu J, Chen L, Feng Y et al (2013) Predicting quality of service for selection by neighborhood-based collaborative filtering. IEEE Trans Syst Man Cybern Syst 43(2):428–439CrossRef Wu J, Chen L, Feng Y et al (2013) Predicting quality of service for selection by neighborhood-based collaborative filtering. IEEE Trans Syst Man Cybern Syst 43(2):428–439CrossRef
16.
go back to reference Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:1–6 Li S, Hou X, Zhang H, Cheng Q (2001) Learning spatially localized, parts-based representation. IEEE Comput Soc Conf Comput Vis Pattern Recognit 1:1–6
17.
go back to reference Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: International ACM SIGIR conference on Research and development in information retrieval. Toronto, pp 267–273 Xu W, Liu X, Gong Y (2003) Document clustering based on non-negative matrix factorization. In: International ACM SIGIR conference on Research and development in information retrieval. Toronto, pp 267–273
18.
go back to reference Bucak S, Gunsel B (2009) Incremental subspace learning via non-negative matrix factorization. Pattern Recognit 42(5):788–797CrossRefMATH Bucak S, Gunsel B (2009) Incremental subspace learning via non-negative matrix factorization. Pattern Recognit 42(5):788–797CrossRefMATH
19.
go back to reference Yu Z, Liu Y, Li B et al (2014) Incremental graph regulated nonnegative matrix factorization for face recognition. J Appl Math 2014(1):1–10 Yu Z, Liu Y, Li B et al (2014) Incremental graph regulated nonnegative matrix factorization for face recognition. J Appl Math 2014(1):1–10
20.
go back to reference Wang F, Li P, Konig AC (2011) Efficient document clustering via online nonnegative matrix factorizations. In: Eleventh Siam international conference on data mining, Arizona, pp 908–919 Wang F, Li P, Konig AC (2011) Efficient document clustering via online nonnegative matrix factorizations. In: Eleventh Siam international conference on data mining, Arizona, pp 908–919
21.
go back to reference Lefèvre A, Bach F, Févotte C (2011) Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence. In Proceedings of IEEE workshop on applications of signal processing to audio and acoustics, vol 53. pp 313–316 Lefèvre A, Bach F, Févotte C (2011) Online algorithms for nonnegative matrix factorization with the Itakura-Saito divergence. In Proceedings of IEEE workshop on applications of signal processing to audio and acoustics, vol 53. pp 313–316
22.
go back to reference Zhou G, Yang Z, Xie S, Yang J (2011) Online blind source separation using incremental nonnegative matrix factorization with volume constraint. IEEE Trans Neural Netw 22(4):550–60CrossRef Zhou G, Yang Z, Xie S, Yang J (2011) Online blind source separation using incremental nonnegative matrix factorization with volume constraint. IEEE Trans Neural Netw 22(4):550–60CrossRef
23.
go back to reference Chen W, Pan B, Fang B et al (2008) Incremental nonnegative matrix factorization for face recognition. Math Prob Eng 2008:1–17MathSciNetMATH Chen W, Pan B, Fang B et al (2008) Incremental nonnegative matrix factorization for face recognition. Math Prob Eng 2008:1–17MathSciNetMATH
24.
go back to reference Tenenbaum J, De Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef Tenenbaum J, De Silva V, Langford J (2000) A global geometric framework for nonlinear dimensionality reduction. Science 290(5500):2319–2323CrossRef
25.
go back to reference Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef Roweis S, Saul L (2000) Nonlinear dimensionality reduction by locally linear embedding. Science 290(5500):2323–2326CrossRef
26.
go back to reference Mao Y, Saul L (2004) Modeling distances in large-scale networks by matrix factorization. In: Proceedings of the 4th ACM SIGCOMM conference on internet measurement. Taormina, Sicily, pp 278–287 Mao Y, Saul L (2004) Modeling distances in large-scale networks by matrix factorization. In: Proceedings of the 4th ACM SIGCOMM conference on internet measurement. Taormina, Sicily, pp 278–287
27.
go back to reference Chung F (1997) Spectral graph theory. CBMS Regional Conference Series in Mathematics, 92. American Mathematical Society, Providence, RI Chung F (1997) Spectral graph theory. CBMS Regional Conference Series in Mathematics, 92. American Mathematical Society, Providence, RI
28.
go back to reference Cai D, He X, Hu Y et al (2007) Learning a spatially smooth subspace for face recognition. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 1–7 Cai D, He X, Hu Y et al (2007) Learning a spatially smooth subspace for face recognition. In: IEEE conference on computer vision and pattern recognition. IEEE, pp 1–7
Metadata
Title
Incremental nonnegative matrix factorization based on correlation and graph regularization for matrix completion
Authors
Xiaoxia Zhang
Degang Chen
Kesheng Wu
Publication date
15-03-2018
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 6/2019
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-018-0808-7

Other articles of this Issue 6/2019

International Journal of Machine Learning and Cybernetics 6/2019 Go to the issue