Skip to main content
Erschienen in: Knowledge and Information Systems 3/2014

01.06.2014 | Regular Paper

Bounded matrix factorization for recommender system

verfasst von: Ramakrishnan Kannan, Mariya Ishteva, Haesun Park

Erschienen in: Knowledge and Information Systems | Ausgabe 3/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Matrix factorization has been widely utilized as a latent factor model for solving the recommender system problem using collaborative filtering. For a recommender system, all the ratings in the rating matrix are bounded within a pre-determined range. In this paper, we propose a new improved matrix factorization approach for such a rating matrix, called Bounded Matrix Factorization (BMF), which imposes a lower and an upper bound on every estimated missing element of the rating matrix. We present an efficient algorithm to solve BMF based on the block coordinate descent method. We show that our algorithm is scalable for large matrices with missing elements on multicore systems with low memory. We present substantial experimental results illustrating that the proposed method outperforms the state of the art algorithms for recommender system such as stochastic gradient descent, alternating least squares with regularization, SVD++ and Bias-SVD on real-world datasets such as Jester, Movielens, Book crossing, Online dating and Netflix.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Throughout this paper, we might use rows and users, columns and items, reduced rank and hidden latent features, values and ratings, low-rank factors and user/item-feature matrix, interchangeably and appropriately chosen for better understanding of the idea.
 
2
In our notation, if the inequality is between a vector/matrix and a scalar, every element in the vector/matrix should satisfy the inequality against the scalar.
 
Literatur
1.
Zurück zum Zitat Bertsekas DP (1999) Nonlinear programming. Athena Scientific, BelmontMATH Bertsekas DP (1999) Nonlinear programming. Athena Scientific, BelmontMATH
2.
Zurück zum Zitat Brozovsky L, Petricek V (2007) Recommender system for online dating service. In: Proceedings of conference Znalosti 2007, Ostrava, VSB Brozovsky L, Petricek V (2007) Recommender system for online dating service. In: Proceedings of conference Znalosti 2007, Ostrava, VSB
3.
Zurück zum Zitat Cichocki A, Anh-Huy P (2009) Fast local algorithms for large scale nonnegative matrix and tensor factorizations. IEICE Trans Fundam Electron Commun Comput Sci E92-A:708–721 Cichocki A, Anh-Huy P (2009) Fast local algorithms for large scale nonnegative matrix and tensor factorizations. IEICE Trans Fundam Electron Commun Comput Sci E92-A:708–721
4.
Zurück zum Zitat Cichocki A, Zdunek R, Amari S (2007) Hierarchical als algorithms for nonnegative matrix and 3d tensor factorization. Lect Notes Comput Sci 4666:169–176 Cichocki A, Zdunek R, Amari S (2007) Hierarchical als algorithms for nonnegative matrix and 3d tensor factorization. Lect Notes Comput Sci 4666:169–176
5.
Zurück zum Zitat Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41:391–407CrossRef Deerwester S, Dumais ST, Furnas GW, Landauer TK, Harshman R (1990) Indexing by latent semantic analysis. J Am Soc Inf Sci 41:391–407CrossRef
8.
Zurück zum Zitat Golub GH, Van Loan CF (1996) Matrix computations, 3rd edition. The Johns Hopkins University Press, Baltimore Golub GH, Van Loan CF (1996) Matrix computations, 3rd edition. The Johns Hopkins University Press, Baltimore
9.
Zurück zum Zitat Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MATHMathSciNet Grippo L, Sciandrone M (2000) On the convergence of the block nonlinear gauss-seidel method under convex constraints. Oper Res Lett 26(3):127–136MATHMathSciNet
10.
Zurück zum Zitat Ho ND, Van Dooren P, Blondel VD (2008) Descent methods for nonnegative matrix factorization. CoRR, abs/0801.3199 Ho ND, Van Dooren P, Blondel VD (2008) Descent methods for nonnegative matrix factorization. CoRR, abs/0801.3199
11.
Zurück zum Zitat Kim H, Park H (2007) Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis. Bioinformatics 23(12):1495–1502CrossRef Kim H, Park H (2007) Sparse non-negative matrix factorizations via alternating non-negativity-constrained least squares for microarray data analysis. Bioinformatics 23(12):1495–1502CrossRef
12.
Zurück zum Zitat Kim H, Park H (2008) Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J Matrix Anal Appl 30(2):713–730CrossRefMATHMathSciNet Kim H, Park H (2008) Nonnegative matrix factorization based on alternating nonnegativity constrained least squares and active set method. SIAM J Matrix Anal Appl 30(2):713–730CrossRefMATHMathSciNet
13.
Zurück zum Zitat Kim J, Park H (2011) Fast nonnegative matrix factorization: an active-set-like method and comparisons. SIAM J Sci Comput 33(6):3261–3281CrossRefMATHMathSciNet Kim J, Park H (2011) Fast nonnegative matrix factorization: an active-set-like method and comparisons. SIAM J Sci Comput 33(6):3261–3281CrossRefMATHMathSciNet
14.
Zurück zum Zitat Kim J, He Y, Park H (2013) Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework. J Glob Optim, pp 1–35 Kim J, He Y, Park H (2013) Algorithms for nonnegative matrix and tensor factorizations: a unified view based on block coordinate descent framework. J Glob Optim, pp 1–35
15.
Zurück zum Zitat Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining-KDD ’08, pp 426–434 Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceeding of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining-KDD ’08, pp 426–434
16.
Zurück zum Zitat Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining—KDD ’09, pp 447 Koren Y (2009) Collaborative filtering with temporal dynamics. In: Proceedings of the 15th ACM SIGKDD international conference on knowledge discovery and data mining—KDD ’09, pp 447
17.
Zurück zum Zitat Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef Koren Y, Bell R, Volinsky C (2009) Matrix factorization techniques for recommender systems. Computer 42(8):30–37CrossRef
18.
Zurück zum Zitat Kuang D, Park H, Ding CHQ (2012) Symmetric nonnegative matrix factorization for graph clustering. In: Proceedings of SIAM international conference on data mining—SDM’12, pp 106–117 Kuang D, Park H, Ding CHQ (2012) Symmetric nonnegative matrix factorization for graph clustering. In: Proceedings of SIAM international conference on data mining—SDM’12, pp 106–117
20.
Zurück zum Zitat Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM (2010) Graphlab: a new parallel framework for machine learning. In: Conference on uncertainty in artificial intelligence (UAI) Low Y, Gonzalez J, Kyrola A, Bickson D, Guestrin C, Hellerstein JM (2010) Graphlab: a new parallel framework for machine learning. In: Conference on uncertainty in artificial intelligence (UAI)
21.
Zurück zum Zitat Mackey LW, Weiss D, Jordan MI (2010) Mixed membership matrix factorization. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 711–718 Mackey LW, Weiss D, Jordan MI (2010) Mixed membership matrix factorization. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 711–718
22.
Zurück zum Zitat Markovsky I (2011) Algorithms and literate programs for weighted low-rank approximation with missing data. In: Levesley J, Iske A, Georgoulis E (eds) Approximation algorithms for complex systems, chapter: 12. Springer, Berlin, pp 255–273 Markovsky I (2011) Algorithms and literate programs for weighted low-rank approximation with missing data. In: Levesley J, Iske A, Georgoulis E (eds) Approximation algorithms for complex systems, chapter: 12. Springer, Berlin, pp 255–273
24.
Zurück zum Zitat Paterek A (2007) Improving regularized singular value decomposition for collaborative filtering. In: Proceedings of 13th ACM international conference on knowledge discovery and data mining-KDD’07, pp 39–42 Paterek A (2007) Improving regularized singular value decomposition for collaborative filtering. In: Proceedings of 13th ACM international conference on knowledge discovery and data mining-KDD’07, pp 39–42
25.
Zurück zum Zitat Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: ICML, pp 880–887 Salakhutdinov R, Mnih A (2008) Bayesian probabilistic matrix factorization using markov chain monte carlo. In: ICML, pp 880–887
26.
Zurück zum Zitat Xiong L, Chen X, Huang TK, Schneider JG, Carbonell JG (2010) Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of the SIAM international conference on data mining-SDM’10, pp 211–222 Xiong L, Chen X, Huang TK, Schneider JG, Carbonell JG (2010) Temporal collaborative filtering with bayesian probabilistic tensor factorization. In: Proceedings of the SIAM international conference on data mining-SDM’10, pp 211–222
27.
Zurück zum Zitat Yu HF, Hsieh CJ, Si S, Dhillon IS (2012) Scalable coordinate descent approaches to parallel matrix factorization for recommender systems. In: Proceedings of the IEEE international conference on data mining-ICDM’12, pp 765–774 Yu HF, Hsieh CJ, Si S, Dhillon IS (2012) Scalable coordinate descent approaches to parallel matrix factorization for recommender systems. In: Proceedings of the IEEE international conference on data mining-ICDM’12, pp 765–774
28.
Zurück zum Zitat Zhou Y, Wilkinson D, Schreiber R, Pan R (2008) Large-scale parallel collaborative filtering for the netflix prize. Algorithmic Aspects Inf Manag 5034:337–348CrossRef Zhou Y, Wilkinson D, Schreiber R, Pan R (2008) Large-scale parallel collaborative filtering for the netflix prize. Algorithmic Aspects Inf Manag 5034:337–348CrossRef
29.
Zurück zum Zitat Ziegler CN, McNee SM, Konstan JA, Lausen G (2005) Improving recommendation lists through topic diversification. In: Proceedings of the 14th international conference on world wide web-WWW’05, pp 22–32 Ziegler CN, McNee SM, Konstan JA, Lausen G (2005) Improving recommendation lists through topic diversification. In: Proceedings of the 14th international conference on world wide web-WWW’05, pp 22–32
Metadaten
Titel
Bounded matrix factorization for recommender system
verfasst von
Ramakrishnan Kannan
Mariya Ishteva
Haesun Park
Publikationsdatum
01.06.2014
Verlag
Springer London
Erschienen in
Knowledge and Information Systems / Ausgabe 3/2014
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI
https://doi.org/10.1007/s10115-013-0710-2

Weitere Artikel der Ausgabe 3/2014

Knowledge and Information Systems 3/2014 Zur Ausgabe

Premium Partner