Skip to main content
Top

2015 | OriginalPaper | Chapter

A Scalable and Feasible Matrix Completion Approach Using Random Projection

Author : Xiang Cao

Published in: Neural Information Processing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The low rank matrix completion problem has attracted great attention and been widely studied in collaborative filtering and recommendation systems. The rank minimization problem is NP-hard, so the problem is usually relaxed into a matrix nuclear norm minimization. However, the usage is limited in scability due to the high computational complexity of singular value decomposition (SVD). In this paper we introduce a random projection to handle this limitation. In particular, we use a randomized SVD to accelerate the classical Soft-Impute algorithm for the matrix completion problem. The empirical results show that our approach is more efficient while achieving almost same performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRefMATH Cai, J.F., Candès, E.J., Shen, Z.: A singular value thresholding algorithm for matrix completion. SIAM J. Optim. 20(4), 1956–1982 (2010)MathSciNetCrossRefMATH
3.
go back to reference Candès, E.J., Tao, T.: The power of convex relaxation: near-optimal matrix completion. IEEE Trans. Inf. Theor. 56(5), 2053–2080 (2010)MathSciNetCrossRef Candès, E.J., Tao, T.: The power of convex relaxation: near-optimal matrix completion. IEEE Trans. Inf. Theor. 56(5), 2053–2080 (2010)MathSciNetCrossRef
4.
go back to reference Clarkson, K.L., Woodruff, D.P.: Low rank approximation and regression in input sparsity time. In: Proceedings of the Forty-Fifth Annual ACM Symposium on Theory of Computing, pp. 81–90. ACM (2013) Clarkson, K.L., Woodruff, D.P.: Low rank approximation and regression in input sparsity time. In: Proceedings of the Forty-Fifth Annual ACM Symposium on Theory of Computing, pp. 81–90. ACM (2013)
5.
go back to reference Dudik, M., Harchaoui, Z., Malick, J., et al.: Lifted coordinate descent for learning with trace-norm regularization. In: AISTATS-Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics-2012, vol. 22, pp. 327–336 (2012) Dudik, M., Harchaoui, Z., Malick, J., et al.: Lifted coordinate descent for learning with trace-norm regularization. In: AISTATS-Proceedings of the Fifteenth International Conference on Artificial Intelligence and Statistics-2012, vol. 22, pp. 327–336 (2012)
6.
go back to reference Goldberg, K., Roeder, T., Gupta, D., Perkins, C.: Eigentaste: a constant time collaborative filtering algorithm. Inf. Retrieval 4(2), 133–151 (2001)CrossRefMATH Goldberg, K., Roeder, T., Gupta, D., Perkins, C.: Eigentaste: a constant time collaborative filtering algorithm. Inf. Retrieval 4(2), 133–151 (2001)CrossRefMATH
7.
go back to reference Halko, N., Martinsson, P.G., Tropp, J.A.: Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev. 53(2), 217–288 (2011)MathSciNetCrossRefMATH Halko, N., Martinsson, P.G., Tropp, J.A.: Finding structure with randomness: probabilistic algorithms for constructing approximate matrix decompositions. SIAM Rev. 53(2), 217–288 (2011)MathSciNetCrossRefMATH
8.
go back to reference Hastie, T., Mazumder, R., Lee, J., Zadeh, R.: Matrix completion and low-rank svd via fast alternating least squares (2014). arXiv preprint arXiv:1410.2596 Hastie, T., Mazumder, R., Lee, J., Zadeh, R.: Matrix completion and low-rank svd via fast alternating least squares (2014). arXiv preprint arXiv:​1410.​2596
9.
go back to reference Ma, S., Goldfarb, D., Chen, L.: Fixed point and bregman iterative methods for matrix rank minimization. Math. Prog. 128(1–2), 321–353 (2011)MathSciNetCrossRefMATH Ma, S., Goldfarb, D., Chen, L.: Fixed point and bregman iterative methods for matrix rank minimization. Math. Prog. 128(1–2), 321–353 (2011)MathSciNetCrossRefMATH
10.
go back to reference Mazumder, R., Hastie, T., Tibshirani, R.: Spectral regularization algorithms for learning large incomplete matrices. J. Mach. Learn. Res. 11, 2287–2322 (2010)MathSciNetMATH Mazumder, R., Hastie, T., Tibshirani, R.: Spectral regularization algorithms for learning large incomplete matrices. J. Mach. Learn. Res. 11, 2287–2322 (2010)MathSciNetMATH
11.
go back to reference Shalev-Shwartz, S., Gonen, A., Shamir, O.: Large-scale convex minimization with a low-rank constraint (2011) Shalev-Shwartz, S., Gonen, A., Shamir, O.: Large-scale convex minimization with a low-rank constraint (2011)
12.
go back to reference Srebro, N., Rennie, J., Jaakkola, T.S.: Maximum-margin matrix factorization. In: Advances in Neural Information Processing Systems, pp. 1329–1336 (2004) Srebro, N., Rennie, J., Jaakkola, T.S.: Maximum-margin matrix factorization. In: Advances in Neural Information Processing Systems, pp. 1329–1336 (2004)
13.
go back to reference Toh, K.C., Yun, S.: An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems. Pacific J. Optim. 6(615–640), 15 (2010)MathSciNetMATH Toh, K.C., Yun, S.: An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems. Pacific J. Optim. 6(615–640), 15 (2010)MathSciNetMATH
14.
go back to reference Wang, Z., Lai, M.J., Lu, Z., Fan, W., Davulcu, H., Ye, J.: Rank-one matrix pursuit for matrix completion. In: Proceedings of the 31st International Conference on Machine Learning (ICML 2014), pp. 91–99 (2014) Wang, Z., Lai, M.J., Lu, Z., Fan, W., Davulcu, H., Ye, J.: Rank-one matrix pursuit for matrix completion. In: Proceedings of the 31st International Conference on Machine Learning (ICML 2014), pp. 91–99 (2014)
15.
go back to reference Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Prog. Comput. 4(4), 333–361 (2012)MathSciNetCrossRefMATH Wen, Z., Yin, W., Zhang, Y.: Solving a low-rank factorization model for matrix completion by a nonlinear successive over-relaxation algorithm. Math. Prog. Comput. 4(4), 333–361 (2012)MathSciNetCrossRefMATH
Metadata
Title
A Scalable and Feasible Matrix Completion Approach Using Random Projection
Author
Xiang Cao
Copyright Year
2015
DOI
https://doi.org/10.1007/978-3-319-26555-1_62

Premium Partner