Florian Strub
ABSTRACT
A standard model for Recommender Systems is the Matrix Completion setting: given partially known matrix of ratings given by users (rows) to items (columns), infer the unknown ratings. In the last decades, few attempts where done to handle that objective with Neural Networks, but recently an architecture based on Autoencoders proved to be a promising approach. In current paper, we enhanced that architecture (i) by using a loss function adapted to input data with missing values, and (ii) by incorporating side information. The experiments demonstrate that while side information only slightly improve the test error averaged on all users/items, it has more impact on cold users/items.
- R. P. Adams and G. E. D. I. Murray. Incorporating side information in probabilistic matrix factorization with gaussian processes. In Proc. of UAI'10, 2010.Google Scholar
- C. M. Bishop. Neural networks for pattern recognition. Oxford univ. press, 1995. Google ScholarDigital Library
- C. Chen, D. Li, Y. Zhao, Q. Lv, and L. Shang. Wemarec: Accurate and scalable recommendation through weighted and ensemble matrix approximation. In Proc. of the Int. ACM SIGIR Conf. on Res. and Dev. in Information Retrieval, pages 303--312, 2015. Google ScholarDigital Library
- T. Chen, W. Zhang, Q. Lu, K. Chen, Z. Zheng, and Y. Yong. Svdfeature: a toolkit for feature-based collaborative filtering. JMLR, 13(1):3619--3622, 2012. Google ScholarDigital Library
- G. Dziugaite and D. Roy. Neural network matrix factorization. arXiv preprint arXiv:1511.06443, 2015.Google Scholar
- X. Glorot and Y. Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proc. of AISTATS'10, pages 249--256, 2010.Google Scholar
- X. Glorot, A. Bordes, and Y. Bengio. Deep sparse rectifier neural networks. In Proc. of AISTATS'11, pages 315--323, 2011.Google Scholar
- C. Gomez-Uribe and N. Hunt. The netflix recommender system: Algorithms, business value, and innovation. ACM Trans. Manage. Inf. Syst., 6(4):13:1--13:19, 2015. Google ScholarDigital Library
- Y.-D. Kim and S. Choi. Scalable variational bayesian matrix factorization with side information. In Proc. of AISTATS'14, Reykjavik, Iceland, 2014.Google Scholar
- Y. Koren, R. Bell, and C. Volinsky. Matrix factorization techniques for recommender systems. Computer, 42(8):30--37, 2009. Google ScholarDigital Library
- M. A. Kramer. Nonlinear principal component analysis using autoassociative neural networks. AIChE journal, 37(2):233--243, 1991.Google ScholarCross Ref
- R. Kumar, B. K. Verma, and S. S. Rastogi. Social popularity based svd++ recommender system. International Journal of Computer Applications, 87(14), 2014.Google ScholarCross Ref
- Y. LeCun, Y. Bengio, and G. Hinton. Deep learning. Nature, 521(7553):436--444, 2015.Google ScholarCross Ref
- Y. LeCun, L. Bottou, G. Orr, and K. Muller. Efficient backprop. In Neural networks: Tricks of the trade, pages 9--48. Springer, 1998. Google Scholar
- H. Lee, A. Battle, R. Raina, and A. Ng. Efficient sparse coding algorithms. In Advances in neural information processing systems, pages 801--808, 2006. Google ScholarDigital Library
- J. Lee, S. Kim, G. Lebanon, and Y. Singerm. Local low-rank matrix approximation. In Proc. of ICML'13, pages 82--90, 2013.Google Scholar
- J. Lee, M. Sun, and G. Lebanon. A comparative study of collaborative filtering algorithms. arXiv preprint arXiv:1205.3193, 2012.Google Scholar
- D. Li, C. Chen, Q. Lv, J. Yan, L. Shang, and S. Chu. Low-rank matrix approximation with stability. In Proc. of ICML'16, 2016.Google Scholar
- S. Li, J. Kawale, and Y. Fu. Deep collaborative filtering via marginalized denoising auto-encoder. In Proc. of CIKM'15, pages 811--820. ACM, 2015. Google ScholarDigital Library
- P. Lops, M. D. Gemmis, and G. Semeraro. Content-based recommender systems: State of the art and trends. In Recommender systems handbook, pages 73--105. Springer, 2011.Google ScholarCross Ref
- H. Ma, D. Zhou, C. Liu, M. R. Lyu, and I. King. Recommender systems with social regularization. In Proc. of the int. conf. on Web search and data mining (WSDM '11), pages 287--296, 2011. Google ScholarDigital Library
- V. Miranda, J. Krstulovic, H. Keko, C. Moreira, and J. Pereira. Reconstructing Missing Data in State Estimation With Autoencoders. IEEE Transactions on Power Systems, 27(2):604--611, 2012.Google Scholar
- A. Mnih and R. Salakhutdinov. Probabilistic matrix factorization. In NIPS'07, pages 1257--1264, 2007. Google ScholarDigital Library
- I. Porteous and M. W. A. U. Asuncion. Bayesian matrix factorization with side information and dirichlet process mixtures. In Proc. of AAAI'10, 2010. Google ScholarDigital Library
- S. Rendle. Factorization machines. In Proc. of ICDM'10, pages 995--1000, 2010. Google ScholarDigital Library
- R. Salakhutdinov and A. Mnih. Bayesian probabilistic matrix factorization using markov chain monte carlo. In Proc. of ICML'08, pages 880--887. ACM, 2008. Google ScholarDigital Library
- R. Salakhutdinov, A. Mnih, and G. Hinton. Restricted boltzmann machines for collaborative filtering. In Proc. of ICML'07, pages 791--798. ACM, 2007. Google ScholarDigital Library
- S. Sedhain, A. K. Menon, S. Sanner, and L. Xie. Autorec: Autoencoders meet collaborative filtering. In Proc. of Int. Conf. on World Wide Web Companion, pages 111--112, 2015. Google ScholarDigital Library
- N. Srivastava, G. Hinton, A. Krizhevsk, I. Sutskever, and R. Salakhutdinov. Dropout: A simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research, 15(1):1929--1958, 2014. Google ScholarDigital Library
- F. Strub and J. Mary. Collaborative Filtering with Stacked Denoising AutoEncoders and Sparse Inputs. In NIPS Workshop on Machine Learning for eCommerce, Montreal, Canada, 2015.Google Scholar
- O. Teytaud, S. Gelly, and J. Mary. Active learning in regression, with application to stochastic dynamic programming. In A. International Conference On Informatics in Control and Robotics, editors, ICINCO and CAP, pages 373--386, 2007.Google Scholar
- V. Tresp, S. Ahmad, and R. Neuneier. Training Neural Networks with Deficient Data. Advances in Neural Information Processing Systems 6, pages 128--135, 1994. Google ScholarDigital Library
- T. T. Truyen, D. Phung, and S. Venkatesh. Ordinal boltzmann machines for collaborative filtering. In Proc. of UAI'09, pages 548--556. AUAI Press, 2009. Google ScholarDigital Library
- A. Van den Oord, S. Dieleman, and B. Schrauwen. Deep content-based music recommendation. In Proc. of NIPS'13, pages 2643--2651, 2013. Google ScholarDigital Library
- P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. Manzagol. Stacked Denoising Autoencoders: Learning Useful Representations in a Deep Network with a Local Denoising Criterion. Jour. of Mach. Learn. Res., 11(3):3371--3408, 2010. Google ScholarDigital Library
- H. Wang, N. Wang, and D.-Y. Yeung. Collaborative deep learning for recommender systems. Proc. of Int. Conf. on Knowledge Discovery and Data Mining (KDD'14), 2014. Google ScholarDigital Library
- X. Wang and Y. Wang. Improving content-based and hybrid music recommendation using deep learning. In Proc. of the ACM Int. Conf. on Multimedia, pages 627--636. ACM, 2014. Google ScholarDigital Library
- Y. Wu, C. DuBois, A. Zheng, and M. Ester. Collaborative denoising auto-encoders for top-n recommender systems. In Proc. of WSDM'16, pages 153--162. ACM, 2016. Google ScholarDigital Library
- Y. Zhou, D. Wilkinson, R. Schreiber, and R. Pan. Large-scale parallel collaborative filtering for the netflix prize. In Algorithmic Aspects in Information and Management, pages 337--348. Springer, 2008. Google ScholarDigital Library
- F. Zhuang, D. Luo, X. Jin, H. Xiong, P. Luo, and Q. He. Representation learning via semi-supervised autoencoder for multi-task learning. In Proc. of ICDM'15, 2015. Google ScholarDigital Library
- Hybrid Recommender System based on Autoencoders
Recommendations
A Scalable, Accurate Hybrid Recommender System
WKDD '10: Proceedings of the 2010 Third International Conference on Knowledge Discovery and Data MiningRecommender systems apply machine learning techniques for filtering unseen information and can predict whether a user would like a given resource. There are three main types of recommender systems: collaborative filtering, content-based filtering, and ...
Hybrid Recommender System Based on Multi-Hierarchical Ontologies
WebMedia '18: Proceedings of the 24th Brazilian Symposium on Multimedia and the WebRecommender Systems (RSs) are usually based in User Profiles (UP) to identify items of interest to a user, among the items of a usually vast collection. Traditional RSs are mostly based on ratings of items made by users and do not attempt to estimate ...
Hybrid Recommender Systems: Survey and Experiments
Recommender systems represent user preferences for the purpose of suggesting items to purchase or examine. They have become fundamental applications in electronic commerce and information access, providing suggestions that effectively prune large ...
Comments