Yang Song
ABSTRACT
Modeling temporal behavior in recommendation systems is an important and challenging problem. Its challenges come from the fact that temporal modeling increases the cost of parameter estimation and inference, while requiring large amount of data to reliably learn the model with the additional time dimensions. Therefore, it is often difficult to model temporal behavior in large-scale real-world recommendation systems. In this work, we propose a novel deep neural network based architecture that models the combination of long-term static and short-term temporal user preferences to improve the recommendation performance. To train the model efficiently for large-scale applications, we propose a novel pre-train method to reduce the number of free parameters significantly. The resulted model is applied to a real-world data set from a commercial News recommendation system. We compare to a set of established baselines and the experimental results show that our method outperforms the state-of-the-art significantly.
- Recurrent neural networks for collaborative filtering. http://erikbern.com/2014/06/28/recurrent-neural-networks-for-collaborative-filtering/. Accessed: 2016-01-18.Google Scholar
- L. Baltrunas and X. Amatriain. Towards time-dependant recommendation based on implicit feedback. In Workshop on (CARS09), 2009.Google Scholar
- N. Bell and M. Garland. Implementing sparse matrix-vector multiplication on throughput-oriented processors. In Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis, page 18. ACM, 2009. Google ScholarDigital Library
- Y. Bengio, P. Lamblin, D. Popovici, H. Larochelle, et al. Greedy layer-wise training of deep networks. 2007.Google ScholarCross Ref
- P. G. Campos, F. Díez, and I. Cantador. Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols. User Modeling and User-Adapted Interaction, 24(1-2):67--119, 2014. Google ScholarDigital Library
- A. M. Elkahky, Y. Song, and X. He. A multi-view deep learning approach for cross domain user modeling in recommendation systems. In Proceedings of WWW2015, pages 278--288, 2015. Google ScholarDigital Library
- G. Guo, J. Zhang, Z. Sun, and N. Yorke-Smith. Librec: A java library for recommender systems.Google Scholar
- B. Hidasi, A. Karatzoglou, L. Baltrunas, and D. Tikk. Session-based recommendations with recurrent neural networks. CoRR, abs/1511.06939, 2015.Google Scholar
- G. E. Hinton and R. R. Salakhutdinov. Reducing the dimensionality of data with neural networks. Science, 313(5786):504--507, 2006.Google ScholarCross Ref
- Y. Hu, Y. Koren, and C. Volinsky. Collaborative filtering for implicit feedback datasets. In ICDM'08. Google ScholarDigital Library
- P.-S. Huang, X. He, J. Gao, L. Deng, A. Acero, and L. Heck. Learning deep structured semantic models for web search using clickthrough data. In CIKM'13. Google ScholarDigital Library
- N. Koenigstein, G. Dror, and Y. Koren. Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy. In Recsys'11. Google ScholarDigital Library
- Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD'08. Google ScholarDigital Library
- Y. Koren. Collaborative filtering with temporal dynamics. Communications of the ACM, 53(4):89--97, 2010. Google ScholarDigital Library
- L. Li, L. Zheng, F. Yang, and T. Li. Modeling and broadening temporal user interest in personalized news recommendation. Expert Systems with Applications, 41(7):3168--3177, 2014. Google ScholarDigital Library
- J. Liu, P. Dolan, and E. R. Pedersen. Personalized news recommendation based on click behavior. In Proceedings of the 15th international conference on Intelligent user interfaces, pages 31--40. ACM, 2010. Google ScholarDigital Library
- T. Mikolov, I. Sutskever, K. Chen, G. S. Corrado, and J. Dean. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems, pages 3111--3119, 2013.Google ScholarDigital Library
- A. Paterek. Improving regularized singular value decomposition for collaborative filtering. 2007.Google Scholar
- S. Rendle and C. Freudenthaler. Improving pairwise learning for item recommendation from implicit feedback. In WSDM'14. Google ScholarDigital Library
- R. Salakhutdinov, A. Mnih, and G. Hinton. Restricted boltzmann machines for collaborative filtering. In Proceedings of the 24th international conference on Machine learning, pages 791--798. ACM, 2007. Google ScholarDigital Library
- A. Van den Oord, S. Dieleman, and B. Schrauwen. Deep content-based music recommendation. In NIPS'13.Google Scholar
- H. Wang, N. Wang, and D.-Y. Yeung. Collaborative deep learning for recommender systems. arXiv preprint arXiv:1409.2944, 2014.Google Scholar
- L. Xiong, X. Chen, T.-K. Huang, J. G. Schneider, and J. G. Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. SIAM.Google Scholar
- H. Yu, N. Rao, and I. S. Dhillon. Temporal regularized matrix factorization. CoRR, abs/1509.08333, 2015.Google Scholar
- Q. Yuan, G. Cong, Z. Ma, A. Sun, and N. M. Thalmann. Time-aware point-of-interest recommendation. In SIGIR'13. Google ScholarDigital Library
Index Terms
- Multi-Rate Deep Learning for Temporal Recommendation
Recommendations
Multi‐model deep learning approach for collaborative filtering recommendation system
As a result of a huge volume of implicit feedback such as browsing and clicks, many researchers are involving in designing recommender systems (RSs) based on implicit feedback. Though implicit feedback is too challenging, it is highly applicable to use in ...
Top-N Recommendation System Using Explicit Feedback and Outer Product Based Residual CNN
AbstractDeep Neural Networks (DNN) has attained impressive results in various natural language processing tasks. It attracts the researchers to apply DNN in the Recommender Systems (RS). Typically, majority of the recommendation algorithms apply ...
Deep Neural Networks for News Recommendations
CIKM '17: Proceedings of the 2017 ACM on Conference on Information and Knowledge ManagementA fundamental role of news websites is to recommend articles that are interesting to read. The key challenge of news recommendation is to recommend newly published articles. Unlike other domains, outdated items are considered to be irrelevant in the ...
Comments