Chen Cheng
ABSTRACT
Recommendation techniques have been well developed in the past decades. Most of them build models only based on user item rating matrix. However, in real world, there is plenty of auxiliary information available in recommendation systems. We can utilize these information as additional features to improve recommendation performance. We refer to recommendation with auxiliary information as context-aware recommendation. Context-aware Factorization Machines (FM) is one of the most successful context-aware recommendation models. FM models pairwise interactions between all features, in such way, a certain feature latent vector is shared to compute the factorized parameters it involved. In practice, there are tens of context features and not all the pairwise feature interactions are useful. Thus, one important challenge for context-aware recommendation is how to effectively select "good" interaction features. In this paper, we focus on solving this problem and propose a greedy interaction feature selection algorithm based on gradient boosting. Then we propose a novel Gradient Boosting Factorization Machine (GBFM) model to incorporate feature selection algorithm with Factorization Machines into a unified framework. The experimental results on both synthetic and real datasets demonstrate the efficiency and effectiveness of our algorithm compared to other state-of-the-art methods.
Supplemental Material
- G. Adomavicius, R. Sankaranarayanan, S. Sen, and A. Tuzhilin. Incorporating contextual information in recommender systems using a multidimensional approach. pages 103--145, 2005. Google Scholar
Digital Library
- D. Agarwal and B.-C. Chen. Regression-based latent factor models. In KDD, pages 19--28, 2009. Google ScholarDigital Library
- L. Baltrunas, B. Ludwig, and F. Ricci. Matrix factorization techniques for context aware recommendation. In RecSys, pages 301--304, 2011. Google ScholarDigital Library
- R. M. Bell and Y. Koren. Lessons from the netix prize challenge. SIGKDD Explorations, 9(2):75--79, 2007. Google ScholarDigital Library
- C. J. Burges. From ranknet to lambdarank to lambdamart: An overview. Learning, 11:23--581, 2010.Google Scholar
- T. Chen, H. Li, Q. Yang, and Y. Yu. General functional matrix factorization using gradient boosting. In Proceedings of The 30th International Conference on Machine Learning, pages 436--444, 2013.Google Scholar
- T. Chen, L. Tang, Q. Liu, D. Yang, S. Xie, X. Cao, C. Wu, E. Yao, Z. Liu, Z. Jiang, et al. Combining factorization model and additive forest for collaborative followee recommendation. KDD CUP, 2012.Google Scholar
- C. Cheng, H. Yang, I. King, and M. R. Lyu. Fused matrix factorization with geographical and social influence in location-based social networks. In AAAI, 2012.Google ScholarDigital Library
- C. Cheng, H. Yang, M. R. Lyu, and I. King. Where you like to go next: Successive point-of-interest recommendation. In Proceedings of the Twenty-Third international joint conference on Artificial Intelligence, pages 2605--2611. AAAI Press, 2013. Google ScholarDigital Library
- J. Friedman, T. Hastie, and R. Tibshirani. Special invited paper. additive logistic regression: A statistical view of boosting. Annals of statistics, pages 337--374, 2000.Google Scholar
- J. H. Friedman. Greedy function approximation: a gradient boosting machine. Annals of Statistics, pages 1189--1232, 2001.Google ScholarCross Ref
- T. Hastie, R. Tibshirani, J. Friedman, T. Hastie, J. Friedman, and R. Tibshirani. The elements of statistical learning, volume 2. Springer, 2009.Google ScholarCross Ref
- M. Jamali and M. Ester. A matrix factorization technique with trust propagation for recommendation in social networks. In RecSys, pages 135--142, 2010. Google ScholarDigital Library
- A. Karatzoglou, X. Amatriain, L. Baltrunas, and N. Oliver. Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering. In RecSys, pages 79--86, 2010. Google ScholarDigital Library
- T. G. Kolda and B. W. Bader. Tensor decompositions and applications. SIAM review, 51(3):455--500, 2009. Google ScholarDigital Library
- Y. Koren. Factorization meets the neighborhood: a multifaceted collaborative filtering model. In KDD, pages 426--434, 2008. Google ScholarDigital Library
- Y. Koren. Collaborative filtering with temporal dynamics. In KDD, pages 447--456, 2009. Google ScholarDigital Library
- N. D. Lawrence and R. Urtasun. Non-linear matrix factorization with gaussian processes. In ICML, page 76, 2009. Google ScholarDigital Library
- X. Liu and K. Aberer. Soco: a social network aided context-aware recommender system. In WWW, pages 781--802, 2013. Google ScholarDigital Library
- H. Ma, I. King, and M. R. Lyu. Learning to recommend with explicit and implicit social relations. ACM TIST, 2(3):29, 2011. Google ScholarDigital Library
- U. Panniello, A. Tuzhilin, M. Gorgoglione, C. Palmisano, and A. Pedone. Experimental comparison of pre- vs. post-filtering approaches in context-aware recommender systems. In RecSys, pages 265--268, 2009. Google ScholarDigital Library
- S. Rendle. Factorization machines. In ICDM, pages 995--1000, 2010. Google ScholarDigital Library
- S. Rendle. Social network and click-through prediction with factorization machines. In KDD-Cup Workshop, 2012.Google Scholar
- S. Rendle. Scaling factorization machines to relational data. PVLDB, 6(5):337--348, 2013. Google ScholarDigital Library
- S. Rendle, Z. Gantner, C. Freudenthaler, and L. Schmidt-Thieme. Fast context-aware recommendations with factorization machines. In SIGIR, pages 635--644, 2011. Google ScholarDigital Library
- S. Rendle and L. Schmidt-Thieme. Pairwise interaction tensor factorization for personalized tag recommendation. In WSDM, pages 81--90, 2010. Google ScholarDigital Library
- R. Salakhutdinov and A. Mnih. Probabilistic matrix factorization. In NIPS, 2007.Google ScholarDigital Library
- B. M. Sarwar, G. Karypis, J. A. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In WWW, pages 285--295, 2001. Google ScholarDigital Library
- N. Srebro, J. D. M. Rennie, and T. Jaakkola. Maximum-margin matrix factorization. In NIPS, 2004.Google ScholarDigital Library
- D. H. Stern, R. Herbrich, and T. Graepel. Matchbox: large scale online bayesian recommendations. In WWW, pages 111--120, 2009. Google ScholarDigital Library
- L. R. Tucker. Some mathematical notes on three-mode factor analysis. Psychometrika, 31(3):279--311, 1966.Google ScholarCross Ref
- J. Weston, C. Wang, R. J. Weiss, and A. Berenzweig. Latent collaborative retrieval. In ICML, 2012.Google Scholar
- L. Xiong, X. Chen, T.-K. Huang, J. G. Schneider, and J. G. Carbonell. Temporal collaborative filtering with bayesian probabilistic tensor factorization. In SDM, pages 211--222, 2010.Google ScholarCross Ref
- J. Xu and H. Li. Adarank: a boosting algorithm for information retrieval. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval, pages 391--398. ACM, 2007. Google ScholarDigital Library
- M. Ye, P. Yin, W.-C. Lee, and D. L. Lee. Exploiting geographical inuence for collaborative point-of-interest recommendation. In SIGIR, pages 325--334, 2011. Google ScholarDigital Library
- E. Zhong, W. Fan, and Q. Y. 0001. Contextual collaborative filtering via hierarchical matrix factorization. In SDM, pages 744--755, 2012.Google ScholarCross Ref
Index Terms
- Gradient boosting factorization machines
Recommendations
Textual Context Aware Factorization Machines: Improving Recommendation by Leveraging Users' Reviews
ICSDE'18: Proceedings of the 2nd International Conference on Smart Digital EnvironmentContext Aware Recommender Systems (CARS) are Recommender Systems (RS) that consider, in addition to users and items, other contextual information to provide more accurate predictions. However, in the real-life applications, obtaining contextual ...
Attributes coupling based matrix factorization for item recommendation
Recommender systems have attracted lots of attention since they alleviate the information overload problem for users. Matrix factorization is one of the most widely employed collaborative filtering techniques in the research of recommender systems due ...
Multi-linear interactive matrix factorization
A multi-linear interactive matrix factorization algorithm is introduced.The interactions between users and factors are empirically analyzed.Results show interactive factors significantly enhance recommendation performance. Recommender systems, which can ...
Comments