Òscar Celma
ABSTRACT
This paper presents two methods, named Item- and User-centric, to evaluate the quality of novel recommendations. The former method focuses on analyzing the item-based recommendation network. The aim is to detect whether the network topology has any pathology that hinders novel recommendations. The latter, user-centric evaluation, aims at measuring users' perceived quality of novel, previously unknown, recommendations.
The results of the experiments, done in the music recommendation context, show that last.fm social recommender, based on collaborative filtering, is prone to popularity bias. This has direct consequences on the topology of the item-based recommendation network. Pure audio content-based methods (CB) are not affected by popularity. However, a user-centric experiment done with 288 subjects shows that even though a social-based approach recommends less novel items than our CB, users' perceived quality is better than those recommended by a pure CB method.
- G. Adomavicius and A. Tuzhilin. Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6):734--749, 2005. Google Scholar
Digital Library
- C. Anderson. The long tail. Why the Future of Business is Selling Less of More. Hyperion Verlag, 2006. Google ScholarDigital Library
- A. L. Barabási and R. Albert. Emergence of scaling in a random networks. Science, 286(5439):509--512, October 1999.Google ScholarCross Ref
- A.-L. Barabási, R. Albert, H. Jeong, and G. Bianconi. a Power-law distribution of the world wide web. Science, 287:2115a, 2000.Google ScholarCross Ref
- D. Billsus and M. J. Pazzani. User modeling for adaptive news access. User Modeling and User-Adapted Interaction, 10(2-3):147--180, 2000. Google ScholarDigital Library
- J. S. Breese, D. Heckerman, and C. Kadie. Empirical analysis of predictive algorithms for collaborative filtering. Technical report, 1998.Google Scholar
- P. Cano, M. Koppenberger, and N. Wack. An industrial-strength content-based music recommendation system. In Proceedings of 28th International ACM SIGIR Conference, Salvador, Brazil, 2005. Google ScholarDigital Library
- Ò. Celma and P. Lamere. Music recommendation tutorial. In Proceedings of 8th International Conference on Music Information Retrieval, Vienna, Austria, 2007.Google Scholar
- D. M. Fleder and K. Hosanagar. Blockbuster Culture's Next Rise or Fall: The Impact of Recommender Systems on Sales Diversity. SSRN eLibrary, 2007.Google Scholar
- J. L. Herlocker, J. A. Konstan, L. G. Terveen, and J. T. Riedl. Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst., 22(1):5--53, 2004. Google ScholarDigital Library
- K. Kilkki. A practical model for analyzing long tails. First Monday, 12(5), May 2007.Google Scholar
- J. M. Kleinberg. Navigation in a small world. Nature, 406:845, 2000.Google ScholarCross Ref
- S. M. Mcnee, J. Riedl, and J. A. Konstan. Being accurate is not enough: how accuracy metrics have hurt recommender systems. In Computer Human Interaction. Human factors in computing systems, pages 1097--1101, New York, NY, USA, 2006. ACM. Google ScholarDigital Library
- M. E. J. Newman. Assortative mixing in networks. Physical Review Letters, 89(20), 2002.Google ScholarCross Ref
- M. J. Salganik, P. S. Dodds, and D. J. Watts. Experimental study of inequality and unpredictability in an artificial cultural market. Science, 311(5762):854--856, February 2006.Google ScholarCross Ref
- B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In A. Press, editor, Proceedings of 10th International World Wide Web Conference, pages 285--295, Hong Kong, 2001. Google ScholarDigital Library
- D. J. Watts and S. H. Strogatz. Collective dynamics of 'small-world' networks. Nature, 393(6684):440--442, June 1998.Google ScholarCross Ref
- L.-T. Weng, Y. Xu, Y. Li, and R. Nayak. Improving recommendation novelty based on topic taxonomy. In Proceedings of the IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, pages 115--118, Washington, DC, USA, 2007. IEEE Computer Society. Google ScholarDigital Library
- Y. Yang and J. Z. Li. Interest-based recommendation in digital library. Journal of Computer Science, 1(1):40--46, 2005.Google ScholarCross Ref
- Y. Zhang, J. Callan, and T. Minka. Novelty and redundancy detection in adaptive filtering. In Proceedings of the 25th international ACM SIGIR conference, pages 81--88, New York, NY, USA, 2002. ACM. Google ScholarDigital Library
- C.-N. Ziegler, S. M. McNee, J. A. Konstan, and G. Lausen. Improving recommendation lists through topic diversification. In Proceedings of the 14th international conference on World Wide Web, pages 22--32, New York, NY, USA, 2005. ACM. Google ScholarDigital Library
Index Terms
- A new approach to evaluating novel recommendations
Recommendations
Optimizing multiple objectives in collaborative filtering
RecSys '10: Proceedings of the fourth ACM conference on Recommender systemsThis paper is about the utility of making personalized recommendations. While it is important to accurately predict the target user's preference, in practice the accuracy should not be the only concern; a useful recommender system needs to consider the ...
Investigating serendipity in recommender systems based on real user feedback
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied ComputingOver the past several years, research in recommender systems has emphasized the importance of serendipity, but there is still no consensus on the definition of this concept and whether serendipitous items should be recommended is still not a well-...
User Similarity Adjustment for Improved Recommendations
MIKE 2015: Proceedings of the Third International Conference on Mining Intelligence and Knowledge Exploration - Volume 9468Recommender systems are becoming more and more attractive in both research and commercial communities due to Information overload problem and the popularity of the Internet applications. Collaborative Filtering, a popular branch of recommendation ...
Comments