ABSTRACT
Collaborative Filtering (CF) algorithms, used to build web-based recommender systems, are often evaluated in terms of how accurately they predict user ratings. However, current evaluation techniques disregard the fact that users continue to rate items over time: the temporal characteristics of the system's top-N recommendations are not investigated. In particular, there is no means of measuring the extent that the same items are being recommended to users over and over again. In this work, we show that temporal diversity is an important facet of recommender systems, by showing how CF data changes over time and performing a user survey. We then evaluate three CF algorithms from the point of view of the diversity in the sequence of recommendation lists they produce over time. We examine how a number of characteristics of user rating patterns (including profile size and time between rating) affect diversity. We then propose and evaluate set methods that maximise temporal recommendation diversity without extensively penalising accuracy.
- J. Herlocker, J. Konstan, L. Terveen, and J. Riedl. Evaluating Collaborative Filtering Recommender Systems. In ACM TOIS, volume 22, pages 5--53, 2004. Google ScholarDigital Library
- M. Mull. Characteristics of High-Volume Recommender Systems. In Proceedings of Recommenders '06, Bilbao, Spain, September 2006.Google Scholar
- Y. Koren. Collaborative Filtering With Temporal Dynamics. In ACM KDD, Paris, France, June 2009. Google ScholarDigital Library
- N. Lathia, S. Hailes, and L. Capra. Temporal Collaborative Filtering With Adaptive Neighbourhoods. In ACM SIGIR, Boston, USA, 2009. Google ScholarDigital Library
- G. Adomavicius and A. Tuzhilin. Towards the Next Generation of Recommender Systems: A Survey of the State-of-the-Art and Possible Extensions. IEEE TKDE, 17(6), June 2005. Google ScholarDigital Library
- S.M. McNee, S.K. Lam, C. Guetzlaff, J.A. Konstan, and J. Riedl. Confidence Displays and Training in Recommender Systems. In ACM CHI, 2003.Google Scholar
- R. Burke. Hybrid Recommender Systems: Survey and Experiments. User Modeling and User-Adapted Interaction, 12(4), 2002. Google ScholarDigital Library
- F. Radlinski and S. Dumais. Improving Personalized Web Search Using Result Diversification. In ACM SIGIR, Seattle, USA, 2006. Google ScholarDigital Library
- R. Agrawal, S. Gollapudi, A. Halverson, and S. Ieong. Diversifying Search Results. In ACM WSDM, Barcelona, Spain, 2009. Google ScholarDigital Library
- D. Hawking, T. Rowlands, and P. Thomas. C-TEST: Supporting Novelty and Diversity in Testfiles for Search Evaluation. In ACM SIGIR Workshop on Redundancy, Diversity and Interdependent Document Relevance, Boston, USA, 2009.Google Scholar
- B. Smyth and P. McClave. Similarity vs. Diversity. In 4th International Conference on Case-Based Reasoning, Vancouver, Canada, 2001. Google ScholarDigital Library
- M. Zhang and N. Hurley. Avoiding Monotony: Improving the Diversity of Recommendation Lists. In ACM RecSys, Lausanne, Switzerland, 2008. Google ScholarDigital Library
Index Terms
- Temporal diversity in recommender systems
Recommendations
A Clustering Approach for Personalizing Diversity in Collaborative Recommender Systems
UMAP '17: Proceedings of the 25th Conference on User Modeling, Adaptation and PersonalizationMuch of the focus of recommender systems research has been on the accurate prediction of users' ratings for unseen items. Recent work has suggested that objectives such as diversity and novelty in recommendations are also important factors in the ...
A Novel Framework for Improving Recommender Diversity
International Workshop on Behavior and Social Informatics on Behavior and Social Computing - Volume 8178Recommender systems are being used to assist users in finding relevant items from a large set of alternatives in many online applications. However, while most research up to this point has focused on improving the accuracy of recommender systems, other ...
On Unexpectedness in Recommender Systems: Or How to Better Expect the Unexpected
Special Sections on Diversity and Discovery in Recommender Systems, Online Advertising and Regular PapersAlthough the broad social and business success of recommender systems has been achieved across several domains, there is still a long way to go in terms of user satisfaction. One of the key dimensions for significant improvement is the concept of ...
Comments