Skip to main content

2021 | OriginalPaper | Buchkapitel

43. Recommender Systems Evaluator: A Framework for Evaluating the Performance of Recommender Systems

verfasst von : Paulo V. G. dos Santos, Bruno Tardiole Kuehne, Bruno G. Batista, Dionisio M. Leite, Maycon L. M. Peixoto, Edmilson Marmo Moreira, Stephan Reiff-Marganiec

Erschienen in: ITNG 2021 18th International Conference on Information Technology-New Generations

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recommender systems are filters that suggest products of interest to customers, which may positively impact sales. Nowadays, there is a multitude of algorithms for recommender systems, and their performance varies widely. So it is crucial to choose the most suitable option given a situation, but it is not a trivial task. In this context, we propose the Recommender Systems Evaluator (RSE): a framework aimed to accomplish an offline performance evaluation of recommender systems. We argue that the usage of a proper methodology is crucial when evaluating the available options. However, it is frequently overlooked, leading to inconsistent results. To help appraisers draw reliable conclusions, RSE is based on statistical concepts and displays results intuitively. A comparative study of classical recommendation algorithms is presented as an evaluation, highlighting RSE’s critical features.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat M. Nadeem, E.B. Allen, B.J. Williams, A method for recommending computer-security training for software developers: Leveraging the power of static analysis techniques and vulnerability repositories, in 2015 12th International Conference on Information Technology New Generations, (2015), pp. 534–539 M. Nadeem, E.B. Allen, B.J. Williams, A method for recommending computer-security training for software developers: Leveraging the power of static analysis techniques and vulnerability repositories, in 2015 12th International Conference on Information Technology New Generations, (2015), pp. 534–539
2.
Zurück zum Zitat J. Lu, D. Wu, M. Mao, W. Wang, G. Zhang, Recommender system application developments: a survey. Decision Support Systems 74, 12–32 (2015)CrossRef J. Lu, D. Wu, M. Mao, W. Wang, G. Zhang, Recommender system application developments: a survey. Decision Support Systems 74, 12–32 (2015)CrossRef
3.
Zurück zum Zitat S. Trewin, Knowledge-based recommender systems. Encyclopedia of Library and Information Science 69(Supplement 32), 180 (2000) S. Trewin, Knowledge-based recommender systems. Encyclopedia of Library and Information Science 69(Supplement 32), 180 (2000)
4.
Zurück zum Zitat B. Sarwar, G. Karypis, J. Konstan, J. Riedl, Item-based collaborative filtering recommendation algorithms, in Proceedings of the 10th International Conference on World Wide Web, (ACM, 2001), pp. 285–295CrossRef B. Sarwar, G. Karypis, J. Konstan, J. Riedl, Item-based collaborative filtering recommendation algorithms, in Proceedings of the 10th International Conference on World Wide Web, (ACM, 2001), pp. 285–295CrossRef
5.
Zurück zum Zitat L. Lü, M. Medo, C.H. Yeung, Y.-C. Zhang, Z.-K. Zhang, T. Zhou, Recommender systems. Phys. Rep. 519(1), 1–49 (2012)CrossRef L. Lü, M. Medo, C.H. Yeung, Y.-C. Zhang, Z.-K. Zhang, T. Zhou, Recommender systems. Phys. Rep. 519(1), 1–49 (2012)CrossRef
6.
Zurück zum Zitat D. Kowald, S. Kopeinik, E. Lex, The TagRec framework as a toolkit for the development of tag-based recommender systems, in Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization, (ACM, 2017), pp. 23–28CrossRef D. Kowald, S. Kopeinik, E. Lex, The TagRec framework as a toolkit for the development of tag-based recommender systems, in Adjunct Publication of the 25th Conference on User Modeling, Adaptation and Personalization, (ACM, 2017), pp. 23–28CrossRef
7.
Zurück zum Zitat A. Said, B.’ı. Alejandro, RiVal: A toolkit to foster reproducibility in recommender system evaluation, in Proceedings of the 8th ACM Conference on Recommender Systems, (ACM, 2014), pp. 371–372CrossRef A. Said, B.’ı. Alejandro, RiVal: A toolkit to foster reproducibility in recommender system evaluation, in Proceedings of the 8th ACM Conference on Recommender Systems, (ACM, 2014), pp. 371–372CrossRef
8.
Zurück zum Zitat M.D. Ekstrand, M. Ludwig, J.A. Konstan, J.T. Riedl, Rethinking the recommender research ecosystem: Reproducibility, openness, and Lenskit, in Proceedings of the fifth ACM conference on Recommender Systems, (ACM, 2011), pp. 133–140CrossRef M.D. Ekstrand, M. Ludwig, J.A. Konstan, J.T. Riedl, Rethinking the recommender research ecosystem: Reproducibility, openness, and Lenskit, in Proceedings of the fifth ACM conference on Recommender Systems, (ACM, 2011), pp. 133–140CrossRef
9.
Zurück zum Zitat A. Dayan, G. Katz, N. Biasdi, L. Rokach, B. Shapira, A. Aydin, R. Schwaiger, R. Fishel, Recommenders benchmark framework, in Proceedings of the fifth ACM conference on Recommender Systems, (ACM, 2011), pp. 353–354CrossRef A. Dayan, G. Katz, N. Biasdi, L. Rokach, B. Shapira, A. Aydin, R. Schwaiger, R. Fishel, Recommenders benchmark framework, in Proceedings of the fifth ACM conference on Recommender Systems, (ACM, 2011), pp. 353–354CrossRef
10.
Zurück zum Zitat R. Jain, The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling (Wiley, New York, 1990) R. Jain, The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling (Wiley, New York, 1990)
11.
Zurück zum Zitat D.H. Park, H.K. Kim, I.Y. Choi, J.K. Kim, A literature review and classification of recommender systems research. Expert Syst. Appl. 39(11), 10059–10072 (2012)CrossRef D.H. Park, H.K. Kim, I.Y. Choi, J.K. Kim, A literature review and classification of recommender systems research. Expert Syst. Appl. 39(11), 10059–10072 (2012)CrossRef
12.
Zurück zum Zitat F. Maxwell Harper, J.A. Konstan, The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (TiiS) 5(4), 19 (2016) F. Maxwell Harper, J.A. Konstan, The movielens datasets: History and context. ACM Transactions on Interactive Intelligent Systems (TiiS) 5(4), 19 (2016)
13.
Zurück zum Zitat J. Vig, S. Sen, J. Riedl, The tag genome: Encoding community knowledge to support novel interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2(3), 13 (2012) J. Vig, S. Sen, J. Riedl, The tag genome: Encoding community knowledge to support novel interaction. ACM Transactions on Interactive Intelligent Systems (TiiS) 2(3), 13 (2012)
Metadaten
Titel
Recommender Systems Evaluator: A Framework for Evaluating the Performance of Recommender Systems
verfasst von
Paulo V. G. dos Santos
Bruno Tardiole Kuehne
Bruno G. Batista
Dionisio M. Leite
Maycon L. M. Peixoto
Edmilson Marmo Moreira
Stephan Reiff-Marganiec
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-70416-2_43