Skip to main content
Top

2018 | OriginalPaper | Chapter

Towards a Comprehensive Evaluation of Recommenders: A Cognition-Based Approach

Authors : Alaa Alslaity, Thomas Tran

Published in: Advances in Artificial Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Evaluating Recommender Systems (RSs) is a challenging issue that is significantly magnified by the multifaceted properties of RSs, which makes it insufficient to use only one metric to evaluate recommenders. This challenge necessitates the need for a unified evaluation model that comprehensively assesses multiple aspects of the recommender. This position paper proposes a cognition-based comprehensive evaluation to evaluate the main activities of RSs. We innovated the proposed model based on the cognitive dimension of Bloom’s taxonomy, a widely used model for classifying learning objectives in the teaching area. We created a phase-wise mapping between RSs and Bloom’s taxonomy to come up with an overall evaluation for recommenders. Based on these connections, we believe that the proposed evaluation model would have the potential to support the decision of selecting the most appropriate recommender systems by giving a benchmarked score for different aspects of RSs.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of the Fifth ACM Conference on Recommender Systems, pp. 157–164. ACM, October 2011 Pu, P., Chen, L., Hu, R.: A user-centric evaluation framework for recommender systems. In: Proceedings of the Fifth ACM Conference on Recommender Systems, pp. 157–164. ACM, October 2011
3.
go back to reference Seminario, C.E., Wilson, D.C.: Robustness and accuracy tradeoffs for recommender systems under attack. In: FLAIRS Conference (2012) Seminario, C.E., Wilson, D.C.: Robustness and accuracy tradeoffs for recommender systems under attack. In: FLAIRS Conference (2012)
4.
go back to reference Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)CrossRef Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions. IEEE Trans. Knowl. Data Eng. 17(6), 734–749 (2005)CrossRef
5.
go back to reference Kowald, D., Lex, E.: Evaluating tag recommender algorithms in real-world folksonomies: a comparative study. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 265–268. ACM (2015) Kowald, D., Lex, E.: Evaluating tag recommender algorithms in real-world folksonomies: a comparative study. In: Proceedings of the 9th ACM Conference on Recommender Systems, pp. 265–268. ACM (2015)
6.
go back to reference Said, A., Tikk, D., Stumpf, K., Shi, Y., Larson, M., Cremonesi, P.: Recommender systems evaluation: a 3D benchmark. In: RUE@ RecSys, pp. 21–23 (2012) Said, A., Tikk, D., Stumpf, K., Shi, Y., Larson, M., Cremonesi, P.: Recommender systems evaluation: a 3D benchmark. In: RUE@ RecSys, pp. 21–23 (2012)
7.
go back to reference Karthwohl, D.R., Anderson, W.: A revision of Bloom’s taxonomy: an overview theory into practice. The Ohio State University (2002) Karthwohl, D.R., Anderson, W.: A revision of Bloom’s taxonomy: an overview theory into practice. The Ohio State University (2002)
8.
go back to reference Isinkaye, F.O., Folajimi, Y.O., Ojokoh, B.A.: Recommendation systems: principles, methods and evaluation. Egypt. Inform. J. 16(3), 261–273 (2015)CrossRef Isinkaye, F.O., Folajimi, Y.O., Ojokoh, B.A.: Recommendation systems: principles, methods and evaluation. Egypt. Inform. J. 16(3), 261–273 (2015)CrossRef
10.
go back to reference Salfner, F., Lenk, M., Malek, M.: A survey of online failure prediction methods. ACM Comput. Surv. (CSUR) 42(3), 10 (2010)CrossRef Salfner, F., Lenk, M., Malek, M.: A survey of online failure prediction methods. ACM Comput. Surv. (CSUR) 42(3), 10 (2010)CrossRef
Metadata
Title
Towards a Comprehensive Evaluation of Recommenders: A Cognition-Based Approach
Authors
Alaa Alslaity
Thomas Tran
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-89656-4_32

Premium Partner