nach oben

Erschienen in:

2015 | OriginalPaper | Buchkapitel

24. Active Learning in Recommender Systems

verfasst von : Neil Rubens, Mehdi Elahi, Masashi Sugiyama, Dain Kaplan

Erschienen in: Recommender Systems Handbook

Verlag: Springer US

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In Recommender Systems (RS), a user’s preferences are expressed in terms of rated items, where incorporating each rating may improve the RS’s predictive accuracy. In addition to a user rating items at-will (a passive process), RSs may also actively elicit the user to rate items, a process known as Active Learning (AL). However, the number of interactions between the RS and the user is still limited. One aim of AL is therefore the selection of items whose ratings are likely to provide the most information about the user’s preferences. In this chapter, we provide an overview of AL within RSs, discuss general objectives and considerations, and then summarize a variety of methods commonly employed. AL methods are categorized based on our interpretation of their primary motivation/goal, and then sub-classified into two commonly classified types, instance-based and model-based, for easier comprehension. We conclude the chapter by outlining ways in which AL methods could be evaluated, and provide a brief summary of methods performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Vorheriges Kapitel Aggregation Functions for Recommender Systems

Nächstes Kapitel Multi-Criteria Recommender Systems

Unless our goal is to learn a kind of micro-preference, which we can define as a person’s tendency to be more “picky” concerning alternatives close to one another in an genre they like.

Supplementary materials on Active Learning can be found at: http://ActiveIntelligence.org.

This may be dependent on the specific prediction method used in the RS.

For comparing of recommendations with various lengths, normalized Discounted Cumulative Gain (NDCG) is frequently used.

The way in which an item is represented depends on the RS and the underlying predictive method. In Collaborative Filtering based approaches items could represented through the ratings of the users, or, in content based RSs, items could be represented through their descriptions.

If the ordinal properties of the labels are considered, it is referred to as Ordinal Classification.

Defining a neighbor as a similar item is also feasible depending on the method.

Recently it has also been proposed to utilize transfer learning for leveraging pre-existing labeled data from related tasks to improve the performance of an active learning algorithm [34, 69].

Abe, N., Mamitsuka, H.: Query learning strategies using boosting and bagging. In: Proceedings of the Fifteenth International Conference on Machine Learning, vol. 388. Morgan Kaufmann Publishers Inc. (1998)

Adomavicius, G., Tuzhilin, A.: Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering 17(6), 734–749 (2005)CrossRef

Ahn, L.V.: Games with a purpose. Computer 39(6), 92–94 (2006). DOI 10.1109/MC.2006.196 CrossRef

Bailey, R.A.: Design of Comparative Experiments. Cambridge University Press (2008)

Balcan, M.F., Beygelzimer, A., Langford, J.: Agnostic active learning. In: ICML ’06: Proceedings of the 23rd international conference on Machine learning, pp. 65–72. ACM, New York, NY, USA (2006). DOI http://doi.acm.org/10.1145/1143844.1143853

Boutilier, C., Zemel, R., Marlin, B.: Active collaborative filtering. In: Proceedings of the Nineteenth Annual Conference on Uncertainty in Artificial Intelligence, pp. 98–106 (2003). URL citeseer.ist.psu.edu/boutilier03active.html

Box, G., Hunter, S.J., Hunter, W.G.: Statistics for Experimenters: Design, Innovation, and Discovery. Wiley-Interscience (2005)

Breiman, L., Breiman, L.: Bagging predictors. In: Machine Learning, pp. 123–140 (1996)

Bridge, D., Ricci, F.: Supporting product selection with query editing recommendations. In: RecSys ’07: Proceedings of the 2007 ACM conference on Recommender systems, pp. 65–72. ACM, New York, NY, USA (2007). DOI http://doi.acm.org/10.1145/1297231.1297243

10.

Burke, R.: Evaluating the dynamic properties of recommendation algorithms. In: Proceedings of the fourth ACM conference on Recommender systems, RecSys ’10, pp. 225–228. ACM, New York, NY, USA (2010). DOI http://doi.acm.org/10.1145/1864708.1864753. URL http://doi.acm.org/10.1145/1864708.1864753

11.

Carenini, G., Smith, J., Poole, D.: Towards more conversational and collaborative recommender systems. In: IUI ’03: Proceedings of the 8th international conference on Intelligent user interfaces, pp. 12–18. ACM, New York, NY, USA (2003). DOI http://doi.acm.org/10.1145/604045.604052

12.

Chan, N.: A-optimality for regression designs. Tech. rep., Stanford University, Department of Statistics (1981)

13.

Cohn, D.A.: Neural network exploration using optimal experiment design 6, 679–686 (1994). URL citeseer.ist.psu.edu/article/cohn94neural.html

14.

Cohn, D.A., Ghahramani, Z., Jordan, M.I.: Active learning with statistical models. Journal of Artificial Intelligence Research 4, 129–145 (1996)MATH

15.

Dagan, I., Engelson, S.: Committee-based sampling for training probabilistic classifiers. In: Proceedings of the International Conference on Machine Learning (ICML), pp. 150–157. Citeseer (1995)

16.

Danziger, S., Zeng, J., Wang, Y., Brachmann, R., Lathrop, R.: Choosing where to look next in a mutation sequence space: Active learning of informative p53 cancer rescue mutants. Bioinformatics 23(13), 104–114 (2007)CrossRef

17.

Dasgupta, S., Lee, W., Long, P.: A theoretical analysis of query selection for collaborative filtering. Machine Learning 51, 283–298 (2003). URL citeseer.ist.psu.edu/dasgupta02theoretical.html

18.

Diaz-Aviles, E., Drumond, L., Schmidt-Thieme, L., Nejdl, W.: Real-time top-n recommendation in social streams. In: Proceedings of the Sixth ACM Conference on Recommender Systems, RecSys ’12, pp. 59–66. ACM, New York, NY, USA (2012). DOI 10.1145/2365952.2365968. URL http://doi.acm.org/10.1145/2365952.2365968

19.

Elahi, M.: Adaptive active learning in recommender systems. In: User Modeling, Adaption and Personalization—19th International Conference, UMAP 2011, Girona, Spain, July 11–15, 2011. Proceedings, pp. 414–417 (2011)

20.

Elahi, M., Ricci, F., Rubens, N.: Active learning strategies for rating elicitation in collaborative filtering: a system-wide perspective. ACM Transactions on Intelligent Systems and Technology 5(11) (2013)

21.

Ertekin, S., Huang, J., Bottou, L., Giles, L.: Learning on the border: active learning in imbalanced data classification. In: Proceedings of the sixteenth ACM conference on Conference on information and knowledge management, pp. 127–136. ACM (2007)

22.

Freund, Y., Schapire, R.: A decision-theoretic generalization of on-line learning and an application to boosting. Journal of computer and system sciences 55(1), 119–139 (1997)MATHMathSciNetCrossRef

23.

Fujii, A., Tokunaga, T., Inui, K., Tanaka, H.: Selective sampling for example-based word sense disambiguation. Computational Linguistics 24, 24–4 (1998)

24.

Greiner, R., Grove, A., Roth, D.: Learning cost-sensitive active classifiers. Artificial Intelligence 139, 137–174 (2002)MathSciNetCrossRef

25.

Harpale, A.S., Yang, Y.: Personalized active learning for collaborative filtering. In: SIGIR ’08: Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval, pp. 91–98. ACM, New York, NY, USA (2008). DOI http://doi.acm.org/10.1145/1390334.1390352

26.

Herlocker, J.L., Konstan, J.A., Borchers, A., Riedl, J.: An algorithmic framework for performing collaborative filtering. In: Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR ’99, pp. 230–237. ACM, New York, NY, USA (1999). DOI http://doi.acm.org/10.1145/312624.312682. URL http://doi.acm.org/10.1145/312624.312682

27.

Herlocker, J.L., Konstan, J.A., Terveen, L.G., Riedl, J.T.: Evaluating collaborative filtering recommender systems. ACM Trans. Inf. Syst. 22(1), 5–53 (2004). DOI http://doi.acm.org/10.1145/963770.963772

28.

Hinkelmann, K., Kempthorne, O.: Design and Analysis of Experiments, Advanced Experimental Design. Wiley Series in Probability and Statistics (2005)

29.

Hofmann, T.: Collaborative filtering via gaussian probabilistic latent semantic analysis. In: SIGIR ’03: Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, pp. 259–266. ACM, New York, NY, USA (2003). DOI http://doi.acm.org/10.1145/860435.860483

30.

Huang, Z.: Selectively acquiring ratings for product recommendation. In: ICEC ’07: Proceedings of the ninth international conference on Electronic commerce, pp. 379–388. ACM, New York, NY, USA (2007). DOI http://doi.acm.org/10.1145/1282100.1282171

31.

Jin, R., Si, L.: A bayesian approach toward active learning for collaborative filtering. In: AUAI ’04: Proceedings of the 20th conference on Uncertainty in artificial intelligence, pp. 278–285. AUAI Press, Arlington, Virginia, United States (2004)

32.

Johar, M., Mookerjee, V., Sarkar, S.: Selling vs. profiling: Optimizing the offer set in web-based personalization. Information Systems Research 25(2), 285–306 (2014).

33.

John, R.C.S., Draper, N.R.: D-optimality for regression designs: A review. Technometrics 17(1), 15–23 (1975)MATHMathSciNetCrossRef

34.

Kale, D., Liu, Y.: Accelerating active learning with transfer learning. In: Data Mining (ICDM), 2013 IEEE 13th International Conference on, pp. 1085–1090 (2013). DOI 10.1109/ICDM.2013.160

35.

Kapoor, A., Horvitz, E., Basu, S.: Selective supervision: Guiding supervised learning with decision-theoretic active learning. In: Proceedings of International Joint Conference on Artificial Intelligence (IJCAI), pp. 877–882 (2007)

36.

Karimi, R., Freudenthaler, C., Nanopoulos, A., Schmidt-Thieme, L.: Exploiting the characteristics of matrix factorization for active learning in recommender systems. In: Proceedings of the Sixth ACM Conference on Recommender Systems, RecSys ’12, pp. 317–320. ACM, New York, NY, USA (2012). DOI 10.1145/2365952.2366031. URL http://doi.acm.org/10.1145/2365952.2366031

37.

Kohrs, A., Merialdo, B.: Improving collaborative filtering for new users by smart object selection. In: Proceedings of International Conference on Media Features (ICMF) (2001)

38.

Le, Q.T., Tu, M.P.: Active learning for co-clustering based collaborative filtering. In: Computing and Communication Technologies, Research, Innovation, and Vision for the Future (RIVF), 2010 IEEE RIVF International Conference on, pp. 1–4 (2010). DOI 10.1109/RIVF.2010.5633245

39.

Leino, J., Räihä, K.J.: Case amazon: ratings and reviews as part of recommendations. In: RecSys ’07: Proceedings of the 2007 ACM conference on Recommender systems, pp. 137–140. ACM, New York, NY, USA (2007). DOI http://doi.acm.org/10.1145/1297231.1297255

40.

Lomasky, R., Brodley, C., Aernecke, M., Walt, D., Friedl, M.: Active class selection. In: In Proceedings of the European Conference on Machine Learning (ECML). Springer (2007)

41.

McCallum, A., Nigam, K.: Employing em and pool-based active learning for text classification. In: ICML ’98: Proceedings of the Fifteenth International Conference on Machine Learning, pp. 350–358. San Francisco, CA, USA (1998)

42.

Mcginty, L., Smyth, B.: On the Role of Diversity in Conversational Recommender Systems. Case-Based Reasoning Research and Development pp. 276–290 (2003)

43.

McNee, S.M., Riedl, J., Konstan, J.A.: Being accurate is not enough: how accuracy metrics have hurt recommender systems. In: CHI ’06: CHI ’06 extended abstracts on Human factors in computing systems, pp. 1097–1101. ACM Press, New York, NY, USA (2006). DOI http://doi.acm.org/10.1145/1125451.1125659

44.

Nakamura, A., Abe, N.: Collaborative filtering using weighted majority prediction algorithms. In: ICML ’98: Proceedings of the Fifteenth International Conference on Machine Learning, pp. 395–403. Morgan Kaufmann Publishers Inc., San Francisco, CA, USA (1998)

45.

Pu, P., Chen, L.: User-Involved Preference Elicitation for Product Search and Recommender Systems. AI magazine pp. 93–103 (2009). URL http://www.aaai.org/ojs/index.php/aimagazine/article/viewArticle/2200

46.

Rashid, A.M., Albert, I., Cosley, D., Lam, S.K., McNee, S.M., Konstan, J.A., Riedl, J.: Getting to know you: learning new user preferences in recommender systems. In: IUI ’02: Proceedings of the 7th international conference on Intelligent user interfaces, pp. 127–134. ACM Press, New York, NY, USA (2002). DOI http://doi.acm.org/10.1145/502716.502737

47.

Rashid, A.M., Karypis, G., Riedl, J.: Influence in ratings-based recommender systems: An algorithm-independent approach. In: SIAM International Conference on Data Mining, pp. 556–560 (2005)

48.

Resnick, P., Sami, R.: The influence limiter: provably manipulation-resistant recommender systems. In: Proceedings of the 2007 ACM conference on Recommender systems, RecSys ’07, pp. 25–32. ACM, New York, NY, USA (2007). DOI http://doi.acm.org/10.1145/1297231.1297236. URL http://doi.acm.org/10.1145/1297231.1297236

49.

Ricci, F., Nguyen, Q.N.: Acquiring and revising preferences in a critique-based mobile recommender system. IEEE Intelligent Systems 22(3), 22–29 (2007). DOI http://dx.doi.org/10.1109/MIS.2007.43

50.

Rokach, L., Naamani, L., Shmilovici, A.: Pessimistic cost-sensitive active learning of decision trees for profit maximizing targeting campaigns. Data Mining and Knowledge Discovery 17(2), 283–316 (2008). DOI http://dx.doi.org/10.1007/s10618-008-0105-2

51.

Roy, N., Mccallum, A.: Toward optimal active learning through sampling estimation of error reduction. In: In Proc. 18th International Conf. on Machine Learning, pp. 441–448. Morgan Kaufmann (2001)

52.

Rubens, N., Sugiyama, M.: Influence-based collaborative active learning. In: Proceedings of the 2007 ACM conference on Recommender systems (RecSys 2007). ACM (2007). DOI http://doi.acm.org/10.1145/1297231.1297257

53.

Rubens, N., Tomioka, R., Sugiyama, M.: Output divergence criterion for active learning in collaborative settings. IPSJ Transactions on Mathematical Modeling and Its Applications 2(3), 87–96 (2009)

54.

Saar-Tsechansky, M., Provost, F.: Decision-centric active learning of binary-outcome models. Information Systems Research 18(1), 4–22 (2007). DOI http://dx.doi.org/10.1287/isre.1070.0111

55.

Schein, A.I., Popescul, A., Ungar, L.H., Pennock, D.M.: Methods and metrics for cold-start recommendations. In: SIGIR ’02: Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval, pp. 253–260. ACM, New York, NY, USA (2002). DOI http://doi.acm.org/10.1145/564376.564421

56.

Schohn, G., Cohn, D.: Less is more: Active learning with support vector machines. In: Proc. 17th International Conf. on Machine Learning, pp. 839–846. Morgan Kaufmann, San Francisco, CA (2000). URL citeseer.ist.psu.edu/schohn00less.html

57.

Settles, B.: Active learning literature survey. Computer Sciences Technical Report 1648, University of Wisconsin–Madison (2009)

58.

Settles, B., Craven, M.: An analysis of active learning strategies for sequence labeling tasks. In: Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 1069–1078. ACL Press (2008)

59.

Settles, B., Craven, M., Friedland, L.: Active learning with real annotation costs. In: Proceedings of the NIPS Workshop on Cost-Sensitive Learning, pp. 1–10 (2008)

60.

Settles, B., Craven, M., Ray, S.: Multiple-instance active learning. In: Advances in Neural Information Processing Systems (NIPS), vol. 20, pp. 1289–1296. MIT Press (2008)

61.

Seung, H.S., Opper, M., Sompolinsky, H.: Query by committee. In: Computational Learning Theory, pp. 287–294 (1992). URL citeseer.ist.psu.edu/seung92query.html

62.

Sugiyama, M.: Active learning in approximately linear regression based on conditional expectation of generalization error. Journal of Machine Learning Research 7, 141–166 (2006)MATHMathSciNet

63.

Sugiyama, M., Rubens, N.: A batch ensemble approach to active learning with model selection. Neural Netw. 21(9), 1278–1286 (2008). DOI http://dx.doi.org/10.1016/j.neunet.2008.06.004

64.

Sugiyama, M., Rubens, N., Müller, K.R.: Dataset Shift in Machine Learning, chap. A conditional expectation approach to model selection and active learning under covariate shift. MIT Press, Cambridge (2008)

65.

Sutherland, D.J., Póczos, B., Schneider, J.: Active learning and search on low-rank matrices. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD ’13, pp. 212–220. ACM, New York, NY, USA (2013). DOI 10.1145/2487575.2487627. URL http://doi.acm.org/10.1145/2487575.2487627

66.

Swearingen, K., Sinha, R.: Beyond algorithms: An hci perspective on recommender systems. ACM SIGIR 2001 Workshop on Recommender Systems (2001). URL http://citeseer.ist.psu.edu/cache/papers/cs/31330/http:zSzzSzweb.engr.oregonstate.eduzSz~herlockzSzrsw2001zSzfinalzSzfull_length_paperszSz4_swearingenzPz.pdf/swearingen01beyond.pdf

67.

Tong, S., Koller, D.: Support vector machine active learning with applications to text classification. In: P. Langley (ed.) Proceedings of ICML-00, 17th International Conference on Machine Learning, pp. 999–1006. Morgan Kaufmann Publishers, San Francisco, US, Stanford, US (2000). URL citeseer.ist.psu.edu/article/tong01support.html

68.

Yu, K., Bi, J., Tresp, V.: Active learning via transductive experimental design. In: Proceedings of the 23rd Int. Conference on Machine Learning ICML ’06, pp. 1081–1088. ACM, New York, NY, USA (2006). DOI http://doi.acm.org/10.1145/1143844.1143980

69.

Zhao, L., Pan, S.J., Xiang, E.W., Zhong, E., Lu, Z., Yang, Q.: Active transfer learning for cross-system recommendation. In: AAAI (2013)

70.

Zhao, X., Zhang, W., Wang, J.: Interactive collaborative filtering. In: Proceedings of the 22nd ACM international conference on Conference on information & knowledge management, CIKM ’13, pp. 1411–1420. ACM, New York, NY, USA (2013). DOI 10.1145/2505515.2505690. URL http://doi.acm.org/10.1145/2505515.2505690

Titel: Active Learning in Recommender Systems
verfasst von: Neil Rubens
Mehdi Elahi
Masashi Sugiyama
Dain Kaplan
Verlag: Springer US
Buch: Recommender Systems Handbook
Print ISBN: 978-1-4899-7636-9

Electronic ISBN: 978-1-4899-7637-6

Copyright-Jahr: 2015
DOI: https://doi.org/10.1007/978-1-4899-7637-6_24

Neuer Inhalt

Bildnachweise

VDI-Icon, Profil Icon, inhalt2, Springer Professional Modul/© Springer Fachmedien Wiesbaden GmbH, Nachhaltigkeitsaward Key Visual/© Cometis AG/Global ESG Monitor | Daniel Rupp | Generiert mit KI, Search Icon, Banner Hanser, Arbeitszeit/© granata68 / Fotolia, E-Autos im Fuhrpark: Lohnt sich das noch?/© Petair / stock.adobe.com, Kryptowährungen/© gopixa / Getty Images / iStock, Zeitschrift Wissensmanagement Cover, PatentFit-Logo/© Springer Fachmedien Wiesbaden GmbH, Sustainibility Finance/© Robert Kneschke / stock.adobe.com / Springer Fachmedien Wiesbaden GmbH, Zukunftswerkstatt Sales Excellence 2024/© AndreyPopov / Getty Images / iStock, 2023_Antrieb/© supervisuell

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Neuer Inhalt

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.