Skip to main content

2021 | OriginalPaper | Buchkapitel

Causality-Aware Neighborhood Methods for Recommender Systems

verfasst von : Masahiro Sato, Janmajay Singh, Sho Takemori, Qian Zhang

Erschienen in: Advances in Information Retrieval

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The business objectives of recommenders, such as increasing sales, are aligned with the causal effect of recommendations. Previous recommenders targeting for the causal effect employ the inverse propensity scoring (IPS) in causal inference. However, IPS is prone to suffer from high variance. The matching estimator is another representative method in causal inference field. It does not use propensity and hence free from the above variance problem. In this work, we unify traditional neighborhood recommendation methods with the matching estimator, and develop robust ranking methods for the causal effect of recommendations. Our experiments demonstrate that the proposed methods outperform various baselines in ranking metrics for the causal effect. The results suggest that the proposed methods can achieve more sales and user engagement than previous recommenders.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
If we focus on ATE or ATT, as often the case in causal inference, the random noise is not a severe problem since it disappears by taking average of large samples. It becomes a problem when we want to rank items by the estimates for each item.
 
2
Note that the deployed recommender is different from recommenders that we train and evaluate from \(\{Y_{ui}\}\) and \(\{Z_{ui}\}\), hence we might not have control over previous recommendation logs. In experiment section, we also investigate how different conditions of previous recommendations affect the proposed recommenders.
 
3
The latter two taken together are called the stable unit treatment value assumption (SUTVA).
 
4
The codes and chosen hyper parameters for each method are available as ancillary files at http://​arxiv.​org/​abs/​2012.​09442.
 
Literatur
2.
Zurück zum Zitat Agarwal, A., Takatsu, K., Zaitsev, I., Joachims, T.: A general framework for counterfactual learning-to-rank. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, pp. 5–14. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3331184.3331202 Agarwal, A., Takatsu, K., Zaitsev, I., Joachims, T.: A general framework for counterfactual learning-to-rank. In: Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2019, pp. 5–14. Association for Computing Machinery, New York (2019). https://​doi.​org/​10.​1145/​3331184.​3331202
3.
Zurück zum Zitat Bilgic, M., Mooney, R.J.: Explaining recommendations: satisfaction vs. promotion. In: Beyond Personalization Workshop, IUI, vol. 5, p. 153 (2005) Bilgic, M., Mooney, R.J.: Explaining recommendations: satisfaction vs. promotion. In: Beyond Personalization Workshop, IUI, vol. 5, p. 153 (2005)
4.
Zurück zum Zitat Bodapati, A.V.: Recommendation systems with purchase data. J. Mark. Res. 45(1), 77–93 (2008)CrossRef Bodapati, A.V.: Recommendation systems with purchase data. J. Mark. Res. 45(1), 77–93 (2008)CrossRef
6.
Zurück zum Zitat Bottou, L., et al.: Counterfactual reasoning and learning systems: the example of computational advertising. J. Mach. Learn. Res. 14(1), 3207–3260 (2013)MathSciNetMATH Bottou, L., et al.: Counterfactual reasoning and learning systems: the example of computational advertising. J. Mach. Learn. Res. 14(1), 3207–3260 (2013)MathSciNetMATH
7.
Zurück zum Zitat Dacrema, M.F., Cremonesi, P., Jannach, D.: Are we really making much progress? a worrying analysis of recent neural recommendation approaches. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 101–109. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3298689.3347058 Dacrema, M.F., Cremonesi, P., Jannach, D.: Are we really making much progress? a worrying analysis of recent neural recommendation approaches. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 101–109. Association for Computing Machinery, New York (2019). https://​doi.​org/​10.​1145/​3298689.​3347058
8.
Zurück zum Zitat Devriendt, F., Moldovan, D., Verbeke, W.: A literature survey and experimental evaluation of the state-of-the-art in uplift modeling: a stepping stone toward the development of prescriptive analytics. Big Data 6(1), 13–41 (2018)CrossRef Devriendt, F., Moldovan, D., Verbeke, W.: A literature survey and experimental evaluation of the state-of-the-art in uplift modeling: a stepping stone toward the development of prescriptive analytics. Big Data 6(1), 13–41 (2018)CrossRef
9.
Zurück zum Zitat Fouss, F., Pirotte, A., Renders, J.M., Saerens, M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369 (2007)CrossRef Fouss, F., Pirotte, A., Renders, J.M., Saerens, M.: Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE Trans. Knowl. Data Eng. 19(3), 355–369 (2007)CrossRef
11.
Zurück zum Zitat Hernán, M., Robins, J.: Causal Inference: What If. Chapman & Hill/CRC, Boca Raton (2020) Hernán, M., Robins, J.: Causal Inference: What If. Chapman & Hill/CRC, Boca Raton (2020)
13.
Zurück zum Zitat Hudgens, M.G., Halloran, M.E.: Toward causal inference with interference. J. Am. Stat. Assoc. 103(482), 832–842 (2008)MathSciNetCrossRef Hudgens, M.G., Halloran, M.E.: Toward causal inference with interference. J. Am. Stat. Assoc. 103(482), 832–842 (2008)MathSciNetCrossRef
14.
Zurück zum Zitat Imbens, G.W., Rubin, D.B.: Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press, New York (2015)CrossRef Imbens, G.W., Rubin, D.B.: Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction. Cambridge University Press, New York (2015)CrossRef
16.
Zurück zum Zitat Jaskowski, M., Jaroszewicz, S.: Uplift modeling for clinical trial data. In: ICML Workshop on Clinical Data Analysis (2012) Jaskowski, M., Jaroszewicz, S.: Uplift modeling for clinical trial data. In: ICML Workshop on Clinical Data Analysis (2012)
18.
Zurück zum Zitat Joachims, T., Swaminathan, A., Schnabel, T.: Unbiased learning-to-rank with biased feedback. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, pp. 781–789. Association for Computing Machinery, New York (2017). https://doi.org/10.1145/3018661.3018699 Joachims, T., Swaminathan, A., Schnabel, T.: Unbiased learning-to-rank with biased feedback. In: Proceedings of the Tenth ACM International Conference on Web Search and Data Mining, WSDM 2017, pp. 781–789. Association for Computing Machinery, New York (2017). https://​doi.​org/​10.​1145/​3018661.​3018699
19.
Zurück zum Zitat Johansson, F.D., Shalit, U., Sontag, D.: Learning representations for counterfactual inference. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML 2016, vol. 48, pp. 3020–3029. JMLR.org (2016) Johansson, F.D., Shalit, U., Sontag, D.: Learning representations for counterfactual inference. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML 2016, vol. 48, pp. 3020–3029. JMLR.org (2016)
20.
Zurück zum Zitat Johnson, C.C.: Logistic matrix factorization for implicit feedback data. Adv. Neural. Inf. Process. Syst. 27, 1–9 (2014) Johnson, C.C.: Logistic matrix factorization for implicit feedback data. Adv. Neural. Inf. Process. Syst. 27, 1–9 (2014)
21.
Zurück zum Zitat Kabbur, S., Ning, X., Karypis, G.: FISM: factored item similarity models for top-N recommender systems. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013, pp. 659–667. Association for Computing Machinery, New York (2013). https://doi.org/10.1145/2487575.2487589 Kabbur, S., Ning, X., Karypis, G.: FISM: factored item similarity models for top-N recommender systems. In: Proceedings of the 19th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, KDD 2013, pp. 659–667. Association for Computing Machinery, New York (2013). https://​doi.​org/​10.​1145/​2487575.​2487589
22.
Zurück zum Zitat Kane, K., Lo, V.S., Zheng, J.: Mining for the truly responsive customers and prospects using true-lift modeling: comparison of new and existing methods. J. Mark. Anal. 2(4), 218–238 (2014)CrossRef Kane, K., Lo, V.S., Zheng, J.: Mining for the truly responsive customers and prospects using true-lift modeling: comparison of new and existing methods. J. Mark. Anal. 2(4), 218–238 (2014)CrossRef
24.
Zurück zum Zitat Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)CrossRef Koren, Y., Bell, R., Volinsky, C.: Matrix factorization techniques for recommender systems. Computer 8, 30–37 (2009)CrossRef
25.
Zurück zum Zitat Liang, D., Charlin, L., McInerney, J., Blei, D.M.: Modeling user exposure in recommendation. In: Proceedings of the 25th International Conference on World Wide Web, WWW 2016, pp. 951–961 (2016) Liang, D., Charlin, L., McInerney, J., Blei, D.M.: Modeling user exposure in recommendation. In: Proceedings of the 25th International Conference on World Wide Web, WWW 2016, pp. 951–961 (2016)
26.
Zurück zum Zitat Ludewig, M., Mauro, N., Latifi, S., Jannach, D.: Performance comparison of neural and non-neural approaches to session-based recommendation. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 462–466. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3298689.3347041 Ludewig, M., Mauro, N., Latifi, S., Jannach, D.: Performance comparison of neural and non-neural approaches to session-based recommendation. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 462–466. Association for Computing Machinery, New York (2019). https://​doi.​org/​10.​1145/​3298689.​3347041
27.
Zurück zum Zitat Lunceford, J.K., Davidian, M.: Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Stat. Med. 23(19), 2937–2960 (2004)CrossRef Lunceford, J.K., Davidian, M.: Stratification and weighting via the propensity score in estimation of causal treatment effects: a comparative study. Stat. Med. 23(19), 2937–2960 (2004)CrossRef
28.
Zurück zum Zitat Luo, H., Niu, C., Shen, R., Ullrich, C.: A collaborative filtering framework based on both local user similarity and global user similarity. Mach. Learn. 72(3), 231–245 (2008)CrossRef Luo, H., Niu, C., Shen, R., Ullrich, C.: A collaborative filtering framework based on both local user similarity and global user similarity. Mach. Learn. 72(3), 231–245 (2008)CrossRef
30.
Zurück zum Zitat Ning, X., Karypis, G.: SLIM: sparse linear methods for top-N recommender systems. In: 2011 IEEE 11th International Conference on Data Mining, pp. 497–506. IEEE (2011) Ning, X., Karypis, G.: SLIM: sparse linear methods for top-N recommender systems. In: 2011 IEEE 11th International Conference on Data Mining, pp. 497–506. IEEE (2011)
31.
Zurück zum Zitat Oosterhuis, H., Jagerman, R., de Rijke, M.: Unbiased learning to rank: counterfactual and online approaches. In: Companion Proceedings of the Web Conference 2020, WWW 2020, pp. 299–300. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3366424.3383107 Oosterhuis, H., Jagerman, R., de Rijke, M.: Unbiased learning to rank: counterfactual and online approaches. In: Companion Proceedings of the Web Conference 2020, WWW 2020, pp. 299–300. Association for Computing Machinery, New York (2020). https://​doi.​org/​10.​1145/​3366424.​3383107
32.
Zurück zum Zitat Radcliffe, N.J., Surry, P.D.: Real-world uplift modelling with significance-based uplift trees. White Paper TR-2011-1, Stochastic Solutions (2011) Radcliffe, N.J., Surry, P.D.: Real-world uplift modelling with significance-based uplift trees. White Paper TR-2011-1, Stochastic Solutions (2011)
33.
Zurück zum Zitat Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI 2009, pp. 452–461. AUAI Press, Arlington (2009) Rendle, S., Freudenthaler, C., Gantner, Z., Schmidt-Thieme, L.: BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of the Twenty-Fifth Conference on Uncertainty in Artificial Intelligence, UAI 2009, pp. 452–461. AUAI Press, Arlington (2009)
34.
Zurück zum Zitat Rubin, D.B.: Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol. 66(5), 688 (1974)CrossRef Rubin, D.B.: Estimating causal effects of treatments in randomized and nonrandomized studies. J. Educ. Psychol. 66(5), 688 (1974)CrossRef
35.
36.
Zurück zum Zitat Saito, Y., Yaginuma, S., Nishino, Y., Sakata, H., Nakata, K.: Unbiased recommender learning from missing-not-at-random implicit feedback. In: Proceedings of the 13th International Conference on Web Search and Data Mining, WSDM 2020, pp. 501–509. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3336191.3371783 Saito, Y., Yaginuma, S., Nishino, Y., Sakata, H., Nakata, K.: Unbiased recommender learning from missing-not-at-random implicit feedback. In: Proceedings of the 13th International Conference on Web Search and Data Mining, WSDM 2020, pp. 501–509. Association for Computing Machinery, New York (2020). https://​doi.​org/​10.​1145/​3336191.​3371783
37.
Zurück zum Zitat Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web, WWW 2001, pp. 285–295. Association for Computing Machinery, New York (2001). https://doi.org/10.1145/371920.372071 Sarwar, B., Karypis, G., Konstan, J., Riedl, J.: Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th International Conference on World Wide Web, WWW 2001, pp. 285–295. Association for Computing Machinery, New York (2001). https://​doi.​org/​10.​1145/​371920.​372071
38.
Zurück zum Zitat Sato, M., Izumo, H., Sonoda, T.: Modeling individual users’ responsiveness to maximize recommendation impact. In: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization, UMAP 2016, pp. 259–267. ACM, New York (2016). https://doi.org/10.1145/2930238.2930259 Sato, M., Izumo, H., Sonoda, T.: Modeling individual users’ responsiveness to maximize recommendation impact. In: Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization, UMAP 2016, pp. 259–267. ACM, New York (2016). https://​doi.​org/​10.​1145/​2930238.​2930259
39.
Zurück zum Zitat Sato, M., Singh, J., Takemori, S., Sonoda, T., Zhang, Q., Ohkuma, T.: Uplift-based evaluation and optimization of recommenders. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 296–304. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3298689.3347018 Sato, M., Singh, J., Takemori, S., Sonoda, T., Zhang, Q., Ohkuma, T.: Uplift-based evaluation and optimization of recommenders. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 296–304. Association for Computing Machinery, New York (2019). https://​doi.​org/​10.​1145/​3298689.​3347018
40.
Zurück zum Zitat Sato, M., Takemori, S., Singh, J., Ohkuma, T.: Unbiased learning for the causal effect of recommendation. In: Fourteenth ACM Conference on Recommender Systems, RecSys 2020, pp. 378–387. Association for Computing Machinery, New York (2020). https://doi.org/10.1145/3383313.3412261 Sato, M., Takemori, S., Singh, J., Ohkuma, T.: Unbiased learning for the causal effect of recommendation. In: Fourteenth ACM Conference on Recommender Systems, RecSys 2020, pp. 378–387. Association for Computing Machinery, New York (2020). https://​doi.​org/​10.​1145/​3383313.​3412261
41.
Zurück zum Zitat Schnabel, T., Swaminathan, A., Singh, A., Chandak, N., Joachims, T.: Recommendations as treatments: debiasing learning and evaluation. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML 2016, vol. 48. pp. 1670–1679. JMLR.org (2016) Schnabel, T., Swaminathan, A., Singh, A., Chandak, N., Joachims, T.: Recommendations as treatments: debiasing learning and evaluation. In: Proceedings of the 33rd International Conference on International Conference on Machine Learning, ICML 2016, vol. 48. pp. 1670–1679. JMLR.org (2016)
42.
Zurück zum Zitat Shardanand, U., Maes, P.: Social information filtering: algorithms for automating “word of mouth”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1995, pp. 210–217. ACM Press/Addison-Wesley Publishing Co., New York (1995). https://doi.org/10.1145/223904.223931 Shardanand, U., Maes, P.: Social information filtering: algorithms for automating “word of mouth”. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, CHI 1995, pp. 210–217. ACM Press/Addison-Wesley Publishing Co., New York (1995). https://​doi.​org/​10.​1145/​223904.​223931
43.
Zurück zum Zitat Sharma, A., Hofman, J.M., Watts, D.J.: Estimating the causal impact of recommendation systems from observational data. In: Proceedings of the Sixteenth ACM Conference on Economics and Computation, EC 2015, pp. 453–470. ACM, New York (2015). https://doi.org/10.1145/2764468.2764488 Sharma, A., Hofman, J.M., Watts, D.J.: Estimating the causal impact of recommendation systems from observational data. In: Proceedings of the Sixteenth ACM Conference on Economics and Computation, EC 2015, pp. 453–470. ACM, New York (2015). https://​doi.​org/​10.​1145/​2764468.​2764488
46.
Zurück zum Zitat Tintarev, N., Masthoff, J.: Over- and underestimation in different product domains. In: Ghallab, M., Spyropoulos, C., Fakotakis, N., Avouris, N. (eds.) Workshop on Recommender Systems, 18th European Conference on Artificial Intelligence (ECAI 2008), 21–25 July 2008. IOS Press (2008) Tintarev, N., Masthoff, J.: Over- and underestimation in different product domains. In: Ghallab, M., Spyropoulos, C., Fakotakis, N., Avouris, N. (eds.) Workshop on Recommender Systems, 18th European Conference on Artificial Intelligence (ECAI 2008), 21–25 July 2008. IOS Press (2008)
48.
Zurück zum Zitat Torkamaan, H., Barbu, C.M., Ziegler, J.: How can they know that? a study of factors affecting the creepiness of recommendations. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 423–427. Association for Computing Machinery, New York (2019). https://doi.org/10.1145/3298689.3346982 Torkamaan, H., Barbu, C.M., Ziegler, J.: How can they know that? a study of factors affecting the creepiness of recommendations. In: Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, pp. 423–427. Association for Computing Machinery, New York (2019). https://​doi.​org/​10.​1145/​3298689.​3346982
49.
Zurück zum Zitat Tyler, J.V., Miguel, A.H., et al.: Causal inference under multiple versions of treatment. J. Causal Inference 1(1), 1–20 (2013)CrossRef Tyler, J.V., Miguel, A.H., et al.: Causal inference under multiple versions of treatment. J. Causal Inference 1(1), 1–20 (2013)CrossRef
50.
Zurück zum Zitat Wang, X., Zhang, R., Sun, Y., Qi, J.: Doubly robust joint learning for recommendation on data missing not at random. In: Chaudhuri, K., Salakhutdinov, R. (eds.) Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 97, pp. 6638–6647. PMLR, Long Beach, 09–15 June 2019. http://proceedings.mlr.press/v97/wang19n.html Wang, X., Zhang, R., Sun, Y., Qi, J.: Doubly robust joint learning for recommendation on data missing not at random. In: Chaudhuri, K., Salakhutdinov, R. (eds.) Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, vol. 97, pp. 6638–6647. PMLR, Long Beach, 09–15 June 2019. http://​proceedings.​mlr.​press/​v97/​wang19n.​html
51.
Zurück zum Zitat Wang, X., Bendersky, M., Metzler, D., Najork, M.: Learning to rank with selection bias in personal search. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2016, pp. 115–124. Association for Computing Machinery, New York (2016). https://doi.org/10.1145/2911451.2911537 Wang, X., Bendersky, M., Metzler, D., Najork, M.: Learning to rank with selection bias in personal search. In: Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2016, pp. 115–124. Association for Computing Machinery, New York (2016). https://​doi.​org/​10.​1145/​2911451.​2911537
52.
Metadaten
Titel
Causality-Aware Neighborhood Methods for Recommender Systems
verfasst von
Masahiro Sato
Janmajay Singh
Sho Takemori
Qian Zhang
Copyright-Jahr
2021
DOI
https://doi.org/10.1007/978-3-030-72113-8_40