Skip to main content
Erschienen in: International Journal of Multimedia Information Retrieval 1/2023

01.06.2023 | Regular Paper

Multiple feedback based adversarial collaborative filtering with aesthetics

verfasst von: Zhefu Wu, Yuhang Ma, Junzhuo Cao, Agyemang Paul, Xiang Li

Erschienen in: International Journal of Multimedia Information Retrieval | Ausgabe 1/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Visual-aware personalized recommendation systems can estimate the potential demand by evaluating consumer personalized preferences. In general, consumer feedback data is deduced from either explicit feedback or implicit feedback. However, explicit and implicit feedback raises the chance of malicious operation or misoperation, which can lead to deviations in recommended outcomes. Adversarial learning, a regularization approach that can resist disturbances, could be a promising choice for enhancing model resilience. We propose a novel adversarial collaborative filtering with aesthetics (ACFA) for the visual recommendation that utilizes adversarial learning to improve resilience and performance in the case of perturbation. The ACFA algorithm applies three types of input to the visual Bayesian personalized ranking: negative, unobserved, and positive feedback. Through feedbacks at various levels, it uses a probabilistic approach to obtain consumer personalized preferences. Since in visual recommendation, the aesthetic data in determining consumer preferences on product is critical, we construct the consumer personalized preferences model with aesthetic elements, and then use them to enhance the sampling quality when training the algorithm. To mitigate the negative effects of feedback noise, We use minimax adversarial learning to learn the ACFA objective function. Experiments using two datasets demonstrate that the ACFA model outperforms state-of-the-art algorithms on two metrics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hu L, Cao J, Xu G et al (2013) Personalized recommendation via cross domain triadic factorization. In: Proceedings of international conference on world wide web, pp 595–606 Hu L, Cao J, Xu G et al (2013) Personalized recommendation via cross domain triadic factorization. In: Proceedings of international conference on world wide web, pp 595–606
2.
Zurück zum Zitat Deshpande M, Karypis G (2004) Item-based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef Deshpande M, Karypis G (2004) Item-based top-N recommendation algorithms. ACM Trans Inf Syst 22(1):143–177CrossRef
3.
Zurück zum Zitat Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434 Koren Y (2008) Factorization meets the neighborhood: a multifaceted collaborative filtering model. In: Proceedings of ACM SIGKDD international conference on knowledge discovery and data mining, pp 426–434
4.
Zurück zum Zitat Rendle S, Freudenthaler C, Gantner Z et al (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of uncertainty in artificial intelligence, pp 452–461 Rendle S, Freudenthaler C, Gantner Z et al (2009) BPR: Bayesian personalized ranking from implicit feedback. In: Proceedings of uncertainty in artificial intelligence, pp 452–461
5.
Zurück zum Zitat Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of IEEE international conference on data mining, pp 502–511 Pan R, Zhou Y, Cao B et al (2008) One-class collaborative filtering. In: Proceedings of IEEE international conference on data mining, pp 502–511
6.
Zurück zum Zitat Cao Z (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of machine learning, pp 129–136 Cao Z (2007) Learning to rank: from pairwise approach to listwise approach. In: Proceedings of machine learning, pp 129–136
7.
Zurück zum Zitat He R, McAuley J (2016) VBPR: visual bayesian personalized ranking from implicit feedback. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 144–150 He R, McAuley J (2016) VBPR: visual bayesian personalized ranking from implicit feedback. In: Proceedings of the thirtieth AAAI conference on artificial intelligence, pp 144–150
8.
Zurück zum Zitat Yu W, Zhang H, He X et al (2018) Aesthetic-based clothing recommendation. In: Proceedings of the 2018 world wide web conference on world wide web, pp 649–658 Yu W, Zhang H, He X et al (2018) Aesthetic-based clothing recommendation. In: Proceedings of the 2018 world wide web conference on world wide web, pp 649–658
9.
Zurück zum Zitat Tang J, Du X, He X, Yuan F, Tian Q, Chua TS (2020) Adversarial training towards robust multimedia recommender system. IEEE Trans Knowl Data Eng 32(5):855–867CrossRef Tang J, Du X, He X, Yuan F, Tian Q, Chua TS (2020) Adversarial training towards robust multimedia recommender system. IEEE Trans Knowl Data Eng 32(5):855–867CrossRef
10.
Zurück zum Zitat Yu DJ, Chen C, Wu JH et al (2018) Personalized game recommendation based on implicit feedback. Chin J Electron 27(4):2626–2632 Yu DJ, Chen C, Wu JH et al (2018) Personalized game recommendation based on implicit feedback. Chin J Electron 27(4):2626–2632
11.
Zurück zum Zitat Liu TY (2009) Learning to rank for information retrieval. Found Trends Inf Ret 3(3):225–331CrossRef Liu TY (2009) Learning to rank for information retrieval. Found Trends Inf Ret 3(3):225–331CrossRef
12.
Zurück zum Zitat Zhao T, McAuley J, King I (2014) Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of ACM international conference on information and knowledge management, pp 261–270 Zhao T, McAuley J, King I (2014) Leveraging social connections to improve personalized ranking for collaborative filtering. In: Proceedings of ACM international conference on information and knowledge management, pp 261–270
13.
Zurück zum Zitat Peugh JL, Enders CK (2004) Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev Educ Res 74(4):525–556CrossRef Peugh JL, Enders CK (2004) Missing data in educational research: a review of reporting practices and suggestions for improvement. Rev Educ Res 74(4):525–556CrossRef
14.
Zurück zum Zitat He X, Zhang H, Kan M Y et al (2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval, pp 549–558 He X, Zhang H, Kan M Y et al (2016) Fast matrix factorization for online recommendation with implicit feedback. In: Proceedings of the 39th international ACM SIGIR conference on research and development in information retrieval, pp 549–558
15.
Zurück zum Zitat Runlong Y, Yunzhou Z, Yuyang Y et al (2018) Multiple pairwise ranking with implicit feedback. In: Proceedings of ACM international conference on information and knowledge management, pp 1727–1730 Runlong Y, Yunzhou Z, Yuyang Y et al (2018) Multiple pairwise ranking with implicit feedback. In: Proceedings of ACM international conference on information and knowledge management, pp 1727–1730
16.
Zurück zum Zitat Loftin R, Peng B, MacGlashan J et al (2016) Learning behaviors via human-delivered discrete feedback: modeling implicit feedback strategies to speed up learning. Auton Agent Multi-Ag 30(1):30–59CrossRef Loftin R, Peng B, MacGlashan J et al (2016) Learning behaviors via human-delivered discrete feedback: modeling implicit feedback strategies to speed up learning. Auton Agent Multi-Ag 30(1):30–59CrossRef
17.
Zurück zum Zitat Chen X, Wang P F, Qin Z et al (2016) Hlbpr: a hybrid local Bayesian personal ranking method. In: Proceedings of international conference on world wide web, pp 21–22 Chen X, Wang P F, Qin Z et al (2016) Hlbpr: a hybrid local Bayesian personal ranking method. In: Proceedings of international conference on world wide web, pp 21–22
18.
Zurück zum Zitat Babak L, Roberto P, Martha L et al (2016) Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM conference on recommender systems, pp 361–364 Babak L, Roberto P, Martha L et al (2016) Bayesian personalized ranking with multi-channel user feedback. In: Proceedings of the 10th ACM conference on recommender systems, pp 361–364
19.
Zurück zum Zitat He R, Lin C, Wang J, Mcauley J (2016) Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3740–3746 He R, Lin C, Wang J, Mcauley J (2016) Sherlock: sparse hierarchical embeddings for visually-aware one-class collaborative filtering. In: Proceedings of the twenty-fifth international joint conference on artificial intelligence, pp 3740–3746
20.
Zurück zum Zitat He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of the 25th international conference on world wide web, pp 507–517 He R, McAuley J (2016) Ups and downs: modeling the visual evolution of fashion trends with one-class collaborative filtering. In: Proceedings of the 25th international conference on world wide web, pp 507–517
21.
Zurück zum Zitat Wu Z, Agyemang P, Chan M et al. (2017) Improved one-class collaborative filtering for online recommendation. In: International workshop on complex systems and networks (IWCSN), pp 205–209 Wu Z, Agyemang P, Chan M et al. (2017) Improved one-class collaborative filtering for online recommendation. In: International workshop on complex systems and networks (IWCSN), pp 205–209
22.
Zurück zum Zitat Niu W, Caverlee J, Lu H (2018) Neural personalized ranking for image recommendation. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 423–431 Niu W, Caverlee J, Lu H (2018) Neural personalized ranking for image recommendation. In: Proceedings of the eleventh ACM international conference on web search and data mining, pp 423–431
23.
Zurück zum Zitat Kang W C, Fang C, Wang Z, McAuley JJ (2017) Visually-aware fashion recommendation and design with generative image models. In: IEEE international conference on data mining, pp 207–216 Kang W C, Fang C, Wang Z, McAuley JJ (2017) Visually-aware fashion recommendation and design with generative image models. In: IEEE international conference on data mining, pp 207–216
24.
Zurück zum Zitat Liu Q, Wu S, Wang L (2017) DeepStyle: learning user preferences for visual recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 841–844 Liu Q, Wu S, Wang L (2017) DeepStyle: learning user preferences for visual recommendation. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 841–844
25.
Zurück zum Zitat Meng L, Feng F, He X et al. (2020) Heterogeneous fusion of semantic and collaborative information for visually-aware food recommendation. In: ACM multimedia, pp 3460–3468 Meng L, Feng F, He X et al. (2020) Heterogeneous fusion of semantic and collaborative information for visually-aware food recommendation. In: ACM multimedia, pp 3460–3468
26.
Zurück zum Zitat Chen J, Zhang H, He X et al (2017) Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In : Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 335-344 Chen J, Zhang H, He X et al (2017) Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In : Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 335-344
27.
Zurück zum Zitat Yin R, Li K, Lu J, Zhang G (2019) Enhancing fashion recommendation with visual compatibility relationship. In: The world wide web conference, pp 3434–3440 Yin R, Li K, Lu J, Zhang G (2019) Enhancing fashion recommendation with visual compatibility relationship. In: The world wide web conference, pp 3434–3440
29.
Zurück zum Zitat Anelli VW, Deldjoo Y, Noia TD et al. (2021) A study of defensive methods to protect visual recommendation against adversarial manipulation of images. In: SIGIR, pp 1094–1103 Anelli VW, Deldjoo Y, Noia TD et al. (2021) A study of defensive methods to protect visual recommendation against adversarial manipulation of images. In: SIGIR, pp 1094–1103
30.
Zurück zum Zitat Noia TD, Malitesta D, Merra FA (2020) TAaMR: targeted adversarial attack against multimedia recommender systems. In: 50th annual IEEE/IFIP international conference on dependable systems and networks workshops, pp 1–8 Noia TD, Malitesta D, Merra FA (2020) TAaMR: targeted adversarial attack against multimedia recommender systems. In: 50th annual IEEE/IFIP international conference on dependable systems and networks workshops, pp 1–8
31.
Zurück zum Zitat Cohen R, Shalom OS, Jannach D, Amir A (2021) A black-box attack model for visually-aware recommender systems. In: The fourteenth ACM international conference on web search and data mining, pp 94–102 Cohen R, Shalom OS, Jannach D, Amir A (2021) A black-box attack model for visually-aware recommender systems. In: The fourteenth ACM international conference on web search and data mining, pp 94–102
32.
Zurück zum Zitat Liu Z, Larson M (2021) Adversarial item promotion: vulnerabilities at the core of top-N recommenders that use images to address cold start. In: WWW.ACM/IW3C2, pp 3590–3602 Liu Z, Larson M (2021) Adversarial item promotion: vulnerabilities at the core of top-N recommenders that use images to address cold start. In: WWW.​ACM/​IW3C2, pp 3590–3602
Metadaten
Titel
Multiple feedback based adversarial collaborative filtering with aesthetics
verfasst von
Zhefu Wu
Yuhang Ma
Junzhuo Cao
Agyemang Paul
Xiang Li
Publikationsdatum
01.06.2023
Verlag
Springer London
Erschienen in
International Journal of Multimedia Information Retrieval / Ausgabe 1/2023
Print ISSN: 2192-6611
Elektronische ISSN: 2192-662X
DOI
https://doi.org/10.1007/s13735-023-00273-w

Weitere Artikel der Ausgabe 1/2023

International Journal of Multimedia Information Retrieval 1/2023 Zur Ausgabe

Premium Partner