Skip to main content
Erschienen in: Neural Computing and Applications 15/2021

15.02.2021 | Original Article

AutoFM: an efficient factorization machine model via probabilistic auto-encoders

verfasst von: Tianlin Huang, Lvqing Bi, Ning Wang, Defu Zhang

Erschienen in: Neural Computing and Applications | Ausgabe 15/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Studies show that conventional factorization machines (FMs) have low performance in capturing both local and global structures of user–item correlation simultaneously. Recently, deep neural networks (DNNs) have been applied to improve FMs. However, DNNs increase the complexity of the training process. Moreover, DNN-based FMs ignore the integration of neighborhood-based approaches. An efficient method called factorization machine model via probabilistic auto-encoders (AutoFM) is proposed to resolve this issue in the present study. The proposed AutoFM can extract non-trivial and local structures characteristics from user–user/item–item co-occurrence pairs by integrating a low-complexity probabilistic auto-encoder. Furthermore, it supports both explicit and implicit feedback datasets. Extensive experiments on four real-world datasets demonstrate the effectiveness of the proposed method. The results show that the AutoFM outperforms the current state-of-the-art methods in rating prediction tasks. Compared with the DNN-based FM models, the proposed AutoFM model improves the item ranking at least 1.16%\(\sim\) 4.37%.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Ebesu T, Shen B, Fang Y (2018) Collaborative memory network for recommendation systems. In: The 41st International ACM SIGIR Conference on research and development in information retrieval, pp 515–524 Ebesu T, Shen B, Fang Y (2018) Collaborative memory network for recommendation systems. In: The 41st International ACM SIGIR Conference on research and development in information retrieval, pp 515–524
2.
Zurück zum Zitat Rendle S (2010) Factorization machines, in: 2010 IEEE International conference on data mining. IEEE, pp 995–1000 Rendle S (2010) Factorization machines, in: 2010 IEEE International conference on data mining. IEEE, pp 995–1000
3.
Zurück zum Zitat Rendle S (2012) Factorization machines with libfm. Acm Trans Intell Syst Technol 3(3):1–22CrossRef Rendle S (2012) Factorization machines with libfm. Acm Trans Intell Syst Technol 3(3):1–22CrossRef
4.
Zurück zum Zitat Koren Y (2008) Factorization meets the neighborhood: A multifaceted collaborative filtering model. In: ACM SIGKDD International Conference on knowledge discovery and data mining, pp 426–434 Koren Y (2008) Factorization meets the neighborhood: A multifaceted collaborative filtering model. In: ACM SIGKDD International Conference on knowledge discovery and data mining, pp 426–434
5.
Zurück zum Zitat Koren Y (2010) Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Trans Knowl Discov Data 4(1):1–24CrossRef Koren Y (2010) Factor in the neighbors: Scalable and accurate collaborative filtering. ACM Trans Knowl Discov Data 4(1):1–24CrossRef
6.
Zurück zum Zitat He X, Chua T-S (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 355–364 He X, Chua T-S (2017) Neural factorization machines for sparse predictive analytics. In: Proceedings of the 40th international ACM SIGIR conference on research and development in information retrieval, pp 355–364
7.
Zurück zum Zitat Liu C, Zhang T, Zhao P, Zhou J, Sun J (2017) Locally linear factorization machines. In: Proceedings of the 26th International joint conference on artificial intelligence, pp 2294–2300 Liu C, Zhang T, Zhao P, Zhou J, Sun J (2017) Locally linear factorization machines. In: Proceedings of the 26th International joint conference on artificial intelligence, pp 2294–2300
8.
Zurück zum Zitat Guo H, Tang R, Ye Y, Li Z, He X (2017) DeepFM: a factorization-machine based neural network for CTR prediction. arXiv preprint. arXiv:1703.04247 Guo H, Tang R, Ye Y, Li Z, He X (2017) DeepFM: a factorization-machine based neural network for CTR prediction. arXiv preprint. arXiv:​1703.​04247
10.
Zurück zum Zitat Zhuang F, Zhang Z, Qian M, Shi C, Xie X, He Q (2017) Representation learning via dual-autoencoder for recommendation. Neural Netw 90:83–89CrossRef Zhuang F, Zhang Z, Qian M, Shi C, Xie X, He Q (2017) Representation learning via dual-autoencoder for recommendation. Neural Netw 90:83–89CrossRef
11.
Zurück zum Zitat Huang T, Zhang D, Bi L (2020) Neural embedding collaborative filtering for recommender systems. Neural Comput Appl 32(22):17043–17057CrossRef Huang T, Zhang D, Bi L (2020) Neural embedding collaborative filtering for recommender systems. Neural Comput Appl 32(22):17043–17057CrossRef
12.
Zurück zum Zitat Zhang S, Yao L, Tay Y, Xu X, Zhang X, Zhu L (2018) Metric factorization: recommendation beyond matrix factorization. arXiv preprint. arXiv:1802.04606 Zhang S, Yao L, Tay Y, Xu X, Zhang X, Zhu L (2018) Metric factorization: recommendation beyond matrix factorization. arXiv preprint. arXiv:​1802.​04606
13.
Zurück zum Zitat Mikolov T, Sutskever I, Kai C, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Proc Syst 26:3111–3119 Mikolov T, Sutskever I, Kai C, Corrado G, Dean J (2013) Distributed representations of words and phrases and their compositionality. Adv Neural Inf Proc Syst 26:3111–3119
14.
16.
Zurück zum Zitat Barkan O, Koenigstein N (2016) Item2vec: neural item embedding for collaborative filtering. In: Machine learning for signal processing (MLSP), 2016 IEEE 26th international workshop on, IEEE, pp 1–6 Barkan O, Koenigstein N (2016) Item2vec: neural item embedding for collaborative filtering. In: Machine learning for signal processing (MLSP), 2016 IEEE 26th international workshop on, IEEE, pp 1–6
17.
Zurück zum Zitat Liang D, Altosaar J, Charlin L, Blei DM (2016) Factorization meets the item embedding: Regularizing matrix factorization with item co-occurrence. In: Proceedings of the 10th ACM conference on recommender systems, pp 59–66 Liang D, Altosaar J, Charlin L, Blei DM (2016) Factorization meets the item embedding: Regularizing matrix factorization with item co-occurrence. In: Proceedings of the 10th ACM conference on recommender systems, pp 59–66
18.
Zurück zum Zitat Liang H, Baldwin T (2015) A probabilistic rating auto-encoder for personalized recommender systems. In: Proceedings of the 24th ACM International on conference on information and knowledge management, pp 1863–1866 Liang H, Baldwin T (2015) A probabilistic rating auto-encoder for personalized recommender systems. In: Proceedings of the 24th ACM International on conference on information and knowledge management, pp 1863–1866
19.
Zurück zum Zitat Rendle S, Gantner Z, Freudenthaler C, Schmidt-Thieme L (2011) Fast context-aware recommendations with factorization machines. In: Proceedings of the 34th international ACM SIGIR conference on research and development in Information Retrieval, pp 635–644 Rendle S, Gantner Z, Freudenthaler C, Schmidt-Thieme L (2011) Fast context-aware recommendations with factorization machines. In: Proceedings of the 34th international ACM SIGIR conference on research and development in Information Retrieval, pp 635–644
20.
Zurück zum Zitat Baltrunas L, Church K, Karatzoglou A, Oliver N, Frappe: Understanding the usage and perception of mobile app recommendations in-the-wild, arXiv preprint arXiv:1505.03014 Baltrunas L, Church K, Karatzoglou A, Oliver N, Frappe: Understanding the usage and perception of mobile app recommendations in-the-wild, arXiv preprint arXiv:​1505.​03014
21.
Zurück zum Zitat Mingdang Tang ZZ, Zhang Tingting (2018) Qos-aware web service recommendation based on factorization machines. Chin J Comput 41(6):114–127 Mingdang Tang ZZ, Zhang Tingting (2018) Qos-aware web service recommendation based on factorization machines. Chin J Comput 41(6):114–127
22.
Zurück zum Zitat Da C, He X, Nie L, Wei X, Chua TS (2017) Cross-platform app recommendation by jointly modeling ratings and texts. Acm Trans Inf Syst 35(4):1–27 Da C, He X, Nie L, Wei X, Chua TS (2017) Cross-platform app recommendation by jointly modeling ratings and texts. Acm Trans Inf Syst 35(4):1–27
23.
Zurück zum Zitat Oentaryo RJ, Lim EP, Low JW, Lo D, Finegold M (2014) Predicting response in mobile advertising with hierarchical importance-aware factorization machine. In: Acm International conference on web search and data mining Oentaryo RJ, Lim EP, Low JW, Lo D, Finegold M (2014) Predicting response in mobile advertising with hierarchical importance-aware factorization machine. In: Acm International conference on web search and data mining
24.
Zurück zum Zitat Salakhutdinov R, Mnih A, Hinton G (2007) Restricted boltzmann machines for collaborative filtering. In: Proceedings of the 24th international conference on machine learning, pp 791–798 Salakhutdinov R, Mnih A, Hinton G (2007) Restricted boltzmann machines for collaborative filtering. In: Proceedings of the 24th international conference on machine learning, pp 791–798
25.
Zurück zum Zitat Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) Llorma: Local low-rank matrix approximation. J Mach Learn Res 17(1):442–465MathSciNetMATH Lee J, Kim S, Lebanon G, Singer Y, Bengio S (2016) Llorma: Local low-rank matrix approximation. J Mach Learn Res 17(1):442–465MathSciNetMATH
26.
Zurück zum Zitat Sedhain S, Menon AK, Sanner S, Xie L (2015) Autorec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on World Wide Web, pp 111–112 Sedhain S, Menon AK, Sanner S, Xie L (2015) Autorec: Autoencoders meet collaborative filtering. In: Proceedings of the 24th international conference on World Wide Web, pp 111–112
28.
Zurück zum Zitat Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. J Mach Learn Res 15(1):1929–1958MathSciNetMATH
29.
Zurück zum Zitat Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp 285–295 Sarwar B, Karypis G, Konstan J, Riedl J (2001) Item-based collaborative filtering recommendation algorithms. In: Proceedings of the 10th international conference on World Wide Web, pp 285–295
31.
Zurück zum Zitat Ricci F, Rokach L, Shapira B (2011) Introduction to recommender systems handbook. In: Recommender systems handbook. Springer, Boston, MA, pp 1–35 Ricci F, Rokach L, Shapira B (2011) Introduction to recommender systems handbook. In: Recommender systems handbook. Springer, Boston, MA, pp 1–35
32.
Zurück zum Zitat Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 659–667 Kabbur S, Ning X, Karypis G (2013) Fism: factored item similarity models for top-n recommender systems. In: Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining, pp 659–667
33.
Zurück zum Zitat He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering, in: Proceedings of the 26th international conference on world wide web, pp 173–182 He X, Liao L, Zhang H, Nie L, Hu X, Chua T-S (2017) Neural collaborative filtering, in: Proceedings of the 26th international conference on world wide web, pp 173–182
34.
Zurück zum Zitat Haijun Zhang, Yanfang Sun, Mingbo Zhao, Tommy WSC and, Bridging user interest to item content for recommender systems: an optimization model., IEEE transactions on cybernetics Haijun Zhang, Yanfang Sun, Mingbo Zhao, Tommy WSC and, Bridging user interest to item content for recommender systems: an optimization model., IEEE transactions on cybernetics
35.
Zurück zum Zitat Aslanian E, Radmanesh M, Jalili M (2016) Hybrid recommender systems based on content feature relationship. IEEE transactions on industrial informatics 1–1 Aslanian E, Radmanesh M, Jalili M (2016) Hybrid recommender systems based on content feature relationship. IEEE transactions on industrial informatics 1–1
36.
Zurück zum Zitat Castells P, Wang J, Lara R, Zhang D (2014) Introduction to the special issue on diversity and discovery in recommender systems. ACM Trans Intell Syst Technol 5(4):1–3 Castells P, Wang J, Lara R, Zhang D (2014) Introduction to the special issue on diversity and discovery in recommender systems. ACM Trans Intell Syst Technol 5(4):1–3
37.
Zurück zum Zitat Clarke CL, Kolla M, Cormack GV, Vechtomova O, Ashkan A, Büttcher S, MacKinnon I (2008) Novelty and diversity in information retrieval evaluation. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval, pp 659–666 Clarke CL, Kolla M, Cormack GV, Vechtomova O, Ashkan A, Büttcher S, MacKinnon I (2008) Novelty and diversity in information retrieval evaluation. In: Proceedings of the 31st annual international ACM SIGIR conference on research and development in information retrieval, pp 659–666
Metadaten
Titel
AutoFM: an efficient factorization machine model via probabilistic auto-encoders
verfasst von
Tianlin Huang
Lvqing Bi
Ning Wang
Defu Zhang
Publikationsdatum
15.02.2021
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 15/2021
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-021-05705-4

Weitere Artikel der Ausgabe 15/2021

Neural Computing and Applications 15/2021 Zur Ausgabe