Skip to main content
Top

2019 | OriginalPaper | Chapter

RDFM: Resilient Distributed Factorization Machines

Authors : André Rodrigo da Silva, Leonardo M. Rodrigues, Luciana de Oliveira Rech, Aldelir Fernando Luiz

Published in: Artificial Intelligence and Soft Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Factorization Machines algorithms have been successfully applied to recommender systems due to their ability to handle data sparsity and the cold-start problem. Their scalability makes it suitable to produce evergrowing complex predictive models, which are based on Big Data without performance degradation. The algorithm has been scaled to contexts of distributed and parallel computation, but in general with the strong assumption that those environments are safe and are not subject to arbitrary errors, malicious attacks, and hardware failures. In this work, we show that a distributed average consensus strategy is capable to deal with unsafe and dynamic learning environments.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Blanchard, P., Guerraoui, R., Stainer, J., et al.: Machine learning with adversaries: Byzantine tolerant gradient descent. In: Advances in Neural Information Processing Systems. pp. 119–129 (2017) Blanchard, P., Guerraoui, R., Stainer, J., et al.: Machine learning with adversaries: Byzantine tolerant gradient descent. In: Advances in Neural Information Processing Systems. pp. 119–129 (2017)
3.
go back to reference Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research 12(Jul), 2121–2159 (2011) Duchi, J., Hazan, E., Singer, Y.: Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research 12(Jul), 2121–2159 (2011)
4.
go back to reference Flouri, K., Beferull-Lozano, B., Tsakalides, P.: Distributed consensus algorithms for svm training in wireless sensor networks. In: Signal Processing Conference, 2008 16th European. pp. 1–5. IEEE (2008) Flouri, K., Beferull-Lozano, B., Tsakalides, P.: Distributed consensus algorithms for svm training in wireless sensor networks. In: Signal Processing Conference, 2008 16th European. pp. 1–5. IEEE (2008)
5.
go back to reference Harper, F.M., Konstan, J.A.: The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5(4), 19 (2016) Harper, F.M., Konstan, J.A.: The movielens datasets: History and context. Acm transactions on interactive intelligent systems (tiis) 5(4), 19 (2016)
6.
go back to reference Knoll, J., Stübinger, J., Grottke, M.: Exploiting social media with higher-order factorization machines: Statistical arbitrage on high-frequency data of the s&p 500. Tech. rep., FAU Discussion Papers in Economics (2017) Knoll, J., Stübinger, J., Grottke, M.: Exploiting social media with higher-order factorization machines: Statistical arbitrage on high-frequency data of the s&p 500. Tech. rep., FAU Discussion Papers in Economics (2017)
7.
go back to reference Lamport, L., Shostak, R., Pease, M.: The Byzantine Generals Problem. ACM Transactions on Programming Languages and Systems 4(3), 382–401 (1982)CrossRef Lamport, L., Shostak, R., Pease, M.: The Byzantine Generals Problem. ACM Transactions on Programming Languages and Systems 4(3), 382–401 (1982)CrossRef
8.
go back to reference Li, M., Liu, Z., Smola, A.J., Wang, Y.X.: Difacto: Distributed factorization machines. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. pp. 377–386. ACM (2016) Li, M., Liu, Z., Smola, A.J., Wang, Y.X.: Difacto: Distributed factorization machines. In: Proceedings of the Ninth ACM International Conference on Web Search and Data Mining. pp. 377–386. ACM (2016)
9.
go back to reference Prillo, S.: An elementary view on factorization machines. In: Proceedings of the Eleventh ACM Conference on Recommender Systems. pp. 179–183. ACM (2017) Prillo, S.: An elementary view on factorization machines. In: Proceedings of the Eleventh ACM Conference on Recommender Systems. pp. 179–183. ACM (2017)
10.
go back to reference Qiang, R., Liang, F., Yang, J.: Exploiting ranking factorization machines for microblog retrieval. In: Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. pp. 1783–1788. ACM (2013) Qiang, R., Liang, F., Yang, J.: Exploiting ranking factorization machines for microblog retrieval. In: Proceedings of the 22nd ACM international conference on Conference on information & knowledge management. pp. 1783–1788. ACM (2013)
11.
go back to reference Rendle, S.: Factorization machines. In: Data Mining (ICDM), 2010 IEEE 10th International Conference on. pp. 995–1000. IEEE (2010) Rendle, S.: Factorization machines. In: Data Mining (ICDM), 2010 IEEE 10th International Conference on. pp. 995–1000. IEEE (2010)
12.
go back to reference Rendle, S.: Social network and click-through prediction with factorization machines. In: KDD-Cup Workshop (2012) Rendle, S.: Social network and click-through prediction with factorization machines. In: KDD-Cup Workshop (2012)
13.
go back to reference Thai-Nghe, N., Drumond, L., Horváth, T., Schmidt-Thieme, L.: Using factorization machines for student modeling Thai-Nghe, N., Drumond, L., Horváth, T., Schmidt-Thieme, L.: Using factorization machines for student modeling
14.
go back to reference Xiao, L., Boyd, S., Kim, S.J.: Distributed average consensus with least-mean-square deviation. Journal of parallel and distributed computing 67(1), 33–46 (2007)CrossRef Xiao, L., Boyd, S., Kim, S.J.: Distributed average consensus with least-mean-square deviation. Journal of parallel and distributed computing 67(1), 33–46 (2007)CrossRef
15.
go back to reference Yamada, M., Lian, W., Goyal, A., Chen, J., Wimalawarne, K., Khan, S.A., Kaski, S., Mamitsuka, H., Chang, Y.: Convex factorization machine for toxicogenomics prediction. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. pp. 1215–1224. ACM (2017) Yamada, M., Lian, W., Goyal, A., Chen, J., Wimalawarne, K., Khan, S.A., Kaski, S., Mamitsuka, H., Chang, Y.: Convex factorization machine for toxicogenomics prediction. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. pp. 1215–1224. ACM (2017)
16.
go back to reference Yang, Z., Bajwa, W.U.: Rd-svm: A resilient distributed support vector machine. In: ICASSP. pp. 2444–2448 (2016) Yang, Z., Bajwa, W.U.: Rd-svm: A resilient distributed support vector machine. In: ICASSP. pp. 2444–2448 (2016)
Metadata
Title
RDFM: Resilient Distributed Factorization Machines
Authors
André Rodrigo da Silva
Leonardo M. Rodrigues
Luciana de Oliveira Rech
Aldelir Fernando Luiz
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-20915-5_52

Premium Partner