Skip to main content
Erschienen in: Computing 10/2023

11.05.2023 | Regular Paper

A Docker-based federated learning framework design and deployment for multi-modal data stream classification

verfasst von: Arijit Nandi, Fatos Xhafa, Rohit Kumar

Erschienen in: Computing | Ausgabe 10/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the high-performance computing (HPC) domain, federated learning has gained immense popularity. Especially in emotional and physical health analytics and experimental facilities. Federated learning is one of the most promising distributed machine learning frameworks because it supports data privacy and security by not sharing the clients’ data but instead sharing their local models. In federated learning, many clients explicitly train their machine learning/deep learning models (local training) before aggregating them as a global model at the global server. However, the FL framework is difficult to build and deploy across multiple distributed clients due to its heterogeneous nature. We developed Docker-enabled federated learning (DFL) by utilizing client-agnostic technologies like Docker containers to simplify the deployment of FL frameworks for data stream processing on the heterogeneous client. In the DFL, the clients and global servers are written using TensorFlow and lightweight message queuing telemetry transport protocol to communicate between clients and global servers in the IoT environment. Furthermore, the DFL’s effectiveness, efficiency, and scalability are evaluated in the test case scenario where real-time emotion state classification is done from distributed multi-modal physiological data streams under various practical configurations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Shivadekar S, Mangalagiri J, Nguyen P, Chapman D, Halem M, Gite R (2021) An intelligent parallel distributed streaming framework for near real-time science sensors and high-resolution medical images. In: 50th international conference on parallel processing workshop. ICPP Workshops ’21. Association for computing machinery, New York, NY, USA. https://doi.org/10.1145/3458744.3474039 Shivadekar S, Mangalagiri J, Nguyen P, Chapman D, Halem M, Gite R (2021) An intelligent parallel distributed streaming framework for near real-time science sensors and high-resolution medical images. In: 50th international conference on parallel processing workshop. ICPP Workshops ’21. Association for computing machinery, New York, NY, USA. https://​doi.​org/​10.​1145/​3458744.​3474039
6.
Zurück zum Zitat McMahan B, Moore E, Ramage D, Hampson S, Arcas BAy (2017) Communication-efficient learning of deep networks from decentralized data. In: Singh A, Zhu J (eds.) Proceedings of the 20th international conference on artificial intelligence and statistics. Proceedings of machine learning research, vol 54, pp 1273–1282. https://proceedings.mlr.press/v54/mcmahan17a.html McMahan B, Moore E, Ramage D, Hampson S, Arcas BAy (2017) Communication-efficient learning of deep networks from decentralized data. In: Singh A, Zhu J (eds.) Proceedings of the 20th international conference on artificial intelligence and statistics. Proceedings of machine learning research, vol 54, pp 1273–1282. https://​proceedings.​mlr.​press/​v54/​mcmahan17a.​html
13.
Zurück zum Zitat Caldas S, Duddu SMK, Wu P, Li T, Konečnỳ J, McMahan HB, Smith V, Talwalkar A (2018) Leaf: a benchmark for federated settings. arXiv preprint arXiv:1812.01097 Caldas S, Duddu SMK, Wu P, Li T, Konečnỳ J, McMahan HB, Smith V, Talwalkar A (2018) Leaf: a benchmark for federated settings. arXiv preprint arXiv:​1812.​01097
15.
Zurück zum Zitat Ryffel T, Trask A, Dahl M, Wagner B, Mancuso J, Rueckert D, Passerat-Palmbach J (2018) A generic framework for privacy preserving deep learning. arXiv preprint arXiv:1811.04017 Ryffel T, Trask A, Dahl M, Wagner B, Mancuso J, Rueckert D, Passerat-Palmbach J (2018) A generic framework for privacy preserving deep learning. arXiv preprint arXiv:​1811.​04017
17.
Zurück zum Zitat Ma Y, Yu D, Wu T, Wang H (2019) Paddlepaddle: an open-source deep learning platform from industrial practice. Front Data Comput 1(1):105–115 Ma Y, Yu D, Wu T, Wang H (2019) Paddlepaddle: an open-source deep learning platform from industrial practice. Front Data Comput 1(1):105–115
19.
Zurück zum Zitat Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) Moa: Massive online analysis. J Mach Learn Res 11:1601–1604 Bifet A, Holmes G, Kirkby R, Pfahringer B (2010) Moa: Massive online analysis. J Mach Learn Res 11:1601–1604
20.
Zurück zum Zitat Gomes HM, Bifet A, Read J, Barddal JP, Enembreck F, Pfharinger B, Holmes G, Abdessalem T (2017) Adaptive random forests for evolving data stream classification. Mach Learn 106:1469–1495MathSciNetCrossRef Gomes HM, Bifet A, Read J, Barddal JP, Enembreck F, Pfharinger B, Holmes G, Abdessalem T (2017) Adaptive random forests for evolving data stream classification. Mach Learn 106:1469–1495MathSciNetCrossRef
21.
Zurück zum Zitat Kolter JZ, Maloof MA (2007) Dynamic weighted majority: an ensemble method for drifting concepts. J Mach Learn Res 8(91):2755–2790MATH Kolter JZ, Maloof MA (2007) Dynamic weighted majority: an ensemble method for drifting concepts. J Mach Learn Res 8(91):2755–2790MATH
25.
Zurück zum Zitat Haddadpour F, Kamani MM, Mokhtari A, Mahdavi M (2020) Federated learning with compression: unified analysis and sharp guarantees. arXiv preprint arXiv:2007.01154 Haddadpour F, Kamani MM, Mokhtari A, Mahdavi M (2020) Federated learning with compression: unified analysis and sharp guarantees. arXiv preprint arXiv:​2007.​01154
26.
Zurück zum Zitat He C, Li S, So J, Zhang M, Wang H, Wang X, Vepakomma P, Singh A, Qiu H, Shen L, Zhao P, Kang Y, Liu Y, Raskar R, Yang Q, Annavaram M, Avestimehr S (2020) Fedml: a research library and benchmark for federated machine learning. arXiv:2007.13518 He C, Li S, So J, Zhang M, Wang H, Wang X, Vepakomma P, Singh A, Qiu H, Shen L, Zhao P, Kang Y, Liu Y, Raskar R, Yang Q, Annavaram M, Avestimehr S (2020) Fedml: a research library and benchmark for federated machine learning. arXiv:​2007.​13518
31.
Zurück zum Zitat Ismail BI, Jagadisan D, Khalid MF (2011) Determining overhead, variance & isolation metrics in virtualization for iaas cloud. In: Lin SC, Yen E (eds) Data driven e-Science. Springer, New York, NY, pp 315–330CrossRef Ismail BI, Jagadisan D, Khalid MF (2011) Determining overhead, variance & isolation metrics in virtualization for iaas cloud. In: Lin SC, Yen E (eds) Data driven e-Science. Springer, New York, NY, pp 315–330CrossRef
33.
Zurück zum Zitat Nandi A, Xhafa F, Subirats L, Fort S (2021) Real-time multimodal emotion classification system in e-learning context. In: Proceedings of the 22nd engineering applications of neural networks conference, pp 423–435 Nandi A, Xhafa F, Subirats L, Fort S (2021) Real-time multimodal emotion classification system in e-learning context. In: Proceedings of the 22nd engineering applications of neural networks conference, pp 423–435
35.
Zurück zum Zitat Zhang Y, Jiang C, Yue B, Wan J, Guizani M (2022) Information fusion for edge intelligence: a survey. Inf Fusion 81:171–186CrossRef Zhang Y, Jiang C, Yue B, Wan J, Guizani M (2022) Information fusion for edge intelligence: a survey. Inf Fusion 81:171–186CrossRef
38.
Zurück zum Zitat Koelstra S, Muhl C, Soleymani M, Lee J-S, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2012) Deap: a database for emotion analysis;using physiological signals. IEEE Trans Affect Comput 3(1):18–31CrossRef Koelstra S, Muhl C, Soleymani M, Lee J-S, Yazdani A, Ebrahimi T, Pun T, Nijholt A, Patras I (2012) Deap: a database for emotion analysis;using physiological signals. IEEE Trans Affect Comput 3(1):18–31CrossRef
39.
Zurück zum Zitat Ayata D, Yaslan Y, Kamaşak M (2016) Emotion recognition via random forest and galvanic skin response: comparison of time based feature sets, window sizes and wavelet approaches. In: Medical technologies national congress, pp 1–4 Ayata D, Yaslan Y, Kamaşak M (2016) Emotion recognition via random forest and galvanic skin response: comparison of time based feature sets, window sizes and wavelet approaches. In: Medical technologies national congress, pp 1–4
40.
Zurück zum Zitat Candra H, Yuwono M, Chai R, Handojoseno A, Elamvazuthi I, Nguyen HT, Su S (2015) Investigation of window size in classification of EEg-emotion signal with wavelet entropy and support vector machine. In: 37th annual international conference of the IEEE EMBS, pp 7250–7253 Candra H, Yuwono M, Chai R, Handojoseno A, Elamvazuthi I, Nguyen HT, Su S (2015) Investigation of window size in classification of EEg-emotion signal with wavelet entropy and support vector machine. In: 37th annual international conference of the IEEE EMBS, pp 7250–7253
43.
Zurück zum Zitat Ayata D, Yaslan Y, Kamasak EM (2020) Emotion recognition from multimodal physiological signals for emotion aware healthcare systems. J Med Biol Eng 149–157 Ayata D, Yaslan Y, Kamasak EM (2020) Emotion recognition from multimodal physiological signals for emotion aware healthcare systems. J Med Biol Eng 149–157
Metadaten
Titel
A Docker-based federated learning framework design and deployment for multi-modal data stream classification
verfasst von
Arijit Nandi
Fatos Xhafa
Rohit Kumar
Publikationsdatum
11.05.2023
Verlag
Springer Vienna
Erschienen in
Computing / Ausgabe 10/2023
Print ISSN: 0010-485X
Elektronische ISSN: 1436-5057
DOI
https://doi.org/10.1007/s00607-023-01179-5

Weitere Artikel der Ausgabe 10/2023

Computing 10/2023 Zur Ausgabe

Premium Partner