Skip to main content
Top
Published in: The Journal of Supercomputing 14/2023

18-04-2023

Reliable federated learning in a cloud-fog-IoT environment

Authors: Mradula Sharma, Parmeet Kaur

Published in: The Journal of Supercomputing | Issue 14/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The paper presents RelFL, a Reliable Federated Learning system for collaborative and decentralized training of a deep learning model in a cloud-fog-Internet of Things (IoT) environment. Data generated by IoT devices is used at fog nodes for locally train a global deep learning model received from a cloud server. Further, a subset of reliable fog nodes is selected as the dominating set (DS) to act as local aggregators (LAs). A LA is responsible for aggregating its own locally trained model’s weights with the weights shared by non-LA nodes in its vicinity. The locally aggregated weights are transferred by the LAs to the cloud server for updating the global model. The updated global model is then pushed back to the LAs, which transfer this model to non-LA nodes to start the next round of training. The selection of reliable fog nodes as LAs alleviates the risk of losing model updates due to fog nodes’ failures. Results show that RelFL outperforms FedAvg, a widely established FL method, and its variant, FedProx in the presence of fog nodes’ failures. RelFL also achieves the results of a centralized convolutional neural network (CNN) while preserving data privacy.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference AbdulRahman S, Tout H, Ould-Slimane H, Mourad A, Talhi C, Guizani M (2020) A survey on federated learning: the journey from centralized to distributed on-site learning and beyond. IEEE Internet Things J 8(7):5476–5497CrossRef AbdulRahman S, Tout H, Ould-Slimane H, Mourad A, Talhi C, Guizani M (2020) A survey on federated learning: the journey from centralized to distributed on-site learning and beyond. IEEE Internet Things J 8(7):5476–5497CrossRef
3.
go back to reference Yang Q, Liu Y, Cheng Y, Kang Y, Chen T, Yu H (2019) Federated learning. Synth Lect Artif Intell Mach Learn 13(3):1–207 Yang Q, Liu Y, Cheng Y, Kang Y, Chen T, Yu H (2019) Federated learning. Synth Lect Artif Intell Mach Learn 13(3):1–207
4.
go back to reference Hard A, Kanishka R, Rajiv M, Ramaswamy S, Beaufays F, Augenstein S, Eichner H, Kiddon C, Ramage D (2018) Federated learning for mobile keyboard prediction. arXiv preprint arXiv:1811.03604 Hard A, Kanishka R, Rajiv M, Ramaswamy S, Beaufays F, Augenstein S, Eichner H, Kiddon C, Ramage D (2018) Federated learning for mobile keyboard prediction. arXiv preprint arXiv:​1811.​03604
5.
go back to reference McMahan B, Moore E, Ramage D, Hampson S, Arcas BA (2017). Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. pp. 1273–1282. PMLR McMahan B, Moore E, Ramage D, Hampson S, Arcas BA (2017). Communication-efficient learning of deep networks from decentralized data. In: Artificial intelligence and statistics. pp. 1273–1282. PMLR
6.
go back to reference Sang N, Salcic Z, Zhang X (2018) Big data processing in fog-smart parking case study. In: 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom), pp. 127–134. IEEE, 2018 Sang N, Salcic Z, Zhang X (2018) Big data processing in fog-smart parking case study. In: 2018 IEEE Intl Conf on Parallel & Distributed Processing with Applications, Ubiquitous Computing & Communications, Big Data & Cloud Computing, Social Computing & Networking, Sustainable Computing & Communications (ISPA/IUCC/BDCloud/SocialCom/SustainCom), pp. 127–134. IEEE, 2018
7.
go back to reference Lalle Y, Fourati M, Fourati LC, Barraca JPA. Hierarchical clustering federated learning-based blockchain scheme for privacy-preserving in water demand prediction. Available at SSRN 4108575 Lalle Y, Fourati M, Fourati LC, Barraca JPA. Hierarchical clustering federated learning-based blockchain scheme for privacy-preserving in water demand prediction. Available at SSRN 4108575
9.
go back to reference Saleem A, Khan A, Malik SUR, Pervaiz H, Malik H, Alam M, Jindal A (2019) FESDA: fog-enabled secure data aggregation in smart grid IoT network. IEEE Internet Things J 7(7):6132–6142CrossRef Saleem A, Khan A, Malik SUR, Pervaiz H, Malik H, Alam M, Jindal A (2019) FESDA: fog-enabled secure data aggregation in smart grid IoT network. IEEE Internet Things J 7(7):6132–6142CrossRef
10.
go back to reference Kaur P (2022) Fault tolerant data offloading in opportunistic fog enhanced IoT architecture. Multiagent Grid Syst 18(2):107–118MathSciNetCrossRef Kaur P (2022) Fault tolerant data offloading in opportunistic fog enhanced IoT architecture. Multiagent Grid Syst 18(2):107–118MathSciNetCrossRef
11.
go back to reference Dubey K, Sharma SC, Kumar M (2022) A secure IoT applications allocation framework for integrated fog-cloud environment. J Grid Comput 20(1):1–23CrossRef Dubey K, Sharma SC, Kumar M (2022) A secure IoT applications allocation framework for integrated fog-cloud environment. J Grid Comput 20(1):1–23CrossRef
12.
go back to reference Puliafito C, Mingozzi E, Longo F, Puliafito A, Rana O (2019) Fog computing for the internet of things: a survey. ACM Trans Internet Technol (TOIT) 19(2):1–41CrossRef Puliafito C, Mingozzi E, Longo F, Puliafito A, Rana O (2019) Fog computing for the internet of things: a survey. ACM Trans Internet Technol (TOIT) 19(2):1–41CrossRef
14.
go back to reference Saha R, Misra S, Deb PK (2020) FogFL: fog-assisted federated learning for resource-constrained IoT devices. IEEE Internet Things J 8(10):8456–8463CrossRef Saha R, Misra S, Deb PK (2020) FogFL: fog-assisted federated learning for resource-constrained IoT devices. IEEE Internet Things J 8(10):8456–8463CrossRef
15.
go back to reference Liu L, Zhang J, Song SH, Letaief KB (2020) Client-edge-cloud hierarchical federated learning. In: ICC 2020–2020 IEEE International Conference on Communications (ICC), pp 1–6. IEEE, 2020 Liu L, Zhang J, Song SH, Letaief KB (2020) Client-edge-cloud hierarchical federated learning. In: ICC 2020–2020 IEEE International Conference on Communications (ICC), pp 1–6. IEEE, 2020
16.
go back to reference Mathur A, Beutel DJ, de Gusmão PPB, Fernandez-Marques J, Topal T, Qiu X, Parcollet T, Gao Y, Lane ND (2021) On-device federated learning with flower. arXiv preprint arXiv:2104.03042 Mathur A, Beutel DJ, de Gusmão PPB, Fernandez-Marques J, Topal T, Qiu X, Parcollet T, Gao Y, Lane ND (2021) On-device federated learning with flower. arXiv preprint arXiv:​2104.​03042
17.
go back to reference LlisterriGiménez N, Grau MM, PueyoCentelles R, Freitag F (2022) On-device training of machine learning models on microcontrollers with federated learning. Electronics 11(4):573CrossRef LlisterriGiménez N, Grau MM, PueyoCentelles R, Freitag F (2022) On-device training of machine learning models on microcontrollers with federated learning. Electronics 11(4):573CrossRef
18.
go back to reference Li C, Li G, Varshney PK (2021) Decentralized federated learning via mutual knowledge transfer. IEEE Internet Things J 9(2):1136–1147CrossRef Li C, Li G, Varshney PK (2021) Decentralized federated learning via mutual knowledge transfer. IEEE Internet Things J 9(2):1136–1147CrossRef
19.
go back to reference Wang H, Wang L (2022) FedKG: Model-Optimized Federated Learning for Local Client Training with Non-IID Private Data. In: 2021 Ninth International Conference on Advanced Cloud and Big Data (CBD). pp 51–57. IEEE Wang H, Wang L (2022) FedKG: Model-Optimized Federated Learning for Local Client Training with Non-IID Private Data. In: 2021 Ninth International Conference on Advanced Cloud and Big Data (CBD). pp 51–57. IEEE
20.
go back to reference Huang W, Ye M, Du B (2022) Learn from others and be yourself in heterogeneous federated learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10143–10153 Huang W, Ye M, Du B (2022) Learn from others and be yourself in heterogeneous federated learning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 10143–10153
21.
go back to reference Charles Z, Konecny J (2021) Convergence and accuracy trade-offs in federated learning ` and meta-learning. In International Conference on Artificial Intelligence and Statistics, pages 2575–2583. PMLR, 2021 Charles Z, Konecny J (2021) Convergence and accuracy trade-offs in federated learning ` and meta-learning. In International Conference on Artificial Intelligence and Statistics, pages 2575–2583. PMLR, 2021
22.
go back to reference Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2018) On the convergence of federated optimization in heterogeneous networks. arXiv preprint arXiv:1812.06127 Li T, Sahu AK, Zaheer M, Sanjabi M, Talwalkar A, Smith V (2018) On the convergence of federated optimization in heterogeneous networks. arXiv preprint arXiv:​1812.​06127
23.
go back to reference Karimireddy SP, Kale S, Mohri M, Reddi S, Stich S, Suresh AT (2020) Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning. pp 5132–5143 Karimireddy SP, Kale S, Mohri M, Reddi S, Stich S, Suresh AT (2020) Scaffold: Stochastic controlled averaging for federated learning. In International Conference on Machine Learning. pp 5132–5143
24.
25.
go back to reference Wang J, Liu Q, Liang H, Joshi G, Vincent Poor H (2020) Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv Neural Inf Process Syst 33:7611–7623 Wang J, Liu Q, Liang H, Joshi G, Vincent Poor H (2020) Tackling the objective inconsistency problem in heterogeneous federated optimization. Adv Neural Inf Process Syst 33:7611–7623
26.
go back to reference Mitra A, Jaafar R, Pappas GJ, Hassani H (2021) Linear convergence in federated learning: tackling client heterogeneity and sparse gradients. Adv Neural Inf Process Syst 34:14606–14619 Mitra A, Jaafar R, Pappas GJ, Hassani H (2021) Linear convergence in federated learning: tackling client heterogeneity and sparse gradients. Adv Neural Inf Process Syst 34:14606–14619
27.
go back to reference Bayılmış C, Ali Ebleme M, Çavuşoğlu Ü, Küçük K, Sevin A (2022) A survey on communication protocols and performance evaluations for Internet of Things. Digit Commun Netw 8(6):1094–1104CrossRef Bayılmış C, Ali Ebleme M, Çavuşoğlu Ü, Küçük K, Sevin A (2022) A survey on communication protocols and performance evaluations for Internet of Things. Digit Commun Netw 8(6):1094–1104CrossRef
28.
go back to reference Mu B, Bakiras S (2013) Private proximity detection for convex polygons. In: Proceedings of the 12th International ACM Workshop on Data Engineering for Wireless and Mobile Acess. pp. 36–43 Mu B, Bakiras S (2013) Private proximity detection for convex polygons. In: Proceedings of the 12th International ACM Workshop on Data Engineering for Wireless and Mobile Acess. pp. 36–43
29.
go back to reference Bonawitz K, Eichner H, Grieskamp W, Huba D, Ingerman A, Ivanov V, Kiddon C et al. (2019) Towards federated learning at scale: System design.In: Proceedings of Machine Learning and Systems, 1: 374–388 Bonawitz K, Eichner H, Grieskamp W, Huba D, Ingerman A, Ivanov V, Kiddon C et al. (2019) Towards federated learning at scale: System design.In: Proceedings of Machine Learning and Systems, 1: 374–388
30.
go back to reference Pereira P, Araujo J, Melo C, Santos V, Maciel P (2021) Analytical models for availability evaluation of edge and fog computing nodes. J Supercomput 77(9):9905–9933CrossRef Pereira P, Araujo J, Melo C, Santos V, Maciel P (2021) Analytical models for availability evaluation of edge and fog computing nodes. J Supercomput 77(9):9905–9933CrossRef
31.
go back to reference Sharareh A, Futuhi E, Karimi S (2020) On distributed algorithms for minimum dominating set problem, from theory to application. arXiv preprint arXiv:2012.04883 Sharareh A, Futuhi E, Karimi S (2020) On distributed algorithms for minimum dominating set problem, from theory to application. arXiv preprint arXiv:​2012.​04883
32.
go back to reference Deng L (2012) The mnist database of handwritten digit images for machine learning research. IEEE Signal Process Mag 29(6):141–142CrossRef Deng L (2012) The mnist database of handwritten digit images for machine learning research. IEEE Signal Process Mag 29(6):141–142CrossRef
33.
go back to reference Shoham N, Avidor T, Keren A, Israel N, Benditkis D, Mor-Yosef L, Zeitak I (2019) Overcoming forgetting in federated learning on non-iid data. arXiv preprint arXiv:1910.07796 Shoham N, Avidor T, Keren A, Israel N, Benditkis D, Mor-Yosef L, Zeitak I (2019) Overcoming forgetting in federated learning on non-iid data. arXiv preprint arXiv:​1910.​07796
34.
go back to reference Westby I, Yang X, Liu T, Xu H (2021) FPGA acceleration on a multi-layer perceptron neural network for digit recognition. J Supercomput 77(12):14356–14373CrossRef Westby I, Yang X, Liu T, Xu H (2021) FPGA acceleration on a multi-layer perceptron neural network for digit recognition. J Supercomput 77(12):14356–14373CrossRef
Metadata
Title
Reliable federated learning in a cloud-fog-IoT environment
Authors
Mradula Sharma
Parmeet Kaur
Publication date
18-04-2023
Publisher
Springer US
Published in
The Journal of Supercomputing / Issue 14/2023
Print ISSN: 0920-8542
Electronic ISSN: 1573-0484
DOI
https://doi.org/10.1007/s11227-023-05252-w

Other articles of this Issue 14/2023

The Journal of Supercomputing 14/2023 Go to the issue

Premium Partner