Skip to main content
Top
Published in: Neural Computing and Applications 14/2024

19-02-2024 | Original Article

Performance evaluation of cluster-based federated machine learning

Authors: Karim Asif Sattar, Uthman Baroudi

Published in: Neural Computing and Applications | Issue 14/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Federated Learning (FL) is a collaborative training method for machine learning (ML) that aggregates model weights from multiple participants during the training phase. The learning phase of machine learning techniques is distributed, in which each participating device trains a model using its local data set and sends model weights to a centralized node. The central node aggregates weights and sends the updated weights back to devices. The process continues until a specific threshold is reached such accuracy, response time. In this paper, we present a performance evaluation of FL in a clustering-based multi-hop network to simulate the effect of the dynamic environment on the accuracy of the global model. It is observed that a minimum number of participating nodes is required within a cluster to maintain a high level of global accuracy. A global threshold value needs to be defined to maintain high global accuracy and avoid degradation of model performance.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Pyle D, San José C (2015) An executive’s guide to machine learning. McKinsey Q 3:44–53 Pyle D, San José C (2015) An executive’s guide to machine learning. McKinsey Q 3:44–53
2.
go back to reference .Bhardwaj R, Nambiar AR, Dutta D (2017) A study of machine learning in healthcare. In 2017 IEEE 41st annual computer software and applications conference (COMPSAC), vol 2, pp 236–241 .Bhardwaj R, Nambiar AR, Dutta D (2017) A study of machine learning in healthcare. In 2017 IEEE 41st annual computer software and applications conference (COMPSAC), vol 2, pp 236–241
3.
go back to reference Shah N, Engineer S, Bhagat N, Chauhan H, Shah M (2020) Research trends on the usage of machine learning and artificial intelligence in advertising. Augment Hum Res 5(1):1–15CrossRef Shah N, Engineer S, Bhagat N, Chauhan H, Shah M (2020) Research trends on the usage of machine learning and artificial intelligence in advertising. Augment Hum Res 5(1):1–15CrossRef
4.
go back to reference . Gourisaria MK, Agrawal R, Harshvardhan GM, Pandey M, and Rautaray SS (2021) Application of machine learning in industry 4.0. In: Machine learning: theoretical foundations and practical applications, Springer, pp. 57–87 . Gourisaria MK, Agrawal R, Harshvardhan GM, Pandey M, and Rautaray SS (2021) Application of machine learning in industry 4.0. In: Machine learning: theoretical foundations and practical applications, Springer, pp. 57–87
5.
go back to reference Agrawal A, Gans J, Goldfarb A (2020) How to win with machine learning. Harv Bus Rev Agrawal A, Gans J, Goldfarb A (2020) How to win with machine learning. Harv Bus Rev
8.
go back to reference Aledhari M, Razzak R, Parizi RM, Saeed F (2020) Federated learning: a survey on enabling technologies, protocols, and applications. IEEE Access 8:140699–140725CrossRef Aledhari M, Razzak R, Parizi RM, Saeed F (2020) Federated learning: a survey on enabling technologies, protocols, and applications. IEEE Access 8:140699–140725CrossRef
10.
go back to reference Sheller MJ et al (2020) Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci Rep 10(1):1–12CrossRef Sheller MJ et al (2020) Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Sci Rep 10(1):1–12CrossRef
11.
go back to reference Du Z, Wu C, Yoshinaga T, Yau K-LA, Ji Y, Li J (2020) Federated learning for vehicular internet of things: recent advances and open issues. IEEE Open J Comput Soc 1:45–61CrossRef Du Z, Wu C, Yoshinaga T, Yau K-LA, Ji Y, Li J (2020) Federated learning for vehicular internet of things: recent advances and open issues. IEEE Open J Comput Soc 1:45–61CrossRef
12.
go back to reference Malandrino F, Chiasserini CF (2021) Federated learning at the network edge: when not all nodes are created equal. IEEE Commun Mag 59(7):68–73CrossRef Malandrino F, Chiasserini CF (2021) Federated learning at the network edge: when not all nodes are created equal. IEEE Commun Mag 59(7):68–73CrossRef
14.
go back to reference Singhal K, Sidahmed H, Garrett Z, Wu S, Rush J, Prakash S (2021) Federated reconstruction: partially local federated learning. Adv Neural Inf Process Syst 34:11220–11232 Singhal K, Sidahmed H, Garrett Z, Wu S, Rush J, Prakash S (2021) Federated reconstruction: partially local federated learning. Adv Neural Inf Process Syst 34:11220–11232
16.
go back to reference Yang Q, Liu Y, Chen T, Tong Y (2019) Federated machine learning: concept and applications. ACM Trans Intell Syst Technol (TIST) 10(2):1–19CrossRef Yang Q, Liu Y, Chen T, Tong Y (2019) Federated machine learning: concept and applications. ACM Trans Intell Syst Technol (TIST) 10(2):1–19CrossRef
17.
go back to reference Liang B (2015) A discrete-event simulation tool for resource constrained networks. Rensselaer Polytechnic Institute, Troy Liang B (2015) A discrete-event simulation tool for resource constrained networks. Rensselaer Polytechnic Institute, Troy
18.
go back to reference Caldas S, Konečny J, McMahan HB, Talwalkar A (2018) Expanding the reach of federated learning by reducing client resource requirements. arXiv preprint arXiv:1812.07210 Caldas S, Konečny J, McMahan HB, Talwalkar A (2018) Expanding the reach of federated learning by reducing client resource requirements. arXiv preprint arXiv:​1812.​07210
19.
go back to reference Wen D, Jeon K-J, Huang K (2022) Federated dropout—a simple approach for enabling federated learning on resource constrained devices. IEEE Wirel Commun Lett 11(5):923–927CrossRef Wen D, Jeon K-J, Huang K (2022) Federated dropout—a simple approach for enabling federated learning on resource constrained devices. IEEE Wirel Commun Lett 11(5):923–927CrossRef
21.
go back to reference Ouyang X, Xie Z, Zhou J, Huang J, Xing G (2021) Clusterfl: a similarity-aware federated learning system for human activity recognition. In: Proceedings of the 19th annual international conference on mobile systems, applications, and services, pp 54–66 Ouyang X, Xie Z, Zhou J, Huang J, Xing G (2021) Clusterfl: a similarity-aware federated learning system for human activity recognition. In: Proceedings of the 19th annual international conference on mobile systems, applications, and services, pp 54–66
23.
go back to reference Rawat P, Chauhan S (2022) A novel cluster head selection and data aggregation protocol for heterogeneous wireless sensor network. Arab J Sci Eng 47(2):1971–1986CrossRef Rawat P, Chauhan S (2022) A novel cluster head selection and data aggregation protocol for heterogeneous wireless sensor network. Arab J Sci Eng 47(2):1971–1986CrossRef
24.
go back to reference Kang SH, Nguyen T (2012) Distance based thresholds for cluster head selection in wireless sensor networks. IEEE Commun Lett 16(9):1396–1399CrossRef Kang SH, Nguyen T (2012) Distance based thresholds for cluster head selection in wireless sensor networks. IEEE Commun Lett 16(9):1396–1399CrossRef
25.
go back to reference Rawat P, Chauhan S (2021) Clustering protocols in wireless sensor network: a survey, classification, issues, and future directions. Comput Sci Rev 40:100396MathSciNetCrossRef Rawat P, Chauhan S (2021) Clustering protocols in wireless sensor network: a survey, classification, issues, and future directions. Comput Sci Rev 40:100396MathSciNetCrossRef
26.
go back to reference El Khediri S (2022) Wireless sensor networks: a survey, categorization, main issues, and future orientations for clustering protocols. Computing 104(8):1775–1837MathSciNetCrossRef El Khediri S (2022) Wireless sensor networks: a survey, categorization, main issues, and future orientations for clustering protocols. Computing 104(8):1775–1837MathSciNetCrossRef
27.
go back to reference Bhandari S, Wang X, Lee R (2020) Mobility and location-aware stable clustering scheme for UAV networks. IEEE Access 8:106364–106372CrossRef Bhandari S, Wang X, Lee R (2020) Mobility and location-aware stable clustering scheme for UAV networks. IEEE Access 8:106364–106372CrossRef
28.
go back to reference Hussein AH, Salem AOA, Yousef S (2008) A flexible weighted clustering algorithm based on battery power for mobile ad hoc networks. In: IEEE international symposium on industrial electronics, pp 2102 2107 Hussein AH, Salem AOA, Yousef S (2008) A flexible weighted clustering algorithm based on battery power for mobile ad hoc networks. In: IEEE international symposium on industrial electronics, pp 2102 2107
29.
go back to reference Sarkar A, Senthil Murugan T (2019) Cluster head selection for energy efficient and delay-less routing in wireless sensor network. Wirel Netw 25(1):303–320CrossRef Sarkar A, Senthil Murugan T (2019) Cluster head selection for energy efficient and delay-less routing in wireless sensor network. Wirel Netw 25(1):303–320CrossRef
30.
go back to reference Wu M, Zhang Z. (2010) Handwritten digit classification using the mnist data set. Course project CSE802: pattern classification & analysis Wu M, Zhang Z. (2010) Handwritten digit classification using the mnist data set. Course project CSE802: pattern classification & analysis
32.
go back to reference Singh VK, Paulus R, Agrawal A, Agrawal N (2018) Simulation based analysis of AODV routing protocol in Ad Hoc network under different mobility and propagation loss models using NS-3. Int J Comput Appl 975:8887 Singh VK, Paulus R, Agrawal A, Agrawal N (2018) Simulation based analysis of AODV routing protocol in Ad Hoc network under different mobility and propagation loss models using NS-3. Int J Comput Appl 975:8887
34.
go back to reference N. Ketkar (2017) Introduction to keras. In: Deep learning with python, Springer, pp 97–111 N. Ketkar (2017) Introduction to keras. In: Deep learning with python, Springer, pp 97–111
35.
go back to reference Nayak R, Manohar N (2021) Computer-vision based face mask detection using CNN. In: 2021 6th international conference on communication and electronics systems (ICCES), pp 1780–1786. Nayak R, Manohar N (2021) Computer-vision based face mask detection using CNN. In: 2021 6th international conference on communication and electronics systems (ICCES), pp 1780–1786.
36.
go back to reference Perkins C, Belding-Royer E, Das S (2003) RFC3561: Ad hoc on-demand distance vector (AODV) routing. RFC editor Perkins C, Belding-Royer E, Das S (2003) RFC3561: Ad hoc on-demand distance vector (AODV) routing. RFC editor
37.
go back to reference He G (2002) Destination-sequenced distance vector (DSDV) protocol. Netw Lab Helsinki Univ Technol 135:1–9 He G (2002) Destination-sequenced distance vector (DSDV) protocol. Netw Lab Helsinki Univ Technol 135:1–9
38.
go back to reference Clausen T, Jacquet P (2003) Optimized link state routing protocol (OLSR) Clausen T, Jacquet P (2003) Optimized link state routing protocol (OLSR)
Metadata
Title
Performance evaluation of cluster-based federated machine learning
Authors
Karim Asif Sattar
Uthman Baroudi
Publication date
19-02-2024
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 14/2024
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-024-09487-3

Other articles of this Issue 14/2024

Neural Computing and Applications 14/2024 Go to the issue

Premium Partner