Top

Wireless Personal Communications

Published in:

10-03-2022

Survey on Federated-Learning Approaches in Distributed Environment

Authors: Ruchi Gupta, Tanweer Alam

Published in: Wireless Personal Communications | Issue 2/2022

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Federated-Learning (FL), a new paradigm in the machine-learning approach, wherein the clients train the global model collaboratively across various computational distributed units. The participants of the FL-networks performs communication with the centralized server without the exchange of sample data. This mechanism permits the users to obtain the richer global model performing training upon the larger data points. In this study, various researches of federated learning in distributed environment have been analysed. The Federated-learning framework model is implemented in centralized, decentralized and heterogeneous approach. Further, the privacy of the data collaborations and maintenance of secured framework in FL is focused. Differential-privacy technique is highly concentrated in various researches as the standardized method for mitigating those privacy risks. In some FL models, such as DRL-Deep reinforcement learning model is evolved for assisting the edge computing in a distributed environment, are highly focused in various studies. FedGRU-algorithm for traffic-flow prediction, non-IID, non-balanced, sparse and distributed attributes of federated-optimization is also analysed. The federated-learning framework contributes to obtain the global model in distributed systems handling heterogeneous resources in certain researches. The latter section of the paper demonstrates the critical analysis of the study, and the parameters relying upon the federated learning model were analysed.

previous article Optimal Scheme for the Detection and Classification of Clone Node Attack in WSN Using TAIGBRFCNIA

next article Marine Propeller Design Using Evolving Chaotic Autonomous Particle Swarm Optimization

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Kang, J., Xiong, Z., Niyato, D., Zou, Y., Zhang, Y., & Guizani, M. (2020). Reliable federated learning for mobile networks. IEEE Wireless Communications, 27, 72–80. https://doi.org/10.1109/mwc.001.1900119CrossRef

Yang, Q., Liu, Y., Chen, T., & Tong, Y. (2019). Federated machine learning: Concept and applications. ACM Transactions on Intelligent Systems and Technology (TIST), 10, 1–19. https://doi.org/10.1145/3298981CrossRef

Liu, Y., Peng, J., Kang, J., Iliyasu, A. M., Niyato, D., & Abd El-Latif, A. A. (2020). A secure federated learning framework for 5G networks. IEEE Wireless Communications, 27, 24–31. https://doi.org/10.1109/mwc.01.1900525CrossRef

Kairouz, P., McMahan, H. B., Avent, B., Bellet, A., Bennis, M., Bhagoji, A. N. et al. (2019). Advances and open problems in federated learning. Foundations and Trends® in Machine Learning, 14(1–2), 1–210. https://doi.org/10.1561/2200000083

Qin, Z., Li, G. Y., & Ye, H. (2020). Federated learning and wireless communications. arXiv preprint arXiv:2005.05265

Wang, S., Tuor, T., Salonidis, T., Leung, K. K., Makaya, C., He, T., & Chan, K. (2019). Adaptive federated learning in resource-constrained edge computing systems. IEEE Journal on Selected Areas in Communications, 37, 1205–1221. https://doi.org/10.1109/jsac.2019.2904348CrossRef

Nguyen, H. T., Luong, N. C., Zhao, J., Yuen, C., & Niyato, D. (2020) Resource allocation in mobility-aware federated learning networks: a deep reinforcement learning approach. In 2020 IEEE 6th world forum on internet of things (WF-IoT) (pp. 1–6). https://doi.org/10.1109/wf-iot48130.2020.9221089

Xu, R., Baracaldo, N., Zhou, Y., Anwar, A., & Ludwig, H. (2019). Hybridalpha: An efficient approach for privacy-preserving federated learning. In Proceedings of the 12th ACM workshop on artificial intelligence and security (pp. 13–23). https://doi.org/10.1145/3338501.3357371

Savazzi, S., Nicoli, M., & Rampa, V. (2020). Federated learning with cooperating devices: A consensus approach for massive IoT networks. IEEE Internet of Things Journal, 7, 4641–4654. https://doi.org/10.1109/jiot.2020.2964162CrossRef

10.

Han, P., Wang, S., & Leung, K. K. (2020). Adaptive gradient sparsification for efficient federated learning: An online learning approach. arXiv preprint arXiv:2001.04756

11.

Fallah, A., Mokhtari, A., & Ozdaglar, A. (2020). Personalized federated learning: A meta-learning approach. arXiv preprint arXiv:2002.07948

12.

Liu, Y., James, J., Kang, J., Niyato, D., & Zhang, S. (2020). Privacy-preserving traffic flow prediction: A federated learning approach. IEEE Internet of Things Journal, 7, 7751–7763. https://doi.org/10.1109/jiot.2020.2991401CrossRef

13.

Asad, M., Moustafa, A., Ito, T., & Aslam, M. (2020). Evaluating the communication efficiency in federated learning algorithms. arXiv preprint arXiv:2004.02738

14.

Ye, D., Yu, R., Pan, M., & Han, Z. (2020). Federated learning in vehicular edge computing: A selective model aggregation approach. IEEE Access, 8, 23920–23935. https://doi.org/10.1109/access.2020.2968399CrossRef

15.

Chen, Y., Luo, F., Li, T., Xiang, T., Liu, Z., & Li, J. (2020). A training-integrity privacy-preserving federated learning scheme with trusted execution environment. Information Sciences, 522, 69–79. https://doi.org/10.1016/j.ins.2020.02.037CrossRef

16.

Sheller, M. J., Edwards, B., Reina, G. A., Martin, J., Pati, S., Kotrotsou, A., Milchenko, M., Xu, W., Marcus, D., Colen, R. R., & Bakas, S. (2020). Federated learning in medicine: facilitating multi-institutional collaborations without sharing patient data. Scientific Reports, 10, 1–120. https://doi.org/10.1038/s41598-020-69250-1CrossRef

17.

Yin, B., Yin, H., Wu, Y., & Jiang, Z. (2020). FDC: A secure federated deep learning mechanism for data collaborations in the Internet of Things. IEEE Internet of Things Journal, 7, 6348–6359. https://doi.org/10.1109/jiot.2020.2966778CrossRef

18.

Konečný, J., McMahan, H. B., Ramage, D., & Richtárik, P. (2016). Federated optimization: Distributed machine learning for on-device intelligence. arXiv preprint arXiv:1610.02527

19.

Samarakoon, S., Bennis, M., Saad, W., & Debbah, M. (2019). Distributed federated learning for ultra-reliable low-latency vehicular communications. IEEE Transactions on Communications, 68, 1146–1159. https://doi.org/10.1109/tcomm.2019.2956472CrossRef

20.

Wang, X., Han, Y., Wang, C., Zhao, Q., Chen, X., & Chen, M. (2019). In-edge AI: Intelligentizing mobile edge computing, caching and communication by federated learning. IEEE Network, 33, 156–165. https://doi.org/10.1109/mnet.2019.1800286CrossRef

21.

Abad, M. S. H., Ozfatura, E., Gunduz, D., & Ercetin, O. (2020). Hierarchical federated learning across heterogeneous cellular networks. In ICASSP 2020–2020 IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 8866–8870). https://doi.org/10.1109/icassp40776.2020.9054634

22.

Li, D., & Wang, J. (2019) Fedmd: Heterogenous federated learning via model distillation. arXiv preprint arXiv:1910.03581

23.

So, J., Güler, B., & Avestimehr, A. S. (2021). Turbo-aggregate: Breaking the quadratic aggregation barrier in secure federated learning. IEEE Journal on Selected Areas in Information Theory. https://doi.org/10.1109/jsait.2021.3054610CrossRef

24.

Kim, Y. J., & Hong, C. S. (2019). Blockchain-based node-aware dynamic weighting methods for improving federated learning performance. In 2019 20th Asia-pacific network operations and management symposium (APNOMS) (pp. 1–4). https://doi.org/10.23919/APNOMS.2019.8893114

25.

Ren, J., Wang, H., Hou, T., Zheng, S., & Tang, C. (2019). Federated learning-based computation offloading optimization in edge computing-supported internet of things. IEEE Access, 7, 69194–69201. https://doi.org/10.1109/access.2019.2919736CrossRef

26.

Mowla, N. I., Tran, N. H., Doh, I., & Chae, K. (2019). Federated learning-based cognitive detection of jamming attack in flying ad-hoc network. IEEE Access, 8, 4338–4350. https://doi.org/10.1109/access.2019.2962873CrossRef

27.

Chen, Y., Ning, Y., & Rangwala, H. (2019). Asynchronous online federated learning for edge devices. arXiv preprint arXiv:1911.02134

28.

Hao, M., Li, H., Luo, X., Xu, G., Yang, H., & Liu, S. (2019). Efficient and privacy-enhanced federated learning for industrial artificial intelligence. IEEE Transactions on Industrial Informatics, 16, 6532–6542. https://doi.org/10.1109/tii.2019.2945367CrossRef

29.

Subramanya, T., & Riggio, R. (2021). Centralized and federated learning for predictive VNF autoscaling in multi-domain 5G networks and beyond. IEEE Transactions on Network and Service Management. https://doi.org/10.1109/tnsm.2021.3050955CrossRef

30.

Qian, Y., Hu, L., Chen, J., Guan, X., Hassan, M. M., & Alelaiwi, A. (2019). Privacy-aware service placement for mobile edge computing via federated learning. Information Sciences, 505, 562–570. https://doi.org/10.1016/j.ins.2019.07.069CrossRef

31.

Zhao, Y., Li, M., Lai, L., Suda, N., Civin, D., & Chandra, V. (2018). Federated learning with non-iid data. arXiv preprint arXiv:1806.00582

32.

Kim, H., Park, J., Bennis, M., & Kim, S.-L. (2019). Blockchained on-device federated learning. IEEE Communications Letters, 24, 1279–1283. https://doi.org/10.1109/lcomm.2019.2921755CrossRef

33.

Zhu, H., & Jin, Y. (2019). Multi-objective evolutionary federated learning. IEEE Transactions on Neural Networks and Learning Systems, 31, 1310–1322. https://doi.org/10.1109/tnnls.2019.2919699CrossRef

34.

Roy, A. G., Siddiqui, S., Pölsterl, S., Navab, N., & Wachinger, C. (2019). Braintorrent: A peer-to-peer environment for decentralized federated learning. arXiv preprint arXiv:1905.06731

35.

Zhao, Y., Zhao, J., Jiang, L., Tan, R., Niyato, D., Li, Z., Lyu, L., & Liu, Y. (2020). Privacy-preserving blockchain-based federated learning for IoT devices. IEEE Internet of Things Journal. https://doi.org/10.1109/jiot.2020.3017377CrossRef

36.

Hu, C., Jiang, J., & Wang, Z. (2019). Decentralized federated learning: a segmented gossip approach. arXiv preprint arXiv:1908.07782

37.

Lu, S., Zhang, Y., Wang, Y., & Mack, C. (2019). Learn electronic health records by fully decentralized federated learning. arXiv preprint arXiv:1912.01792

38.

Xing, H., Simeone, O., & Bi, S. (2020). Decentralized federated learning via SGD over wireless D2D networks. In 2020 IEEE 21st international workshop on signal processing advances in wireless communications (SPAWC) (pp. 1–5). https://doi.org/10.1109/spawc48557.2020.9154332

39.

Ma, C., Li, J., Ding, M., Shi, L., Wang, T., Han, Z., & Poor, H. V. (2020). When federated learning meets blockchain: A new distributed learning paradigm. arXiv preprint arXiv:2009.09338

40.

Pappas, C., Chatzopoulos, D., Lalis, S., & Vavalis, M. (2021) IPLS: A framework for decentralized federated learning. arXiv preprint arXiv:2101.01901

41.

Li, J., Shao, Y., Wei, K., Ding, M., Ma, C., Shi, L., Han, Z., & Poor, H. V. (2021). Blockchain assisted decentralized federated learning (BLADE-FL): Performance analysis and resource allocation. arXiv preprint arXiv:2101.06905

42.

Conway-Jones, D., Tuor, T., Wang, S., & Leung, K. K. (2019). Demonstration of federated learning in a resource-constrained networked environment. In 2019 IEEE international conference on smart computing (SMARTCOMP) (pp. 484–486). https://doi.org/10.1109/smartcomp.2019.00095

43.

Wang, X., Wang, C., Li, X., Leung, V. C., & Taleb, T. (2020). Federated deep reinforcement learning for internet of things with decentralized cooperative edge caching. IEEE Internet of Things Journal, 7, 9441–9455. https://doi.org/10.1109/jiot.2020.2986803CrossRef

44.

Lu, Y., Huang, X., Dai, Y., Maharjan, S., & Zhang, Y. (2019). Differentially private asynchronous federated learning for mobile edge computing in urban informatics. IEEE Transactions on Industrial Informatics, 16, 2134–2143. https://doi.org/10.1109/tii.2019.2942179CrossRef

45.

Qu, Y., Gao, L., Luan, T. H., Xiang, Y., Yu, S., Li, B., & Zheng, G. (2020). Decentralized privacy using blockchain-enabled federated learning in fog computing. IEEE Internet of Things Journal, 7, 5171–5183. https://doi.org/10.1109/jiot.2020.2977383CrossRef

46.

Ghosh, A., Hong, J., Yin, D., & Ramchandran, K. (2019). Robust federated learning in a heterogeneous environment. arXiv preprint arXiv:1906.06629

47.

Pang, J., Huang, Y., Xie, Z., Han, Q., & Cai, Z. (2020). Realizing the heterogeneity: A self-organized federated learning framework for IoT. IEEE Internet of Things Journal. https://doi.org/10.1109/jiot.2020.3007662CrossRef

48.

Chang, H., Shejwalkar, V., Shokri, R., & Houmansadr, A. (2019). Cronus: Robust and heterogeneous collaborative learning with black-box knowledge transfer. arXiv preprint arXiv:1912.11279

49.

Hosseinalipour, S., Brinton, C. G., Aggarwal, V., Dai, H., & Chiang, M. (2020). From federated to fog learning: Distributed machine learning over heterogeneous wireless networks. IEEE Communications Magazine, 58, 41–47. https://doi.org/10.1109/mcom.001.2000410CrossRef

50.

Yu, F., Zhang, W., Qin, Z., Xu, Z., Wang, D., Liu, C., Tian, Z., & Chen, X. (2020). Heterogeneous federated learning. arXiv preprint arXiv:2008.06767

51.

Stripelis, D., & Ambite, J. L. (2020). Accelerating federated learning in heterogeneous data and computational environments. arXiv preprint arXiv:2008.11281

52.

Pilla, L. L. (2020). Optimal task assignment to heterogeneous federated learning devices. arXiv preprint arXiv:2010.00239

53.

Gudur, G. K., Balaji, B. S., & Perepu, S. K. (2020) Resource-constrained federated learning with heterogeneous labels and models. arXiv preprint arXiv:2011.03206

54.

Yang, L., Beliard, C., & Rossi, D. (2020). Heterogeneous data-aware federated learning. arXiv preprint arXiv:2011.06393

55.

Wang, S., Lee, M., Hosseinalipour, S., Morabito, R., Chiang, M., & Brinton, C. G. (2021). Device sampling for heterogeneous federated learning: Theory, algorithms, and implementation. arXiv preprint arXiv:2101.00787

56.

Fadlullah, Z. M., & Kato, N. (2020). HCP: Heterogeneous computing platform for federated learning-based collaborative content caching towards 6G networks. IEEE Transactions on Emerging Topics in Computing. https://doi.org/10.1109/tetc.2020.2986238CrossRef

57.

Sahu, A. K., Li, T., Sanjabi, M., Zaheer, M., Talwalkar, A., & Smith, V. (2018). On the convergence of federated optimization in heterogeneous networks (Vol. 3). arXiv preprint arXiv:1812.06127

58.

Zhang, W., Wang, X., Zhou, P., Wu, W., & Zhang, X. (2021). Client selection for federated learning with Non-IID Data in mobile edge computing. IEEE Access, 9, 24462–24474. https://doi.org/10.1109/access.2021.3056919CrossRef

59.

Murata, T., & Suzuki, T. (2021). Bias-variance reduced local SGD for less heterogeneous federated learning. arXiv preprint arXiv:2102.03198

60.

Chen, Z., Tian, P., Liao, W., & Yu, W. (2020). Zero-knowledge clustering based adversarial mitigation in heterogeneous federated learning. IEEE Transactions on Network Science and Engineering. https://doi.org/10.1109/tnse.2020.3002796CrossRef

61.

Chadha, M., Jindal, A., & Gerndt, M. (2020). Towards federated learning using FaaS fabric. In Proceedings of the 2020 sixth international workshop on serverless computing (pp. 49–54). https://doi.org/10.1145/3429880.3430100

Title: Survey on Federated-Learning Approaches in Distributed Environment
Authors: Ruchi Gupta
Tanweer Alam
Publication date: 10-03-2022
Publisher: Springer US
Published in: Wireless Personal Communications / Issue 2/2022
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI: https://doi.org/10.1007/s11277-022-09624-y

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 2/2022

Enhancing the Route Optimization Using Hybrid MAF Optimization Algorithm for the Internet of Vehicle

Home Security System Using Wireless Sensors Network

Enhancing the Error Performance of 5G New Radio Using Hierarchical and Statistical QAM

Heterogeneous Load Balancing using Predictive Load Summarization

Optimal Scheme for the Detection and Classification of Clone Node Attack in WSN Using TAIGBRFCNIA

Pilot Contamination Suppression Based Coordination in Multi-cell Massive MIMO Systems