Top

Published in:

2024 | OriginalPaper | Chapter

Mapping of Newcomer Clients in Federated Learning Based on Activation Strength

Authors : Tatjana Legler, Vinit Hegiste, Martin Ruskowski

Published in: Flexible Automation and Intelligent Manufacturing: Establishing Bridges for More Sustainable Manufacturing Systems

Publisher: Springer Nature Switzerland

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Federated learning is a collaborative machine learning approach that allows multiple parties to train a model without exchanging sensitive data. In manufacturing, where different parties may have proprietary or sensitive data that cannot be shared, this is especially useful. However, traditional federated learning approaches (as proposed by McMahan et al.) do not consider the differences in data and computing resources across different parties, leading to sub-optimal model performance. Personalized federated learning addresses this issue by allowing each party to contribute to the model training according to its specific data and resources. Furthermore, most common approaches only consider a limited set of data and a short period of time, without considering the system’s long-term usefulness. It is important to consider the integration of new clients and the continuous change of data, which could result in the addition of new classes. This paper will explore the potential of federated learning in manufacturing and present a flexible and expandable approach, focusing on mapping newcomer clients based on activation strength of weights.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Analysis of Constructive Heuristics with Cuckoo Search Algorithm, Firefly Algorithm and Simulated Annealing in Scheduling Problems

next chapter An AI-Powered Network Intrusion Detection System in Industrial IoT Devices via Deep Learning

Satyanarayanan, M.: The emergence of edge computing. Computer 50(1), 30–39 (2017)CrossRef

Pike, R., et al.: Plan 9 from bell labs. Comput. Syst. 8(3), 221–254 (1995)

Liu, L., Zhang, J., Song, S.H., Letaief, K.B.: Client-edge-cloud hierarchical federated learning. In: ICC 2020 - 2020 IEEE International Conference on Communications (ICC), pp. 1–6. IEEE (2020)

Choudhary, A.K., Harding, J.A., Tiwari, M.K.: Data mining in manufacturing: a review based on the kind of knowledge. J. Intell. Manuf. 20(5), 501–521 (2009)CrossRef

Dogan, A., Birant, D.: Machine learning and data mining in manufacturing. Expert Syst. Appl. 166, 114060 (2021)CrossRef

McMahan, B., Moore, E., Ramage, D., Hampson, S., Arcas, B.A.: Communication-efficient learning of deep networks from decentralized data. Artificial Intelligence and Statistics, pp. 1273–1282 (2017)

Kairouz, P., McMahan, H.B., Avent, B., Bellet, A., Bennis, M., Nitin Bhagoji, A., et al.: Advances and open problems in federated learning. FNT Mach. Learn. (Found. Trends Mach. Learn.) 14(1–2), 1–210 (2021)CrossRef

Dean, J., et al.: Large scale distributed deep networks. In: Pereira, F., Burges, C.J., Bottou, L., Weinberger, K.Q. (eds.) Advances in Neural Information Processing Systems, vol. 25. Curran Associates, Inc. (2012)

Caruana, R.: Multitask learning. In: Thrun, S., Pratt, L. (eds.) Learning to Learn, pp. 95–133. Springer, Boston (1998). https://doi.org/10.1007/978-1-4615-5529-2_5

10.

Zhang, Y., Yang, Q.: A survey on multi-task learning. IEEE Trans. Knowl. Data Eng. 34(12), 5586–5609 (2022)CrossRef

11.

Li, H., Ng, J.Y.H., Natsev, P.: Ensemblenet: end-to-end optimization of multi-headed models

12.

Lee, S., Purushwalkam, S., Cogswell, M., Crandall, D., Batra, D.: Why m heads are better than one: training a diverse ensemble of deep networks

13.

Parisi, G.I., Kemker, R., Part, J.L., Kanan, C., Wermter, S.: Continual lifelong learning with neural networks: a review. Neural Netw. Off. J. Int. Neural Netw. Soc. 113, 54–71 (2019)CrossRef

14.

French, R.: Catastrophic forgetting in connectionist networks. Trends Cogn. Sci. 3(4), 128–135 (1999)CrossRef

15.

Grossberg, S.: Studies of Mind and Brain: Neural Principles of Learning, Perception, Development, Cognition, and Motor Control, Boston Studies in the Philosophy of Science, vol. 70. Springer, Dordrecht (1982). https://doi.org/10.1007/978-94-009-7758-7CrossRef

16.

Abraham, W.C., Robins, A.: Memory retention-the synaptic stability versus plasticity dilemma. Trends Neurosci. 28(2), 73–78 (2005)CrossRef

17.

McCloskey, M., Cohen, N.J.: Catastrophic interference in connectionist networks: The sequential learning problem. In: Bower, G.H. (ed.) The Psychology of Learning and Motivation, Psychology of Learning and Motivation, vol. 24, pp. 109–165. Academic Press, London (1989)

18.

Thrun, S., Mitchell, T.M.: Lifelong robot learning. In: Steels, L. (ed.) The Biology and Technology of Intelligent Autonomous Agents, pp. 165–196. Springer, Heidelberg (1995). https://doi.org/10.1007/978-3-642-79629-6_7CrossRef

19.

Hassabis, D., Kumaran, D., Summerfield, C., Botvinick, M.: Neuroscience-inspired artificial intelligence. Neuron 95(2), 245–258 (2017)CrossRef

20.

Kern, W.: Methodik zur gestaltung eines modularen montagesystems. Modulare Produktion: Methodik zur Gestaltung eines modularen Montagesystems für die variantenreiche Serienmontage im Automobilbau, pp. 149–222 (2021)

21.

Accorsi, R., Bortolini, M., Galizia, F.G., Gualano, F., Oliani, M.: Scalability analysis in industry 4.0 manufacturing. In: Scholz, S.G. (ed.) Sustainable Design and Manufacturing 2020, Smart Innovation, Systems and Technologies, vol. 200, pp. 161–171. Springer, Singapore (2021). https://doi.org/10.1007/978-981-15-8131-1_15

22.

Reiman, A., Kaivo-oja, J., Parviainen, E., Takala, E.P., Lauraeus, T.: Human factors and ergonomics in manufacturing in the industry 4.0 context – a scoping review. Technol. Soc. 65, 101572 (2021)

23.

Komesker, S., Motsch, W., Popper, J., Sidorenko, A., Wagner, A., Ruskowski, M.: Enabling a multi-agent system for resilient production flow in modular production systems. Procedia CIRP 107, 991–998 (2022)CrossRef

24.

Zambrano, V., et al.: Industrial digitalization in the industry 4.0 era: classification, reuse and authoring of digital models on digital twin platforms. Array 14, 100176 (2022)

25.

Kagermann, H., Wahlster, W.: Ten years of industrie 4.0. Science 4(3), 26 (2022)

26.

Abbas, J.: Impact of total quality management on corporate sustainability through the mediating effect of knowledge management. J. Clean. Prod. 244, 118806 (2020)CrossRef

27.

Hegiste, V., Legler, T., Ruskowski, M.: Application of federated machine learning in manufacturing. In: 2022 International Conference on Industry 4.0 Technology (I4Tech), pp. 1–8. IEEE (2022)

28.

Leung, K.: Neural network architecture diagrams. https://github.com/kennethleungty/Neural-Network-Architecture-Diagrams

29.

Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. CoRR abs/1409.1556 (2014)

30.

Tan, M., Le, Q.: Efficientnetv2: smaller models and faster training. In: International Conference on Machine Learning, pp. 10096–10106 (2021)

31.

Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., Fei-Fei, L.: Imagenet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition, pp. 248–255. IEEE, Piscataway, NJ (2009)

32.

Bostock, M.: Imagenet hierarchy. https://observablehq.com/@mbostock/imagenet-hierarchy

Title: Mapping of Newcomer Clients in Federated Learning Based on Activation Strength
Authors: Tatjana Legler
Vinit Hegiste
Martin Ruskowski
Publisher: Springer Nature Switzerland
Book: Flexible Automation and Intelligent Manufacturing: Establishing Bridges for More Sustainable Manufacturing Systems
Print ISBN: 978-3-031-38164-5

Electronic ISBN: 978-3-031-38165-2

Copyright Year: 2024
DOI: https://doi.org/10.1007/978-3-031-38165-2_130