Skip to main content
Erschienen in: International Journal of Machine Learning and Cybernetics 2/2024

02.08.2023 | Original Article

Federated domain generalization for intelligent fault diagnosis based on pseudo-siamese network and robust global model aggregation

verfasst von: Yan Song, Peng Liu

Erschienen in: International Journal of Machine Learning and Cybernetics | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Federated learning (FL) based intelligent fault diagnosis has developed rapidly in recent years owing to the need for data privacy. However, models trained using FL may suffer from performance degradation when applied to unseen domains. In this regard, we propose a federated domain generalization approach using a pseudo-Siamese network (PSN) and robust model aggregation for intelligent fault diagnosis. Firstly, the proposed method employs PSN to calculate the discrepancy between client and global models at the local clients. This enhances the feature space boundary of fault diagnosis models. Then the proposed method computes cross-classification losses of locally trained global models on the central server for robust model aggregation. Finally, we evaluate our approach through experiments where local clients contain data from varying datasets. Experimental results on the proposed method and other transfer learning and federated learning methods prove the outperformance of the proposed method.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Weitere Produktempfehlungen anzeigen
Literatur
1.
Zurück zum Zitat Wen L, Li X, Gao L, Zhang Y (2018) A new convolutional neural network-based data-driven fault diagnosis method. IEEE Trans Ind Electron 65:5990–5998CrossRef Wen L, Li X, Gao L, Zhang Y (2018) A new convolutional neural network-based data-driven fault diagnosis method. IEEE Trans Ind Electron 65:5990–5998CrossRef
2.
Zurück zum Zitat Chen J, Li K, Yu PS (2021) Privacy-preserving deep learning model for decentralized vanets using fully homomorphic encryption and blockchain. IEEE Trans Intell Transp Syst 23:11633–11642CrossRef Chen J, Li K, Yu PS (2021) Privacy-preserving deep learning model for decentralized vanets using fully homomorphic encryption and blockchain. IEEE Trans Intell Transp Syst 23:11633–11642CrossRef
3.
Zurück zum Zitat Zhang Z, Guan C, Chen H, Yang X, Gong W, Yang A (2022) Adaptive privacy-preserving federated learning for fault diagnosis in internet of ships. IEEE Internet Things J 9:6844–6854CrossRef Zhang Z, Guan C, Chen H, Yang X, Gong W, Yang A (2022) Adaptive privacy-preserving federated learning for fault diagnosis in internet of ships. IEEE Internet Things J 9:6844–6854CrossRef
4.
Zurück zum Zitat Lu S, Gao Z, Xu Q, Jiang C, Zhang A, Wang X (2022) Class-imbalance privacy-preserving federated learning for decentralized fault diagnosis with biometric authentication. IEEE Trans Ind Inf 18:9101–9111CrossRef Lu S, Gao Z, Xu Q, Jiang C, Zhang A, Wang X (2022) Class-imbalance privacy-preserving federated learning for decentralized fault diagnosis with biometric authentication. IEEE Trans Ind Inf 18:9101–9111CrossRef
5.
Zurück zum Zitat Li Y, Chen Y, Zhu K, Bai C, Zhang J (2022) An effective federated learning verification strategy and its applications for fault diagnosis in industrial IoT systems. IEEE Internet Things J 9:16835–16849CrossRef Li Y, Chen Y, Zhu K, Bai C, Zhang J (2022) An effective federated learning verification strategy and its applications for fault diagnosis in industrial IoT systems. IEEE Internet Things J 9:16835–16849CrossRef
6.
Zurück zum Zitat Zhang W, Wang Z, Li X (2022) Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis. Reliab Eng Syst Saf 229:108885CrossRef Zhang W, Wang Z, Li X (2022) Blockchain-based decentralized federated transfer learning methodology for collaborative machinery fault diagnosis. Reliab Eng Syst Saf 229:108885CrossRef
7.
Zurück zum Zitat Yang W, Chen J, Chen Z, Liao Y, Li W (2021) Federated transfer learning for bearing fault diagnosis based on averaging shared layers. In: 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing), pp 1–7 Yang W, Chen J, Chen Z, Liao Y, Li W (2021) Federated transfer learning for bearing fault diagnosis based on averaging shared layers. In: 2021 Global Reliability and Prognostics and Health Management (PHM-Nanjing), pp 1–7
8.
Zurück zum Zitat Chen J, Li J, Huang R, Yue K, Chen Z, Li W (2022) Federated transfer learning for bearing fault diagnosis with discrepancy-based weighted federated averaging. IEEE Trans Instrum Meas 71:1–11 Chen J, Li J, Huang R, Yue K, Chen Z, Li W (2022) Federated transfer learning for bearing fault diagnosis with discrepancy-based weighted federated averaging. IEEE Trans Instrum Meas 71:1–11
9.
Zurück zum Zitat Chen J, Li K, Bilal K, Zhou X, Li K, Yu PS (2018) A bi-layered parallel training architecture for large-scale convolutional neural networks. IEEE Trans Parallel Distrib Syst 30:965–976CrossRef Chen J, Li K, Bilal K, Zhou X, Li K, Yu PS (2018) A bi-layered parallel training architecture for large-scale convolutional neural networks. IEEE Trans Parallel Distrib Syst 30:965–976CrossRef
10.
Zurück zum Zitat Miao M, Sun Y, Yu J (2022) Sparse representation convolutional autoencoder for feature learning of vibration signals and its applications in machinery fault diagnosis. IEEE Trans Ind Electron 69:13565–13575CrossRef Miao M, Sun Y, Yu J (2022) Sparse representation convolutional autoencoder for feature learning of vibration signals and its applications in machinery fault diagnosis. IEEE Trans Ind Electron 69:13565–13575CrossRef
11.
Zurück zum Zitat Abdul ZK, Al-Talabani AK, Ramadan DO (2020) A hybrid temporal feature for gear fault diagnosis using the long short term memory. IEEE Sens J 20:14444–14452CrossRef Abdul ZK, Al-Talabani AK, Ramadan DO (2020) A hybrid temporal feature for gear fault diagnosis using the long short term memory. IEEE Sens J 20:14444–14452CrossRef
12.
Zurück zum Zitat Lin H, Hu J, Wang X, Alhamid MF, Piran MJ (2021) Toward secure data fusion in industrial IoT using transfer learning. IEEE Trans Ind Inf 17:7114–7122CrossRef Lin H, Hu J, Wang X, Alhamid MF, Piran MJ (2021) Toward secure data fusion in industrial IoT using transfer learning. IEEE Trans Ind Inf 17:7114–7122CrossRef
13.
Zurück zum Zitat Zheng H, Yang Y, Yin J, Li Y, Wang R, Xu M (2021) Deep domain generalization combining a priori diagnosis knowledge toward cross-domain fault diagnosis of rolling bearing. IEEE Trans Instrum Meas 70:1–11CrossRef Zheng H, Yang Y, Yin J, Li Y, Wang R, Xu M (2021) Deep domain generalization combining a priori diagnosis knowledge toward cross-domain fault diagnosis of rolling bearing. IEEE Trans Instrum Meas 70:1–11CrossRef
14.
Zurück zum Zitat Zhang Q, Zhao Z, Zhang X, Liu Y, Sun C, Li M, Wang S, Chen X (2021) Conditional adversarial domain generalization with a single discriminator for bearing fault diagnosis. IEEE Trans Instrum Meas 70:1–15CrossRef Zhang Q, Zhao Z, Zhang X, Liu Y, Sun C, Li M, Wang S, Chen X (2021) Conditional adversarial domain generalization with a single discriminator for bearing fault diagnosis. IEEE Trans Instrum Meas 70:1–15CrossRef
15.
Zurück zum Zitat Zheng H, Wang R, Yang Y, Li Y, Xu M (2020) Intelligent fault identification based on multisource domain generalization towards actual diagnosis scenario. IEEE Trans Ind Electron 67:1293–1304CrossRef Zheng H, Wang R, Yang Y, Li Y, Xu M (2020) Intelligent fault identification based on multisource domain generalization towards actual diagnosis scenario. IEEE Trans Ind Electron 67:1293–1304CrossRef
16.
Zurück zum Zitat Xiao X, Tang Z, Li C, Xiao B, Li K (2023) Sca: sybil-based collusion attacks of IoT data poisoning in federated learning. IEEE Trans Ind Inf 19:2608–2618CrossRef Xiao X, Tang Z, Li C, Xiao B, Li K (2023) Sca: sybil-based collusion attacks of IoT data poisoning in federated learning. IEEE Trans Ind Inf 19:2608–2618CrossRef
17.
Zurück zum Zitat Liu Q, Yang B-J, Wang Z, Zhu D, Wang X, Ma K, Guan X (2022) Asynchronous decentralized federated learning for collaborative fault diagnosis of PV stations. IEEE Trans Netw Sci Eng 9:1680–1696MathSciNetCrossRef Liu Q, Yang B-J, Wang Z, Zhu D, Wang X, Ma K, Guan X (2022) Asynchronous decentralized federated learning for collaborative fault diagnosis of PV stations. IEEE Trans Netw Sci Eng 9:1680–1696MathSciNetCrossRef
18.
Zurück zum Zitat Wu Y, He K (2019) Group normalization. Int J Comput Vis 128:742–755CrossRef Wu Y, He K (2019) Group normalization. Int J Comput Vis 128:742–755CrossRef
19.
Zurück zum Zitat Xu J, Li Z, Du B, Zhang M, Liu J (2020) Reluplex made more practical: Leaky relu. In: 2020 IEEE Symposium on Computers and Communications (ISCC), pp 1–7 Xu J, Li Z, Du B, Zhang M, Liu J (2020) Reluplex made more practical: Leaky relu. In: 2020 IEEE Symposium on Computers and Communications (ISCC), pp 1–7
20.
Zurück zum Zitat Yu Q, Aizawa K (2019) Unsupervised out-of-distribution detection by maximum classifier discrepancy. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp 9517–9525 Yu Q, Aizawa K (2019) Unsupervised out-of-distribution detection by maximum classifier discrepancy. In: 2019 IEEE/CVF International Conference on Computer Vision (ICCV), pp 9517–9525
21.
Zurück zum Zitat Bromley J, Bentz JW, Bottou L, Subramanian IR, LeCun Y, Moore C, Säckinger E, Shah R (1993) Signature verification using a siamese time delay neural network. Int J Pattern Recognit Artif Intell 7:669–688CrossRef Bromley J, Bentz JW, Bottou L, Subramanian IR, LeCun Y, Moore C, Säckinger E, Shah R (1993) Signature verification using a siamese time delay neural network. Int J Pattern Recognit Artif Intell 7:669–688CrossRef
22.
Zurück zum Zitat Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: ECCV Workshops Sun B, Saenko K (2016) Deep coral: correlation alignment for deep domain adaptation. In: ECCV Workshops
23.
Zurück zum Zitat Li M, Zhang T, Chen Y, Smola A (2014) Efficient mini-batch training for stochastic optimization. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining Li M, Zhang T, Chen Y, Smola A (2014) Efficient mini-batch training for stochastic optimization. In: Proceedings of the 20th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining
24.
Zurück zum Zitat Lessmeier C, Kimotho JK, Zimmer D, Sextro W (2016) Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification. PHM Society European Conference, vol 3, No 1 Lessmeier C, Kimotho JK, Zimmer D, Sextro W (2016) Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification. PHM Society European Conference, vol 3, No 1
25.
Zurück zum Zitat Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the case western reserve university data: a benchmark study. Mech Syst Signal Process 64:100–131CrossRef Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the case western reserve university data: a benchmark study. Mech Syst Signal Process 64:100–131CrossRef
26.
Zurück zum Zitat Wang B, Lei Y, Li N, Li N (2020) A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Trans Reliab 69:401–412CrossRef Wang B, Lei Y, Li N, Li N (2020) A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Trans Reliab 69:401–412CrossRef
27.
Zurück zum Zitat Liu X, Li H, Xu G, Lu R, He M (2020) Adaptive privacy-preserving federated learning. Peer-to-Peer Netw Appl 13:2356–2366CrossRef Liu X, Li H, Xu G, Lu R, He M (2020) Adaptive privacy-preserving federated learning. Peer-to-Peer Netw Appl 13:2356–2366CrossRef
28.
Zurück zum Zitat Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky VS (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17:2030–2096MathSciNet Ganin Y, Ustinova E, Ajakan H, Germain P, Larochelle H, Laviolette F, Marchand M, Lempitsky VS (2016) Domain-adversarial training of neural networks. J Mach Learn Res 17:2030–2096MathSciNet
29.
Zurück zum Zitat Dziugaite GK, Roy DM, Ghahramani Z (2015) Training generative neural networks via maximum mean discrepancy optimization. ArXiv abs/1505.03906 Dziugaite GK, Roy DM, Ghahramani Z (2015) Training generative neural networks via maximum mean discrepancy optimization. ArXiv abs/1505.03906
30.
Zurück zum Zitat van der Maaten L, Hinton GE (2008) Visualizing data using t-sne. J Mach Learn Res 9:2579–2605 van der Maaten L, Hinton GE (2008) Visualizing data using t-sne. J Mach Learn Res 9:2579–2605
Metadaten
Titel
Federated domain generalization for intelligent fault diagnosis based on pseudo-siamese network and robust global model aggregation
verfasst von
Yan Song
Peng Liu
Publikationsdatum
02.08.2023
Verlag
Springer Berlin Heidelberg
Erschienen in
International Journal of Machine Learning and Cybernetics / Ausgabe 2/2024
Print ISSN: 1868-8071
Elektronische ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-023-01934-2

Weitere Artikel der Ausgabe 2/2024

International Journal of Machine Learning and Cybernetics 2/2024 Zur Ausgabe

Neuer Inhalt