Skip to main content
Top
Published in: Neural Computing and Applications 10/2020

26-02-2019 | Original Article

A transfer convolutional neural network for fault diagnosis based on ResNet-50

Authors: Long Wen, Xinyu Li, Liang Gao

Published in: Neural Computing and Applications | Issue 10/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

With the rapid development of smart manufacturing, data-driven fault diagnosis has attracted increasing attentions. As one of the most popular methods applied in fault diagnosis, deep learning (DL) has achieved remarkable results. However, due to the fact that the volume of labeled samples is small in fault diagnosis, the depths of DL models for fault diagnosis are shallow compared with convolutional neural network in other areas (including ImageNet), which limits their final prediction accuracies. In this research, a new TCNN(ResNet-50) with the depth of 51 convolutional layers is proposed for fault diagnosis. By combining with transfer learning, TCNN(ResNet-50) applies ResNet-50 trained on ImageNet as feature extractor for fault diagnosis. Firstly, a signal-to-image method is developed to convert time-domain fault signals to RGB images format as the input datatype of ResNet-50. Then, a new structure of TCNN(ResNet-50) is proposed. Finally, the proposed TCNN(ResNet-50) has been tested on three datasets, including bearing damage dataset provided by KAT datacenter, motor bearing dataset provided by Case Western Reserve University (CWRU) and self-priming centrifugal pump dataset. It achieved state-of-the-art results. The prediction accuracies of TCNN(ResNet-50) are as high as 98.95% ± 0.0074, 99.99% ± 0 and 99.20% ± 0, which demonstrates that TCNN(ResNet-50) outperforms other DL models and traditional methods.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Yin S, Ding SX, Xie XC, Luo H (2014) A review on basic data-driven approaches for industrial process monitoring. IEEE Trans Ind Electron 61(11):6418–6428CrossRef Yin S, Ding SX, Xie XC, Luo H (2014) A review on basic data-driven approaches for industrial process monitoring. IEEE Trans Ind Electron 61(11):6418–6428CrossRef
3.
go back to reference Li XY, Gao L (2016) An effective hybrid genetic algorithm and tabu search for flexible job shop scheduling problem. Int J Prod Econ 174:93–110CrossRef Li XY, Gao L (2016) An effective hybrid genetic algorithm and tabu search for flexible job shop scheduling problem. Int J Prod Econ 174:93–110CrossRef
5.
go back to reference Dai X, Gao Z (2013) From model, signal to knowledge: a data-driven perspective of fault detection and diagnosis. IEEE Trans Ind Inf 9(4):2226–2238CrossRef Dai X, Gao Z (2013) From model, signal to knowledge: a data-driven perspective of fault detection and diagnosis. IEEE Trans Ind Inf 9(4):2226–2238CrossRef
7.
go back to reference Yang C, Song P, Liu X (2019) Failure prognostics of heavy vehicle hydro-pneumatic spring based on novel degradation feature and support vector regression. Neural Comput Appl 31(1):139–156CrossRef Yang C, Song P, Liu X (2019) Failure prognostics of heavy vehicle hydro-pneumatic spring based on novel degradation feature and support vector regression. Neural Comput Appl 31(1):139–156CrossRef
8.
go back to reference Ertunc HM, Ocak H, Aliustaoglu C (2013) ANN- and ANFIS-based multi-staged decision algorithm for the detection and diagnosis of bearing faults. Neural Comput Appl 22(1):435–446CrossRef Ertunc HM, Ocak H, Aliustaoglu C (2013) ANN- and ANFIS-based multi-staged decision algorithm for the detection and diagnosis of bearing faults. Neural Comput Appl 22(1):435–446CrossRef
9.
go back to reference Kiakojoori S, Khorasani K (2016) Dynamic neural networks for gas turbine engine degradation prediction, health monitoring and prognosis. Neural Comput Appl 27(8):2157–2192CrossRef Kiakojoori S, Khorasani K (2016) Dynamic neural networks for gas turbine engine degradation prediction, health monitoring and prognosis. Neural Comput Appl 27(8):2157–2192CrossRef
10.
go back to reference Seera M, Lim CP, Ishak D, Singh H (2013) Application of the fuzzy min–max neural network to fault detection and diagnosis of induction motors. Neural Comput Appl 23(1):191–200CrossRef Seera M, Lim CP, Ishak D, Singh H (2013) Application of the fuzzy min–max neural network to fault detection and diagnosis of induction motors. Neural Comput Appl 23(1):191–200CrossRef
11.
go back to reference Liu RN, Yang BY, Zio E, Chen XF (2018) Artificial intelligence for fault diagnosis of rotating machinery: a review. Mech Syst Signal Process 108:33–47CrossRef Liu RN, Yang BY, Zio E, Chen XF (2018) Artificial intelligence for fault diagnosis of rotating machinery: a review. Mech Syst Signal Process 108:33–47CrossRef
12.
go back to reference Wang JJ, Ma YL, Zhang LB, Gao RX, Wu DZ (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48(Part C):144–156CrossRef Wang JJ, Ma YL, Zhang LB, Gao RX, Wu DZ (2018) Deep learning for smart manufacturing: methods and applications. J Manuf Syst 48(Part C):144–156CrossRef
13.
go back to reference LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRef LeCun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521(7553):436–444CrossRef
14.
go back to reference Zhao R, Yan RQ, Chen ZH, Mao KZ, Wang P, Gao RX (2019) Deep learning and its applications to machine health monitoring. Mech Syst Signal Process 115:213–237CrossRef Zhao R, Yan RQ, Chen ZH, Mao KZ, Wang P, Gao RX (2019) Deep learning and its applications to machine health monitoring. Mech Syst Signal Process 115:213–237CrossRef
15.
go back to reference Donahue J, Jia YQ, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655 Donahue J, Jia YQ, Vinyals O, Hoffman J, Zhang N, Tzeng E, Darrell T (2014) Decaf: a deep convolutional activation feature for generic visual recognition. In: International conference on machine learning, pp 647–655
16.
go back to reference Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems, pp 3320–3328 Yosinski J, Clune J, Bengio Y, Lipson H (2014) How transferable are features in deep neural networks? In: Advances in neural information processing systems, pp 3320–3328
17.
go back to reference He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778 He KM, Zhang XY, Ren SQ, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778
18.
go back to reference Li XY, Lu C, Gao L, Xiao SQ, Wen L (2018) An effective multi-objective algorithm for energy efficient scheduling in a real-life welding shop. IEEE Trans Ind Inf 14(12):5400–5409CrossRef Li XY, Lu C, Gao L, Xiao SQ, Wen L (2018) An effective multi-objective algorithm for energy efficient scheduling in a real-life welding shop. IEEE Trans Ind Inf 14(12):5400–5409CrossRef
20.
go back to reference Cho HC, Knowles J, Fadali MS, Lee KS (2010) Fault detection and isolation of induction motors using recurrent neural networks and dynamic Bayesian modeling. IEEE Trans Control Syst Technol 18(2):430–437CrossRef Cho HC, Knowles J, Fadali MS, Lee KS (2010) Fault detection and isolation of induction motors using recurrent neural networks and dynamic Bayesian modeling. IEEE Trans Control Syst Technol 18(2):430–437CrossRef
21.
go back to reference Sun C, Ma M, Zhao Z, Chen X (2018) Sparse deep stacking network for fault diagnosis of motor. IEEE Trans Ind Inf 14(7):3261–3270CrossRef Sun C, Ma M, Zhao Z, Chen X (2018) Sparse deep stacking network for fault diagnosis of motor. IEEE Trans Ind Inf 14(7):3261–3270CrossRef
22.
go back to reference Verma NK, Gupta VK, Sharma M, Sevakula RK (2013) Intelligent condition based monitoring of rotating machines using sparse auto-encoders. In: IEEE conference on prognostics and health management (PHM), Gaithersburg, MD, pp 1–7 Verma NK, Gupta VK, Sharma M, Sevakula RK (2013) Intelligent condition based monitoring of rotating machines using sparse auto-encoders. In: IEEE conference on prognostics and health management (PHM), Gaithersburg, MD, pp 1–7
23.
go back to reference Jia F, Lei Y, Guo L, Lin J, Xing S (2018) A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines. Neurocomputing 272(10):619–628CrossRef Jia F, Lei Y, Guo L, Lin J, Xing S (2018) A neural network constructed by deep learning technique and its application to intelligent fault diagnosis of machines. Neurocomputing 272(10):619–628CrossRef
24.
go back to reference Qi Y, Shen C, Wang D, Shi J, Jiang X, Zhu Z (2017) Stacked sparse autoencoder-based deep network for fault diagnosis of rotating machinery. IEEE Access 5:15066–15079CrossRef Qi Y, Shen C, Wang D, Shi J, Jiang X, Zhu Z (2017) Stacked sparse autoencoder-based deep network for fault diagnosis of rotating machinery. IEEE Access 5:15066–15079CrossRef
25.
go back to reference Gan M, Wang C (2016) Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mech Syst Signal Process 72:92–104CrossRef Gan M, Wang C (2016) Construction of hierarchical diagnosis network based on deep learning and its application in the fault pattern recognition of rolling element bearings. Mech Syst Signal Process 72:92–104CrossRef
26.
go back to reference Han T, Liu C, Yang WG, Jiang DX (2018) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. arXiv preprint arXiv:1804.07265 Han T, Liu C, Yang WG, Jiang DX (2018) Deep transfer network with joint distribution adaptation: a new intelligent fault diagnosis framework for industry application. arXiv preprint arXiv:​1804.​07265
27.
go back to reference Zhang HJ, Cao X, Ho J, Chow T (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13(2):520–531CrossRef Zhang HJ, Cao X, Ho J, Chow T (2017) Object-level video advertising: an optimization framework. IEEE Trans Ind Inf 13(2):520–531CrossRef
29.
go back to reference Wen L, Li XY, Gao L, Zhang YY (2018) A new convolutional neural network based data-driven fault diagnosis method. IEEE Trans Ind Electron 65(7):5990–5998CrossRef Wen L, Li XY, Gao L, Zhang YY (2018) A new convolutional neural network based data-driven fault diagnosis method. IEEE Trans Ind Electron 65(7):5990–5998CrossRef
30.
go back to reference Wang F, Jiang HK, Shao HD, Duan WJ, Wu SP (2017) An adaptive deep convolutional neural network for rolling bearing fault diagnosis. Meas Sci Technol 28(9):095005CrossRef Wang F, Jiang HK, Shao HD, Duan WJ, Wu SP (2017) An adaptive deep convolutional neural network for rolling bearing fault diagnosis. Meas Sci Technol 28(9):095005CrossRef
31.
go back to reference Guo X, Chen L, Shen C (2016) Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis. Measurement 93:490–502CrossRef Guo X, Chen L, Shen C (2016) Hierarchical adaptive deep convolution neural network and its application to bearing fault diagnosis. Measurement 93:490–502CrossRef
32.
go back to reference Lu C, Wang ZY, Zhou B (2017) Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Adv Eng Inf 32:139–151CrossRef Lu C, Wang ZY, Zhou B (2017) Intelligent fault diagnosis of rolling bearing using hierarchical convolutional network based health state classification. Adv Eng Inf 32:139–151CrossRef
33.
go back to reference Xie Y, Zhang T (2017) Fault diagnosis for rotating machinery based on convolutional neural network and empirical mode decomposition. Shock Vib. Article ID 3084197 Xie Y, Zhang T (2017) Fault diagnosis for rotating machinery based on convolutional neural network and empirical mode decomposition. Shock Vib. Article ID 3084197
34.
go back to reference Xia M, Li T, Xu L, Liu L, de Silva CW (2018) Fault diagnosis for rotating machinery using multiple sensors and convolutional neural networks. IEEE/ASME Trans Mechatron 23(1):101–110CrossRef Xia M, Li T, Xu L, Liu L, de Silva CW (2018) Fault diagnosis for rotating machinery using multiple sensors and convolutional neural networks. IEEE/ASME Trans Mechatron 23(1):101–110CrossRef
35.
go back to reference Ren R, Hung T, Tan KC (2018) A generic deep-learning-based approach for automated surface inspection. IEEE Trans Cybern 48(3):929–940CrossRef Ren R, Hung T, Tan KC (2018) A generic deep-learning-based approach for automated surface inspection. IEEE Trans Cybern 48(3):929–940CrossRef
36.
go back to reference Wehrmann J, Simoes GS, Barros RC, Cavalcante VF (2018) Adult content detection in videos with convolutional and recurrent neural networks. Neurocomputing 272:432–438CrossRef Wehrmann J, Simoes GS, Barros RC, Cavalcante VF (2018) Adult content detection in videos with convolutional and recurrent neural networks. Neurocomputing 272:432–438CrossRef
37.
go back to reference Shin HC, Roth HR, Gao MC, Lu L, Xu ZY, Nogues I, Yao JH, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298CrossRef Shin HC, Roth HR, Gao MC, Lu L, Xu ZY, Nogues I, Yao JH, Mollura D, Summers RM (2016) Deep convolutional neural networks for computer-aided detection: CNN architectures, dataset characteristics and transfer learning. IEEE Trans Med Imaging 35(5):1285–1298CrossRef
38.
go back to reference Janssens O, Van de Walle R, Loccufier M, Van Hoecke S (2018) Deep learning for infrared thermal image based machine health monitoring. IEEE/ASME Trans Mechatron 23(1):151–159CrossRef Janssens O, Van de Walle R, Loccufier M, Van Hoecke S (2018) Deep learning for infrared thermal image based machine health monitoring. IEEE/ASME Trans Mechatron 23(1):151–159CrossRef
40.
go back to reference Chong UP (2011) Signal model-based fault detection and diagnosis for induction motors using features of vibration signal in two-dimension domain. Stroj Vestn J Mech Eng 57(9):655–666CrossRef Chong UP (2011) Signal model-based fault detection and diagnosis for induction motors using features of vibration signal in two-dimension domain. Stroj Vestn J Mech Eng 57(9):655–666CrossRef
41.
go back to reference Kang M, Kim JM (2014) Reliable fault diagnosis of multiple induction motor defects using a 2-d representation of Shannon wavelets. IEEE Trans Magn 50(10):1–13CrossRef Kang M, Kim JM (2014) Reliable fault diagnosis of multiple induction motor defects using a 2-d representation of Shannon wavelets. IEEE Trans Magn 50(10):1–13CrossRef
42.
go back to reference Lu C, Wang Y, Ragulskis M, Cheng Y (2016) Fault diagnosis for rotating machinery: a method based on image processing. PLoS ONE 11(10):e0164111CrossRef Lu C, Wang Y, Ragulskis M, Cheng Y (2016) Fault diagnosis for rotating machinery: a method based on image processing. PLoS ONE 11(10):e0164111CrossRef
43.
go back to reference Rauber TW, Assis Boldt F, Varejão FM (2015) Heterogeneous feature models and feature selection applied to bearing fault diagnosis. IEEE Trans Ind Electron 62(1):637–646CrossRef Rauber TW, Assis Boldt F, Varejão FM (2015) Heterogeneous feature models and feature selection applied to bearing fault diagnosis. IEEE Trans Ind Electron 62(1):637–646CrossRef
44.
go back to reference Han T, Jiang D, Zhao Q, Wang L, Yin K (2017) Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery. In: Transactions of the institute of measurement and control, pp 1–13 Han T, Jiang D, Zhao Q, Wang L, Yin K (2017) Comparison of random forest, artificial neural networks and support vector machine for intelligent diagnosis of rotating machinery. In: Transactions of the institute of measurement and control, pp 1–13
45.
go back to reference Zhu K, Song X, Xue D (2014) A roller bearing fault diagnosis method based on hierarchical entropy and support vector machine with particle swarm optimization algorithm. Measurement 47:669–675CrossRef Zhu K, Song X, Xue D (2014) A roller bearing fault diagnosis method based on hierarchical entropy and support vector machine with particle swarm optimization algorithm. Measurement 47:669–675CrossRef
46.
go back to reference Lessmeier C, Kimotho JK, Zimmer D, Sextro W (2016) Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification. In: Proceedings of the European conference of the prognostics and health management society, pp 05–08 Lessmeier C, Kimotho JK, Zimmer D, Sextro W (2016) Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: a benchmark data set for data-driven classification. In: Proceedings of the European conference of the prognostics and health management society, pp 05–08
47.
go back to reference Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the Case Western Reserve University data: a benchmark study. Mech Syst Signal Process 64:100–131CrossRef Smith WA, Randall RB (2015) Rolling element bearing diagnostics using the Case Western Reserve University data: a benchmark study. Mech Syst Signal Process 64:100–131CrossRef
48.
go back to reference Lei Y, Jia F, Lin J, Xing S, Ding SX (2016) An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data. IEEE Trans Ind Electron 63(5):3137–3147CrossRef Lei Y, Jia F, Lin J, Xing S, Ding SX (2016) An intelligent fault diagnosis method using unsupervised feature learning towards mechanical big data. IEEE Trans Ind Electron 63(5):3137–3147CrossRef
Metadata
Title
A transfer convolutional neural network for fault diagnosis based on ResNet-50
Authors
Long Wen
Xinyu Li
Liang Gao
Publication date
26-02-2019
Publisher
Springer London
Published in
Neural Computing and Applications / Issue 10/2020
Print ISSN: 0941-0643
Electronic ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-019-04097-w

Other articles of this Issue 10/2020

Neural Computing and Applications 10/2020 Go to the issue

Advances in Parallel and Distributed Computing for Neural Computing

Optimizing partitioned CSR-based SpGEMM on the Sunway TaihuLight

Premium Partner