Skip to main content
Top
Published in: International Journal of Parallel Programming 1/2020

14-11-2019

Empirical Mode Decomposition and Temporal Convolutional Networks for Remaining Useful Life Estimation

Authors: Wensi Yang, Qingfeng Yao, Kejiang Ye, Cheng-Zhong Xu

Published in: International Journal of Parallel Programming | Issue 1/2020

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Remaining useful life (RUL) prediction plays an important role in guaranteeing safe operation and reducing maintenance cost in modern industry. In this paper, we present a novel deep learning method for RUL estimation based on time empirical mode decomposition (EMD) and temporal convolutional networks (TCN). The proposed framework can effectively reveal the non-stationary characteristics of bearing degradation signals and acquire time-series degradation signals which namely intrinsic mode functions through empirical mode decomposition. Furthermore, the feature information is used as the input to convolution layer and trained by TCN to predict remaining useful life. The proposed EMD–TCN model structure maintains a superior result compared to several state-of-the-art convolutional algorithms on public data sets. Experimental results show that the average score of EMD–TCN model is improved by 10–20% than traditional convolutional algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Heng, A., Tan, A.C., Mathew, J., Montgomery, N., Banjevic, D., Jardine, A.K.: Intelligent condition-based prediction of machinery reliability. Mech. Syst. Signal Process. 23(5), 1600–1614 (2009)CrossRef Heng, A., Tan, A.C., Mathew, J., Montgomery, N., Banjevic, D., Jardine, A.K.: Intelligent condition-based prediction of machinery reliability. Mech. Syst. Signal Process. 23(5), 1600–1614 (2009)CrossRef
2.
go back to reference Zhang, J., Jiang, N., Li, H., Li, N.: Online health assessment of wind turbine based on operational condition recognition. Trans. Inst. Meas. Control. 41(10), 2970–2981 (2019) CrossRef Zhang, J., Jiang, N., Li, H., Li, N.: Online health assessment of wind turbine based on operational condition recognition. Trans. Inst. Meas. Control. 41(10), 2970–2981 (2019) CrossRef
3.
go back to reference Fan, M., Zeng, Z., Zio, E., Kang, R., Chen, Y.: A sequential bayesian approach for remaining useful life prediction of dependent competing failure processes. IEEE Trans. Reliab. 68(1), 317–329 (2018)CrossRef Fan, M., Zeng, Z., Zio, E., Kang, R., Chen, Y.: A sequential bayesian approach for remaining useful life prediction of dependent competing failure processes. IEEE Trans. Reliab. 68(1), 317–329 (2018)CrossRef
4.
go back to reference Khorasgani, H., Kulkarni, C., Biswas, G., Celaya, J.R., Goebel, K.: Degredation modeling and remaining useful life prediction of electrolytic capacitors under thermal overstress condition using particle filters. In: Annual Conference of the Prognostics and Health Management Society (PHM’13) (2013) Khorasgani, H., Kulkarni, C., Biswas, G., Celaya, J.R., Goebel, K.: Degredation modeling and remaining useful life prediction of electrolytic capacitors under thermal overstress condition using particle filters. In: Annual Conference of the Prognostics and Health Management Society (PHM’13) (2013)
5.
go back to reference Zheng, Z., Podobnik, B., Feng, L., Li, B.: Changes in cross-correlations as an indicator for systemic risk. Sci Rep 2, 888 (2012)CrossRef Zheng, Z., Podobnik, B., Feng, L., Li, B.: Changes in cross-correlations as an indicator for systemic risk. Sci Rep 2, 888 (2012)CrossRef
6.
go back to reference Zhang, C., Hong, G.S., Xu, H., Tan, K.C., Zhou, J.H., Chan, H.L., Li, H.: A data-driven prognostics framework for tool remaining useful life estimation in tool condition monitoring. In 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1–8. IEEE (2017) Zhang, C., Hong, G.S., Xu, H., Tan, K.C., Zhou, J.H., Chan, H.L., Li, H.: A data-driven prognostics framework for tool remaining useful life estimation in tool condition monitoring. In 2017 22nd IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), pp. 1–8. IEEE (2017)
7.
go back to reference Si, X.-S., Wang, W., Hu, C.-H., Zhou, D.-H.: Remaining useful life estimation—a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)MathSciNetCrossRef Si, X.-S., Wang, W., Hu, C.-H., Zhou, D.-H.: Remaining useful life estimation—a review on the statistical data driven approaches. Eur. J. Oper. Res. 213(1), 1–14 (2011)MathSciNetCrossRef
8.
go back to reference Fu, D., Zheng, Z., Gui, J., Xiao, R., Huang, G., Li, Y.: Development of a fuel management model for a multi-source district heating system under multi-uncertainty and multi-dimensional constraints. Energy Convers. Manag. 153, 243–256 (2017)CrossRef Fu, D., Zheng, Z., Gui, J., Xiao, R., Huang, G., Li, Y.: Development of a fuel management model for a multi-source district heating system under multi-uncertainty and multi-dimensional constraints. Energy Convers. Manag. 153, 243–256 (2017)CrossRef
9.
go back to reference Li, X., Ding, Q., Sun, J.-Q.: Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab. Eng. Syst. Saf. 172, 1–11 (2018)CrossRef Li, X., Ding, Q., Sun, J.-Q.: Remaining useful life estimation in prognostics using deep convolution neural networks. Reliab. Eng. Syst. Saf. 172, 1–11 (2018)CrossRef
10.
go back to reference Huang, N.E., Shen, Z., Long, S.R., Wu, M.C., Shih, H.H., Zheng, Q., Yen, N.-C., Tung, C.C., Liu, H.H.: The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 454(1971), 903–995 (1998)MathSciNetCrossRef Huang, N.E., Shen, Z., Long, S.R., Wu, M.C., Shih, H.H., Zheng, Q., Yen, N.-C., Tung, C.C., Liu, H.H.: The empirical mode decomposition and the hilbert spectrum for nonlinear and non-stationary time series analysis. Proc. R. Soc. Lond. Ser. A Math. Phys. Eng. Sci. 454(1971), 903–995 (1998)MathSciNetCrossRef
11.
go back to reference Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B., Zerhouni, N., Varnier, C.: Pronostia: an experimental platform for bearings accelerated degradation tests. In: IEEE International Conference on Prognostics and Health Management, PHM’12. IEEE Catalog Number: CPF12PHM-CDR, pp. 1–8 (2012) Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B., Zerhouni, N., Varnier, C.: Pronostia: an experimental platform for bearings accelerated degradation tests. In: IEEE International Conference on Prognostics and Health Management, PHM’12. IEEE Catalog Number: CPF12PHM-CDR, pp. 1–8 (2012)
12.
go back to reference Ahmadzadeh, F., Lundberg, J.: Remaining useful life estimation. Int. J. Syst. Assur. Eng. Manag. 5(4), 461–474 (2014)CrossRef Ahmadzadeh, F., Lundberg, J.: Remaining useful life estimation. Int. J. Syst. Assur. Eng. Manag. 5(4), 461–474 (2014)CrossRef
13.
go back to reference Gao, Z., Cecati, C., Ding, S.X.: A survey of fault diagnosis and fault-tolerant techniques—part I: fault diagnosis with model-based and signal-based approaches. IEEE Trans. Ind. Electron. 62(6), 3757–3767 (2015)CrossRef Gao, Z., Cecati, C., Ding, S.X.: A survey of fault diagnosis and fault-tolerant techniques—part I: fault diagnosis with model-based and signal-based approaches. IEEE Trans. Ind. Electron. 62(6), 3757–3767 (2015)CrossRef
14.
go back to reference Luo, J., Bixby, A., Pattipati, K., Qiao, L., Kawamoto, M., Chigusa, S.: An interacting multiple model approach to model-based prognostics. In: SMC’03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance (Cat. No. 03CH37483), vol. 1, pp. 189–194. IEEE (2003) Luo, J., Bixby, A., Pattipati, K., Qiao, L., Kawamoto, M., Chigusa, S.: An interacting multiple model approach to model-based prognostics. In: SMC’03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme-System Security and Assurance (Cat. No. 03CH37483), vol. 1, pp. 189–194. IEEE (2003)
15.
go back to reference Li, Y., Kurfess, T., Liang, S.: Stochastic prognostics for rolling element bearings. Mech. Syst. Signal Process. 14(5), 747–762 (2000)CrossRef Li, Y., Kurfess, T., Liang, S.: Stochastic prognostics for rolling element bearings. Mech. Syst. Signal Process. 14(5), 747–762 (2000)CrossRef
16.
go back to reference Baillie, D., Mathew, J.: Nonlinear model-based fault diagnosis of bearings. NDT e Int. 5(30), 328 (1997) Baillie, D., Mathew, J.: Nonlinear model-based fault diagnosis of bearings. NDT e Int. 5(30), 328 (1997)
17.
go back to reference Tobon-Mejia, D.A., Medjaher, K., Zerhouni, N., Tripot, G.: A data-driven failure prognostics method based on mixture of gaussians hidden markov models. IEEE Trans. Reliab. 61(2), 491–503 (2012)CrossRef Tobon-Mejia, D.A., Medjaher, K., Zerhouni, N., Tripot, G.: A data-driven failure prognostics method based on mixture of gaussians hidden markov models. IEEE Trans. Reliab. 61(2), 491–503 (2012)CrossRef
18.
go back to reference Cheng, F., Qu, L., Qiao, W., Hao, L.: Enhanced particle filtering for bearing remaining useful life prediction of wind turbine drivetrain gearboxes. IEEE Trans. Ind. Electron. 66(6), 4738–4748 (2018)CrossRef Cheng, F., Qu, L., Qiao, W., Hao, L.: Enhanced particle filtering for bearing remaining useful life prediction of wind turbine drivetrain gearboxes. IEEE Trans. Ind. Electron. 66(6), 4738–4748 (2018)CrossRef
19.
go back to reference Banjevic, D., Jardine, A.: Calculation of reliability function and remaining useful life for a markov failure time process. IMA J. Manag. Math. 17(2), 115–130 (2006)MathSciNetCrossRef Banjevic, D., Jardine, A.: Calculation of reliability function and remaining useful life for a markov failure time process. IMA J. Manag. Math. 17(2), 115–130 (2006)MathSciNetCrossRef
20.
go back to reference Sankararaman, S., Goebel, K.: Uncertainty quantification in remaining useful life of aerospace components using state space models and inverse form. In: 54th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, p. 1537 (2013) Sankararaman, S., Goebel, K.: Uncertainty quantification in remaining useful life of aerospace components using state space models and inverse form. In: 54th AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics, and Materials Conference, p. 1537 (2013)
21.
go back to reference Zhang, J., Wang, S., Chen, L., Guo, G., Chen, R., Vanasse, A.: Time-dependent survival neural network for remaining useful life prediction. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 441–452. Springer (2019) Zhang, J., Wang, S., Chen, L., Guo, G., Chen, R., Vanasse, A.: Time-dependent survival neural network for remaining useful life prediction. In: Pacific-Asia Conference on Knowledge Discovery and Data Mining, pp. 441–452. Springer (2019)
22.
go back to reference Tian, Z.: An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring. J. Intell. Manuf. 23(2), 227–237 (2012)CrossRef Tian, Z.: An artificial neural network method for remaining useful life prediction of equipment subject to condition monitoring. J. Intell. Manuf. 23(2), 227–237 (2012)CrossRef
23.
go back to reference Soualhi, A., Medjaher, K., Zerhouni, N.: Bearing health monitoring based on Hilbert–Huang transform, support vector machine, and regression. IEEE Trans. Instrum. Meas. 64(1), 52–62 (2014)CrossRef Soualhi, A., Medjaher, K., Zerhouni, N.: Bearing health monitoring based on Hilbert–Huang transform, support vector machine, and regression. IEEE Trans. Instrum. Meas. 64(1), 52–62 (2014)CrossRef
24.
go back to reference Zhu, M., Ye, K., Wang, Y., Xu, C.-Z.: A deep learning approach for network anomaly detection based on AMF-LSTM. In: IFIP International Conference on Network and Parallel Computing, pp. 137–141. Springer (2018) Zhu, M., Ye, K., Wang, Y., Xu, C.-Z.: A deep learning approach for network anomaly detection based on AMF-LSTM. In: IFIP International Conference on Network and Parallel Computing, pp. 137–141. Springer (2018)
25.
go back to reference Zhu, M., Ye, K., Xu, C.-Z.: Network anomaly detection and identification based on deep learning methods. In: International Conference on Cloud Computing, pp. 219–234. Springer (2018) Zhu, M., Ye, K., Xu, C.-Z.: Network anomaly detection and identification based on deep learning methods. In: International Conference on Cloud Computing, pp. 219–234. Springer (2018)
26.
go back to reference Lin, P., Ye, K., Xu, C.-Z.: Dynamic network anomaly detection system by using deep learning techniques. In: International Conference on Cloud Computing, pp. 161–176. Springer (2019) Lin, P., Ye, K., Xu, C.-Z.: Dynamic network anomaly detection system by using deep learning techniques. In: International Conference on Cloud Computing, pp. 161–176. Springer (2019)
27.
go back to reference Ye, K., Liu, Y., Xu, G., Xu, C.-Z.: Fault injection and detection for artificial intelligence applications in container-based clouds. In: International Conference on Cloud Computing, pp. 112–127. Springer (2018) Ye, K., Liu, Y., Xu, G., Xu, C.-Z.: Fault injection and detection for artificial intelligence applications in container-based clouds. In: International Conference on Cloud Computing, pp. 112–127. Springer (2018)
28.
go back to reference Pinheiro, H., Jain, P., Joos, G.: Series-parallel resonant converter in the self-sustained oscillating mode for unity power factor applications. In: Proceedings of APEC 97-Applied Power Electronics Conference, vol. 1, pp. 477–483. IEEE (1997) Pinheiro, H., Jain, P., Joos, G.: Series-parallel resonant converter in the self-sustained oscillating mode for unity power factor applications. In: Proceedings of APEC 97-Applied Power Electronics Conference, vol. 1, pp. 477–483. IEEE (1997)
29.
go back to reference Bai, S., Kolter, J. Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling (2018). arXiv preprint arXiv:1803.01271 Bai, S., Kolter, J. Z., Koltun, V.: An empirical evaluation of generic convolutional and recurrent networks for sequence modeling (2018). arXiv preprint arXiv:​1803.​01271
30.
go back to reference Deng, S., Zhang, N., Zhang, W., Chen, J., Pan, J. Z., Chen, H.: Knowledge-driven stock trend prediction and explanation via temporal convolutional network. In: Companion Proceedings of The 2019 World Wide Web Conference, pp. 678–685. ACM (2019) Deng, S., Zhang, N., Zhang, W., Chen, J., Pan, J. Z., Chen, H.: Knowledge-driven stock trend prediction and explanation via temporal convolutional network. In: Companion Proceedings of The 2019 World Wide Web Conference, pp. 678–685. ACM (2019)
31.
go back to reference Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp. 807–814 (2010) Nair, V., Hinton, G.E.: Rectified linear units improve restricted boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp. 807–814 (2010)
32.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 (2016) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778 (2016)
Metadata
Title
Empirical Mode Decomposition and Temporal Convolutional Networks for Remaining Useful Life Estimation
Authors
Wensi Yang
Qingfeng Yao
Kejiang Ye
Cheng-Zhong Xu
Publication date
14-11-2019
Publisher
Springer US
Published in
International Journal of Parallel Programming / Issue 1/2020
Print ISSN: 0885-7458
Electronic ISSN: 1573-7640
DOI
https://doi.org/10.1007/s10766-019-00650-1

Other articles of this Issue 1/2020

International Journal of Parallel Programming 1/2020 Go to the issue

Premium Partner