Top

Journal of Intelligent Manufacturing

Published in:

27-08-2021

Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions

Authors: Han Cheng, Xianguang Kong, Qibin Wang, Hongbo Ma, Shengkang Yang, Gaige Chen

Published in: Journal of Intelligent Manufacturing | Issue 2/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Remaining useful life (RUL) prediction can effectively avoid unexpected mechanical breakdowns, thus improving operational reliability. However, the distribution discrepancy caused by different working conditions may lead to deterioration in the prognostic task of machinery. Inspired by the idea of transfer learning, a novel intelligent approach based on dynamic domain adaptation (DDA) is proposed for the machinery RUL prediction of multiple working conditions in this paper. At first, reverse validation technology is utilized to select appropriate source samples to construct the training dataset. Then two dynamic domain adaptation networks are trained to extract domain invariant degradation feature and predict RUL, namely dynamic distribution adaptation network and dynamic adversarial adaptation network. In the dynamic domain adaptation network, the fuzzy set theory is employed to calculate conditional distribution discrepancy loss, and the dynamic adaptive factor is introduced to dynamically adjust the distribution weights. Finally, the proposed method is proved to be effective through two run-to-failure bearing datasets. Related experimental results indicate that, compared with other related RUL prediction methods, the DDA-based prognostic method not only achieves better prediction performance, but also avoids the influence of negative transfer and distribution weight fluctuation.

previous article A data-driven method of selective disassembly planning at end-of-life under uncertainty

next article Towards the efficient generation of variant design in product development networks: network nodes importance based product configuration evaluation approach

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Ahmad, W., Khan, S. A., Islam, M. M. M., & Kim, J. M. (2019). A reliable technique for remaining useful life estimation of rolling element bearings using dynamic regression models. Reliability Engineering & System Safety, 184, 67–76. https://doi.org/10.1016/j.ress.2018.02.003CrossRef

Benkedjouh, T., Medjaher, K., Zerhouni, N., & Rechak, S. (2013). Remaining useful life estimation based on nonlinear feature reduction and support vector regression. Engineering Applications of Artificial Intelligence, 26(7), 1751–1760. https://doi.org/10.1016/j.engappai.2013.02.006CrossRef

Benkedjouh, T., Medjaher, K., Zerhouni, N., & Rechak, S. (2015). Health assessment and life prediction of cutting tools based on support vector regression. Journal of intelligent manufacturing, 26(2), 213–223. https://doi.org/10.1007/s10845-013-0774-6CrossRef

Cao, L., Qian, Z., Zareipour, H., Wood, D., Mollasalehi, E., Tian, S., & Pei, Y. (2018). Prediction of remaining useful life of wind turbine bearings under non-stationary operating conditions. Energies, 11(12), 3318.CrossRef

Chen, Z., Wu, M., Zhao, R., Guretno, F., Yan, R., & Li, X. (2020). Machine remaining useful life prediction via an attention based deep learning approach. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/TIE.2020.2972443CrossRef

Chen, G., Wang, P., Feng, B., Li, Y., & Liu, D. (2020). The framework design of smart factory in discrete manufacturing industry based on cyber-physical system. International Journal of Computer Integrated Manufacturing, 33(1), 79–101. https://doi.org/10.1080/0951192X.2019.1699254CrossRef

Cheng, H., Kong, X., Chen, G., Wang, Q., & Wang, R. (2021). Transferable convolutional neural network based remaining useful life prediction of bearing under multiple failure behaviors. Measurement, 168, 108286. https://doi.org/10.1016/j.measurement.2020.108286CrossRef

Da Costa, P. R. D. O., Akçay, A., Zhang, Y., & Kaymak, U. (2020). Remaining useful lifetime prediction via deep domain adaptation. Reliability Engineering & System Safety, 195, 106682. https://doi.org/10.1016/j.ress.2019.106682CrossRef

Ganin, Y., Ustinova, E., Ajakan, H., Germain, P., Larochelle, H., Laviolette, F., Marchand, M., & Lempitsky, C. (2016). Domain-adversarial training of neural networks. Jounal of Machine Learning Research., 17(1), 2096–2030.

Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A. and Bengio, Y. (2014). Generative Adversarial Nets. In Advances in Neural Information Processing Systems (pp. 2672–2680).

Guo, L., Li, N., Jia, F., Lei, Y., & Lin, J. (2017). A recurrent neural network based health indicator for remaining useful life prediction of bearings. Neurocomputing, 240, 98–109. https://doi.org/10.1016/j.neucom.2017.02.045CrossRef

Javed, K., Gouriveau, R., Zerhouni, N., & Nectoux, P. (2015). Enabling health monitoring approach based on vibration data for accurate prognostics. IEEE Transactions on Industrial Electronics, 62(1), 647–656. https://doi.org/10.1109/TIE.2014.2327917CrossRef

Kingma, D. P., & Ba, J. (2014). Adam: A method for stochastic optimization. In arXiv preprint https://arxiv.org/abs/1412.6980.

Kong, X., Mao, G., Wang, Q., Ma, H., & Yang, W. (2020). A multi-ensemble method based on deep auto-encoders for fault diagnosis of rolling bearings. Measurement, 151, 107132. https://doi.org/10.1016/j.measurement.2019.107132CrossRef

Kundu, P., Chopra, S., & Lad, B. K. (2019). Multiple failure behaviors identification and remaining useful life prediction of ball bearings. Journal of Intelligent Manufacturing, 30(4), 1795–1807. https://doi.org/10.1007/s10845-017-1357-8CrossRef

LeCun, Y., Bengio, Y., & Hinton, G. (2015). Deep learning. Nature, 521(7553), 436–444. https://doi.org/10.1038/nature14539CrossRef

Lee, J., Wu, F., Zhao, W., Ghaffari, M., Liao, L., & Siegel, D. (2014). Prognostics and health management design for rotary machinery systems—Reviews, methodology and applications. Mechanical Systems and Signal Processing, 42(1), 314–334. https://doi.org/10.1016/j.ymssp.2013.06.004CrossRef

Lei, Y., Li, N., & Lin, J. (2016). A new method based on stochastic process models for machine remaining useful life prediction. IEEE Transactions on Instrumentation and Measurement, 65(12), 2671–2684. https://doi.org/10.1109/TIM.2016.2601004CrossRef

Lei, Y., Li, N., Guo, L., Li, N., Yan, T., & Lin, J. (2018). Machinery health prognostics: A systematic review from data acquisition to RUL prediction. Mechanical Systems and Signal Processing, 104, 799–834. https://doi.org/10.1016/j.ymssp.2017.11.016CrossRef

Li, X., & Zhang, W. (2020). Deep learning-based partial domain adaptation method on intelligent machinery fault diagnostics. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/TIE.2020.2984968CrossRef

Li, X., Zhang, W., & Ding, Q. (2019). Deep learning-based remaining useful life estimation of bearings using multi-scale feature extraction. Reliability Engineering & System Safety, 182, 208–218. https://doi.org/10.1016/j.ress.2018.11.011CrossRef

Li, X., Zhang, W., Ma, H., Luo, Z., & Li, X. (2020). Data alignments in machinery remaining useful life prediction using deep adversarial neural networks. Knowledge-Based Systems. https://doi.org/10.1016/j.knosys.2020.105843CrossRef

Li, X., Li, X., & Ma, H. (2020). Deep representation clustering-based fault diagnosis method with unsupervised data applied to rotating machinery. Mechanical Systems and Signal Processing, 143, 106825. https://doi.org/10.1016/j.ymssp.2020.106825CrossRef

Li, X., Zhang, W., Xu, N., & Ding, Q. (2020). Deep learning-based machinery fault diagnostics with domain adaptation across sensors at different places. IEEE Transactions on Industrial Electronics, 67(8), 6785–6794. https://doi.org/10.1109/TIE.2019.2935987CrossRef

Liu, C., Zhang, L., Niu, J., Yao, R., & Wu, C. (2020). Intelligent prognostics of machining tools based on adaptive variational mode decomposition and deep learning method with attention mechanism. Neurocomputing. https://doi.org/10.1016/j.neucom.2020.06.116CrossRef

Long, M., Cao, Y., Wang, J., & Jordan, M. (2015). Learning transferable features with deep adaptation networks. In Proceedings of the 32nd International Conference on Machine Learning (Vol. 37, pp. 97–105).

Long, M., Zhu, H., Wang, J., & Jordan, M. I. (2017). Deep transfer learning with joint adaptation networks. In Proceedings of the 34th International Conference on Machine Learning (Vol. 70, pp. 2208–2217). Sydney, NSW, Australia.

Mao, W., He, J., & Zuo, M. J. (2020). Predicting remaining useful life of rolling bearings based on deep feature representation and transfer learning. IEEE Transactions on Instrumentation and Measurement, 69(4), 1594–1608. https://doi.org/10.1109/TIM.2019.2917735CrossRef

Mo, Y., Wu, Q., Li, X., & Huang, B. (2021). Remaining useful life estimation via transformer encoder enhanced by a gated convolutional unit. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01750-xCrossRef

Nectoux, P., Gouriveau, R., Medjaher, K., Ramasso, E., Chebel-Morello, B., Zerhouni, N., & Varnier, C. (2012). PRONOSTIA : an experimental platform for bearings accelerated degradation tests. In IEEE International Conference on Prognostics and Health Management (PHM’12) (pp. 1–8). Denver, Colorado, United States. https://hal.archives-ouvertes.fr/hal-00719503

Pan, S. J., & Yang, Q. (2010). A survey on transfer learning. IEEE Transactions on Knowledge and Data Engineering, 22(10), 1345–1359. https://doi.org/10.1109/TKDE.2009.191CrossRef

Pan, Z., Meng, Z., Chen, Z., Gao, W., & Shi, Y. (2020). A two-stage method based on extreme learning machine for predicting the remaining useful life of rolling-element bearings. Mechanical Systems and Signal Processing, 144, 106899. https://doi.org/10.1016/j.ymssp.2020.106899CrossRef

Pillai, S., & Vadakkepat, P. (2021). Deep learning for machine health prognostics using Kernel-based feature transformation. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-021-01747-6CrossRef

Schölkopf, B., Platt, J., & Hofmann, T. (2007). Analysis of representations for domain adaptation. In Advances in Neural Information Processing Systems 19: Proceedings of the 2006 Conference (pp. 137–144). MITP. https://ieeexplore.ieee.org/document/6287402

Si, X., Wang, W., Hu, C., & Zhou, D. (2011). Remaining useful life estimation – A review on the statistical data driven approaches. European Journal of Operational Research, 213(1), 1–14. https://doi.org/10.1016/j.ejor.2010.11.018CrossRef

Stringer, D. B., Sheth, P. N., & Allaire, P. E. (2012). Physics-based modeling strategies for diagnostic and prognostic application in aerospace systems. Journal of Intelligent Manufacturing, 23(2), 155–162.CrossRef

Sun, C., Ma, M., Zhao, Z., Tian, S., Yan, R., & Chen, X. (2019). Deep transfer learning based on sparse autoencoder for remaining useful life prediction of tool in manufacturing. IEEE Transactions on Industrial Informatics, 15(4), 2416–2425. https://doi.org/10.1109/TII.2018.2881543CrossRef

Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., & Liu, C. (2018). A Survey on deep transfer learning. In Artificial Neural Networks and Machine Learning – ICANN 2018 (pp. 270–279).

Tzeng, E., Hoffman, J., Zhang, N., Saenko, K., & Darrell, T. (2014). Deep domain confusion: maximizing for domain invariance.

Wang, P., & Luo, M. (2021). A digital twin-based big data virtual and real fusion learning reference framework supported by industrial internet towards smart manufacturing. Journal of Manufacturing Systems, 58, 16–32. https://doi.org/10.1016/j.jmsy.2020.11.012CrossRef

Wang, X., & Zhao, J. (2020). A complex process fault diagnosis method based on manifold distribution adaptation. Engineering Applications of Artificial Intelligence, 87, 103267. https://doi.org/10.1016/j.engappai.2019.103267CrossRef

Wang, H., Huang, H., Li, Y., & Yang, Y. (2016). Condition-based maintenance with scheduling threshold and maintenance threshold. IEEE Transactions on Reliability.

Wang, J., Gao, R. X., Yuan, Z., Fan, Z., & Zhang, L. (2019). A joint particle filter and expectation maximization approach to machine condition prognosis. Journal of Intelligent Manufacturing, 30(2), 605–621. https://doi.org/10.1007/s10845-016-1268-0CrossRef

Wang, Q., Zhao, B., Ma, H., Chang, J., & Mao, G. (2019). A method for rapidly evaluating reliability and predicting remaining useful life using two-dimensional convolutional neural network with signal conversion. Journal of Mechanical Science and Technology, 33(6), 2561–2571. https://doi.org/10.1007/s12206-019-0504-xCrossRef

Wang, B., Lei, Y., Li, N., & Yan, T. (2019). Deep separable convolutional network for remaining useful life prediction of machinery. Mechanical Systems and Signal Processing, 134, 106330. https://doi.org/10.1016/j.ymssp.2019.106330CrossRef

Wang, B., Lei, Y., Li, N., & Wang, W. (2020). Multi-scale convolutional attention network for predicting remaining useful life of machinery. IEEE Transactions on Industrial Electronics. https://doi.org/10.1109/TIE.2020.3003649CrossRef

Wang, B., Lei, Y., Li, N., & Li, N. (2020). A hybrid prognostics approach for estimating remaining useful life of rolling element bearings. IEEE Transactions on Reliability, 69(1), 401–412. https://doi.org/10.1109/TR.2018.2882682CrossRef

Wang, B., Lei, Y., Yan, T., Li, N., & Guo, L. (2020). Recurrent convolutional neural network: A new framework for remaining useful life prediction of machinery. Neurocomputing, 379, 117–129. https://doi.org/10.1016/j.neucom.2019.10.064CrossRef

Wang, J., Chen, Y., Feng, W., Yu, H., Huang, M., & Yang, Q. (2020d). Transfer learning with dynamic distribution adaptation. ACM Intelligent Systems and Technology, 11(1). doi: https://doi.org/10.1145/3360309

Wu, D., Lawhern, V. J., Gordon, S., Lance, B. J., & Lin, C. (2017). Driver drowsiness estimation from EEG signals using online weighted adaptation regularization for regression (OwARR). IEEE Transactions on Fuzzy Systems, 25(6), 1522–1535. https://doi.org/10.1109/TFUZZ.2016.2633379CrossRef

Yang, B., Liu, R., & Zio, E. (2019). Remaining useful life prediction based on a double-convolutional neural network architecture. IEEE Transactions on Industrial Electronics, 66(12), 9521–9530.CrossRef

Yu, C., Wang, J., Chen, Y., & Huang, M. (2019). Transfer Learning with Dynamic Adversarial Adaptation Network. In 2019 IEEE International Conference on Data Mining (ICDM) (pp. 778–786). doi: https://doi.org/10.1109/ICDM.2019.00088

Yu, K., Lin, T. R., Ma, H., Li, X., & Li, X. (2021). A multi-stage semi-supervised learning approach for intelligent fault diagnosis of rolling bearing using data augmentation and metric learning. Mechanical Systems and Signal Processing, 146, 107043. https://doi.org/10.1016/j.ymssp.2020.107043CrossRef

Zadeh, L. A. (1965). Fuzzy sets. Information and Control, 8(3), 338–353. https://doi.org/10.1016/S0019-9958(65)90241-XCrossRef

Zemouri, R., & Gouriveau, R. (2010). Towards accurate and reproducible predictions for prognostic : an approach combining a RRBF Network and an AutoRegressive Model. IFAC Proceedings Volumes, 43(3), 140–145.CrossRef

Zhang, L., Guo, L., Gao, H., Dong, D., Fu, G., & Hong, X. (2020). Instance-based ensemble deep transfer learning network: A new intelligent degradation recognition method and its application on ball screw. Mechanical Systems and Signal Processing, 140, 106681. https://doi.org/10.1016/j.ymssp.2020.106681CrossRef

Zheng, H., Wang, R., Yang, Y., Yin, J., Li, Y., Li, Y., & Xu, M. (2019). Cross-domain fault diagnosis using knowledge transfer strategy: A review. IEEE Access, 7, 129260–129290. https://doi.org/10.1109/ACCESS.2019.2939876CrossRef

Zheng, P., Xu, X., & Chen, C. H. (2020). A data-driven cyber-physical approach for personalised smart, connected product co-development in a cloud-based environment. Journal of Intelligent Manufacturing, 31(1), 3–18.CrossRef

Zhong, E., Fan, W., Yang, Q., Verscheure, O., & Ren, J. (2010). Cross validation framework to choose amongst models and datasets for transfer learning. In Machine Learning and Knowledge Discovery in Databases (pp. 547–562). Berlin, Heidelberg: Springer Berlin Heidelberg.

Zhu, Y., Zhuang, F., Wang, J., Chen, J., Shi, Z., Wu, W., & He, Q. (2019). Multi-representation adaptation network for cross-domain image classification. Neural Networks, 119, 214–221.CrossRef

Zhu, J., Chen, N., & Shen, C. (2020). A new data-driven transferable remaining useful life prediction approach for bearing under different working conditions. Mechanical Systems and Signal Processing, 139, 106602. https://doi.org/10.1016/j.ymssp.2019.106602CrossRef

Zhuang, F., Qi, Z., Duan, K., Xi, D., Zhu, Y., Zhu, H., et al. (2020). A comprehensive survey on transfer learning. Proceedings of the IEEE. https://doi.org/10.1109/JPROC.2020.3004555CrossRef

Title: Deep transfer learning based on dynamic domain adaptation for remaining useful life prediction under different working conditions
Authors: Han Cheng
Xianguang Kong
Qibin Wang
Hongbo Ma
Shengkang Yang
Gaige Chen
Publication date: 27-08-2021
Publisher: Springer US
Published in: Journal of Intelligent Manufacturing / Issue 2/2023
Print ISSN: 0956-5515
Electronic ISSN: 1572-8145
DOI: https://doi.org/10.1007/s10845-021-01814-y

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 2/2023

Predicting the quality of a machined workpiece with a variational autoencoder approach

Towards the efficient generation of variant design in product development networks: network nodes importance based product configuration evaluation approach

An assembly timing planning method based on knowledge and mixed integer linear programming

A data-driven workflow for evaporation performance degradation analysis: a full-scale case study in the herbal medicine manufacturing industry

A low-cost intelligent tracking system for clothing manufacturers

Correction to: A data-driven method for performance analysis and improvement in production systems with quality inspection

Premium Partners