Skip to main content
Erschienen in: Journal of Intelligent Manufacturing 6/2022

03.03.2021

Deep learning for machine health prognostics using Kernel-based feature transformation

verfasst von: Shanmugasivam Pillai, Prahlad Vadakkepat

Erschienen in: Journal of Intelligent Manufacturing | Ausgabe 6/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Prognostic health management minimizes system downtime and improves overall equipment effectiveness. Accurate prediction of remaining useful life (RUL) is key to prognostics. Prominent machine learning algorithms implement handcrafted feature extraction to improve RUL prediction. Deep learning automates feature extraction from raw data but requires large datasets and computationally expensive fine-tuning. Data-specific handcrafting and fine-tuning limit the generalization capability of existing models. Proposed framework addresses these challenges using Temporal Multivariate 3D Convolutional Network (TM3C) and Kernel-based Transformation (KT) of features. KT generates 3D features that incorporate trendable degradation patterns from multivariate temporal relationship among sensor data. TM3C implements 3D convolutional layers with temporal filters for RUL prediction. KT is generalizable and improves feature relevance. Full-width filters in TM3C reduce number of tunable parameters and convolution operations. Proposed TM3C-KT capitalizes on the strength of deep learning while lowering the cost for feature discovery, parameter learning, and model fine-tuning. TM3C-KT is evaluated on three prognostics applications, (1) RUL prediction for turbofan engines, (2) Failure state estimation for hydraulic pumps, and (3) Component wear prediction for milling machines. Performance of the framework is comparable and better than benchmark methods in literature. Characteristics of the framework are reviewed on generalizability, prognosability and versatility metrics. Results and corresponding analysis demonstrate suitability of TM3C-KT for industrial applications of machine health prognostics.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Literatur
Zurück zum Zitat Babu, G. S., Zhao, P., & Li, X. L. (2016). Deep convolutional neural network based regression approach for estimation of remaining useful life. Lecture Notes in Computer Science (including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9642, 214–228. https://doi.org/10.1007/978-3-319-32025-0_14.CrossRef Babu, G. S., Zhao, P., & Li, X. L. (2016). Deep convolutional neural network based regression approach for estimation of remaining useful life. Lecture Notes in Computer Science (including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 9642, 214–228. https://​doi.​org/​10.​1007/​978-3-319-32025-0_​14.CrossRef
Zurück zum Zitat Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. In Neural networks: Tricks of the trade (pp. 437–478). Germany: Springer.CrossRef Bengio, Y. (2012). Practical recommendations for gradient-based training of deep architectures. In Neural networks: Tricks of the trade (pp. 437–478). Germany: Springer.CrossRef
Zurück zum Zitat Coble JB (2010) Merging data sources to predict remaining useful life - an automated method to identify prognostic parameters. PhD thesis, University of Tennessee Coble JB (2010) Merging data sources to predict remaining useful life - an automated method to identify prognostic parameters. PhD thesis, University of Tennessee
Zurück zum Zitat Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition Deng J, Dong W, Socher R, Li LJ, Li K, Fei-Fei L (2009) ImageNet: a large-scale hierarchical image database. In: 2009 IEEE Conference on Computer Vision and Pattern Recognition
Zurück zum Zitat Gamboa JCB (2017) Deep learning for time-series analysis. http://arxiv.org/abs/170101887 Gamboa JCB (2017) Deep learning for time-series analysis. http://​arxiv.​org/​abs/​170101887
Zurück zum Zitat Genton, M. G. (2002). Classes of kernels for machine learning: a statistics perspective. Journal of Machine Learning Research, 2, 299–312. Genton, M. G. (2002). Classes of kernels for machine learning: a statistics perspective. Journal of Machine Learning Research, 2, 299–312.
Zurück zum Zitat Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction. Germany: Springer Science & Business Media.CrossRef Hastie, T., Tibshirani, R., & Friedman, J. (2009). The elements of statistical learning: Data mining, inference, and prediction. Germany: Springer Science & Business Media.CrossRef
Zurück zum Zitat Huang B, Di Y, Jin C, Lee J (2017) Review of data-driven prognostics and health management techniques: Lessons learned from PHM data challenge competitions. MFPT 2017 Annual Conference: 50 Years of Failure Prevention Technology Innovation pp 1–17 Huang B, Di Y, Jin C, Lee J (2017) Review of data-driven prognostics and health management techniques: Lessons learned from PHM data challenge competitions. MFPT 2017 Annual Conference: 50 Years of Failure Prevention Technology Innovation pp 1–17
Zurück zum Zitat Jayasinghe L, Samarasinghe T, Yuen C, Low JCN, Ge SS (2018) Temporal convolutional memory networks for remaining useful life estimation of industrial machinery. arXiv:181005644 Jayasinghe L, Samarasinghe T, Yuen C, Low JCN, Ge SS (2018) Temporal convolutional memory networks for remaining useful life estimation of industrial machinery. arXiv:​181005644
Zurück zum Zitat Khalid S, Khalil T, Nasreen S (2014) A survey of feature selection and feature extraction techniques in machine learning. In: Science and Information Conference, pp 1–8 Khalid S, Khalil T, Nasreen S (2014) A survey of feature selection and feature extraction techniques in machine learning. In: Science and Information Conference, pp 1–8
Zurück zum Zitat Krizhevsky, A., Hinton, G., et al. (2009). Learning multiple layers of features from tiny images. Citeseer: Tech. rep. Krizhevsky, A., Hinton, G., et al. (2009). Learning multiple layers of features from tiny images. Citeseer: Tech. rep.
Zurück zum Zitat Liao, L., Jin, W., & Pavel, R. (2016). Prognosability regularization for prognostics and health assessment. IEEE Transactions on Industrial Electronics, 63, 7076–7083.CrossRef Liao, L., Jin, W., & Pavel, R. (2016). Prognosability regularization for prognostics and health assessment. IEEE Transactions on Industrial Electronics, 63, 7076–7083.CrossRef
Zurück zum Zitat Malhotra P, TV V, Ramakrishnan A, Anand G, Vig L, Agarwal P, Shroff G (2016) Multi-sensor prognostics using an unsupervised health index based on LSTM encoder-decoder. arXiv:160806154 Malhotra P, TV V, Ramakrishnan A, Anand G, Vig L, Agarwal P, Shroff G (2016) Multi-sensor prognostics using an unsupervised health index based on LSTM encoder-decoder. arXiv:​160806154
Zurück zum Zitat Naduvil-Vadukootu S, Angryk RA, Riley P (2017) Evaluating preprocessing strategies for time series prediction using deep learning architectures. FLAIRS 2017 - Proceedings of the 30th International Florida Artificial Intelligence Research Society Conference pp 520–525 Naduvil-Vadukootu S, Angryk RA, Riley P (2017) Evaluating preprocessing strategies for time series prediction using deep learning architectures. FLAIRS 2017 - Proceedings of the 30th International Florida Artificial Intelligence Research Society Conference pp 520–525
Zurück zum Zitat Nemenyi, P. B. (1963). Distribution-free multiple comparisons (doctoral dissertation, princeton university, 1963). Dissertation Abstracts International, 25(2), 1233. Nemenyi, P. B. (1963). Distribution-free multiple comparisons (doctoral dissertation, princeton university, 1963). Dissertation Abstracts International, 25(2), 1233.
Zurück zum Zitat Ramasso E, Saxena A (2014) Review and analysis of algorithmic approaches developed for prognostics on CMAPSS dataset. PHM 2014 - Proceedings of the Annual Conference of the Prognostics and Health Management Society 2014 pp 612–622 Ramasso E, Saxena A (2014) Review and analysis of algorithmic approaches developed for prognostics on CMAPSS dataset. PHM 2014 - Proceedings of the Annual Conference of the Prognostics and Health Management Society 2014 pp 612–622
Zurück zum Zitat Sadouk, L. (2018). CNN approaches for time-series classification. In: Time series analysis-data, methods, and applications. London: IntechOpen. Sadouk, L. (2018). CNN approaches for time-series classification. In: Time series analysis-data, methods, and applications. London: IntechOpen.
Zurück zum Zitat Shi X, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC (2015) Convolutional LSTM network: A machine learning approach for precipitation nowcasting. Advances in Neural Information Processing Systems 2015-January:802–810 Shi X, Chen Z, Wang H, Yeung DY, Wong WK, Woo WC (2015) Convolutional LSTM network: A machine learning approach for precipitation nowcasting. Advances in Neural Information Processing Systems 2015-January:802–810
Zurück zum Zitat Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489–4497 Tran D, Bourdev L, Fergus R, Torresani L, Paluri M (2015) Learning spatiotemporal features with 3d convolutional networks. In: Proceedings of the IEEE international conference on computer vision, pp 4489–4497
Zurück zum Zitat Wu G, Chang EY, Panda N (2005) Formulating distance functions via the kernel trick. In: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pp 703–709 Wu G, Chang EY, Panda N (2005) Formulating distance functions via the kernel trick. In: Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, pp 703–709
Zurück zum Zitat Yoon AS, Lee T, Lim Y, Jung D, Kang P, Kim D, Park K, Choi Y (2017) Semi-supervised Learning with Deep Generative Models for Asset Failure Prediction. Yoon AS, Lee T, Lim Y, Jung D, Kang P, Kim D, Park K, Choi Y (2017) Semi-supervised Learning with Deep Generative Models for Asset Failure Prediction.
Zurück zum Zitat Zhang, W., Min-Ping Jia, B., Lin Zhu, B., & Xiao-An Yan, B. (2017b). Comprehensive overview on computational intelligence techniques for machinery condition monitoring and fault diagnosis. Chinese Journal of Mechanical Engineering,. https://doi.org/10.1007/s10033-017-0150-0. Zhang, W., Min-Ping Jia, B., Lin Zhu, B., & Xiao-An Yan, B. (2017b). Comprehensive overview on computational intelligence techniques for machinery condition monitoring and fault diagnosis. Chinese Journal of Mechanical Engineering,. https://​doi.​org/​10.​1007/​s10033-017-0150-0.
Metadaten
Titel
Deep learning for machine health prognostics using Kernel-based feature transformation
verfasst von
Shanmugasivam Pillai
Prahlad Vadakkepat
Publikationsdatum
03.03.2021
Verlag
Springer US
Erschienen in
Journal of Intelligent Manufacturing / Ausgabe 6/2022
Print ISSN: 0956-5515
Elektronische ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-021-01747-6

Weitere Artikel der Ausgabe 6/2022

Journal of Intelligent Manufacturing 6/2022 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.