Skip to main content
Erschienen in: Journal of Intelligent Manufacturing 2/2021

12.05.2020

A case study of conditional deep convolutional generative adversarial networks in machine fault diagnosis

verfasst von: Jia Luo, Jinying Huang, Hongmei Li

Erschienen in: Journal of Intelligent Manufacturing | Ausgabe 2/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to the real working conditions, the collected mechanical fault datasets are actually limited and always highly imbalanced, which restricts the diagnosis accuracy and stability. To solve these problems, we present an imbalanced fault diagnosis method based on the generative model of conditional-deep convolutional generative adversarial network (C-DCGAN) and provide a study in detail. Deep convolutional generative adversarial network (DCGAN), based on traditional generative adversarial networks (GAN), introduces convolutional neural network into the training for unsupervised learning to improve the effect of generative networks. Conditional generative adversarial network (CGAN) is a conditional model obtained through introducing conditional extension into GAN. C-DCGAN is a combination of DCGAN and CGAN. In C-DCGAN, based on the feature extraction ability of convolutional networks, through the structural optimization, conditional auxiliary generative samples are used as augmented data and applied in machine fault diagnosis. Two datasets (Bearing dataset and Planetary gear box dataset) are carried out to validate. The simulation experiments showed that the improved performance is mainly due to the generated signals from C-DCGAN to balance the dataset. The proposed method can deal with imbalanced fault classification problem much more effectively. This model could improve the accuracy of fault diagnosis and the generalization ability of the classifier in the case of small samples and display better fault diagnosis performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Buxton, B., Goldston, D., & Doctorow, C. (2008). Big data: Science in the petabyte era. Nature, 455, 1–136.CrossRef Buxton, B., Goldston, D., & Doctorow, C. (2008). Big data: Science in the petabyte era. Nature, 455, 1–136.CrossRef
Zurück zum Zitat Buda, M., Maki, A., & Mazurowski, M. A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Networks, 106, 249–259.CrossRef Buda, M., Maki, A., & Mazurowski, M. A. (2018). A systematic study of the class imbalance problem in convolutional neural networks. Neural Networks, 106, 249–259.CrossRef
Zurück zum Zitat Brock, A., Donahue, J., & Simonyan, K. (2018). Large scale GAN training for high fidelity natural image synthesis. Computer Science for Machine Learning. arXiv preprint arXiv:1809.11096. Brock, A., Donahue, J., & Simonyan, K. (2018). Large scale GAN training for high fidelity natural image synthesis. Computer Science for Machine Learning. arXiv preprint arXiv:​1809.​11096.
Zurück zum Zitat Chen, X., Wang, S., Qiao, B., & Chen, Q. (2018). Basic research on machinery fault diagnostics: Past, present, and future trends. Frontiers of Mechanical Engineering, 13(2), 264–291.CrossRef Chen, X., Wang, S., Qiao, B., & Chen, Q. (2018). Basic research on machinery fault diagnostics: Past, present, and future trends. Frontiers of Mechanical Engineering, 13(2), 264–291.CrossRef
Zurück zum Zitat Chen, J., Li, Z., Pan, J., Chen, G., Zi, Y., Yuan, J., et al. (2016). Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review. Mechanical Systems and Signal Processing, 70, 1–35.CrossRef Chen, J., Li, Z., Pan, J., Chen, G., Zi, Y., Yuan, J., et al. (2016). Wavelet transform based on inner product in fault diagnosis of rotating machinery: A review. Mechanical Systems and Signal Processing, 70, 1–35.CrossRef
Zurück zum Zitat Creswell, A., White, T., Dumoulin, V., Kai, A., Sengupta, B., & Bharath, A. A. (2017). Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35, 53–65.CrossRef Creswell, A., White, T., Dumoulin, V., Kai, A., Sengupta, B., & Bharath, A. A. (2017). Generative adversarial networks: An overview. IEEE Signal Processing Magazine, 35, 53–65.CrossRef
Zurück zum Zitat Chang, L., Deng, X. M., Zhou, M. Q., & Wu, Z. K. (2016). Convolutional neural networks in image understanding. Acta Automatica Sinica, 42(9), 1300–1312. Chang, L., Deng, X. M., Zhou, M. Q., & Wu, Z. K. (2016). Convolutional neural networks in image understanding. Acta Automatica Sinica, 42(9), 1300–1312.
Zurück zum Zitat Ding, Y., Ma, J., Ma, J., Wang, C., & Lu, C. (2019). A generative adversarial network-based intelligent fault diagnosis method for rotating machinery under small sample size conditions. IEEE Access, 7, 149736–149749.CrossRef Ding, Y., Ma, J., Ma, J., Wang, C., & Lu, C. (2019). A generative adversarial network-based intelligent fault diagnosis method for rotating machinery under small sample size conditions. IEEE Access, 7, 149736–149749.CrossRef
Zurück zum Zitat Elbouchikhi, E., Choqueuse, V., Amirat, Y., Benbouzid, M. E. H., & Turri, S. (2017). An efficient Hilbert–Huang transform-based bearing faults detection in induction machines. IEEE Transactions on Energy Conversion, 32, 401–413.CrossRef Elbouchikhi, E., Choqueuse, V., Amirat, Y., Benbouzid, M. E. H., & Turri, S. (2017). An efficient Hilbert–Huang transform-based bearing faults detection in induction machines. IEEE Transactions on Energy Conversion, 32, 401–413.CrossRef
Zurück zum Zitat Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., et al. (2014). Generative adversarial nets. International Conference on Neural Information Processing Systems, 3, 2672–2680. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., et al. (2014). Generative adversarial nets. International Conference on Neural Information Processing Systems, 3, 2672–2680.
Zurück zum Zitat Gu, J., Wang, Z., Kuen, J., Ma, L., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X. & Wang, G. (2015). Recent advances in convolutional neural networks. arXiv preprint arXiv:1512.07108. Gu, J., Wang, Z., Kuen, J., Ma, L., Ma, L., Shahroudy, A., Shuai, B., Liu, T., Wang, X. & Wang, G. (2015). Recent advances in convolutional neural networks. arXiv preprint arXiv:​1512.​07108.
Zurück zum Zitat Ioffe, S., & Szegedy, C. (2015). Batch normalization: accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd international conference on machine learning (pp 448 − 456). Ioffe, S., & Szegedy, C. (2015). Batch normalization: accelerating deep network training by reducing internal covariate shift. In Proceedings of the 32nd international conference on machine learning (pp 448 − 456).
Zurück zum Zitat Jiang, W., Hong, Y., Zhou, B., He, X., & Cheng, C. (2019). A GAN-based anomaly detection approach for imbalanced industrial time series. IEEE Access, 7, 143608–143619.CrossRef Jiang, W., Hong, Y., Zhou, B., He, X., & Cheng, C. (2019). A GAN-based anomaly detection approach for imbalanced industrial time series. IEEE Access, 7, 143608–143619.CrossRef
Zurück zum Zitat Khodja, M. E. A., Aimer, A. F., Boudinar, A. H., Benouzza, N., & Bendiabdellah, A. (2019). Bearing fault diagnosis of a PWM inverter fed-induction motor using an improved short time Fourier transform. Journal of Electrical Engineering and Technology, 14, 1201–1210.CrossRef Khodja, M. E. A., Aimer, A. F., Boudinar, A. H., Benouzza, N., & Bendiabdellah, A. (2019). Bearing fault diagnosis of a PWM inverter fed-induction motor using an improved short time Fourier transform. Journal of Electrical Engineering and Technology, 14, 1201–1210.CrossRef
Zurück zum Zitat Kou, L. L., Qin, Y., Zhao, X. J., & Fu, Y. (2019). Integrating synthetic minority oversampling and gradient boosting decision tree for bogie fault diagnosis in rail vehicles. Proceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit, 233, 312–325.CrossRef Kou, L. L., Qin, Y., Zhao, X. J., & Fu, Y. (2019). Integrating synthetic minority oversampling and gradient boosting decision tree for bogie fault diagnosis in rail vehicles. Proceedings of the Institution of Mechanical Engineers, Part F: Journal of Rail and Rapid Transit, 233, 312–325.CrossRef
Zurück zum Zitat Lee, Y.O., Jo, J., & Hwang, J. (2017). Application of deep neural network and generative adversarial network to industrial maintenance: A case study of induction motor fault detection. In Proceedings—IEEE international conference on big data (Big Data) (pp. 3248–3253). Lee, Y.O., Jo, J., & Hwang, J. (2017). Application of deep neural network and generative adversarial network to industrial maintenance: A case study of induction motor fault detection. In ProceedingsIEEE international conference on big data (Big Data) (pp. 3248–3253).
Zurück zum Zitat Li, Y., Si, S., Liu, Z., & Liang, X. (2019). Review of local mean decomposition and its application in fault diagnosis of rotating machinery. Journal of Systems Engineering and Electronics, 30(4), 799–814.CrossRef Li, Y., Si, S., Liu, Z., & Liang, X. (2019). Review of local mean decomposition and its application in fault diagnosis of rotating machinery. Journal of Systems Engineering and Electronics, 30(4), 799–814.CrossRef
Zurück zum Zitat Liu, B., Fu, J., Kato, M. P., & Masatoshi, Y. (2018a). Beyond narrative description: generating poetry from images by multi-adversarial training. arXiv preprint arXiv:1804.08473. Liu, B., Fu, J., Kato, M. P., & Masatoshi, Y. (2018a). Beyond narrative description: generating poetry from images by multi-adversarial training. arXiv preprint arXiv:​1804.​08473.
Zurück zum Zitat Liu, H., Zhou, J., Xu, Y., Zheng, Y., Peng, X., & Jiang, W. (2018b). Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks. Neurocomputing, 315, 412–424.CrossRef Liu, H., Zhou, J., Xu, Y., Zheng, Y., Peng, X., & Jiang, W. (2018b). Unsupervised fault diagnosis of rolling bearings using a deep neural network based on generative adversarial networks. Neurocomputing, 315, 412–424.CrossRef
Zurück zum Zitat Long, W., Li, X., Liang, G., & Zhang, Y. (2018). A new convolutional neural network based data-driven fault diagnosis method. IEEE Transactions on Industrial Electronics, 65, 5990–5998.CrossRef Long, W., Li, X., Liang, G., & Zhang, Y. (2018). A new convolutional neural network based data-driven fault diagnosis method. IEEE Transactions on Industrial Electronics, 65, 5990–5998.CrossRef
Zurück zum Zitat Lu, X., Chen, M., Wu, J., & Chan, P. (2015). A feature-partition and under-sampling based ensemble classifier for web spam detection. International Journal of Machine Learning and Computing, 5, 454–457.CrossRef Lu, X., Chen, M., Wu, J., & Chan, P. (2015). A feature-partition and under-sampling based ensemble classifier for web spam detection. International Journal of Machine Learning and Computing, 5, 454–457.CrossRef
Zurück zum Zitat Mathieu, M., Couprie, C., & Lecun, Y. (2015). Deep multi-scale video prediction beyond mean square error. arXiv preprint arXiv:1511.05440. Mathieu, M., Couprie, C., & Lecun, Y. (2015). Deep multi-scale video prediction beyond mean square error. arXiv preprint arXiv:​1511.​05440.
Zurück zum Zitat Mao, W., Liu, Y., Ding, L., & Li, Y. (2019). Imbalanced fault diagnosis of rolling bearing based on generative adversarial network: A comparative study. IEEE Access, 7, 9515–9530.CrossRef Mao, W., Liu, Y., Ding, L., & Li, Y. (2019). Imbalanced fault diagnosis of rolling bearing based on generative adversarial network: A comparative study. IEEE Access, 7, 9515–9530.CrossRef
Zurück zum Zitat Nasiri, S., Khosravani, M. R., & Weinberg, K. (2017). Fracture mechanics and mechanical fault detection by artificial intelligence methods: A review. Engineering Failure Analysis, 81, 270–293.CrossRef Nasiri, S., Khosravani, M. R., & Weinberg, K. (2017). Fracture mechanics and mechanical fault detection by artificial intelligence methods: A review. Engineering Failure Analysis, 81, 270–293.CrossRef
Zurück zum Zitat Ng, W. W., Hu, J., Yeung, D. S., Yin, S., & Roli, F. (2015). Diversified sensitivity-based under sampling for imbalance classification problems. IEEE Transactions on Cybernetics, 45, 2402–2412.CrossRef Ng, W. W., Hu, J., Yeung, D. S., Yin, S., & Roli, F. (2015). Diversified sensitivity-based under sampling for imbalance classification problems. IEEE Transactions on Cybernetics, 45, 2402–2412.CrossRef
Zurück zum Zitat Plakias, S., & Boutalis, Y. S. (2019). Exploiting the generative adversarial framework for one-class multi-dimensional fault detection. Neurocomputing, 332, 396–405.CrossRef Plakias, S., & Boutalis, Y. S. (2019). Exploiting the generative adversarial framework for one-class multi-dimensional fault detection. Neurocomputing, 332, 396–405.CrossRef
Zurück zum Zitat Ren, M., Zhang, Q., & Zhang, J. (2019). An introductory survey of probability density function control. Systems Science & Control Engineering, 7(1), 158–170.CrossRef Ren, M., Zhang, Q., & Zhang, J. (2019). An introductory survey of probability density function control. Systems Science & Control Engineering, 7(1), 158–170.CrossRef
Zurück zum Zitat Rama, K. K., & Ramachandran, K. I. (2018). Machinery bearing fault diagnosis using variational mode decomposition and support vector machine as a classifier. Materials Science and Engineering Conference Series, 310(2), 12076.CrossRef Rama, K. K., & Ramachandran, K. I. (2018). Machinery bearing fault diagnosis using variational mode decomposition and support vector machine as a classifier. Materials Science and Engineering Conference Series, 310(2), 12076.CrossRef
Zurück zum Zitat Ramentol, E., Caballero, Y., Bello, R., & Herrera, F. (2012). SMOTE-RSB*: A hybrid preprocessing approach based on oversampling and under sampling for high imbalanced data-sets using SMOTE and rough sets theory. Knowledge and Information Systems, 33, 245–265.CrossRef Ramentol, E., Caballero, Y., Bello, R., & Herrera, F. (2012). SMOTE-RSB*: A hybrid preprocessing approach based on oversampling and under sampling for high imbalanced data-sets using SMOTE and rough sets theory. Knowledge and Information Systems, 33, 245–265.CrossRef
Zurück zum Zitat Radford, A., Metz, L., & Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:1511.06434. Radford, A., Metz, L., & Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv preprint arXiv:​1511.​06434.
Zurück zum Zitat Shao, H., Jiang, H., Zhang, H., Duan, W., Liang, T., & Wu, S. (2018). Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing. Mechanical Systems and Signal Processing, 100, 743–765.CrossRef Shao, H., Jiang, H., Zhang, H., Duan, W., Liang, T., & Wu, S. (2018). Rolling bearing fault feature learning using improved convolutional deep belief network with compressed sensing. Mechanical Systems and Signal Processing, 100, 743–765.CrossRef
Zurück zum Zitat Suh, S., Lee, H., Jo, J., Lukowicz, P., & Lee, Y. O. (2019). Generative oversampling method for imbalanced data on bearing fault detection and diagnosis. Applied Sciences, 9(4), 746.CrossRef Suh, S., Lee, H., Jo, J., Lukowicz, P., & Lee, Y. O. (2019). Generative oversampling method for imbalanced data on bearing fault detection and diagnosis. Applied Sciences, 9(4), 746.CrossRef
Zurück zum Zitat Sun, M., Qian, H., Zhu, K., Guan, D., & Wang, R. (2017). Ensemble learning and SMOTE based fault diagnosis system in selforganizing cellular networks. In: IEEE global communications conference (pp 1–6). Sun, M., Qian, H., Zhu, K., Guan, D., & Wang, R. (2017). Ensemble learning and SMOTE based fault diagnosis system in selforganizing cellular networks. In: IEEE global communications conference (pp 1–6).
Zurück zum Zitat Salehinejad, H., Valaee, S., Colak, E., Barfett, J., & Dowdell, T. (2017). Generalization of deep neural networks for chest pathology classification in X-rays using generative adversarial networks. In Proceedings—IEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 990–994). Salehinejad, H., Valaee, S., Colak, E., Barfett, J., & Dowdell, T. (2017). Generalization of deep neural networks for chest pathology classification in X-rays using generative adversarial networks. In ProceedingsIEEE international conference on acoustics, speech and signal processing (ICASSP) (pp. 990–994).
Zurück zum Zitat Simon, M., Rodner, E., & Denzler, J. (2016). Image Net pre-trained models with batch normalization. arXiv preprint arXiv:1612.01452. Simon, M., Rodner, E., & Denzler, J. (2016). Image Net pre-trained models with batch normalization. arXiv preprint arXiv:​1612.​01452.
Zurück zum Zitat Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1), 1929–1958. Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., & Salakhutdinov, R. (2014). Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research, 15(1), 1929–1958.
Zurück zum Zitat Springenberg, J. T. (2015). Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv preprint arXiv:1511.06390. Springenberg, J. T. (2015). Unsupervised and semi-supervised learning with categorical generative adversarial networks. arXiv preprint arXiv:​1511.​06390.
Zurück zum Zitat Shao, S., Wang, P., & Yan, R. Q. (2019). Generative adversarial networks for data augmentation in machine fault diagnosis. Computers in Industry, 106(4), 85–93.CrossRef Shao, S., Wang, P., & Yan, R. Q. (2019). Generative adversarial networks for data augmentation in machine fault diagnosis. Computers in Industry, 106(4), 85–93.CrossRef
Zurück zum Zitat Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the case western reserve university data: A benchmark study. Mechanical Systems and Signal Processing, 64–65, 100–131.CrossRef Smith, W. A., & Randall, R. B. (2015). Rolling element bearing diagnostics using the case western reserve university data: A benchmark study. Mechanical Systems and Signal Processing, 64–65, 100–131.CrossRef
Zurück zum Zitat Wang, Z., Wang, J., & Wang, Y. (2018). An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition. Neurocomputing, 310, 213–222.CrossRef Wang, Z., Wang, J., & Wang, Y. (2018). An intelligent diagnosis scheme based on generative adversarial learning deep neural networks and its application to planetary gearbox fault pattern recognition. Neurocomputing, 310, 213–222.CrossRef
Zurück zum Zitat Yin, X., Zhang, Q., Wang, H., & Ding, Z. (2019). RBFNN-based minimum entropy filtering for a class of stochastic nonlinear systems. IEEE Transactions on Automatic Control, 65(1), 376–381.CrossRef Yin, X., Zhang, Q., Wang, H., & Ding, Z. (2019). RBFNN-based minimum entropy filtering for a class of stochastic nonlinear systems. IEEE Transactions on Automatic Control, 65(1), 376–381.CrossRef
Zurück zum Zitat Zhou, F., Jin, L., & Dong, J. (2017). Review of convolutional neural network. Chinese Journal of Computers, 40(6), 1229–1251. Zhou, F., Jin, L., & Dong, J. (2017). Review of convolutional neural network. Chinese Journal of Computers, 40(6), 1229–1251.
Metadaten
Titel
A case study of conditional deep convolutional generative adversarial networks in machine fault diagnosis
verfasst von
Jia Luo
Jinying Huang
Hongmei Li
Publikationsdatum
12.05.2020
Verlag
Springer US
Erschienen in
Journal of Intelligent Manufacturing / Ausgabe 2/2021
Print ISSN: 0956-5515
Elektronische ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-020-01579-w

Weitere Artikel der Ausgabe 2/2021

Journal of Intelligent Manufacturing 2/2021 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.