Top

Journal of Intelligent Manufacturing

Published in:

14-03-2023

A novel approach for tool condition monitoring based on transfer learning of deep neural networks using time–frequency images

Authors: Yao Li, Zhengcai Zhao, Yucan Fu, Qingliang Chen

Published in: Journal of Intelligent Manufacturing | Issue 3/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Traditional tool condition monitoring methods developed in an ideal environment are not universal in multiple working conditions considering different signal sources and recognition methods. This paper presents a novel tool condition monitoring approach that packages deep learning networks for accurate condition recognition with a cocktail solver library. First, the multisource signals from the machining process are collected and sequenced as the input of the cocktail solver library. The machining signals are transformed into a series of two-dimensional images by a continuous wavelet transform. In addition, ten pretrained networks with transfer learning are rapidly transferred with a finetuning operation, which contributes to a set of monitor networks. Three major processes are integrated by the cocktail solver library, which is the choosing dataset process for multi-signals, the training option process for network training parameters, and the network package process for the basic monitoring model. A Bayesian optimization method is employed to handle a tradeoff for these three processes to improve the prediction accuracy and reduce the recognition time. In the testing experiment, the milling datasets are used to train the model, and the results show that the accuracy of the model proposed in this paper can exceed 90%. The proposed method was also compared with other traditional methods to verify its effectiveness.

previous article Hierarchical multi-scale network for cross-scale visual defect detection

next article Industrial-oriented machine learning big data framework for temporal-spatial error prediction and control with DTSMGCN model

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Agogino, A., & Goebel, K. (2007). Milling data set. BEST Lab, UC Berkeley. NASA Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA. Retrieved from http://ti.arc.nasa.gov/project/prognostic-data-repository

Ardakani, A. A., Kanafi, A. R., Acharya, U. R., Khadem, N., & Mohammadi, A. (2020). Application of deep learning technique to manage COVID-19 in routine clinical practice using CT images: Results of 10 convolutional neural networks. Computers in Biology and Medicine, 121, 103795. https://doi.org/10.1016/j.compbiomed.2020.103795CrossRefPubMedPubMedCentral

Aslan, A. (2020). Optimization and analysis of process parameters for flank wear, cutting forces and vibration in turning of AISI 5140: A comprehensive study. Measurement, 163, 107959. https://doi.org/10.1016/j.measurement.2020.107959CrossRef

Bhat, N. N., Dutta, S., Vashisth, T., Pal, S., Pal, S. K., & Sen, R. (2016). Tool condition monitoring by SVM classification of machined surface images in turning. The International Journal of Advanced Manufacturing Technology, 83(9–12), 1487–1502. https://doi.org/10.1007/s00170-015-7441-3CrossRef

Cabezas, M., Kentsch, S., Tomhave, L., Gross, J., Caceres, M. L. L., & Diez, Y. (2020). Detection of invasive species in wetlands: Practical DL with heavily imbalanced data. Remote Sensing., 12, 3431. https://doi.org/10.3390/rs12203431ADSCrossRef

Cao, P., Zhang, S., & Tang, J. (2018). Preprocessing-free gear fault diagnosis using small datasets with deep convolutional neural network-based transfer learning. IEEE Access, 6, 26241–26253. https://doi.org/10.1109/ACCESS.2018.2837621CrossRef

Cao, X., Chen, B., Yao, B., & He, W. (2019). Combining translation-invariant wavelet frames and convolutional neural network for intelligent tool wear state identification. Computers in Industry, 106, 71–84. https://doi.org/10.1016/j.compind.2018.12.018CrossRef

Cheng, C., Zhou, B., Ma, G., Wu, D., & Yuan, Y. (2020). Wasserstein distance based deep adversarial transfer learning for intelligent fault diagnosis with unlabeled or insufficient labeled data. Neurocomputing, 409, 35–45. https://doi.org/10.1016/j.neucom.2020.05.040CrossRef

Dara, S., & Tumma, P. (2018). Feature extraction by using deep learning: A survey. 2018 Second International Conference on Electronics, Communication and Aerospace Technology (ICECA), 1795–1801. https://doi.org/10.1109/ICECA.2018.8474912

Ferrag, M. A., Shu, L., Friha, O., & Yang, X. (2021). Cyber security intrusion detection for agriculture 4.0: Machine learning-based solutions, datasets, and future directions. IEEE/CAA Journal of Automatica Sinica, 9(3), 407–436. https://doi.org/10.1109/JAS.2021.1004344CrossRef

Hera, A., & Hou, Z. (2004). Application of wavelet approach for ASCE structural health monitoring benchmark studies. Journal of Engineering Mechanics, 130(1), 96–104. https://doi.org/10.1061/(ASCE)0733-9399(2004)130:1(96)CrossRef

International Organization for Standardization. (1989). Tool life testing in milling—part 2: End milling ISO-8688-2. https://www.iso.org/standard/16092.html

Iwendi, C., Mohan, S., Khan, S., Ibeke, E., Ahmadian, A., & Ciano, T. (2022). Covid-19 fake news sentiment analysis. Computers and Electrical Engineering, 101, 107967. https://doi.org/10.1016/j.compeleceng.2022.107967CrossRefPubMed

Lee, W. J., Wu, H., Huang, A., & Sutherland, J. W. (2020). Learning via acceleration spectrograms of a DC motor system with application to condition monitoring. The International Journal of Advanced Manufacturing Technology, 106(3–4), 803–816. https://doi.org/10.1007/s00170-019-04563-8CrossRef

Li, Y., Mou, W., Li, J., Liu, C., & Gao, J. (2021). An automatic and accurate method for tool wear inspection using grayscale image probability algorithm based on Bayesian inference. Robotics and Computer-Integrated Manufacturing, 68, 102079. https://doi.org/10.1016/j.rcim.2020.102079CrossRef

Li, X., Liu, X., Yue, C., Liang, S. Y., & Wang, L. (2022). Systematic review on tool breakage monitoring techniques in machining operations. International Journal of Machine Tools & Manufacture, 176, 103882. https://doi.org/10.1016/j.ijmachtools.2022.103882CrossRef

Liao, Y., Ragai, I., Huang, Z., & Kerner, S. (2021). Manufacturing process monitoring using time-frequency representation and transfer learning of deep neural networks. Journal of Manufacturing Processes, 68, 231–248. https://doi.org/10.1016/j.jmapro.2021.05.046CrossRef

Marei, M., Zaatari, S. E., & Li, W. (2021). Transfer learning enabled convolutional neural networks for estimating health state of cutting tools. Robotics and Computer-Integrated Manufacturing, 71, 102145. https://doi.org/10.1016/j.rcim.2021.102145CrossRef

Miao, R., Gao, Y., Ge, L., Jiang, Z., & Zhang, J. (2019). Online defect recognition of narrow overlap weld based on two-stage recognition model combining continuous wavelet transform and convolutional neural network. Computers in Industry, 112, 103115. https://doi.org/10.1016/j.compind.2019.07.005CrossRef

Mohanraj, T., Shankar, S., Rajasekar, R., Sakthivel, N. R., & Pramanik, A. (2020). Tool condition monitoring techniques in milling process—A review. Journal of Materials Research and Technology, 9(1), 1032–1042. https://doi.org/10.1016/j.jmrt.2019.10.031CrossRef

Mostaghimi, H., Park, C. I., Kang, G., Park, S. S., & Lee, D. Y. (2021). Reconstruction of cutting forces through fusion of accelerometer and spindle current signals. Journal of Manufacturing Processes, 68, 990–1003. https://doi.org/10.1016/j.jmapro.2021.06.007CrossRef

Nirwan, N. W., & Ramani, H. B. (2022). Condition monitoring and fault detection in roller bearing used in rolling mill by acoustic emission and vibration analysis. Materials Today: Proceedings, 51, 344–354. https://doi.org/10.1016/j.matpr.2021.05.447CrossRef

Opitz, J., & Burst, S. (2019). Macro F1 and Macro F1. https://doi.org/10.48550/arXiv.1911.03347

Pardalos, P. M., Zhigljavsky, A., & Žilinskas, J. (2016). Advances in stochastic and deterministic global optimization. Springer International Publishing.CrossRef

Pimenov, D. Y., Bustillo, A., Wojciechowski, S., Sharma, V. S., Gupta, M. K., & Kuntoğlu, M. (2022). Artificial intelligence systems for tool condition monitoring in machining: Analysis and critical review. Journal of Intelligent Manufacturing. https://doi.org/10.1007/s10845-022-01923-2CrossRef

Sarıkaya, M., Gupta, M. K., Tomaz, I., Pimenov, D. Y., Kuntoğlu, M., Khanna, N., et al. (2021). A state-of-the-art review on tool wear and surface integrity characteristics in machining of superalloys. CIRP Journal of Manufacturing Science and Technology, 35, 624–658. https://doi.org/10.1016/j.cirpj.2021.08.005CrossRef

Shahriari, B., Swersky, K., Wang, Z., Adams, R. P., & de Freitas, N. (2016). Taking the human out of the loop: a review of bayesian optimization. Proceedings of the IEEE, 104(1), 148–175. https://doi.org/10.1109/JPROC.2015.2494218CrossRef

Sun, H., Zhang, J., Mo, R., & Zhang, X. (2020). In-process tool condition forecasting based on a deep learning method. Robotics and Computer-Integrated Manufacturing, 64, 101924. https://doi.org/10.1016/j.rcim.2019.101924CrossRef

Traini, E., Bruno, G., & Lombardi, F. (2021). Tool condition monitoring framework for predictive maintenance: A case study on milling process. International Journal of Production Research, 59(23), 7179–7193. https://doi.org/10.1080/00207543.2020.1836419CrossRef

Wu, J., Xu, X., Liu, C., Deng, C., & Shao, X. (2021). Lamb wave-based damage detection of composite structures using deep convolutional neural network and continuous wavelet transform. Composite Structures, 276, 114590. https://doi.org/10.1016/j.compstruct.2021.114590CrossRef

Xu, D., Liao, Z., Axinte, D., & Hardy, M. (2020). A novel method to continuously map the surface integrity and cutting mechanism transition in various cutting conditions. International Journal of Machine Tools and Manufacture, 151, 103529. https://doi.org/10.1016/j.ijmachtools.2020.103529CrossRef

Xu, L., Huang, C., Li, C., Wang, J., Liu, H., & Wang, X. (2021). Estimation of tool wear and optimization of cutting parameters based on novel ANFIS-PSO method toward intelligent machining. Journal of Intelligent Manufacturing, 32(1), 77–90. https://doi.org/10.1007/s10845-020-01559-0CrossRef

Zhou, C., Guo, K., & Sun, J. (2021). An integrated wireless vibration sensing tool holder for milling tool condition monitoring with singularity analysis. Measurement, 174, 109038. https://doi.org/10.1016/j.measurement.2021.109038CrossRef

Zhu, J., Chen, N., & Shen, C. (2020). A new deep transfer learning method for bearing fault diagnosis under different working conditions. IEEE Sensors Journal, 20(15), 8394–8402. https://doi.org/10.1109/JSEN.2019.2936932ADSCrossRef

Title: A novel approach for tool condition monitoring based on transfer learning of deep neural networks using time–frequency images
Authors: Yao Li
Zhengcai Zhao
Yucan Fu
Qingliang Chen
Publication date: 14-03-2023
Publisher: Springer US
Published in: Journal of Intelligent Manufacturing / Issue 3/2024
Print ISSN: 0956-5515
Electronic ISSN: 1572-8145
DOI: https://doi.org/10.1007/s10845-023-02099-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 3/2024

Bilateral matching for collaborative remanufacturing services based on multi-attribute preferences and mutual interactions

Research on digital twin monitoring system for large complex surface machining

Development of grinding intelligent monitoring and big data-driven decision making expert system towards high efficiency and low energy consumption: experimental approach

Automatic detection and characterization of porosities in cross-section images of metal parts produced by binder jetting using machine learning and image augmentation

Root cause analysis of an out-of-control process using a logical analysis of data regression model and exponential weighted moving average

Attention mechanism-based deep learning for heat load prediction in blast furnace ironmaking process

Premium Partners