Skip to main content
Erschienen in: Journal of Nondestructive Evaluation 1/2021

01.03.2021

Automated Defect Recognition for Welds Using Simulation Assisted TFM Imaging with Artificial Intelligence

verfasst von: Thulsiram Gantala, Krishnan Balasubramaniam

Erschienen in: Journal of Nondestructive Evaluation | Ausgabe 1/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, Artificial Intelligence (AI) algorithms are employed for first, automating the process of creating a large synthetic Total Focusing Method (TFM) imaging dataset using a small set of Finite Element (FE) simulation datasets, and second for the automated defect-recognition (ADR) in butt-welds. In this paper, six types of imaging datasets are created with three approaches. In the first approach, weld TFM images are constructed using ultrasonic A-scan signals obtained from Full Matrix Capture (FMC) performed using FE analysis on models with weld defects (porosity and slag). The second approach generates near real-time weld TFM images by implementing fast deep convolution generative adversarial networks (DCGAN). This second technique permits simulations that are several orders faster when compared to the FE method. In the third approach, noise is extracted from FMC-TFM experimental measurements using the sliding kernel approach, and this noise is supplemented to individual simulated datasets for creating near to realistic scenarios. The first dataset is created using the first approach. The second dataset is created using the second approach, and the third hybrid dataset is a combination of FE and DCGAN weld TFM imaging. The fourth dataset is noise supplemented to FE based dataset. The fifth dataset is generated by adding noise to DCGAN images. The sixth hybrid dataset with noise is a combination of FE and DCGAN weld TFM noise images. AI plays a significant role in object detection and classification through robust feature extraction, reducing human intervention. In this work, for automated weld defect recognition, a convolutional neural network (CNN) is trained using six types of simulation-assisted weld TFM imaging datasets, which improves the reliability and efficiency of welds quality assurance. The mAP value is 85% for the ADR model trained using the hybrid weld TFM dataset with noise. The model prediction on classification on the hybrid dataset for porosity is 0.86 F1-score, and for slag is 0.80 F1-score.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Drinkwater, B.W., Wilcox, P.D.: Ultrasonic arrays for non-destructive evaluation a review. NDT E Int. 39, 525–41 (2006)CrossRef Drinkwater, B.W., Wilcox, P.D.: Ultrasonic arrays for non-destructive evaluation a review. NDT E Int. 39, 525–41 (2006)CrossRef
2.
Zurück zum Zitat Schmerr, L.W.: Fundamentals of Ultrasonic Nondestructive Evaluation—A Modeling approach. Plenum Press, New York (1998)CrossRef Schmerr, L.W.: Fundamentals of Ultrasonic Nondestructive Evaluation—A Modeling approach. Plenum Press, New York (1998)CrossRef
3.
Zurück zum Zitat Holmes, C., Drinkwater, B.W., Wilcox, P.D.: Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation. NDT E Int. 38(8), 701–11 (2005)CrossRef Holmes, C., Drinkwater, B.W., Wilcox, P.D.: Post-processing of the full matrix of ultrasonic transmit-receive array data for non-destructive evaluation. NDT E Int. 38(8), 701–11 (2005)CrossRef
4.
Zurück zum Zitat Jobst, M., Connolly, G.: Demonstration of the Application of the Total Focusing Method to the Inspections of Steel Welds, ECNDT, paper 1.3.4 (2010) Jobst, M., Connolly, G.: Demonstration of the Application of the Total Focusing Method to the Inspections of Steel Welds, ECNDT, paper 1.3.4 (2010)
5.
Zurück zum Zitat Reverdy, F., Benoist, G., Le Ber, L.: Advantages and complementarity of phased-array technology and total focusing method. In: 19th World Conference on Non-Destructive Testing (2016) Reverdy, F., Benoist, G., Le Ber, L.: Advantages and complementarity of phased-array technology and total focusing method. In: 19th World Conference on Non-Destructive Testing (2016)
6.
Zurück zum Zitat Leonard, L.J., Robert, S., Villaverde, E.L., Prada, C.: Plane Wave Imaging for ultrasonic non-destructive testing: generalization to multimodal imaging. Ultrasonics 64, 128–138 (2016)CrossRef Leonard, L.J., Robert, S., Villaverde, E.L., Prada, C.: Plane Wave Imaging for ultrasonic non-destructive testing: generalization to multimodal imaging. Ultrasonics 64, 128–138 (2016)CrossRef
7.
Zurück zum Zitat Zhang, J., Drinkwater, B.W., Wilcox, P.D., Hunter, A.J.: Defect detection using ultrasonic arrays: the multi-mode total focusing method. NDT E Int. 43(2), 123–133 (2010)CrossRef Zhang, J., Drinkwater, B.W., Wilcox, P.D., Hunter, A.J.: Defect detection using ultrasonic arrays: the multi-mode total focusing method. NDT E Int. 43(2), 123–133 (2010)CrossRef
8.
Zurück zum Zitat Felice, M.V., Velichko, A., Wilcox, P.D.: Accurate depth measurement of small surface-breaking cracks using an ultrasonic array post-processing technique. NDT E Int. 68, 105–112 (2014)CrossRef Felice, M.V., Velichko, A., Wilcox, P.D.: Accurate depth measurement of small surface-breaking cracks using an ultrasonic array post-processing technique. NDT E Int. 68, 105–112 (2014)CrossRef
9.
Zurück zum Zitat Sambath, S., Nagaraj, P., Selvakumar, N.: Automatic defect classification in ultrasonic NDT using artificial. J. Nondestruct. Eval. 30, 20–28 (2010)CrossRef Sambath, S., Nagaraj, P., Selvakumar, N.: Automatic defect classification in ultrasonic NDT using artificial. J. Nondestruct. Eval. 30, 20–28 (2010)CrossRef
10.
Zurück zum Zitat Lalithakumari, S., Sheelarani, B., Venkatraman, B.: Artificial neural network based defect detection of welds in TOFD technique. Int. J. Comput. Appl. 0975-8887,V41-No.20 (2012) Lalithakumari, S., Sheelarani, B., Venkatraman, B.: Artificial neural network based defect detection of welds in TOFD technique. Int. J. Comput. Appl. 0975-8887,V41-No.20 (2012)
11.
Zurück zum Zitat Ioannis, V., Dimitrios, K.: Multiclass defect detection and classification in weld radiographic images using geometric and texture features. Expert Syst. Appl. 37, 7606–7614 (2010)CrossRef Ioannis, V., Dimitrios, K.: Multiclass defect detection and classification in weld radiographic images using geometric and texture features. Expert Syst. Appl. 37, 7606–7614 (2010)CrossRef
12.
Zurück zum Zitat Virupakshappa, K., Marino, M., Oruklu, E.: A multi-resolution convolutional neural network architecture for ultrasonic flaw detection. In: 2018 IEEE International Ultrasonics Symposium (IUS), pp. 1–4 (2018) Virupakshappa, K., Marino, M., Oruklu, E.: A multi-resolution convolutional neural network architecture for ultrasonic flaw detection. In: 2018 IEEE International Ultrasonics Symposium (IUS), pp. 1–4 (2018)
13.
Zurück zum Zitat Munir, N., Kim, H., Park, J., Song, S., Kang, S.: Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. Ultrasonics (2019) Munir, N., Kim, H., Park, J., Song, S., Kang, S.: Convolutional neural network for ultrasonic weldment flaw classification in noisy conditions. Ultrasonics (2019)
14.
15.
Zurück zum Zitat Munir, N., Kim, H.J., Song, S.J., Kang, S.S.: Investigation of deep neural network with drop out for ultrasonic flaw classification in weldments. J. Mech. Sci. Technol. 32(7), 3073–3080 (2018)CrossRef Munir, N., Kim, H.J., Song, S.J., Kang, S.S.: Investigation of deep neural network with drop out for ultrasonic flaw classification in weldments. J. Mech. Sci. Technol. 32(7), 3073–3080 (2018)CrossRef
16.
Zurück zum Zitat Du, W., Shen, H., Fu, J., Zhang, G., He, Q.: Approaches for improvement of the x-ray image defect detection of automobile casting aluminum parts based on deep learning. ND E Int. 107, 102144 (2019)CrossRef Du, W., Shen, H., Fu, J., Zhang, G., He, Q.: Approaches for improvement of the x-ray image defect detection of automobile casting aluminum parts based on deep learning. ND E Int. 107, 102144 (2019)CrossRef
17.
Zurück zum Zitat Virkkunen, I.: Virtual cracks and the future of inspection reliability. In: Karnteknikdagarna Nordic Symposium on Nuclear Technology (2017) Virkkunen, I.: Virtual cracks and the future of inspection reliability. In: Karnteknikdagarna Nordic Symposium on Nuclear Technology (2017)
18.
Zurück zum Zitat Virkkunen, I., Miettinen, K., Packalen, T.: Virtual flaws for nde training and qualification. In: 11th European Conference on Non-Destructive Testing (ECNDT 2014), NDT.net, The e-Journal of Non-destructive Testing (2014) Virkkunen, I., Miettinen, K., Packalen, T.: Virtual flaws for nde training and qualification. In: 11th European Conference on Non-Destructive Testing (ECNDT 2014), NDT.net, The e-Journal of Non-destructive Testing (2014)
19.
Zurück zum Zitat Liu, S., Huang, J.H., Sung, J., Lee, C.: Detection of cracks using neural network and computational mechanics. Comput. Appl. Mech. Eng. 191, 2831–2845 (2002)CrossRef Liu, S., Huang, J.H., Sung, J., Lee, C.: Detection of cracks using neural network and computational mechanics. Comput. Appl. Mech. Eng. 191, 2831–2845 (2002)CrossRef
20.
Zurück zum Zitat Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks, arXiv preprint arXiv:1511.06434 (2015) Radford, A., Metz, L., Chintala, S.: Unsupervised representation learning with deep convolutional generative adversarial networks, arXiv preprint arXiv:​1511.​06434 (2015)
21.
Zurück zum Zitat Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014) Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., Bengio, Y.: Generative adversarial nets. In: Advances in Neural Information Processing Systems, pp. 2672–2680 (2014)
22.
Zurück zum Zitat Dhruv, G., Sreedhar, U., Jyothir, R.K.J., Sureka, M., Padma, P., Bikash, G., Krishnan, B.: Automated defect recognition on X-ray radiographs of solid propellant using deep learning based on convolutional neural networks. J. Nondestr. Eval. NDE4.0 (2021) Dhruv, G., Sreedhar, U., Jyothir, R.K.J., Sureka, M., Padma, P., Bikash, G., Krishnan, B.: Automated defect recognition on X-ray radiographs of solid propellant using deep learning based on convolutional neural networks. J. Nondestr. Eval. NDE4.0 (2021)
23.
Zurück zum Zitat Alexey, B., Wang, C.-Y., Liao, H.-Y.: YOLOv4: optimal speed and accuracy of object detection, computer vision and pattern recognition, arXiv preprint arXiv:2004.10934v1 (2020) Alexey, B., Wang, C.-Y., Liao, H.-Y.: YOLOv4: optimal speed and accuracy of object detection, computer vision and pattern recognition, arXiv preprint arXiv:​2004.​10934v1 (2020)
24.
Zurück zum Zitat Redmon, J., Santosh, D., Ross, G., Farhadi, A.: You only look once: unified, real-time object detection, computer vision and pattern recognition, arXiv preprint arXiv:1506.02640v5 (2016) Redmon, J., Santosh, D., Ross, G., Farhadi, A.: You only look once: unified, real-time object detection, computer vision and pattern recognition, arXiv preprint arXiv:​1506.​02640v5 (2016)
25.
Zurück zum Zitat Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger, computer vision and pattern recognition, arXiv preprint arXiv:1612.08242v1 (2016) Redmon, J., Farhadi, A.: YOLO9000: better, faster, stronger, computer vision and pattern recognition, arXiv preprint arXiv:​1612.​08242v1 (2016)
26.
Zurück zum Zitat Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement, computer vision and pattern recognition, arXiv preprint arXiv:1804.02767v1 (2018) Redmon, J., Farhadi, A.: YOLOv3: an incremental improvement, computer vision and pattern recognition, arXiv preprint arXiv:​1804.​02767v1 (2018)
27.
Zurück zum Zitat Smith, R.A., Nelson, L.J., Mienczakowski, M.J., Wilcox, P.D.: Ultrasonic analytic-signal responses from polymer-matrix composite laminates. Trans. Ultrason. Ferroelect. Frequency Control 65(2) (2018) Smith, R.A., Nelson, L.J., Mienczakowski, M.J., Wilcox, P.D.: Ultrasonic analytic-signal responses from polymer-matrix composite laminates. Trans. Ultrason. Ferroelect. Frequency Control 65(2) (2018)
29.
Zurück zum Zitat Everingham, M., Van Gool, L., Williams, C.K.I., et al.: The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338 (2010)CrossRef Everingham, M., Van Gool, L., Williams, C.K.I., et al.: The pascal visual object classes (VOC) challenge. Int. J. Comput. Vis. 88, 303–338 (2010)CrossRef
30.
Zurück zum Zitat Spencer, R., Sunderman, R., Todorov, E.: FMC/TFM experimental comparisons. AIP Conf. Proc. 1949, 020015 (2018)CrossRef Spencer, R., Sunderman, R., Todorov, E.: FMC/TFM experimental comparisons. AIP Conf. Proc. 1949, 020015 (2018)CrossRef
31.
Zurück zum Zitat Bikash, G., Krishnan, B., Krishnamurthy, C.V., Rao, A.S.: Two dimensional fem simulation of ultrasonic wave propagation in isotropic solid media using comsol, excerpt from the proceedings of the comsol conference (2010) Bikash, G., Krishnan, B., Krishnamurthy, C.V., Rao, A.S.: Two dimensional fem simulation of ultrasonic wave propagation in isotropic solid media using comsol, excerpt from the proceedings of the comsol conference (2010)
32.
Zurück zum Zitat Rajagopal, P., Mickael, D., Elizabeth, A.S., Michael, J.S.L., Richard, V.C.: On the use of absorbing layers to simulate the propagation of elastic waves in unbounded isotropic media using commercially available finite element packages. NDT E Int. 51, 30–40 (2012)CrossRef Rajagopal, P., Mickael, D., Elizabeth, A.S., Michael, J.S.L., Richard, V.C.: On the use of absorbing layers to simulate the propagation of elastic waves in unbounded isotropic media using commercially available finite element packages. NDT E Int. 51, 30–40 (2012)CrossRef
33.
Zurück zum Zitat Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training gans. In: Advances in Neural Information Processing Systems, pp. 2234–2242 (2016) Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., Chen, X.: Improved techniques for training gans. In: Advances in Neural Information Processing Systems, pp. 2234–2242 (2016)
34.
Zurück zum Zitat Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456 (2015) Ioffe, S., Szegedy, C.: Batch normalization: accelerating deep network training by reducing internal covariate shift. In: International Conference on Machine Learning, pp. 448–456 (2015)
Metadaten
Titel
Automated Defect Recognition for Welds Using Simulation Assisted TFM Imaging with Artificial Intelligence
verfasst von
Thulsiram Gantala
Krishnan Balasubramaniam
Publikationsdatum
01.03.2021
Verlag
Springer US
Erschienen in
Journal of Nondestructive Evaluation / Ausgabe 1/2021
Print ISSN: 0195-9298
Elektronische ISSN: 1573-4862
DOI
https://doi.org/10.1007/s10921-021-00761-1

Weitere Artikel der Ausgabe 1/2021

Journal of Nondestructive Evaluation 1/2021 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.