Skip to main content
Erschienen in: Journal of Nondestructive Evaluation 2/2024

01.06.2024

Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches

verfasst von: Baoxin Zhang, Xiaopeng Wang, Jinhan Cui, Juntao Wu, Zhi Xiong, Wenpin Zhang, Xinghua Yu

Erschienen in: Journal of Nondestructive Evaluation | Ausgabe 2/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Automated inspection is vital in modern industrial manufacturing, optimizing production processes and ensuring product quality. Welding, a widely used joining technique, is susceptible to defects like porosity and cracks, compromising product reliability. Traditional nondestructive testing (NDT) methods suffer from inefficiency and limited accuracy. Many researchers have tried to apply deep learning for defect detection to address these limitations. This study compares traditional algorithms with deep learning methods, specifically evaluating the SwinUNet model for weld segmentation. The model achieves an impressive F1 score of 96.31, surpassing traditional algorithms. Feature analysis utilizing class activation maps confirms the model's robust recognition and generalization capabilities. Additionally, segmentation results for different welding defects were compared among various models, further substantiating the recognition capabilities of SwinUNet. The findings contribute to the automation of weld identification and segmentation, driving industrial production efficiency and enhancing defect detection.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Nti, I.K., Adekoya, A.F., Weyori, B.A., Nyarko-Boateng, O.: Applications of artificial intelligence in engineering and manufacturing: a systematic review. J. Intell. Manuf. 33, 1581–1601 (2022)CrossRef Nti, I.K., Adekoya, A.F., Weyori, B.A., Nyarko-Boateng, O.: Applications of artificial intelligence in engineering and manufacturing: a systematic review. J. Intell. Manuf. 33, 1581–1601 (2022)CrossRef
2.
Zurück zum Zitat Chen, S.B., Lv, N.: Research evolution on intelligentized technologies for arc welding process. J. Manuf. Process. 16, 109–122 (2014)CrossRef Chen, S.B., Lv, N.: Research evolution on intelligentized technologies for arc welding process. J. Manuf. Process. 16, 109–122 (2014)CrossRef
3.
Zurück zum Zitat Usuga Cadavid, J.P., Lamouri, S., Grabot, B., Pellerin, R., Fortin, A.: Machine learning applied in production planning and control: a state-of-the-art in the era of Industry 4.0. J. Intell. Manuf. 31, 1531–1558 (2020)CrossRef Usuga Cadavid, J.P., Lamouri, S., Grabot, B., Pellerin, R., Fortin, A.: Machine learning applied in production planning and control: a state-of-the-art in the era of Industry 4.0. J. Intell. Manuf. 31, 1531–1558 (2020)CrossRef
4.
Zurück zum Zitat Escobar, C.A., McGovern, M.E., Morales-Menendez, R.: Quality 4.0: a review of big data challenges in manufacturing. J. Intell. Manuf. 32, 2319–2334 (2021)CrossRef Escobar, C.A., McGovern, M.E., Morales-Menendez, R.: Quality 4.0: a review of big data challenges in manufacturing. J. Intell. Manuf. 32, 2319–2334 (2021)CrossRef
5.
Zurück zum Zitat Xu, F., Xu, Y., Zhang, H., Chen, S.: Application of sensing technology in intelligent robotic arc welding: a review. J. Manuf. Process. 79, 854–880 (2022)CrossRef Xu, F., Xu, Y., Zhang, H., Chen, S.: Application of sensing technology in intelligent robotic arc welding: a review. J. Manuf. Process. 79, 854–880 (2022)CrossRef
6.
Zurück zum Zitat Maeda, K., Suzuki, R., Suga, T., Kawahito, Y.: Investigating delayed cracking behaviour in laser welds of high strength steel sheets using an X-ray transmission in situ observation system. Sci. Technol. Weld. Join. 25, 377–382 (2020)CrossRef Maeda, K., Suzuki, R., Suga, T., Kawahito, Y.: Investigating delayed cracking behaviour in laser welds of high strength steel sheets using an X-ray transmission in situ observation system. Sci. Technol. Weld. Join. 25, 377–382 (2020)CrossRef
7.
Zurück zum Zitat Mahto, R.P., Kumar, R., Pal, S.K.: Characterizations of weld defects, intermetallic compounds and mechanical properties of friction stir lap welded dissimilar alloys. Mater Charact 160, 110115 (2020)CrossRef Mahto, R.P., Kumar, R., Pal, S.K.: Characterizations of weld defects, intermetallic compounds and mechanical properties of friction stir lap welded dissimilar alloys. Mater Charact 160, 110115 (2020)CrossRef
8.
Zurück zum Zitat Zhang, Z., Wen, G., Chen, S.: Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc welding. J. Manuf. Process. 45, 208–216 (2019)CrossRef Zhang, Z., Wen, G., Chen, S.: Weld image deep learning-based on-line defects detection using convolutional neural networks for Al alloy in robotic arc welding. J. Manuf. Process. 45, 208–216 (2019)CrossRef
9.
Zurück zum Zitat Deepak, J.R., Bupesh Raja, V.K., Srikanth, D., Surendran, H., Nickolas, M.M.: Nondestructive testing (NDT) techniques for low carbon steel welded joints: a review and experimental study. Mater. Today Proc. 44, 3732–3737 (2021)CrossRef Deepak, J.R., Bupesh Raja, V.K., Srikanth, D., Surendran, H., Nickolas, M.M.: Nondestructive testing (NDT) techniques for low carbon steel welded joints: a review and experimental study. Mater. Today Proc. 44, 3732–3737 (2021)CrossRef
10.
Zurück zum Zitat Zhang, Y.S., Zhang, X.Y., Lai, X.M., Chen, G.L.: Online quality inspection of resistance spot welded joint based on electrode indentation using servo gun. Sci. Technol. Weld. Join. 12, 449–454 (2007)CrossRef Zhang, Y.S., Zhang, X.Y., Lai, X.M., Chen, G.L.: Online quality inspection of resistance spot welded joint based on electrode indentation using servo gun. Sci. Technol. Weld. Join. 12, 449–454 (2007)CrossRef
11.
Zurück zum Zitat Golodov, V.A., Maltseva, A.A.: Approach to weld segmentation and defect classification in radiographic images of pipe welds. NDT & E Int. 127, 102597 (2022)CrossRef Golodov, V.A., Maltseva, A.A.: Approach to weld segmentation and defect classification in radiographic images of pipe welds. NDT & E Int. 127, 102597 (2022)CrossRef
12.
Zurück zum Zitat Yu, R., Huang, Y., Peng, Y., Wang, K.: Monitoring of butt weld penetration based on infrared sensing and improved histograms of oriented gradients. J. Mater. Res. Technol. 22, 3280–3293 (2023)CrossRef Yu, R., Huang, Y., Peng, Y., Wang, K.: Monitoring of butt weld penetration based on infrared sensing and improved histograms of oriented gradients. J. Mater. Res. Technol. 22, 3280–3293 (2023)CrossRef
13.
Zurück zum Zitat Zhang, K., Yan, M., Huang, T., Zheng, J., Li, Z.: 3D reconstruction of complex spatial weld seam for autonomous welding by laser structured light scanning. J. Manuf. Process. 39, 200–207 (2019)CrossRef Zhang, K., Yan, M., Huang, T., Zheng, J., Li, Z.: 3D reconstruction of complex spatial weld seam for autonomous welding by laser structured light scanning. J. Manuf. Process. 39, 200–207 (2019)CrossRef
14.
Zurück zum Zitat Hou, W., Zhang, D., Wei, Y., Guo, J., Zhang, X.: Review on computer aided weld defect detection from radiography images. Appl. Sci. 10, 1878 (2020)CrossRef Hou, W., Zhang, D., Wei, Y., Guo, J., Zhang, X.: Review on computer aided weld defect detection from radiography images. Appl. Sci. 10, 1878 (2020)CrossRef
15.
Zurück zum Zitat Runnemalm, A., Ahlberg, J., Appelgren, A., Sjökvist, S.: Automatic inspection of spot welds by thermography. J. Nondestruct. Eval. 33, 398–406 (2014)CrossRef Runnemalm, A., Ahlberg, J., Appelgren, A., Sjökvist, S.: Automatic inspection of spot welds by thermography. J. Nondestruct. Eval. 33, 398–406 (2014)CrossRef
16.
Zurück zum Zitat Wang, X., Wang, X., Zhang, B., Cui, J., Lu, X., Ren, C., et al.: Binary classification of welding defect based on deep learning. Sci. Technol. Weld. Join. 27(6), 1–11 (2022)CrossRef Wang, X., Wang, X., Zhang, B., Cui, J., Lu, X., Ren, C., et al.: Binary classification of welding defect based on deep learning. Sci. Technol. Weld. Join. 27(6), 1–11 (2022)CrossRef
17.
Zurück zum Zitat Wang, X., Yu, X.: Understanding the effect of transfer learning on the automatic welding defect detection. NDT & E Int. 134, 102784 (2023)CrossRef Wang, X., Yu, X.: Understanding the effect of transfer learning on the automatic welding defect detection. NDT & E Int. 134, 102784 (2023)CrossRef
18.
Zurück zum Zitat Rathod, V.R., Anand, R.S.: A comparative study of different segmentation techniques for detection of flaws in NDE weld images. J. Nondestruct. Eval. 31, 1–16 (2012)CrossRef Rathod, V.R., Anand, R.S.: A comparative study of different segmentation techniques for detection of flaws in NDE weld images. J. Nondestruct. Eval. 31, 1–16 (2012)CrossRef
19.
Zurück zum Zitat Mahmoudi, A., Regragui, F.: Fast segmentation method for defects detection in radiographic images of welds. In: 2009 IEEE/ACS International Conference on Computer Systems and Applications, 2009, pp. 857–860 (2009) Mahmoudi, A., Regragui, F.: Fast segmentation method for defects detection in radiographic images of welds. In: 2009 IEEE/ACS International Conference on Computer Systems and Applications, 2009, pp. 857–860 (2009)
20.
Zurück zum Zitat Boaretto, N., Centeno, T.M.: Automated detection of welding defects in pipelines from radiographic images DWDI. NDT & E Int. 86, 7–13 (2017)CrossRef Boaretto, N., Centeno, T.M.: Automated detection of welding defects in pipelines from radiographic images DWDI. NDT & E Int. 86, 7–13 (2017)CrossRef
21.
Zurück zum Zitat Wang, B., Hu, S.J., Sun, L., Freiheit, T.: Intelligent welding system technologies: state-of-the-art review and perspectives. J. Manuf. Syst. 56, 373–391 (2020)CrossRef Wang, B., Hu, S.J., Sun, L., Freiheit, T.: Intelligent welding system technologies: state-of-the-art review and perspectives. J. Manuf. Syst. 56, 373–391 (2020)CrossRef
22.
Zurück zum Zitat Ji, C., Wang, H., Li, H.: Defects detection in weld joints based on visual attention and deep learning. NDT & E Int. 133, 102764 (2023)CrossRef Ji, C., Wang, H., Li, H.: Defects detection in weld joints based on visual attention and deep learning. NDT & E Int. 133, 102764 (2023)CrossRef
23.
Zurück zum Zitat Dong, Z., Mai, Z., Yin, S., Wang, J., Yuan, J., Fei, Y.: A weld line detection robot based on structure light for automatic NDT. Int. J. Adv. Manuf. Technol. 111, 1831–1845 (2020)CrossRef Dong, Z., Mai, Z., Yin, S., Wang, J., Yuan, J., Fei, Y.: A weld line detection robot based on structure light for automatic NDT. Int. J. Adv. Manuf. Technol. 111, 1831–1845 (2020)CrossRef
24.
Zurück zum Zitat Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder–decoder with Atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds) Computer Vision—ECCV 2018, 2018, pp. 833–851. Springer, Cham (2018) Chen, L.-C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder–decoder with Atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds) Computer Vision—ECCV 2018, 2018, pp. 833–851. Springer, Cham (2018)
25.
Zurück zum Zitat Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6230–6239 (2017) Zhao, H., Shi, J., Qi, X., Wang, X., Jia, J.: Pyramid scene parsing network. In: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017, pp. 6230–6239 (2017)
26.
Zurück zum Zitat Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., et al.: An image is worth 16 × 16 words: transformers for image recognition at scale. In: International Conference on Learning Representations (n.d.) Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., et al.: An image is worth 16 × 16 words: transformers for image recognition at scale. In: International Conference on Learning Representations (n.d.)
27.
Zurück zum Zitat Zhang, B., Wang, X., Cui, J., Wu, J., Wang, X., Li, Y., et al.: Welding defects classification by weakly supervised semantic segmentation. NDT & E Int. 138, 102899 (2023)CrossRef Zhang, B., Wang, X., Cui, J., Wu, J., Wang, X., Li, Y., et al.: Welding defects classification by weakly supervised semantic segmentation. NDT & E Int. 138, 102899 (2023)CrossRef
28.
Zurück zum Zitat Shirai, Y.: Automatic inspection of X-ray photograph of welding. Pattern Recognit. 1, 257–261 (1969)ADSCrossRef Shirai, Y.: Automatic inspection of X-ray photograph of welding. Pattern Recognit. 1, 257–261 (1969)ADSCrossRef
29.
Zurück zum Zitat Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., et al.: GDXray: the database of X-ray images for nondestructive testing. J. Nondestruct. Eval. 34, 42 (2015)CrossRef Mery, D., Riffo, V., Zscherpel, U., Mondragón, G., Lillo, I., Zuccar, I., et al.: GDXray: the database of X-ray images for nondestructive testing. J. Nondestruct. Eval. 34, 42 (2015)CrossRef
30.
Zurück zum Zitat Li, W., Li, W., Yang, F., Wang, P.: Multi-scale object detection in satellite imagery based on YOLT. In: IGARSS 2019—2019 IEEE International Geoscience and Remote Sensing Symposium, 2019, pp. 162–165 (2019) Li, W., Li, W., Yang, F., Wang, P.: Multi-scale object detection in satellite imagery based on YOLT. In: IGARSS 2019—2019 IEEE International Geoscience and Remote Sensing Symposium, 2019, pp. 162–165 (2019)
31.
Zurück zum Zitat Ajmi, C., Zapata, J., Martínez-Álvarez, J.J., Doménech, G., Ruiz, R.: Using deep learning for defect classification on a small weld X-ray image dataset. J. Nondestruct. Eval. 39, 68 (2020)CrossRef Ajmi, C., Zapata, J., Martínez-Álvarez, J.J., Doménech, G., Ruiz, R.: Using deep learning for defect classification on a small weld X-ray image dataset. J. Nondestruct. Eval. 39, 68 (2020)CrossRef
32.
Zurück zum Zitat van der Maaten, L.J.P., Hinton, G.E.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008) van der Maaten, L.J.P., Hinton, G.E.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9, 2579–2605 (2008)
33.
Zurück zum Zitat Xiangdong, G., Na, S.J.: Seam tracking based on estimation of weld position using Kalman filtering. Sci. Technol. Weld. Join. 10, 103–109 (2005)CrossRef Xiangdong, G., Na, S.J.: Seam tracking based on estimation of weld position using Kalman filtering. Sci. Technol. Weld. Join. 10, 103–109 (2005)CrossRef
34.
Zurück zum Zitat Yang, L., Liu, Y., Peng, J.: An automatic detection and identification method of welded joints based on deep neural network. IEEE Access 7, 164952–164961 (2019)CrossRef Yang, L., Liu, Y., Peng, J.: An automatic detection and identification method of welded joints based on deep neural network. IEEE Access 7, 164952–164961 (2019)CrossRef
35.
Zurück zum Zitat Chan, F.H.Y., Lam, F.K., Hui, Z.: Adaptive thresholding by variational method. IEEE Trans. Image Process. 7, 468–473 (1998)ADSCrossRefPubMed Chan, F.H.Y., Lam, F.K., Hui, Z.: Adaptive thresholding by variational method. IEEE Trans. Image Process. 7, 468–473 (1998)ADSCrossRefPubMed
36.
Zurück zum Zitat Chang, Y., Gao, J.: Tamper detection in pipeline girth welding based on radiographic images. Measurement 167, 108436 (2021)CrossRef Chang, Y., Gao, J.: Tamper detection in pipeline girth welding based on radiographic images. Measurement 167, 108436 (2021)CrossRef
37.
Zurück zum Zitat Zou, Y., Zeng, G.: Light-weight segmentation network based on SOLOv2 for weld seam feature extraction. Measurement 208, 112492 (2023)CrossRef Zou, Y., Zeng, G.: Light-weight segmentation network based on SOLOv2 for weld seam feature extraction. Measurement 208, 112492 (2023)CrossRef
38.
Zurück zum Zitat Sun, K., Xiao, B., Liu, D., Wang, J.: Deep high-resolution representation learning for human pose estimation. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 5686–5696 (2019) Sun, K., Xiao, B., Liu, D., Wang, J.: Deep high-resolution representation learning for human pose estimation. In: 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019, pp. 5686–5696 (2019)
39.
Zurück zum Zitat Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 9992–10002 (2021) Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., et al.: Swin transformer: hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 9992–10002 (2021)
40.
Zurück zum Zitat Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, 2015, pp. 234–241 (2015). Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015, 2015, pp. 234–241 (2015).
41.
Zurück zum Zitat Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2921–2929 (2016) Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., Torralba, A.: Learning deep features for discriminative localization. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, pp. 2921–2929 (2016)
Metadaten
Titel
Enhancing Weld Inspection Through Comparative Analysis of Traditional Algorithms and Deep Learning Approaches
verfasst von
Baoxin Zhang
Xiaopeng Wang
Jinhan Cui
Juntao Wu
Zhi Xiong
Wenpin Zhang
Xinghua Yu
Publikationsdatum
01.06.2024
Verlag
Springer US
Erschienen in
Journal of Nondestructive Evaluation / Ausgabe 2/2024
Print ISSN: 0195-9298
Elektronische ISSN: 1573-4862
DOI
https://doi.org/10.1007/s10921-024-01047-y

Weitere Artikel der Ausgabe 2/2024

Journal of Nondestructive Evaluation 2/2024 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.