Skip to main content
Erschienen in: The International Journal of Advanced Manufacturing Technology 9-10/2020

02.11.2020 | ORIGINAL ARTICLE

Autonomous seam recognition and feature extraction for multi-pass welding based on laser stripe edge guidance network

verfasst von: Kaixuan Wu, Tianqi Wang, Junjie He, Yang Liu, Zhenwei Jia

Erschienen in: The International Journal of Advanced Manufacturing Technology | Ausgabe 9-10/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, an autonomous seam recognition and feature extraction method for multi-pass welding based on laser stripe edge guidance network is proposed to overcome the interference of strong reflection, spatter, and arc noise in actual welding environment. Firstly, the laser stripe edge guidance network consisting of modified VGGnet, progressive laser stripe feature extraction, non-local laser stripe edge feature extraction, one-to-one guidance module, and multi-feature fusion module is introduced to recognize the laser stripe under heavy arc noises. Afterwards, the gray centroid method is adopted to obtain the thinning laser stripe. Aiming at extracting the position of feature points, the least square method and non-uniform rational B-splines with second derivative are utilized. Finally, experiments and analysis show that our proposed method performs favorable in terms of effectiveness, flexible, accuracy, and robustness, which could meet the actual welding requirements. Besides, the maximum error and maximum root mean square error for feature extraction are 4.7 pixel and 1.78 pixel, respectively.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Muhammad J, Altun H, Abo-Serie E (2016) A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision. Int J Adv Manuf Technol 101(5-8):1967–1978 Muhammad J, Altun H, Abo-Serie E (2016) A robust butt welding seam finding technique for intelligent robotic welding system using active laser vision. Int J Adv Manuf Technol 101(5-8):1967–1978
2.
Zurück zum Zitat Li X, Li X, Ge SS, Khyam MO, Luo C (2017) Automatic welding seam tracking and identification. IEEE Trans Ind Electron 64(9):7261–7271CrossRef Li X, Li X, Ge SS, Khyam MO, Luo C (2017) Automatic welding seam tracking and identification. IEEE Trans Ind Electron 64(9):7261–7271CrossRef
3.
Zurück zum Zitat Shao WJ, Liu XF, Wu ZJ (2019) A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensor. Int J Adv Manuf Technol 104(5-8):2971–2980CrossRef Shao WJ, Liu XF, Wu ZJ (2019) A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensor. Int J Adv Manuf Technol 104(5-8):2971–2980CrossRef
6.
Zurück zum Zitat Gao X, Mo L, Xiao Z, Chen X, Katayama S (2015) Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image. Int J Adv Manuf Technol 83(1–4):21–32 Gao X, Mo L, Xiao Z, Chen X, Katayama S (2015) Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image. Int J Adv Manuf Technol 83(1–4):21–32
7.
Zurück zum Zitat Liu FQ, Wang ZY, Ji Y (2018) Precise initial weld position identification of a fillet weld seam using laser vision technology. Int J Adv Manuf Technol 99(5-8):2059–2068CrossRef Liu FQ, Wang ZY, Ji Y (2018) Precise initial weld position identification of a fillet weld seam using laser vision technology. Int J Adv Manuf Technol 99(5-8):2059–2068CrossRef
8.
Zurück zum Zitat Zou Y, Chen T (2018) Laser vision seam tracking system based on image processing and continuous convolution operator tracker. Opt Lasers Eng 105:141–149CrossRef Zou Y, Chen T (2018) Laser vision seam tracking system based on image processing and continuous convolution operator tracker. Opt Lasers Eng 105:141–149CrossRef
10.
Zurück zum Zitat Cai ZY, Chen R, Yu FZ, Zhang H, Hu BA (2008) Study on multi-pass welding seam recognition based on wavelet transform. Int J Image Graph 12(2):2344–2350 Cai ZY, Chen R, Yu FZ, Zhang H, Hu BA (2008) Study on multi-pass welding seam recognition based on wavelet transform. Int J Image Graph 12(2):2344–2350
11.
Zurück zum Zitat Zhang HJ, Zhang GJ, Cai CB, Gao HM, Wu L (2009) Laser-based visual recognition of multi-pass seam in robot arc welding. Trans China Weld Inst 30(4):105–108 Zhang HJ, Zhang GJ, Cai CB, Gao HM, Wu L (2009) Laser-based visual recognition of multi-pass seam in robot arc welding. Trans China Weld Inst 30(4):105–108
12.
Zurück zum Zitat Gu WP, Xiong ZY, Wan W (2013) Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int J Adv Manuf Technol 69(1-4):451–460CrossRef Gu WP, Xiong ZY, Wan W (2013) Autonomous seam acquisition and tracking system for multi-pass welding based on vision sensor. Int J Adv Manuf Technol 69(1-4):451–460CrossRef
13.
Zurück zum Zitat He YS, Xu YL, Chen YX, Chen HB, Chen SB (2016) Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model. Robot Comput Integr Manuf 37:251–261CrossRef He YS, Xu YL, Chen YX, Chen HB, Chen SB (2016) Weld seam profile detection and feature point extraction for multi-pass route planning based on visual attention model. Robot Comput Integr Manuf 37:251–261CrossRef
14.
Zurück zum Zitat Zeng JL, Chang BH, Du D, Wang L, Chang SH, Peng GD, Wang WZ (2018) A weld position recognition method based on directional and structured light information fusion in multi-layer/multi-pass welding. Sensors 18(1):129CrossRef Zeng JL, Chang BH, Du D, Wang L, Chang SH, Peng GD, Wang WZ (2018) A weld position recognition method based on directional and structured light information fusion in multi-layer/multi-pass welding. Sensors 18(1):129CrossRef
15.
Zurück zum Zitat Zhang YS, Yang GW, Wang QQ, Ma L, Wang YZ (2019) Weld feature extraction based on fully convolutional network. Chin J Lasers 46(3):28–35 Zhang YS, Yang GW, Wang QQ, Ma L, Wang YZ (2019) Weld feature extraction based on fully convolutional network. Chin J Lasers 46(3):28–35
16.
Zurück zum Zitat Zou YB, Lan R, Wei XZ, Chen JX (2020) Robust seam tracking via a deep learning framework combining tracking and detection. Appl Opt 59(14):4321–4331CrossRef Zou YB, Lan R, Wei XZ, Chen JX (2020) Robust seam tracking via a deep learning framework combining tracking and detection. Appl Opt 59(14):4321–4331CrossRef
17.
Zurück zum Zitat Jia ZW, Wang TQ, He JJ, Li LY, Wu KX (2020) Real-time spatial intersecting seam tracking based on laser vision stereo sensor. Measurement 149:106987CrossRef Jia ZW, Wang TQ, He JJ, Li LY, Wu KX (2020) Real-time spatial intersecting seam tracking based on laser vision stereo sensor. Measurement 149:106987CrossRef
18.
Zurück zum Zitat Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Comput Sci. arXiv:1409.1556 Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. Comput Sci. arXiv:1409.1556
22.
Zurück zum Zitat Sheng LG, Lv Y, Liu SL, Geng R, Li XY (2014) A high accuracy sub-pixel light spot positioning algorithm. Appl Mech Mater 644-650:1459–1463CrossRef Sheng LG, Lv Y, Liu SL, Geng R, Li XY (2014) A high accuracy sub-pixel light spot positioning algorithm. Appl Mech Mater 644-650:1459–1463CrossRef
23.
Zurück zum Zitat Bottou L, Curtis FE, Nocedal J (2016) Optimization methods for large-scale machine learning. SIAM Rev 60(2):223–311MathSciNetCrossRef Bottou L, Curtis FE, Nocedal J (2016) Optimization methods for large-scale machine learning. SIAM Rev 60(2):223–311MathSciNetCrossRef
24.
Zurück zum Zitat Steger C (1998) An unbiased detector of curvilinear structure. IEEE Trans Pattern Anal Mach Intell 20(2):113–125CrossRef Steger C (1998) An unbiased detector of curvilinear structure. IEEE Trans Pattern Anal Mach Intell 20(2):113–125CrossRef
Metadaten
Titel
Autonomous seam recognition and feature extraction for multi-pass welding based on laser stripe edge guidance network
verfasst von
Kaixuan Wu
Tianqi Wang
Junjie He
Yang Liu
Zhenwei Jia
Publikationsdatum
02.11.2020
Verlag
Springer London
Erschienen in
The International Journal of Advanced Manufacturing Technology / Ausgabe 9-10/2020
Print ISSN: 0268-3768
Elektronische ISSN: 1433-3015
DOI
https://doi.org/10.1007/s00170-020-06246-1

Weitere Artikel der Ausgabe 9-10/2020

The International Journal of Advanced Manufacturing Technology 9-10/2020 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.