Skip to main content
Erschienen in: Advances in Manufacturing 4/2020

10.11.2020

Robust identification of weld seam based on region of interest operation

verfasst von: Ying-Zhong Tian, Hong-Fei Liu, Long Li, Wen-Bin Wang, Jie-Cai Feng, Feng-Feng Xi, Guang-Jie Yuan

Erschienen in: Advances in Manufacturing | Ausgabe 4/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

For welding path determination, the use of vision sensors is more effective compared with complex offline programming and teaching in small to medium volume production. However, interference factors such as scratches and stains on the surface of the workpiece may affect the extraction of weld information. In the obtained weld image, the weld seams have two distinct features related to the workpiece, which are continuous in a single process and separated from the workpiece’s gray value. In this paper, a novel method is proposed to identify the welding path based on the region of interest (ROI) operation, which is concentrated around the weld seam to reduce the interference of external noise. To complete the identification of the entire welding path, a novel algorithm is used to adaptively generate a dynamic ROI (DROI) and perform iterative operations. The identification accuracy of this algorithm is improved by setting the boundary conditions within the ROI. Moreover, the experimental results confirm that the coefficient factor used for determining the ROI size is a pivotal influencing factor for the robustness of the algorithm and for obtaining an optimal solution. With this algorithm, the welding path identification accuracy is within 2 pixels for three common butt weld types.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Fan J, Jing F, Fang Z et al (2017) Automatic recognition system of welding seam type based on svm method. Int J Adv Manuf Technol 92(1/4):989–999CrossRef Fan J, Jing F, Fang Z et al (2017) Automatic recognition system of welding seam type based on svm method. Int J Adv Manuf Technol 92(1/4):989–999CrossRef
2.
Zurück zum Zitat Svenman E, Runnemalm A (2017) A complex response inductive method for improved gap measurement in laser welding. Int J Adv Manuf Technol 88(1/4):175–184CrossRef Svenman E, Runnemalm A (2017) A complex response inductive method for improved gap measurement in laser welding. Int J Adv Manuf Technol 88(1/4):175–184CrossRef
3.
Zurück zum Zitat Jeong SK, Lee GY, Lee WK et al (2001) Development of high speed rotating arc sensor and seam tracking controller for welding robots. In: ISIE 2001 IEEE international symposium on industrial electronics proceedings. IEEE, vol 2, pp 845–850 Jeong SK, Lee GY, Lee WK et al (2001) Development of high speed rotating arc sensor and seam tracking controller for welding robots. In: ISIE 2001 IEEE international symposium on industrial electronics proceedings. IEEE, vol 2, pp 845–850
4.
Zurück zum Zitat Chen B, Feng JC (2013) A survey of underwater wet weld seam tracking based on ultrasonic sensor. Appl Mech Mater 1433:2227–2230CrossRef Chen B, Feng JC (2013) A survey of underwater wet weld seam tracking based on ultrasonic sensor. Appl Mech Mater 1433:2227–2230CrossRef
5.
Zurück zum Zitat Gao X, Mo L, Xiao Z et al (2016) Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image. Int J Adv Manuf Technol 83(1/4):21–32CrossRef Gao X, Mo L, Xiao Z et al (2016) Seam tracking based on Kalman filtering of micro-gap weld using magneto-optical image. Int J Adv Manuf Technol 83(1/4):21–32CrossRef
6.
Zurück zum Zitat Ni D, Yew AWW, Ong SK et al (2017) Haptic and visual augmented reality interface for programming welding robots. Adv Manuf 5(3):191–198CrossRef Ni D, Yew AWW, Ong SK et al (2017) Haptic and visual augmented reality interface for programming welding robots. Adv Manuf 5(3):191–198CrossRef
7.
Zurück zum Zitat Xu Y, Fang G, Chen S et al (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9/12):1413–1425CrossRef Xu Y, Fang G, Chen S et al (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9/12):1413–1425CrossRef
8.
Zurück zum Zitat Shah HNM, Sulaiman M, Shukor AZ (2017) Autonomous detection and identification of weld seam path shape position. Int J Adv Manuf Technol 92(9/12):3739–3747CrossRef Shah HNM, Sulaiman M, Shukor AZ (2017) Autonomous detection and identification of weld seam path shape position. Int J Adv Manuf Technol 92(9/12):3739–3747CrossRef
9.
Zurück zum Zitat Li X, Li X, Khyam MO et al (2017) Robust welding seam tracking and recognition. IEEE Sens J 17(17):5609–5617CrossRef Li X, Li X, Khyam MO et al (2017) Robust welding seam tracking and recognition. IEEE Sens J 17(17):5609–5617CrossRef
10.
Zurück zum Zitat Yang L, Li E, Long T et al (2018) A high-speed seam extraction method based on the novel structured-light sensor for arc welding robot: a review. IEEE Sens J 18(21):8631–8641 Yang L, Li E, Long T et al (2018) A high-speed seam extraction method based on the novel structured-light sensor for arc welding robot: a review. IEEE Sens J 18(21):8631–8641
11.
Zurück zum Zitat Dinham M, Fang G (2012) Weld seam detection using computer vision for robotic arc welding. In: IEEE international conference on automation science and engineering. IEEE, pp 771–776 Dinham M, Fang G (2012) Weld seam detection using computer vision for robotic arc welding. In: IEEE international conference on automation science and engineering. IEEE, pp 771–776
12.
Zurück zum Zitat Moradi AN, Dezfulli BMA, Alavi CSE (2013) Development a vision based seam tracking system for none destructive testing machines. Int J Comput Sci Netw Solut 1(4):45–56 Moradi AN, Dezfulli BMA, Alavi CSE (2013) Development a vision based seam tracking system for none destructive testing machines. Int J Comput Sci Netw Solut 1(4):45–56
13.
Zurück zum Zitat Ding Y, Huang W, Kovacevic R (2016) An on-line shape-matching weld seam tracking system. Rob Comput Integr Manuf 42:103–112CrossRef Ding Y, Huang W, Kovacevic R (2016) An on-line shape-matching weld seam tracking system. Rob Comput Integr Manuf 42:103–112CrossRef
14.
Zurück zum Zitat Ye Z, Fang G, Chen S et al (2013) A robust algorithm for weld seam extraction based on prior knowledge of weld seam. Sens Rev 33(2):125–133CrossRef Ye Z, Fang G, Chen S et al (2013) A robust algorithm for weld seam extraction based on prior knowledge of weld seam. Sens Rev 33(2):125–133CrossRef
15.
Zurück zum Zitat Yang LJ, Lou PH, Qian XM (2015) Recognition of initial welding position for large diameter pipeline based on pulse coupled neural network. Ind Robot Int J 42(4):339–346CrossRef Yang LJ, Lou PH, Qian XM (2015) Recognition of initial welding position for large diameter pipeline based on pulse coupled neural network. Ind Robot Int J 42(4):339–346CrossRef
16.
Zurück zum Zitat Fan J, Deng S, Jing F et al (2019) An initial point alignment and seam-tracking system for narrow weld. IEEE Trans Ind Inf 16(2):1–1 Fan J, Deng S, Jing F et al (2019) An initial point alignment and seam-tracking system for narrow weld. IEEE Trans Ind Inf 16(2):1–1
17.
Zurück zum Zitat Dinham M, Fang G (2013) Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding. Rob Comput Integr Manuf 29(5):288–301CrossRef Dinham M, Fang G (2013) Autonomous weld seam identification and localisation using eye-in-hand stereo vision for robotic arc welding. Rob Comput Integr Manuf 29(5):288–301CrossRef
18.
Zurück zum Zitat Li X, Li X, Ge SS et al (2017) Automatic welding seam tracking and identification. IEEE Trans Ind Electron 64(9):7261–7271CrossRef Li X, Li X, Ge SS et al (2017) Automatic welding seam tracking and identification. IEEE Trans Ind Electron 64(9):7261–7271CrossRef
19.
Zurück zum Zitat Shah HNM, Sulaiman M, Shukor AZ et al (2018) Butt welding joints recognition and location identification by using local thresholding. Rob Comput Integr Manuf 51:181–188CrossRef Shah HNM, Sulaiman M, Shukor AZ et al (2018) Butt welding joints recognition and location identification by using local thresholding. Rob Comput Integr Manuf 51:181–188CrossRef
20.
Zurück zum Zitat Shi F, Lin T, Chen S (2009) Efficient weld seam detection for robotic welding based on local image processing. Ind Robot Int J 36(3):277–283CrossRef Shi F, Lin T, Chen S (2009) Efficient weld seam detection for robotic welding based on local image processing. Ind Robot Int J 36(3):277–283CrossRef
21.
Zurück zum Zitat Fang Z, Xu D, Tan M (2011) A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE-ASME T Mech 16(3):540–550CrossRef Fang Z, Xu D, Tan M (2011) A vision-based self-tuning fuzzy controller for fillet weld seam tracking. IEEE-ASME T Mech 16(3):540–550CrossRef
22.
Zurück zum Zitat Dinham M, Fang G (2014) Detection of fillet weld joints using an adaptive line growing algorithm for robotic arc welding. Rob Comput Integr Manuf 30(3):229–243CrossRef Dinham M, Fang G (2014) Detection of fillet weld joints using an adaptive line growing algorithm for robotic arc welding. Rob Comput Integr Manuf 30(3):229–243CrossRef
23.
Zurück zum Zitat Bagger C, Olsen FO (2005) Review of laser hybrid welding. J Laser Appl 17(1):2–14CrossRef Bagger C, Olsen FO (2005) Review of laser hybrid welding. J Laser Appl 17(1):2–14CrossRef
24.
Zurück zum Zitat Bunaziv I, Akselsen OM, Frostevarg J et al (2019) Application of laser-arc hybrid welding of steel for low-temperature service. Int J Adv Manuf Technol 102(5/8):2601–2613CrossRef Bunaziv I, Akselsen OM, Frostevarg J et al (2019) Application of laser-arc hybrid welding of steel for low-temperature service. Int J Adv Manuf Technol 102(5/8):2601–2613CrossRef
25.
Zurück zum Zitat Wei SC, Wang J, Lin T et al (2012) Application of image morphology in detecting and extracting the initial welding position. J Shanghai Jiaotong Univ (Sci) 17(3):323–326CrossRef Wei SC, Wang J, Lin T et al (2012) Application of image morphology in detecting and extracting the initial welding position. J Shanghai Jiaotong Univ (Sci) 17(3):323–326CrossRef
26.
Zurück zum Zitat Fang Z, Xu D, Tan M (2013) Vision-based initial weld point positioning using the geometric relation- ship between two seams. Int J Adv Manuf Technol 66(9/12):1535–1543CrossRef Fang Z, Xu D, Tan M (2013) Vision-based initial weld point positioning using the geometric relation- ship between two seams. Int J Adv Manuf Technol 66(9/12):1535–1543CrossRef
27.
Zurück zum Zitat Shah HM, Sulaiman M, Shukor A et al (2016) Vision based identification and detection of initial, mid and end points of weld seams path in butt-welding joint using point detector methods. J Telecommun Electron Comput Eng 8(7):57–61 Shah HM, Sulaiman M, Shukor A et al (2016) Vision based identification and detection of initial, mid and end points of weld seams path in butt-welding joint using point detector methods. J Telecommun Electron Comput Eng 8(7):57–61
28.
Zurück zum Zitat Tian YZ, Hu HJ, Cui HY et al (2017) Three-dimensional surface microtopography recovery from a multifocus image sequence using an omnidirectional modified laplacian operator with adaptive window size. Appl Opt 56(22):6300–6310CrossRef Tian YZ, Hu HJ, Cui HY et al (2017) Three-dimensional surface microtopography recovery from a multifocus image sequence using an omnidirectional modified laplacian operator with adaptive window size. Appl Opt 56(22):6300–6310CrossRef
29.
Zurück zum Zitat Haug K, Pritschow G (1998) Robust laser-stripe sensor for automated weld-seam-tracking in the shipbuilding industry. In: IECON’98 proceedings of the 24th annual conference of the IEEE industrial electronics society. IEEE, vol 2, pp 1236–1241 Haug K, Pritschow G (1998) Robust laser-stripe sensor for automated weld-seam-tracking in the shipbuilding industry. In: IECON’98 proceedings of the 24th annual conference of the IEEE industrial electronics society. IEEE, vol 2, pp 1236–1241
30.
Zurück zum Zitat Liu F, Wang Z, Ji Y (2018) Precise initial weld position identification of a fillet weld seam using laser vision technology. Int J Adv Manuf Technol 99(5/8):2059–2068CrossRef Liu F, Wang Z, Ji Y (2018) Precise initial weld position identification of a fillet weld seam using laser vision technology. Int J Adv Manuf Technol 99(5/8):2059–2068CrossRef
Metadaten
Titel
Robust identification of weld seam based on region of interest operation
verfasst von
Ying-Zhong Tian
Hong-Fei Liu
Long Li
Wen-Bin Wang
Jie-Cai Feng
Feng-Feng Xi
Guang-Jie Yuan
Publikationsdatum
10.11.2020
Verlag
Shanghai University
Erschienen in
Advances in Manufacturing / Ausgabe 4/2020
Print ISSN: 2095-3127
Elektronische ISSN: 2195-3597
DOI
https://doi.org/10.1007/s40436-020-00325-y

Weitere Artikel der Ausgabe 4/2020

Advances in Manufacturing 4/2020 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.