Top

The International Journal of Advanced Manufacturing Technology

Published in:

04-04-2022 | ORIGINAL ARTICLE

Accurate and robust sub-pixel refinement for fillet weld joint based on directional maximum projection

Authors: Shengfeng Chen, Bing Chen, Jian Liu

Published in: The International Journal of Advanced Manufacturing Technology | Issue 9-10/2022

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Embedded seam tracking system that integrates sensing and computing hardware has obvious advantages due to its miniaturization and flexibility. A core problem of the embedded seam tracking system is to obtain accurate welding seam with low-resolution structured-light images. To remove this burden, an accurate and robust sub-pixel refinement method for fillet weld joint is proposed, and it mainly includes: initial direction detection of structured-light stripes by adopting mean shift algorithm, direction refinement based on weighted least squares method with constraint, and fillet weld joint sub-pixel refinement based on directional maximum projection. The main novelties of this work include: (1) the idea of refining fillet weld joint based on directional maximum projection is proposed for the first time; (2) the proposed method is accurate and robust in heavy noise images. The proposed method is robust, universal, and accurate, and as demonstrated by the following performances: (1) average biases of noise-free, rusty, highly reflective and arc-and-spatter images are 0.51, 0.55, 0.68, and 1.21 pixels, respectively; (2) the CR (effective rate) of pure, rusty, highly reflective, and arc-and-spatter images are all 100%; and (3) the offsets of the initial pixel-level fillet weld joint are effectively rectified.

previous article Cutting force and nonlinear chatter stability of ball-end milling cutter

next article Design of a novel integrated ultrasonic tool holder for friction stir welding

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Available only for authorised users

Rout A, Deepak BBVL, Biswal BB (2019) Advances in weld seam tracking techniques for robotic welding: a review. Robot Comput Integr Manuf 56:12–37. https://doi.org/10.1016/j.rcim.2018.08.003CrossRef

Shao WJ, Liu XF, Wu ZJ (2019) A robust weld seam detection method based on particle filter for laser welding by using a passive vision sensor. Int J Adv Manuf Technol 104(5):2971–2980. https://doi.org/10.1007/s00170-019-04029-xCrossRef

Shah HNM, Sulaiman M, Shukor AZ, Jamaluddin MH, Rashid MZA (2016) Review paper on vision based identification, detection and tracking of weld seams path in welding robot environment. Mod Appl Sci 10(2):83–89. https://doi.org/10.5539/mas.v10n2pCrossRef

Wang N, Zhong K, Shi X, Zhang X (2020) A robust weld seam recognition method under heavy noise based on structured-light vision. Robot Comput Integr Manuf 61:101821. https://doi.org/10.1016/j.rcim.2019.101821CrossRef

Alan MR, Reyes RC, Ismael LJ (2021) A visual path-following learning approach for industrial robots using DRL. Robot Comput Integr Manuf 71:102130. https://doi.org/10.1016/j.rcim.2021.102130CrossRef

Le J, Zhang H, Chen X (2018) Realization of rectangular fillet weld tracking based on rotating arc sensors and analysis of experimental results in gas metal arc welding. Robot Comput Integr Manuf 49:263–276. https://doi.org/10.1016/j.rcim.2017.06.004

Zhang K, Yan M, Huang T, Zheng J, Li Z (2019) 3D reconstruction of complex spatial weld seam for autonomous welding by laser structured light scanning. J Manuf Process 39:200–207. https://doi.org/10.1016/j.jmapro.2019.02.010CrossRef

Bae KY, Park JH (2006) A study on development of inductive sensor for automatic weld seam tracking. J Mater Process Technol 176:111–116. https://doi.org/10.1016/j.jmatprotec.2006.02.020CrossRef

Yang L, Liu Y, Peng J (2020) Advances techniques of the structured light sensing in intelligent welding robots: a review. Int J Adv Manuf Technol 110:1027–1046. https://doi.org/10.1007/s00170-020-05524-2CrossRef

10.

Zou Y, Wei X, Chen J (2020) Conditional generative adversarial network-based training image inpainting for laser vision seam tracking. Opt Laser Eng 134:106140. https://doi.org/10.1016/j.optlaseng.2020.106140CrossRef

11.

Qu Y, Cui C, Chen S, Li J (2005) A fast subpixel edge detection method using Sobel-Zernike moments operator. Image Vis Comput 23(1):11–17. https://doi.org/10.1016/j.imavis.2004.07.003CrossRef

12.

Lyvers EP, Mitchell OR, Akey ML, Reeves AP (1989) Sub pixel measurements using a moment-based edge operator. IEEE Trans Pattern Anal Mach Intell 11(12):1293–1309. https://doi.org/10.1109/34.41367CrossRef

13.

Ghosal S, Mehrotra R (1993) Orthogonal moment operators for sub pixel edge detection. Pattern Recognit 26(2):295–306. https://doi.org/10.1016/0031-3203(93)90038-XCrossRef

14.

Too MX, Ratnam MM, Akil HM (2020) Investigation on the effect of machining parameters on surface roughness during turning of kenaf fiber-reinforced composite using non-contact vision method. Int J Adv Manuf Technol 110:309–325. https://doi.org/10.1007/s00170-020-05691-2CrossRef

15.

Huang C, Jin W, Xu Q, Liu Z, Xu Z (2020) Sub-pixel edge detection algorithm based on Canny-Zernike Moment Method. J Circuit Syst Comput 29(15):2050238. https://doi.org/10.1142/S0218126620502382CrossRef

16.

Watson D (2013) Contouring: a guide to the analysis and display of spatial data. Pergamon, Oxford. https://doi.org/10.1016/0098-3004(93)90069-H

17.

Steger C (2000) Sub pixel-precise extraction of lines and edges. Int Arch Photogramm Remote Sens 33(3):141–156

18.

Zhang C, Zhang J (2013) On-line tool wear measurement for ball-end milling cutter based on machine vision. Comput Ind 64(6):708–719. https://doi.org/10.1016/j.compind.2013.03.010CrossRef

19.

Nalwa VS, Binford TO (1986) On detecting edges. IEEE Trans Pattern Anal Mach Intell 6:699–714. https://doi.org/10.1109/TPAMI.1986.4767852CrossRef

20.

Ye J, Fu G, Poudel UP (2005) High-accuracy edge detection with blurred edge model. Image Vis Comput 23(5):453–467. https://doi.org/10.1016/j.imavis.2004.07.007CrossRef

21.

Chen SB, Chen XZ, Qiu T, Li JQ (2005) Acquisition of weld seam dimensional position information for arc welding robot based on vision computing. J Intell Robot Syst 43(1):77–97. https://doi.org/10.1007/s10846-005-2966-6CrossRef

22.

Shah HNM, Sulaiman M, Shukor AZ, Kamis Z, Rahman AA (2018) Butt welding joints recognition and location identification by using local thresholding. Robot Comput Integr Manuf 51:181–188. https://doi.org/10.1016/j.rcim.2017.12.007CrossRef

23.

Ma Y, Fan J, Deng S, Luo Y, Ma X, Jing F, Tan M (2021) Efficient and accurate start point guiding and seam tracking method for curve weld based on structure light. IEEE Trans Instrum Meas 70:1–10. https://doi.org/10.1109/TIM.2021.3072103

24.

Li XH, Li XD, Khyam MO, Ge SS (2017) Robust welding seam tracking and recognition. IEEE Sens J 17(17):5609–5617. https://doi.org/10.1109/JSEN.2017.2730280CrossRef

25.

Lü X, Gu D, Wang Y, Qu Y, Qin C, Huang F (2018) Feature extraction of welding seam image based on laser vision. IEEE Sens J 18(11):4715–4724. https://doi.org/10.1109/JSEN.2018.2824660CrossRef

26.

Zou Y, Wang Y, Zhou W, Chen X (2018) Real-time seam tracking control system based on line laser visions. Opt Laser Technol 103:182–192. https://doi.org/10.1016/j.optlastec.2018.01.010CrossRef

27.

Geiger A, Moosmann F, Car Ö, Schuster B (2012) Automatic camera and range sensor calibration using a single shot. In: 2012 IEEE Int Conf Robot Autom 3936–3943. https://doi.org/10.1109/ICRA.2012.6224570

28.

Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(2):603–619. https://doi.org/10.1109/34.1000236CrossRef

29.

Cheng Y (1995) Mean shift, mode seeking, and clustering. IEEE Trans Pattern Anal Mach Intell 17 (8):790–799. https://doi.org/10.1109/34.400568

30.

Chen S, Liu J, Chen B, Suo X (2022) Universal fillet weld joint recognition and positioning for robot welding using structured light. Robot Comput Integr Manuf 74:102279. https://doi.org/10.1016/j.rcim.2021.102279CrossRef

Title: Accurate and robust sub-pixel refinement for fillet weld joint based on directional maximum projection
Authors: Shengfeng Chen
Bing Chen
Jian Liu
Publication date: 04-04-2022
Publisher: Springer London
Published in: The International Journal of Advanced Manufacturing Technology / Issue 9-10/2022
Print ISSN: 0268-3768
Electronic ISSN: 1433-3015
DOI: https://doi.org/10.1007/s00170-022-09106-2

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 9-10/2022

Point cloud based tool path generation for corrective machining in ultra-precision diamond turning

Design of a novel integrated ultrasonic tool holder for friction stir welding

Design and experimental research of dynamic magnetic field device based on Halbach array in magnetorheological polishing

Online grinding chatter detection based on minimum entropy deconvolution and autocorrelation function

Solid-state phase transformation-induced residual stress in selective laser melting of martensitic stainless steel

Improvement of formability and corrosion resistance of AZ31 magnesium alloy by pulsed current–assisted laser shock forming

Premium Partners