Skip to main content
Top
Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2023

20-09-2022 | Original Paper

3D complex curve seam tracking using industrial robot based on CAD model and computer vision

Authors: Le Duc Hanh, Le Duc Dao, Nguyen Cong Luan

Published in: International Journal on Interactive Design and Manufacturing (IJIDeM) | Issue 3/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

3D complex curve seam tracking using industrial robots applied in fields that affect human health such as welding, gluing, spraying, painting, etc. However, at present, manual performance by workers or teaching manipulators by using teach-pendant to recognize the planning trajectories curves, especially for 3D complex seam curves which often has complex shape, direction, small width are still the two main approaches. Through these two implementation methods, productivity is low and product quality is not uniform. So this study will present a practical method to overcome the above disadvantages by using a low-cost camera combining an image processing algorithm using a 3D CAD model and a pre-defined 3D curve profile that needs to be attached to that model to extract the contour on the object. This data is then transmitted to the industrial manipulator to perform the task of tracing the planned 3D complex curve. By using this method, the small width 3D complex curve is easily tracked and the system is not complicated. Moreover, the profile to be tracked can be modified easily and quickly by non-expert users with basic knowledge about CAD drawing and image processing. Through the result of the experiments, small error system and fast image processing time about 1.8 mm and 0.5 s respectively, the system proved that it meets the requirement of the production line and it can replace the worker. The system is also easy to maintain and setup.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Liu, Y., Tang, Q., Tian, X.: A discrete method of sphere-pipe intersecting curve for robot welding by offline programming. Robot. Comput. Integr. Manuf. 57, 404–411 (2019)CrossRef Liu, Y., Tang, Q., Tian, X.: A discrete method of sphere-pipe intersecting curve for robot welding by offline programming. Robot. Comput. Integr. Manuf. 57, 404–411 (2019)CrossRef
7.
go back to reference Cook, G.E., Andersen, K., Fernandez, K.R., Shepard, M.E., Wells Jr., A.M.: “Electric arc sensing for robot positioning control”, Robotic Welding, pp. 181–216. IFS (Publications) Ltd, Bedford (2010) Cook, G.E., Andersen, K., Fernandez, K.R., Shepard, M.E., Wells Jr., A.M.: “Electric arc sensing for robot positioning control”, Robotic Welding, pp. 181–216. IFS (Publications) Ltd, Bedford (2010)
8.
go back to reference Fridenfalk, M., Bolmsjo, G.: Design and validation of a universal 6D seam-tracking system in robotic welding using arc sensing. Adv. Robot. 18, 1–21 (2004)CrossRef Fridenfalk, M., Bolmsjo, G.: Design and validation of a universal 6D seam-tracking system in robotic welding using arc sensing. Adv. Robot. 18, 1–21 (2004)CrossRef
9.
go back to reference Suwanratchatamanee, K., Matsumoto, M., Hashimoto, S.: Robotic tactile sensor system and applications. IEEE Trans. Industr. Electron. 57(3), 1074–1087 (2010)CrossRef Suwanratchatamanee, K., Matsumoto, M., Hashimoto, S.: Robotic tactile sensor system and applications. IEEE Trans. Industr. Electron. 57(3), 1074–1087 (2010)CrossRef
10.
go back to reference Xu, Y., Lv, N., Zhong, J., Chen, H., Chen, S.: Research on the real-time tracking information of three-dimension welding seam in robotic GTAW process based on composite sensor technology. J. Intell. Robot. Syst. 68(2), 89–103 (2012)CrossRef Xu, Y., Lv, N., Zhong, J., Chen, H., Chen, S.: Research on the real-time tracking information of three-dimension welding seam in robotic GTAW process based on composite sensor technology. J. Intell. Robot. Syst. 68(2), 89–103 (2012)CrossRef
11.
go back to reference Silvers, G.A., Fang, G.: Human machine interface in weld seam detection using an RGB-D camera. Adv. Mater. Res. 875–877, 1967–1971 (2014)CrossRef Silvers, G.A., Fang, G.: Human machine interface in weld seam detection using an RGB-D camera. Adv. Mater. Res. 875–877, 1967–1971 (2014)CrossRef
15.
go back to reference Xiong, J., Zou, S.: Active vision sensing and feedback control of back penetration for thin sheet aluminum alloy in pulsed MIG suspension welding. J. Process Control 77, 89–96 (2019)CrossRef Xiong, J., Zou, S.: Active vision sensing and feedback control of back penetration for thin sheet aluminum alloy in pulsed MIG suspension welding. J. Process Control 77, 89–96 (2019)CrossRef
18.
go back to reference Yang, L., Liu, Y., Peng, J., Liang, Z.: A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot. Robot. Comput. Integr. Manuf. 64, 101929 (2020)CrossRef Yang, L., Liu, Y., Peng, J., Liang, Z.: A novel system for off-line 3D seam extraction and path planning based on point cloud segmentation for arc welding robot. Robot. Comput. Integr. Manuf. 64, 101929 (2020)CrossRef
23.
go back to reference Zhang, Q., Wu, Z.: Three-dimensional imaging technique based on Gray-coded structured illumination. Infrared Laser Eng. 49(3), 0303004 (2020)CrossRef Zhang, Q., Wu, Z.: Three-dimensional imaging technique based on Gray-coded structured illumination. Infrared Laser Eng. 49(3), 0303004 (2020)CrossRef
28.
go back to reference Du, R.Q., Xu, Y., Hou, Z., Shu, J., Chen, S.: Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding. Int. J. Adv. Manuf. Technol. 101, 2135–2149 (2019)CrossRef Du, R.Q., Xu, Y., Hou, Z., Shu, J., Chen, S.: Strong noise image processing for vision-based seam tracking in robotic gas metal arc welding. Int. J. Adv. Manuf. Technol. 101, 2135–2149 (2019)CrossRef
29.
go back to reference Zou, Y., Lan, R., Wei, X., Chen, J.: Robust seam tracking via a deep learning framework combining tracking and detection. Appl. Opt. 59, 4321–4331 (2020)CrossRef Zou, Y., Lan, R., Wei, X., Chen, J.: Robust seam tracking via a deep learning framework combining tracking and detection. Appl. Opt. 59, 4321–4331 (2020)CrossRef
30.
go back to reference Li, Y., Hu, M., Taiyong, W.: Weld image recognition algorithm based on deep learning. Int. J. Pattern Recognit. Artif. Intell. 34(08), 2052004 (2020)CrossRef Li, Y., Hu, M., Taiyong, W.: Weld image recognition algorithm based on deep learning. Int. J. Pattern Recognit. Artif. Intell. 34(08), 2052004 (2020)CrossRef
36.
go back to reference Hanh, L.D., Lin, C.-Y.: Autonomous gluing based on image based visual servoing. Int. J. Robot. Autom. 36(2), 119–127 (2021) Hanh, L.D., Lin, C.-Y.: Autonomous gluing based on image based visual servoing. Int. J. Robot. Autom. 36(2), 119–127 (2021)
Metadata
Title
3D complex curve seam tracking using industrial robot based on CAD model and computer vision
Authors
Le Duc Hanh
Le Duc Dao
Nguyen Cong Luan
Publication date
20-09-2022
Publisher
Springer Paris
Published in
International Journal on Interactive Design and Manufacturing (IJIDeM) / Issue 3/2023
Print ISSN: 1955-2513
Electronic ISSN: 1955-2505
DOI
https://doi.org/10.1007/s12008-022-01043-4

Other articles of this Issue 3/2023

International Journal on Interactive Design and Manufacturing (IJIDeM) 3/2023 Go to the issue

Premium Partner