Skip to main content
Top

2018 | OriginalPaper | Chapter

Making Industrial Robots Smarter with Adaptive Reasoning and Autonomous Thinking for Real-Time Tasks in Dynamic Environments: A Case Study

Authors : Jaime Zabalza, Zixiang Fei, Cuebong Wong, Yijun Yan, Carmelo Mineo, Erfu Yang, Tony Rodden, Jorn Mehnen, Quang-Cuong Pham, Jinchang Ren

Published in: Advances in Brain Inspired Cognitive Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In order to extend the abilities of current robots in industrial applications towards more autonomous and flexible manufacturing, this work presents an integrated system comprising real-time sensing, path-planning and control of industrial robots to provide them with adaptive reasoning, autonomous thinking and environment interaction under dynamic and challenging conditions. The developed system consists of an intelligent motion planner for a 6 degrees-of-freedom robotic manipulator, which performs pick-and-place tasks according to an optimized path computed in real-time while avoiding a moving obstacle in the workspace. This moving obstacle is tracked by a sensing strategy based on machine vision, working on the HSV space for color detection in order to deal with changing conditions including non-uniform background, lighting reflections and shadows projection. The proposed machine vision is implemented by an off-board scheme with two low-cost cameras, where the second camera is aimed at solving the problem of vision obstruction when the robot invades the field of view of the main sensor. Real-time performance of the overall system has been experimentally tested, using a KUKA KR90 R3100 robot.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Zeng, Y., Zhao, Y., Bai, J., Bo, X.: Toward robot self-consciousness (II): brain-inspired robot bodily self-model for self-recognition. Cogn. Comput. 10(2), 307–320 (2018)CrossRef Zeng, Y., Zhao, Y., Bai, J., Bo, X.: Toward robot self-consciousness (II): brain-inspired robot bodily self-model for self-recognition. Cogn. Comput. 10(2), 307–320 (2018)CrossRef
3.
go back to reference Mineo, C., Pierce, S.G., Nicholson, P.I., Cooper, I.: Robotic path planning for non-destructive testing – a custom MATLAB toolbox approach. Robot. Comput. Integr. Manuf. 37, 1–12 (2016)CrossRef Mineo, C., Pierce, S.G., Nicholson, P.I., Cooper, I.: Robotic path planning for non-destructive testing – a custom MATLAB toolbox approach. Robot. Comput. Integr. Manuf. 37, 1–12 (2016)CrossRef
5.
go back to reference Cherubini, A., Passama, R., Crosnier, A., Lasnier, A., Fraisse, P.: Collaborative manufacturing with physical human–robot interaction. Robot. Comput. Integr. Manuf. 40, 1–13 (2016)CrossRef Cherubini, A., Passama, R., Crosnier, A., Lasnier, A., Fraisse, P.: Collaborative manufacturing with physical human–robot interaction. Robot. Comput. Integr. Manuf. 40, 1–13 (2016)CrossRef
6.
go back to reference Ajwad, S.A., Ullah, M.I., Khelifa, B., Iqbal, J.: A comprehensive state-of-the-art on control of industrial articulated robots. J. Balkan Tribol. Assoc. 20(4), 499–521 (2014) Ajwad, S.A., Ullah, M.I., Khelifa, B., Iqbal, J.: A comprehensive state-of-the-art on control of industrial articulated robots. J. Balkan Tribol. Assoc. 20(4), 499–521 (2014)
7.
go back to reference Lopez-Juarez, I.: Skill acquisition for industrial robots: from stand-alone to distributed learning. In: The 2016 IEEE International Conference on Automatica, pp. 1–5 (2016) Lopez-Juarez, I.: Skill acquisition for industrial robots: from stand-alone to distributed learning. In: The 2016 IEEE International Conference on Automatica, pp. 1–5 (2016)
8.
go back to reference Anand, G., Rahul, E.S., Bhavani, R.R.: A sensor framework for human–robot collaboration in industrial robot work-cell. In: International Conference on Intelligent Computing, Instrumentation and Control Technologies, Kerala State, Kannur, India, pp. 715–720 (2017) Anand, G., Rahul, E.S., Bhavani, R.R.: A sensor framework for human–robot collaboration in industrial robot work-cell. In: International Conference on Intelligent Computing, Instrumentation and Control Technologies, Kerala State, Kannur, India, pp. 715–720 (2017)
9.
go back to reference Perez, L., Rodriguez, I., Rodriguez, N., Usamentiaga, R., Garcia, D.F.: Robot guidance using machine vision techniques in industrial environments: a comparative review. Sensors 16(3), 335 (2016)CrossRef Perez, L., Rodriguez, I., Rodriguez, N., Usamentiaga, R., Garcia, D.F.: Robot guidance using machine vision techniques in industrial environments: a comparative review. Sensors 16(3), 335 (2016)CrossRef
10.
go back to reference Feng, Y., Ren, J., Jiang, J., Halvey, M., Jose, J.M.: Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization. Mach. Vis. Appl. 23, 1011–1027 (2012)CrossRef Feng, Y., Ren, J., Jiang, J., Halvey, M., Jose, J.M.: Effective venue image retrieval using robust feature extraction and model constrained matching for mobile robot localization. Mach. Vis. Appl. 23, 1011–1027 (2012)CrossRef
11.
go back to reference Wang, Z., Ren, J., Zhang, D., Sun, M., Jiang, J.: A deep-learning based feature hybrid framework for spatiotemporal saliency detection inside videos. Neurocomputing 287, 68–83 (2018)CrossRef Wang, Z., Ren, J., Zhang, D., Sun, M., Jiang, J.: A deep-learning based feature hybrid framework for spatiotemporal saliency detection inside videos. Neurocomputing 287, 68–83 (2018)CrossRef
12.
go back to reference Han, J., Zhang, D., Cheng, G., Guo, L., Ren, J.: Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Trans. Geosci. Remote Sens. 53(6), 3325–3337 (2015)CrossRef Han, J., Zhang, D., Cheng, G., Guo, L., Ren, J.: Object detection in optical remote sensing images based on weakly supervised learning and high-level feature learning. IEEE Trans. Geosci. Remote Sens. 53(6), 3325–3337 (2015)CrossRef
13.
go back to reference Yan, Y., et al.: Cognitive fusion of thermal and visible imagery for effective detection and tracking of pedestrians in videos. Cogn. Comput. 10, 94–104 (2018)CrossRef Yan, Y., et al.: Cognitive fusion of thermal and visible imagery for effective detection and tracking of pedestrians in videos. Cogn. Comput. 10, 94–104 (2018)CrossRef
14.
go back to reference Liu, Q., Wang, Y., Minghao, Y., Ren, J., Li, R.: Decontaminate feature for tracking: adaptive tracking via evolutionary feature subset. J. Electron. Imaging 26(6), 063025 (2017) Liu, Q., Wang, Y., Minghao, Y., Ren, J., Li, R.: Decontaminate feature for tracking: adaptive tracking via evolutionary feature subset. J. Electron. Imaging 26(6), 063025 (2017)
15.
go back to reference Ren, J., Orwell, J., Jones, G.A., Xu, M.: Real-time modeling of 3-D soccer ball trajectories from multiple fixed cameras. IEEE Trans. Circ. Syst. Video Technol. 18(3), 350–362 (2008)CrossRef Ren, J., Orwell, J., Jones, G.A., Xu, M.: Real-time modeling of 3-D soccer ball trajectories from multiple fixed cameras. IEEE Trans. Circ. Syst. Video Technol. 18(3), 350–362 (2008)CrossRef
16.
go back to reference Ren, J., Orwell, J., Jones, G.A., Xu, M.: Tracking the soccer ball using multiple fixed cameras. Comput. Vis. Image Underst. 113(5), 633–642 (2009)CrossRef Ren, J., Orwell, J., Jones, G.A., Xu, M.: Tracking the soccer ball using multiple fixed cameras. Comput. Vis. Image Underst. 113(5), 633–642 (2009)CrossRef
17.
go back to reference Ren, J., Xu, M., Orwell, J., Jones, G.A.: Multi-camera video surveillance for real-time analysis and reconstruction of soccer games. Mach. Vis. Appl. 21, 855–863 (2010)CrossRef Ren, J., Xu, M., Orwell, J., Jones, G.A.: Multi-camera video surveillance for real-time analysis and reconstruction of soccer games. Mach. Vis. Appl. 21, 855–863 (2010)CrossRef
18.
go back to reference Kunz, T., Reiser, U., Stilman, M., Verl, A.: Real-time path planning for a robot arm in changing environments. In: The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan (2010) Kunz, T., Reiser, U., Stilman, M., Verl, A.: Real-time path planning for a robot arm in changing environments. In: The 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan (2010)
19.
go back to reference Galvao-Wall, D., Economou, J., Goyder, H., Knowles, K., Silson, P., Lawrance, M.: Mobile robot arm trajectory generation for operation in confined environments. J. Syst. Control Eng. 229(3), 215–234 (2015) Galvao-Wall, D., Economou, J., Goyder, H., Knowles, K., Silson, P., Lawrance, M.: Mobile robot arm trajectory generation for operation in confined environments. J. Syst. Control Eng. 229(3), 215–234 (2015)
21.
go back to reference Leven, P., Hutchinson, S.: A framework for real-time path planning in changing environments. Int. J. Robot. Res. 21(12), 999–1030 (2002)CrossRef Leven, P., Hutchinson, S.: A framework for real-time path planning in changing environments. Int. J. Robot. Res. 21(12), 999–1030 (2002)CrossRef
22.
go back to reference Cui, S.G., Wang, H., Yang, L.: A simulation study of A-star algorithm for robot path planning. In: 16th International Conference on Mechatronics Technology, pp. 506–510 (2012) Cui, S.G., Wang, H., Yang, L.: A simulation study of A-star algorithm for robot path planning. In: 16th International Conference on Mechatronics Technology, pp. 506–510 (2012)
23.
go back to reference De Boor, C.: A Practical Guide to Splines. Applied Mathematical Sciences. Springer, New York (1978)CrossRef De Boor, C.: A Practical Guide to Splines. Applied Mathematical Sciences. Springer, New York (1978)CrossRef
24.
go back to reference Donahoo, M.J., Calvert, K.L.: TCP/IP Sockets in C Practical Guide for Programmers. Morgan Kaufmann, Burlington (2009) Donahoo, M.J., Calvert, K.L.: TCP/IP Sockets in C Practical Guide for Programmers. Morgan Kaufmann, Burlington (2009)
25.
go back to reference Mutlu, M., Melo, K., Vespignani, M., Bernardino, A., Ijspeert, A.J.: Where to place cameras on a snake robot: focus on camera trajectory and motion blur. In: 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pp. 1–8 (2015) Mutlu, M., Melo, K., Vespignani, M., Bernardino, A., Ijspeert, A.J.: Where to place cameras on a snake robot: focus on camera trajectory and motion blur. In: 2015 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pp. 1–8 (2015)
26.
go back to reference Abu, P.A., Fernandez, P.: Performance comparison of the Teknomo–Fernandez algorithm on the RGB and HSV color spaces. In: Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, Palawan, pp. 1–6 (2014) Abu, P.A., Fernandez, P.: Performance comparison of the Teknomo–Fernandez algorithm on the RGB and HSV color spaces. In: Humanoid, Nanotechnology, Information Technology, Communication and Control, Environment and Management, Palawan, pp. 1–6 (2014)
27.
go back to reference Zhou, Y., Zeng, F.Z., Zhao, H., Murray, P., Ren, J.: Hierarchical visual perception and two-dimensional compressive sensing for effective content-based color image retrieval. Cogn. Comput. 8, 877–889 (2016)CrossRef Zhou, Y., Zeng, F.Z., Zhao, H., Murray, P., Ren, J.: Hierarchical visual perception and two-dimensional compressive sensing for effective content-based color image retrieval. Cogn. Comput. 8, 877–889 (2016)CrossRef
Metadata
Title
Making Industrial Robots Smarter with Adaptive Reasoning and Autonomous Thinking for Real-Time Tasks in Dynamic Environments: A Case Study
Authors
Jaime Zabalza
Zixiang Fei
Cuebong Wong
Yijun Yan
Carmelo Mineo
Erfu Yang
Tony Rodden
Jorn Mehnen
Quang-Cuong Pham
Jinchang Ren
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-030-00563-4_77

Premium Partner