Skip to main content
Erschienen in: The International Journal of Advanced Manufacturing Technology 9-10/2022

02.04.2022 | ORIGINAL ARTICLE

An intelligent manufacturing cell based on human–robot collaboration of frequent task learning for flexible manufacturing

verfasst von: Shuai Zhang, Shiqi Li, Haipeng Wang, Xiao Li

Erschienen in: The International Journal of Advanced Manufacturing Technology | Ausgabe 9-10/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The trend of short-run production and personalized customization is more and more popular in the manufacturing industry. And the robots in these production lines must conduct task adjustment efficiently when learning new tasks. Thus, this paper developed the intelligent manufacturing cell based on the human–robot collaboration (HRC-IMC) which can enhance the learning ability of cobots by introducing the intelligence of human. The HRC-IMC was composed with four modules: the imitating learning module, the human–robot safety planning module, the task planning module and the visual inferring module. All of the four modules were designed to provide a set of systematic and effective methods. That was conductive to the efficiency improvement of the task adjustment for cobots’ new task learning. The experimental results indicated that the efficiency of task adjustment can be increased by 42.8 % when the HRC-IMC was employed than that of Moveit. All in all, this study is of great significance for improving the efficiency of new task adjustment of cobots by imitating the manipulation experience of human via combining four algorithm modules.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Zhong R, Xun X, Klotz E, Newman S (2017) Intelligent manufacturing in the context of industry 4.0: a review. Engineering 3(5):616–630 Zhong R, Xun X, Klotz E, Newman S (2017) Intelligent manufacturing in the context of industry 4.0: a review. Engineering 3(5):616–630
2.
Zurück zum Zitat Zhou J, Li P, Zhou Y, Wang B, Meng L (2018) Toward new-generation intelligent manufacturing. Engineering 4(4):11–20CrossRef Zhou J, Li P, Zhou Y, Wang B, Meng L (2018) Toward new-generation intelligent manufacturing. Engineering 4(4):11–20CrossRef
3.
Zurück zum Zitat Zhu H, Gupta A, Rajeswaran A, Levine S, Kumar V (2019) Dexterous manipulation with deep reinforcement learning: Efficient, general, and low-cost. In: 2019 International Conference on Robotics and Automation (ICRA), IEEE, p 3651–3657 Zhu H, Gupta A, Rajeswaran A, Levine S, Kumar V (2019) Dexterous manipulation with deep reinforcement learning: Efficient, general, and low-cost. In: 2019 International Conference on Robotics and Automation (ICRA), IEEE, p 3651–3657
4.
Zurück zum Zitat Karami A, Sadeghian H, Keshmiri M, Oriolo G (2018) Hierarchical tracking task control in redundant manipulators with compliance control in the null-space. Mechatronics 55:171–179CrossRef Karami A, Sadeghian H, Keshmiri M, Oriolo G (2018) Hierarchical tracking task control in redundant manipulators with compliance control in the null-space. Mechatronics 55:171–179CrossRef
5.
Zurück zum Zitat Sheng L, Bao L, Wu P (2018) Application of heuristic approaches in the robot path planning and optimization: a review. Electron Opt Control Sheng L, Bao L, Wu P (2018) Application of heuristic approaches in the robot path planning and optimization: a review. Electron Opt Control
6.
Zurück zum Zitat Raessa M, Chen J, Wan W, Harada K (2020) Human-in-the-loop robotic manipulation planning for collaborative assembly. arXiv 17(4):1800–1814 Raessa M, Chen J, Wan W, Harada K (2020) Human-in-the-loop robotic manipulation planning for collaborative assembly. arXiv 17(4):1800–1814
7.
Zurück zum Zitat Wang X, Kemny Z, Vncza J, Wang L (2017) Human robot collaborative assembly in cyber-physical production: Classification framework and implementation. Cirp Ann Manuf Technol 66(1):5–8CrossRef Wang X, Kemny Z, Vncza J, Wang L (2017) Human robot collaborative assembly in cyber-physical production: Classification framework and implementation. Cirp Ann Manuf Technol 66(1):5–8CrossRef
8.
Zurück zum Zitat Weitschat R, Aschemann H (2018) Safe and efficient human crobot collaboration part ii: Optimal generalized human-in-the-loop real-time motion generation. IEEE Robot Automation Lett 3(4):3781–3789CrossRef Weitschat R, Aschemann H (2018) Safe and efficient human crobot collaboration part ii: Optimal generalized human-in-the-loop real-time motion generation. IEEE Robot Automation Lett 3(4):3781–3789CrossRef
9.
Zurück zum Zitat Music S, Salvietti G, Dohmann P, Chinello F, Hirche S (2019) Human–robot team interaction through wearable haptics for cooperative manipulation. IEEE Trans Haptics 12(3):350–362CrossRef Music S, Salvietti G, Dohmann P, Chinello F, Hirche S (2019) Human–robot team interaction through wearable haptics for cooperative manipulation. IEEE Trans Haptics 12(3):350–362CrossRef
10.
Zurück zum Zitat Rahman S (2019) Cognitive cyber-physical system (c-cps) for human–robot collaborative manufacturing. In: 2019 14th Annual Conference System of Systems Engineering (SoSE) Rahman S (2019) Cognitive cyber-physical system (c-cps) for human–robot collaborative manufacturing. In: 2019 14th Annual Conference System of Systems Engineering (SoSE)
11.
Zurück zum Zitat Nunes D, Silva J, Boavida F (2018) A practical introduction to human-in-the-loop cyber-physical systems. John Wiley & Sons, Hoboken Nunes D, Silva J, Boavida F (2018) A practical introduction to human-in-the-loop cyber-physical systems. John Wiley & Sons, Hoboken
12.
Zurück zum Zitat Schirner G, Erdogmus D, Chowdhury K, Padir T (2013) The future of human-in-the-loop cyber-physical systems. Computer 46(1):36–45CrossRef Schirner G, Erdogmus D, Chowdhury K, Padir T (2013) The future of human-in-the-loop cyber-physical systems. Computer 46(1):36–45CrossRef
13.
Zurück zum Zitat Sowe S, Simmon E, Zettsu K, Vaulx F, Bojanova I (2016) Cyber-physical-human systems: Putting people in the loop. IT Professional 18(1):10–13CrossRef Sowe S, Simmon E, Zettsu K, Vaulx F, Bojanova I (2016) Cyber-physical-human systems: Putting people in the loop. IT Professional 18(1):10–13CrossRef
14.
Zurück zum Zitat Krugh M, Mears L (2018) A complementary cyber-human systems framework for industry 4.0 cyber-physical systems. Manuf Lett 15:89–92CrossRef Krugh M, Mears L (2018) A complementary cyber-human systems framework for industry 4.0 cyber-physical systems. Manuf Lett 15:89–92CrossRef
15.
Zurück zum Zitat Zhou J, Zhou Y, Wang B, Zang J (2019) Human cyber physical systems (hcpss) in the context of new-generation intelligent manufacturing. Engineering Zhou J, Zhou Y, Wang B, Zang J (2019) Human cyber physical systems (hcpss) in the context of new-generation intelligent manufacturing. Engineering
16.
Zurück zum Zitat Wang L, Gao R, Vncza J, Krger J, Chryssolouris G (2019) Symbiotic human–robot collaborative assembly. CIRP Ann - Manuf Technol 68(2):701–726CrossRef Wang L, Gao R, Vncza J, Krger J, Chryssolouris G (2019) Symbiotic human–robot collaborative assembly. CIRP Ann - Manuf Technol 68(2):701–726CrossRef
17.
Zurück zum Zitat Anupma Y, Jayswal S (2018) Modelling of flexible manufacturing system: a review. Int J Prod Res 56(7–8):2464–2487 Anupma Y, Jayswal S (2018) Modelling of flexible manufacturing system: a review. Int J Prod Res 56(7–8):2464–2487
18.
Zurück zum Zitat Ajoudani A, Zanchettin AM, Ivaldi S, Albu-Schffer A, Kosuge K, Khatib O (2017) Progress and prospects of the human–robot collaboration. Auton Robots 42(5):957–975CrossRef Ajoudani A, Zanchettin AM, Ivaldi S, Albu-Schffer A, Kosuge K, Khatib O (2017) Progress and prospects of the human–robot collaboration. Auton Robots 42(5):957–975CrossRef
19.
Zurück zum Zitat Maurtua I, Ibarguren A, Kildal J, Susperregi L, Sierra B (2017) Human–robot collaboration in industrial applications: Safety, interaction and trust. Int J Adv Robot Syst 14(4):1–10 Maurtua I, Ibarguren A, Kildal J, Susperregi L, Sierra B (2017) Human–robot collaboration in industrial applications: Safety, interaction and trust. Int J Adv Robot Syst 14(4):1–10
20.
Zurück zum Zitat Ioannis K, Andreas K, Dimitrios G, Dimitrios T (2017) Robot’s workspace enhancement with dynamic human presence for socially-aware navigation. In: International Conference on Computer Vision Systems, p 279–288 Ioannis K, Andreas K, Dimitrios G, Dimitrios T (2017) Robot’s workspace enhancement with dynamic human presence for socially-aware navigation. In: International Conference on Computer Vision Systems, p 279–288
21.
Zurück zum Zitat Christoph S, Boris L, Patrick P, Wolfram B (2017) An accurate and efficient navigation system for omnidirectional robots in industrial environments. Auton Robots 41(2):473–493CrossRef Christoph S, Boris L, Patrick P, Wolfram B (2017) An accurate and efficient navigation system for omnidirectional robots in industrial environments. Auton Robots 41(2):473–493CrossRef
22.
Zurück zum Zitat Lotsaris K, Fousekis N, Koukas S, Aivaliotis S, Makris S (2021) Augmented reality (ar) based framework for supporting human workers in flexible manufacturing. Proc CIRP 96:301–306CrossRef Lotsaris K, Fousekis N, Koukas S, Aivaliotis S, Makris S (2021) Augmented reality (ar) based framework for supporting human workers in flexible manufacturing. Proc CIRP 96:301–306CrossRef
23.
Zurück zum Zitat Fabrizio F, Torsten K, Alessandro D, Oussama K (2015) A depth space approach for evaluating distance to objects. J Intell Robot Syst 80(1):7–22 Fabrizio F, Torsten K, Alessandro D, Oussama K (2015) A depth space approach for evaluating distance to objects. J Intell Robot Syst 80(1):7–22
24.
Zurück zum Zitat Emanuele M, Federica F, Jacopo R, Fabio P, Alessandro D, Francesco L (2020) Human–robot coexistence and interaction in open industrial cells. Robot Comput-Integr Manuf 61:1–19 Emanuele M, Federica F, Jacopo R, Fabio P, Alessandro D, Francesco L (2020) Human–robot coexistence and interaction in open industrial cells. Robot Comput-Integr Manuf 61:1–19
25.
Zurück zum Zitat Nikolaos N, Vasilis M, Sotiris M (2019) A cyber physical system (cps) approach for safe human–robot collaboration in a shared workplace. Robot Comput-Integr Manuf 56:233–243CrossRef Nikolaos N, Vasilis M, Sotiris M (2019) A cyber physical system (cps) approach for safe human–robot collaboration in a shared workplace. Robot Comput-Integr Manuf 56:233–243CrossRef
26.
Zurück zum Zitat Azfar K, Kirisci P, Khan Z, Zied G, Klausdieter T, Jurgen P (2018) Security framework for industrial collaborative robotic cyber-physical systems. Comput Ind 97:132–145CrossRef Azfar K, Kirisci P, Khan Z, Zied G, Klausdieter T, Jurgen P (2018) Security framework for industrial collaborative robotic cyber-physical systems. Comput Ind 97:132–145CrossRef
27.
Zurück zum Zitat Michalos G, Kousi N, Karagiannis P, Gkournelos C, Dimoulas K, Koukas S, Mparis K, Papavasileiou A, Makris S (2018) Seamless human robot collaborative assembly an automotive case study. Mechatronics 55 Michalos G, Kousi N, Karagiannis P, Gkournelos C, Dimoulas K, Koukas S, Mparis K, Papavasileiou A, Makris S (2018) Seamless human robot collaborative assembly an automotive case study. Mechatronics 55
28.
Zurück zum Zitat Aivaliotis P, Aivaliotis S, Gkournelos C, Kokkalis K, Michalos G, Makris S (2019) Power and force limiting on industrial robots for human–robot collaboration. Robot Comput-Integr Manuf 59:346–360CrossRef Aivaliotis P, Aivaliotis S, Gkournelos C, Kokkalis K, Michalos G, Makris S (2019) Power and force limiting on industrial robots for human–robot collaboration. Robot Comput-Integr Manuf 59:346–360CrossRef
29.
Zurück zum Zitat Zhou Y, Dong H, Saddik A (2020) Learning to estimate 3d human pose from point cloud. IEEE Sens J 99:1–1 Zhou Y, Dong H, Saddik A (2020) Learning to estimate 3d human pose from point cloud. IEEE Sens J 99:1–1
30.
Zurück zum Zitat Shi H, Chen J, Pan W, Hwang K, Cho Y (2019) Collision avoidance for redundant robots in position-based visual servoing. IEEE Syst J 13(3):3479–3489CrossRef Shi H, Chen J, Pan W, Hwang K, Cho Y (2019) Collision avoidance for redundant robots in position-based visual servoing. IEEE Syst J 13(3):3479–3489CrossRef
31.
Zurück zum Zitat Zhu L, Chi Z, Zhou F, Zhuang C (2019) Dynamic motion planning algorithm in human–robot collision avoidance. In: International Conference on Intelligent Robotics and Applications, p 655–666 Zhu L, Chi Z, Zhou F, Zhuang C (2019) Dynamic motion planning algorithm in human–robot collision avoidance. In: International Conference on Intelligent Robotics and Applications, p 655–666
32.
Zurück zum Zitat Edmonds M, Gao F, Xie X, Liu H, Qi S, Zhu Y, Rothrock B, Zhu S (2017) Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp 3530–3537 Edmonds M, Gao F, Xie X, Liu H, Qi S, Zhu Y, Rothrock B, Zhu S (2017) Feeling the force: Integrating force and pose for fluent discovery through imitation learning to open medicine bottles. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). IEEE, pp 3530–3537
33.
Zurück zum Zitat Pham T, Nikolaos K, Argyros A, Abderrahmane K (2017) Hand-object contact force estimation from markerless visual tracking. IEEE Trans Patt Analysis Mach Intell 40(12):2883–2896CrossRef Pham T, Nikolaos K, Argyros A, Abderrahmane K (2017) Hand-object contact force estimation from markerless visual tracking. IEEE Trans Patt Analysis Mach Intell 40(12):2883–2896CrossRef
34.
Zurück zum Zitat Pham T, Abderrahmane K, Ammar Q, Argyros A (2015) Towards force sensing from vision: Observing hand-object interactions to infer manipulation forces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p 2810–2819 Pham T, Abderrahmane K, Ammar Q, Argyros A (2015) Towards force sensing from vision: Observing hand-object interactions to infer manipulation forces. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, p 2810–2819
35.
Zurück zum Zitat Omid T, Nima G, Black M, Dimitrios T (2020) GRAB: a dataset of whole-body human grasping of objects. In: European Conference on Computer Vision (ECCV) Omid T, Nima G, Black M, Dimitrios T (2020) GRAB: a dataset of whole-body human grasping of objects. In: European Conference on Computer Vision (ECCV)
36.
Zurück zum Zitat Brahmbhatt S, Tang C, Twigg C, Kemp C, James H (2020) Contactpose: a dataset of grasps with object contact and hand pose. arXiv preprint: 2007.09545v1 Brahmbhatt S, Tang C, Twigg C, Kemp C, James H (2020) Contactpose: a dataset of grasps with object contact and hand pose. arXiv preprint: 2007.09545v1
37.
Zurück zum Zitat Chang G, Kulic D (2013) Robot task learning from demonstration using petri nets. In: RO-MAN, 2013 IEEE, p 31–36 Chang G, Kulic D (2013) Robot task learning from demonstration using petri nets. In: RO-MAN, 2013 IEEE, p 31–36
38.
Zurück zum Zitat Casalino A, Cividini F, Zanchettin A, Piroddi L, Rocco P (2018) Human–robot collaborative assembly: a use-case application - sciencedirect. IFAC-PapersOnLine 51(11):194–199CrossRef Casalino A, Cividini F, Zanchettin A, Piroddi L, Rocco P (2018) Human–robot collaborative assembly: a use-case application - sciencedirect. IFAC-PapersOnLine 51(11):194–199CrossRef
39.
Zurück zum Zitat Dantam N, Kingston Z, Chaudhuri S, Kavraki L (2016) Incremental task and motion planning: a constraint-based approach. Robot: Sci Syst 12:1–6 Dantam N, Kingston Z, Chaudhuri S, Kavraki L (2016) Incremental task and motion planning: a constraint-based approach. Robot: Sci Syst 12:1–6
40.
Zurück zum Zitat Dantam N, Kingston Z, Chaudhuri S (2018) An incremental constraint-based framework for task and motion planning. Int J Robot Res 37(10):1134–1151CrossRef Dantam N, Kingston Z, Chaudhuri S (2018) An incremental constraint-based framework for task and motion planning. Int J Robot Res 37(10):1134–1151CrossRef
41.
Zurück zum Zitat Evangelou G, Dimitropoulos N, Michalos G, Makris S (2021) An approach for task and action planning in human collaborative cells using AI. Proc CIRP Evangelou G, Dimitropoulos N, Michalos G, Makris S (2021) An approach for task and action planning in human collaborative cells using AI. Proc CIRP
42.
Zurück zum Zitat Tsarouchi P, Matthaiakis A, Makris S, George C (2017) On a human–robot collaboration in an assembly cell. Int J Comput Integr Manuf 30(6):580–589CrossRef Tsarouchi P, Matthaiakis A, Makris S, George C (2017) On a human–robot collaboration in an assembly cell. Int J Comput Integr Manuf 30(6):580–589CrossRef
43.
Zurück zum Zitat Li S, Zhang S, Fu Y, Wang H, Han K (2020) Task-based obstacle avoidance for uncertain targets based on semantic object matrix. Control Eng Pract 105:104649CrossRef Li S, Zhang S, Fu Y, Wang H, Han K (2020) Task-based obstacle avoidance for uncertain targets based on semantic object matrix. Control Eng Pract 105:104649CrossRef
44.
Zurück zum Zitat Li S, Zhang S, Fu Y, Xiong Y, Xie Z (2021) Grasp2hardness: Fuzzy hardness inference of cylindrical objects for grasp force adjustment of force sensor-less robots. Intell Serv Robot 14(2):129–141CrossRef Li S, Zhang S, Fu Y, Xiong Y, Xie Z (2021) Grasp2hardness: Fuzzy hardness inference of cylindrical objects for grasp force adjustment of force sensor-less robots. Intell Serv Robot 14(2):129–141CrossRef
45.
Zurück zum Zitat Pan J, Sachin C, Dinesh M (2012) Fcl: a general purpose library for collision and proximity queries. In: 2012 IEEE International Conference on Robotics and Automation, p 3859–3866 Pan J, Sachin C, Dinesh M (2012) Fcl: a general purpose library for collision and proximity queries. In: 2012 IEEE International Conference on Robotics and Automation, p 3859–3866
46.
Zurück zum Zitat Morgan Q, Ken C, Brian G, Josh F, Tully F, Jeremy L, Rob W, Andrew N (2009) Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software (vol. 3), Kobe, Japan, p 5 Morgan Q, Ken C, Brian G, Josh F, Tully F, Jeremy L, Rob W, Andrew N (2009) Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software (vol. 3), Kobe, Japan, p 5
47.
Zurück zum Zitat Gary B (2000) The opencv library. Dr. Dobb’s J: Softw Tools Professional Programmer 25(11):120–123 Gary B (2000) The opencv library. Dr. Dobb’s J: Softw Tools Professional Programmer 25(11):120–123
48.
Zurück zum Zitat Bogdan R, Cousins S (2011) 3D is here: Point cloud library (PCL). In: 2011 IEEE International Conference on Robotics and Automation, IEEE, p 1–4 Bogdan R, Cousins S (2011) 3D is here: Point cloud library (PCL). In: 2011 IEEE International Conference on Robotics and Automation, IEEE, p 1–4
49.
Zurück zum Zitat Martín A, Paul B, Chen J, Chen Z, Davis A, Jeffrey D, Matthieu D, Sanjay G, Geoffrey I, Michael I (2016) Tensorflow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), p 265–283 Martín A, Paul B, Chen J, Chen Z, Davis A, Jeffrey D, Matthieu D, Sanjay G, Geoffrey I, Michael I (2016) Tensorflow: a system for large-scale machine learning. In: 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 16), p 265–283
Metadaten
Titel
An intelligent manufacturing cell based on human–robot collaboration of frequent task learning for flexible manufacturing
verfasst von
Shuai Zhang
Shiqi Li
Haipeng Wang
Xiao Li
Publikationsdatum
02.04.2022
Verlag
Springer London
Erschienen in
The International Journal of Advanced Manufacturing Technology / Ausgabe 9-10/2022
Print ISSN: 0268-3768
Elektronische ISSN: 1433-3015
DOI
https://doi.org/10.1007/s00170-022-09005-6

Weitere Artikel der Ausgabe 9-10/2022

The International Journal of Advanced Manufacturing Technology 9-10/2022 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.