Skip to main content
Top
Published in: Journal of Intelligent Manufacturing 3/2024

21-03-2023

Development of adaptive safety constraint by predicting trajectories of closest points between human and co-robot

Authors: Yufan Zhu, Silu Chen, Chi Zhang, Zhongyu Piao, Guilin Yang

Published in: Journal of Intelligent Manufacturing | Issue 3/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Safety is a critical component for human–robot cohabitation. The control barrier function (CBF) provides an effective tool to build up the constraint and ensure the safety of human–robot interaction. However, since the human and robot keep moving during human–robot interaction, the closest points between parts of them also change. Especially, the human trajectories are not known in prior, which may cause the above safety constraint to fail. In this paper, we construct the safe constraints based on discrete control barrier function (DCBF) by redefining the distance between each link of the robot and each part of the human body as the distance between two line segments in the space. In addition, the look-backward-and-forward strategy is applied to update the neural network model for predicting of human’s motion trajectory effectively. Meanwhile, the root mean square estimation error is included in the safe constraints as the metric of uncertainty to compensate the estimation error of the predicted trajectory. Combining the discrete-time control Lyapunov function, a comprehensive control method under human–robot-coexistence environment is formed. The trajectory of a human’s right arm collected by Qualisys capture system. The experiment are set up by integrating above testbed with a virtual KUKA iiwa model built by MATLAB. The results show that the robot can maintain a safe distance from the human when the DCBF-based constraints with prediction information are used, which verifies the effectiveness of the proposed method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Agrawal, A., & Sreenath, K. (2017). Discrete control barrier functions for safety-critical control of discrete systems with application to bipedal robot navigation. In Robotics: Science and Systems (Vol. 13). Cambridge University Press. Agrawal, A., & Sreenath, K. (2017). Discrete control barrier functions for safety-critical control of discrete systems with application to bipedal robot navigation. In Robotics: Science and Systems (Vol. 13). Cambridge University Press.
go back to reference Ajoudani, A., Zanchettin, A. M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., & Khatib, O. (2018). Progress and prospects of the human-robot collaboration. Autonomous Robots, 42(5), 957–975.CrossRef Ajoudani, A., Zanchettin, A. M., Ivaldi, S., Albu-Schäffer, A., Kosuge, K., & Khatib, O. (2018). Progress and prospects of the human-robot collaboration. Autonomous Robots, 42(5), 957–975.CrossRef
go back to reference Ames, A. D., Galloway, K., Sreenath, K., & Grizzle, J. W. (2014a). Rapidly exponentially stabilizing control Lyapunov functions and hybrid zero dynamics. IEEE Transactions on Automatic Control, 59(4), 876–891. Ames, A. D., Galloway, K., Sreenath, K., & Grizzle, J. W. (2014a). Rapidly exponentially stabilizing control Lyapunov functions and hybrid zero dynamics. IEEE Transactions on Automatic Control, 59(4), 876–891.
go back to reference Ames, A. D., Grizzle, J. W., & Tabuada, P. (2014b). Control barrier function based quadratic programs with application to adaptive cruise control. In 53rd IEEE Conference on Decision and Control (pp. 6271–6278). IEEE. Ames, A. D., Grizzle, J. W., & Tabuada, P. (2014b). Control barrier function based quadratic programs with application to adaptive cruise control. In 53rd IEEE Conference on Decision and Control (pp. 6271–6278). IEEE.
go back to reference Ames, A. D., Xu, X., Grizzle, J. W., & Tabuada, P. (2016). Control barrier function based quadratic programs for safety critical systems. IEEE Transactions on Automatic Control, 62(8), 3861–3876.MathSciNetCrossRef Ames, A. D., Xu, X., Grizzle, J. W., & Tabuada, P. (2016). Control barrier function based quadratic programs for safety critical systems. IEEE Transactions on Automatic Control, 62(8), 3861–3876.MathSciNetCrossRef
go back to reference Chen, S., Zhu, Y., Liu, Y., Zhang, C., Piao, Z., & Yang, G. (2022). A “look-backward-and-foward’’ strategy for assessing parameter estimation error of human motion prediction model. IEEE Robotics and Automation Letters, 7(2), 2629–2636.CrossRef Chen, S., Zhu, Y., Liu, Y., Zhang, C., Piao, Z., & Yang, G. (2022). A “look-backward-and-foward’’ strategy for assessing parameter estimation error of human motion prediction model. IEEE Robotics and Automation Letters, 7(2), 2629–2636.CrossRef
go back to reference Cheng, Y., Zhao, W., Liu, C., & Tomizuka, M. (2019). Human motion prediction using semi-adaptable neural networks. In 2019 American Control Conference (ACC) (pp. 4884–4890). IEEE. Cheng, Y., Zhao, W., Liu, C., & Tomizuka, M. (2019). Human motion prediction using semi-adaptable neural networks. In 2019 American Control Conference (ACC) (pp. 4884–4890). IEEE.
go back to reference Du, Y., Wang, W., & Wang, L. (2015). Hierarchical recurrent neural network for skeleton based action recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1110–1118). Du, Y., Wang, W., & Wang, L. (2015). Hierarchical recurrent neural network for skeleton based action recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1110–1118).
go back to reference Faccio, M., Granata, I., & Minto, R. (2023). Task allocation model for human-robot collaboration with variable cobot speed. Journal of Intelligent Manufacturing, 1–14. Faccio, M., Granata, I., & Minto, R. (2023). Task allocation model for human-robot collaboration with variable cobot speed. Journal of Intelligent Manufacturing, 1–14.
go back to reference Ferraguti, F., Bertuletti, M., Landi, C. T., Bonfè, M., Fantuzzi, C., & Secchi, C. (2020a). A control barrier function approach for maximizing performance while fulfilling to ISO/TS 15066 regulations. IEEE Robotics and Automation Letters, 5(4), 5921–5928. Ferraguti, F., Bertuletti, M., Landi, C. T., Bonfè, M., Fantuzzi, C., & Secchi, C. (2020a). A control barrier function approach for maximizing performance while fulfilling to ISO/TS 15066 regulations. IEEE Robotics and Automation Letters, 5(4), 5921–5928.
go back to reference Ferraguti, F., Landi, C. T., Costi, S., Bonfè, M., Farsoni, S., Secchi, C., & Fantuzzi, C. (2020b). Safety barrier functions and multi-camera tracking for human-robot shared environment. Robotics and Autonomous Systems, 124, 103388. Ferraguti, F., Landi, C. T., Costi, S., Bonfè, M., Farsoni, S., Secchi, C., & Fantuzzi, C. (2020b). Safety barrier functions and multi-camera tracking for human-robot shared environment. Robotics and Autonomous Systems, 124, 103388.
go back to reference Fujii, S., & Pham, Q.-C. (2022). Realtime trajectory smoothing with neural nets. In 2022 International Conference on Robotics and Automation (ICRA) (pp. 7248–7254). IEEE. Fujii, S., & Pham, Q.-C. (2022). Realtime trajectory smoothing with neural nets. In 2022 International Conference on Robotics and Automation (ICRA) (pp. 7248–7254). IEEE.
go back to reference Grizzle, J., & Kang, J.-M. (2001). Discrete-time control design with positive semi-definite Lyapunov functions. Systems & Control Letters, 43(4), 287–292.MathSciNetCrossRef Grizzle, J., & Kang, J.-M. (2001). Discrete-time control design with positive semi-definite Lyapunov functions. Systems & Control Letters, 43(4), 287–292.MathSciNetCrossRef
go back to reference Hegde, A., & Ghose, D. (2021). Multi-UAV collaborative transportation of payloads with obstacle avoidance. IEEE Control Systems Letters, 6, 926–931.MathSciNetCrossRef Hegde, A., & Ghose, D. (2021). Multi-UAV collaborative transportation of payloads with obstacle avoidance. IEEE Control Systems Letters, 6, 926–931.MathSciNetCrossRef
go back to reference Hu, Y., Wang, Y., Hu, K., & Li, W. (2021). Adaptive obstacle avoidance in path planning of collaborative robots for dynamic manufacturing. Journal of Intelligent Manufacturing, 1–19. Hu, Y., Wang, Y., Hu, K., & Li, W. (2021). Adaptive obstacle avoidance in path planning of collaborative robots for dynamic manufacturing. Journal of Intelligent Manufacturing, 1–19.
go back to reference Lacevic, B., Rocco, P., & Zanchettin, A. M. (2013). Safety assessment and control of robotic manipulators using danger field. IEEE Transactions on Robotics, 29(5), 1257–1270.CrossRef Lacevic, B., Rocco, P., & Zanchettin, A. M. (2013). Safety assessment and control of robotic manipulators using danger field. IEEE Transactions on Robotics, 29(5), 1257–1270.CrossRef
go back to reference Landi, C. T., Ferraguti, F., Costi, S., Bonfè, M., & Secchi, C. (2019). Safety barrier functions for human-robot interaction with industrial manipulators. In 2019 18th European Control Conference (ECC) (pp. 2565–2570). IEEE. Landi, C. T., Ferraguti, F., Costi, S., Bonfè, M., & Secchi, C. (2019). Safety barrier functions for human-robot interaction with industrial manipulators. In 2019 18th European Control Conference (ECC) (pp. 2565–2570). IEEE.
go back to reference Lehrmann, A. M., Gehler, P. V., & Nowozin, S. (2014). Efficient nonlinear Markov models for human motion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1314–1321). Lehrmann, A. M., Gehler, P. V., & Nowozin, S. (2014). Efficient nonlinear Markov models for human motion. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 1314–1321).
go back to reference Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., & Tian, Q. (2021). Symbiotic graph neural networks for 3D skeleton-based human action recognition and motion prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6), 3316–3333.CrossRef Li, M., Chen, S., Chen, X., Zhang, Y., Wang, Y., & Tian, Q. (2021). Symbiotic graph neural networks for 3D skeleton-based human action recognition and motion prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(6), 3316–3333.CrossRef
go back to reference Liu, C., & Tomizuka, M. (2014). Control in a safe set: addressing safety in human-robot interactions. In Dynamic Systems and Control Conference (Vol. 46209, p. 003-42003). American Society of Mechanical Engineers Liu, C., & Tomizuka, M. (2014). Control in a safe set: addressing safety in human-robot interactions. In Dynamic Systems and Control Conference (Vol. 46209, p. 003-42003). American Society of Mechanical Engineers
go back to reference Liu, C., & Tomizuka, M. (2015). Safe exploration: Addressing various uncertainty levels in human robot interactions. In 2015 American Control Conference (ACC) (pp. 465–470). IEEE. Liu, C., & Tomizuka, M. (2015). Safe exploration: Addressing various uncertainty levels in human robot interactions. In 2015 American Control Conference (ACC) (pp. 465–470). IEEE.
go back to reference Maurtua, I., Ibarguren, A., Kildal, J., Susperregi, L., & Sierra, B. (2017). Human-robot collaboration in industrial applications: Safety, interaction and trust. International Journal of Advanced Robotic Systems, 14(4), 1729881417716010. Maurtua, I., Ibarguren, A., Kildal, J., Susperregi, L., & Sierra, B. (2017). Human-robot collaboration in industrial applications: Safety, interaction and trust. International Journal of Advanced Robotic Systems, 14(4), 1729881417716010.
go back to reference Merkt, W., Ivan, V., & Vijayakumar, S. (2019). Continuous-time collision avoidance for trajectory optimization in dynamic environments. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 7248–7255). IEEE Merkt, W., Ivan, V., & Vijayakumar, S. (2019). Continuous-time collision avoidance for trajectory optimization in dynamic environments. In 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 7248–7255). IEEE
go back to reference Nascimento, H., Mujica, M., & Benoussaad, M. (2020). Collision avoidance interaction between human and a hidden robot based on kinect and robot data fusion. IEEE Robotics and Automation Letters, 6(1), 88–94. Nascimento, H., Mujica, M., & Benoussaad, M. (2020). Collision avoidance interaction between human and a hidden robot based on kinect and robot data fusion. IEEE Robotics and Automation Letters, 6(1), 88–94.
go back to reference Nguyen, Q., Hereid, A., Grizzle, J. W., Ames, A. D., & Sreenath, K. (2016). 3D dynamic walking on stepping stones with control barrier functions. In 2016 IEEE 55th Conference on Decision and Control (CDC) (pp. 827–834). IEEE. Nguyen, Q., Hereid, A., Grizzle, J. W., Ames, A. D., & Sreenath, K. (2016). 3D dynamic walking on stepping stones with control barrier functions. In 2016 IEEE 55th Conference on Decision and Control (CDC) (pp. 827–834). IEEE.
go back to reference Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008). Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. In Humanoids 2008-8th IEEE-RAS international conference on humanoid robots (pp. 91–98). IEEE Park, D.-H., Hoffmann, H., Pastor, P., & Schaal, S. (2008). Movement reproduction and obstacle avoidance with dynamic movement primitives and potential fields. In Humanoids 2008-8th IEEE-RAS international conference on humanoid robots (pp. 91–98). IEEE
go back to reference Rauscher, M., Kimmel, M., & Hirche, S. (2016). Constrained robot control using control barrier functions. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 279–285). IEEE. Rauscher, M., Kimmel, M., & Hirche, S. (2016). Constrained robot control using control barrier functions. In 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 279–285). IEEE.
go back to reference Siciliano, B. (1990). Kinematic control of redundant robot manipulators: A tutorial. Journal of Intelligent and Robotic Systems, 3(3), 201–212.CrossRef Siciliano, B. (1990). Kinematic control of redundant robot manipulators: A tutorial. Journal of Intelligent and Robotic Systems, 3(3), 201–212.CrossRef
go back to reference Singletary, A., Klingebiel, K., Bourne, J., Browning, A., Tokumaru, P., & Ames, A. (2020). Comparative analysis of control barrier functions and artificial potential fields for obstacle avoidance. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 8129–8136). IEEE. Singletary, A., Klingebiel, K., Bourne, J., Browning, A., Tokumaru, P., & Ames, A. (2020). Comparative analysis of control barrier functions and artificial potential fields for obstacle avoidance. In 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (pp. 8129–8136). IEEE.
go back to reference Singletary, A., Kolathaya, S., & Ames, A. D. (2021). Safety-critical kinematic control of robotic systems. IEEE Control Systems Letters, 6, 139–144.MathSciNetCrossRef Singletary, A., Kolathaya, S., & Ames, A. D. (2021). Safety-critical kinematic control of robotic systems. IEEE Control Systems Letters, 6, 139–144.MathSciNetCrossRef
go back to reference Tang, Y., Ma, L., Liu, W., & Zheng, W. (2018). Long-term human motion prediction by modeling motion context and enhancing motion dynamic. In 27th International Joint Conference on Artificial Intelligence (IJCAI’18) (pp. 935–941). ACM. Tang, Y., Ma, L., Liu, W., & Zheng, W. (2018). Long-term human motion prediction by modeling motion context and enhancing motion dynamic. In 27th International Joint Conference on Artificial Intelligence (IJCAI’18) (pp. 935–941). ACM.
go back to reference Tanimoto, J., Hagishima, A., & Tanaka, Y. (2010). Study of bottleneck effect at an emergency evacuation exit using cellular automata model, mean field approximation analysis, and game theory. Physica A: Statistical Mechanics and Its Applications, 389(24), 5611–5618.ADSCrossRef Tanimoto, J., Hagishima, A., & Tanaka, Y. (2010). Study of bottleneck effect at an emergency evacuation exit using cellular automata model, mean field approximation analysis, and game theory. Physica A: Statistical Mechanics and Its Applications, 389(24), 5611–5618.ADSCrossRef
go back to reference Yoshida, E., Esteves, C., Belousov, I., Laumond, J.-P., Sakaguchi, T., & Yokoi, K. (2008). Planning 3-d collision-free dynamic robotic motion through iterative reshaping. IEEE Transactions on Robotics, 24(5), 1186–1198.CrossRef Yoshida, E., Esteves, C., Belousov, I., Laumond, J.-P., Sakaguchi, T., & Yokoi, K. (2008). Planning 3-d collision-free dynamic robotic motion through iterative reshaping. IEEE Transactions on Robotics, 24(5), 1186–1198.CrossRef
Metadata
Title
Development of adaptive safety constraint by predicting trajectories of closest points between human and co-robot
Authors
Yufan Zhu
Silu Chen
Chi Zhang
Zhongyu Piao
Guilin Yang
Publication date
21-03-2023
Publisher
Springer US
Published in
Journal of Intelligent Manufacturing / Issue 3/2024
Print ISSN: 0956-5515
Electronic ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-023-02102-7

Other articles of this Issue 3/2024

Journal of Intelligent Manufacturing 3/2024 Go to the issue

Premium Partners