Skip to main content
Top

02-05-2024 | Research

Physical Integrated Digital twin-based Interaction Mechanism of Artificial Intelligence Rehabilitation Robots Combining Visual Cognition and Motion Control

Authors: Ke Tao, Jincan Lei, Jing Huang

Published in: Wireless Personal Communications

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Within the evolving landscape of rehabilitation robotics, integrating cyber-physical systems with digital twin generation presents a singular paradigm for enhancing the effectiveness and personalisation in interaction applications. This paper introduces an interaction mechanism for artificial intelligence (AI) rehabilitation robots that synergises visible cognition and movement management within a Cyber-physical device framework underpinned through a digital twin-based approach. Our method leverages the twin skills of AI to interpret complex visual stimuli and execute specific, adaptive movement control, thereby permitting a more intuitive and responsive rehabilitation system designed to individual patient wishes. The core of our proposed mechanism lies in developing a virtual twin for each affected person, a digital duplicate that dynamically updates and evolves in response to the affected person’s progress and interactions with the AI rehabilitation robotic. This virtual dual serves as a sandbox for simulating and optimising rehabilitation sporting events, permitting therapists to expect results, personalise remedy plans, and make knowledgeable adjustments in actual time. We integrate superior visual cognition algorithms to interpret the affected person’s actions, facial expressions, and gestures, facilitating a nuanced knowledge of the patient’s attempt, discomfort, or engagement tiers. Our experimental consequences display significant improvements in patient outcomes, such as better motor function, increased engagement, and quicker recuperation times. The virtual dual-based totally interplay mechanism no longer best bridges the space among virtual and physical geographical regions; however, it also allows continuous learning and version of the AI rehabilitation robots, promising a brand-new generation of personalised, green, and patient-centric rehabilitation practices.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Xames, M., Doulotuzzaman, & Taylan, G. (2024). Topcu. A Systematic Literature Review of Digital Twin Research for Healthcare Systems: Research Trends, gaps, and Realization challenges. IEEE Access: Practical Innovations, Open Solutions. Xames, M., Doulotuzzaman, & Taylan, G. (2024). Topcu. A Systematic Literature Review of Digital Twin Research for Healthcare Systems: Research Trends, gaps, and Realization challenges. IEEE Access: Practical Innovations, Open Solutions.
2.
go back to reference Asad, U. (2023). Human-Centric Digital Twins in Industry: A Comprehensive Review of Enabling Technologies and Implementation Strategies. Sensors 23.8: 3938. Asad, U. (2023). Human-Centric Digital Twins in Industry: A Comprehensive Review of Enabling Technologies and Implementation Strategies. Sensors 23.8: 3938.
3.
go back to reference Su, Y. P., et al. (2023). Integrating virtual, mixed, and augmented reality into remote robotic applications: A brief review of extended reality-enhanced Robotic systems for Intuitive Telemanipulation and Telemanufacturing tasks in Hazardous conditions. Applied Sciences, 13, 12129.CrossRef Su, Y. P., et al. (2023). Integrating virtual, mixed, and augmented reality into remote robotic applications: A brief review of extended reality-enhanced Robotic systems for Intuitive Telemanipulation and Telemanufacturing tasks in Hazardous conditions. Applied Sciences, 13, 12129.CrossRef
4.
go back to reference Liu, Y. C., Khong, M. H., & Ou, T. W. (2017). Nonlinear bilateral teleoperators with Non-collocated Remote Controller over delayed network. Mechatronics, 45, 25–36.CrossRef Liu, Y. C., Khong, M. H., & Ou, T. W. (2017). Nonlinear bilateral teleoperators with Non-collocated Remote Controller over delayed network. Mechatronics, 45, 25–36.CrossRef
5.
go back to reference Lai, Z. H., Tao, W., Leu, M. C., & Yin, Z. (2020). Smart augmented reality Instructional System for Mechanical Assembly towards Worker- centered Intelligent Manufacturing. Journal of Manufacturing Systems, 55, 69–81.CrossRef Lai, Z. H., Tao, W., Leu, M. C., & Yin, Z. (2020). Smart augmented reality Instructional System for Mechanical Assembly towards Worker- centered Intelligent Manufacturing. Journal of Manufacturing Systems, 55, 69–81.CrossRef
6.
go back to reference Walker, M. E., Hedayati, H., & Szafir, D. (2019). Robot Teleoperation with Augmented Reality Virtual Surrogates. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Daegu, Republic of Korea, 11–14 March; pp. 202–210. Walker, M. E., Hedayati, H., & Szafir, D. (2019). Robot Teleoperation with Augmented Reality Virtual Surrogates. In Proceedings of the ACM/IEEE International Conference on Human-Robot Interaction, Daegu, Republic of Korea, 11–14 March; pp. 202–210.
7.
go back to reference Liu, H., & Wang, L. (2020). Remote Human—Robot collaboration: A Cyber—Physical System Application for Hazard Manufacturing Environment. Journal of Manufacturing Systems, 54, 24–34.CrossRef Liu, H., & Wang, L. (2020). Remote Human—Robot collaboration: A Cyber—Physical System Application for Hazard Manufacturing Environment. Journal of Manufacturing Systems, 54, 24–34.CrossRef
8.
go back to reference Stotko, P., Krumpen, S., Schwarz, M., Lenz, C., Behnke, S., Klein, R., & Weinmann, M. (2019). A VR System for Immersive Teleoperation and Live Exploration with a Mobile Robot. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macao, China, 3–8 November; pp. 3630–3637. Stotko, P., Krumpen, S., Schwarz, M., Lenz, C., Behnke, S., Klein, R., & Weinmann, M. (2019). A VR System for Immersive Teleoperation and Live Exploration with a Mobile Robot. In Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Macao, China, 3–8 November; pp. 3630–3637.
9.
go back to reference Lu, Q., Xie, X., Parlikad, A. K., & Schooling, J. M. (2020). Digital twin-enabled anomaly detection for built asset monitoring in operation and maintenance, Automation in Construction, 118, 103277. Lu, Q., Xie, X., Parlikad, A. K., & Schooling, J. M. (2020). Digital twin-enabled anomaly detection for built asset monitoring in operation and maintenance, Automation in Construction, 118, 103277.
10.
go back to reference van Dinter, R., Tekinerdogan, B., & Catal, C. (2022). Predictive maintenance using digital twins: A systematic literature review. Information and Software Technology, 151, 107008. van Dinter, R., Tekinerdogan, B., & Catal, C. (2022). Predictive maintenance using digital twins: A systematic literature review. Information and Software Technology, 151, 107008.
11.
go back to reference Botín-Sanabria, D. M., Mihaita, A. S., Peimbert- García, R. E., Ramírez-Moreno, M. A., Ramírez-Mendoza, R. A., & Lozoya-Santos, J. D. J. (2022). Digital twin technology challenges and applications: A comprehensive review, Remote Sensing, 14(6), 1335. Botín-Sanabria, D. M., Mihaita, A. S., Peimbert- García, R. E., Ramírez-Moreno, M. A., Ramírez-Mendoza, R. A., & Lozoya-Santos, J. D. J. (2022). Digital twin technology challenges and applications: A comprehensive review, Remote Sensing, 14(6), 1335.
12.
go back to reference Kumbhar, M., Ng, A. H. C., & Bandaru, S. (2023). ‘‘A digital twin based = framework for detection, diagnosis, and improvement of throughput bottlenecks,’’ J. Manuf. Syst., vol. 66, pp. 92–106, Feb. Kumbhar, M., Ng, A. H. C., & Bandaru, S. (2023). ‘‘A digital twin based = framework for detection, diagnosis, and improvement of throughput bottlenecks,’’ J. Manuf. Syst., vol. 66, pp. 92–106, Feb.
13.
go back to reference Liu, M., Fang, S., Dong, H., & Xu, C. (2021). Review of digital twin about concepts, technologies, and industrial applications. Journal of Manufacturing Systems, 58, 346–361.CrossRef Liu, M., Fang, S., Dong, H., & Xu, C. (2021). Review of digital twin about concepts, technologies, and industrial applications. Journal of Manufacturing Systems, 58, 346–361.CrossRef
14.
go back to reference Turner, C. J., & Garn, W. (2022). Next generation DES simulation: A research agenda for human centric manufacturing systems. J Ind Inf Integr, 28, 100354. Turner, C. J., & Garn, W. (2022). Next generation DES simulation: A research agenda for human centric manufacturing systems. J Ind Inf Integr, 28, 100354.
15.
go back to reference Tao, F., Zhang, H., Liu, A., & Nee, A. Y. (2019). Digital Twin in Industry: State-of-the-art. IEEE Transactions on Industrial Informatics / A Publication of the Ieee Industrial Electronics Society, 15, 2405–2415.CrossRef Tao, F., Zhang, H., Liu, A., & Nee, A. Y. (2019). Digital Twin in Industry: State-of-the-art. IEEE Transactions on Industrial Informatics / A Publication of the Ieee Industrial Electronics Society, 15, 2405–2415.CrossRef
16.
go back to reference Wang, L. (2022). A futuristic perspective on human-centric assembly. Journal of Manufacturing Systems, 62, 199–201.CrossRef Wang, L. (2022). A futuristic perspective on human-centric assembly. Journal of Manufacturing Systems, 62, 199–201.CrossRef
17.
go back to reference Khalid, A., Khan, Z. H., Idrees, M., Kirisci, P., Ghrairi, Z., Thoben, K. D., & Pannek, J. (2022). Understanding vulnerabilities in cyber physical production systems. International Journal of Computer Integrated Manufacturing, 35(6), 569-582.CrossRef Khalid, A., Khan, Z. H., Idrees, M., Kirisci, P., Ghrairi, Z., Thoben, K. D., & Pannek, J. (2022). Understanding vulnerabilities in cyber physical production systems. International Journal of Computer Integrated Manufacturing, 35(6), 569-582.CrossRef
18.
go back to reference He, B., & Bai, K. J. (2021). Digital twin-based sustainable intelligent manufacturing: A review, Advances in Manufacturing, 9(1), 1-21. He, B., & Bai, K. J. (2021). Digital twin-based sustainable intelligent manufacturing: A review, Advances in Manufacturing, 9(1), 1-21.
19.
go back to reference Tao, F., Sui, F., Liu, A., Qi, Q., Zhang, M., Song, B.,... & Nee, A. Y. (2019). Digital twin-driven product design framework. International Journal of Production Research, 57(12), 3935–3953. Tao, F., Sui, F., Liu, A., Qi, Q., Zhang, M., Song, B.,... & Nee, A. Y. (2019). Digital twin-driven product design framework. International Journal of Production Research, 57(12), 3935–3953.
20.
go back to reference Huang, S., Wang, G., & Yan, Y. (2020). Building blocks for digital twin of reconfigurable machine tools from design perspective, Int. J. Prod. Res., pp. 1–15, Dec. Huang, S., Wang, G., & Yan, Y. (2020). Building blocks for digital twin of reconfigurable machine tools from design perspective, Int. J. Prod. Res., pp. 1–15, Dec.
21.
go back to reference Liu, Q., Leng, J., Yan, D., Zhang, D., Wei, L., Yu, A., Zhao, R., Zhang, H., & Chen, X. (Jan. 2021). Digital twin-based designing of the configuration, motion, control, and optimization model of a flow-type smart manufacturing system. Journal of Manufacturing Systems, 58, 52–64. Liu, Q., Leng, J., Yan, D., Zhang, D., Wei, L., Yu, A., Zhao, R., Zhang, H., & Chen, X. (Jan. 2021). Digital twin-based designing of the configuration, motion, control, and optimization model of a flow-type smart manufacturing system. Journal of Manufacturing Systems, 58, 52–64.
22.
go back to reference Leng, J., Zhou, M., Xiao, Y., Zhang, H., Liu, Q., Shen, W., Su, Q., & Li, L. (2021). Jul., Digital twins-based remote semi-physical commissioning of flow-type smart manufacturing systems. Journal of Cleaner Production, 306, 127278. Leng, J., Zhou, M., Xiao, Y., Zhang, H., Liu, Q., Shen, W., Su, Q., & Li, L. (2021). Jul., Digital twins-based remote semi-physical commissioning of flow-type smart manufacturing systems. Journal of Cleaner Production, 306, 127278.
23.
go back to reference Zhu, Z., Xi, X., Xu, X., & Cai, Y. (2021). Digital twin-driven machining process for thin-walled part manufacturing, Journal of Manufacturing Systems, 59, 453–466. Zhu, Z., Xi, X., Xu, X., & Cai, Y. (2021). Digital twin-driven machining process for thin-walled part manufacturing, Journal of Manufacturing Systems, 59, 453–466.
24.
go back to reference Deebak, B. D., & Al-Turjman, F. (2021). Digital-twin assisted: Fault diagnosis using deep transfer learning for machining tool condition, International Journal of Intelligent Systems, 37(12), 10289–10316. Deebak, B. D., & Al-Turjman, F. (2021). Digital-twin assisted: Fault diagnosis using deep transfer learning for machining tool condition, International Journal of Intelligent Systems, 37(12), 10289–10316.
25.
go back to reference Xiong, M., Wang, H., Fu, Q., & Xu, Y. (2021). Digital twin–driven aero-engine intelligent predictive maintenance, The International Journal of Advanced Manufacturing Technology, 114(11), 3751–3761. Xiong, M., Wang, H., Fu, Q., & Xu, Y. (2021). Digital twin–driven aero-engine intelligent predictive maintenance, The International Journal of Advanced Manufacturing Technology, 114(11), 3751–3761.
26.
go back to reference Luo, W., Hu, T., Ye, Y., Zhang, C., & Wei, Y. (2020). A hybrid predictive maintenance approach for CNC machine tool driven by Digital Twin. Robotics and Computer-Integrated Manufacturing, 65, 101974. Luo, W., Hu, T., Ye, Y., Zhang, C., & Wei, Y. (2020). A hybrid predictive maintenance approach for CNC machine tool driven by Digital Twin. Robotics and Computer-Integrated Manufacturing, 65, 101974.
27.
go back to reference Peng, C., Tang, Z., Gui, W., Chen, Q., Zhang, L., Yuan, X., & Deng, X. (2020). ‘‘Review of key Technologies and Progress in Industrial Equipment Health Management ’’ IEEE Access, 8, 151764–151776. Peng, C., Tang, Z., Gui, W., Chen, Q., Zhang, L., Yuan, X., & Deng, X. (2020). ‘‘Review of key Technologies and Progress in Industrial Equipment Health Management ’’ IEEE Access, 8, 151764–151776.
28.
go back to reference Errandonea, I., Beltrán, S., & Arrizabalaga, S. (2020). Digital Twin for maintenance: A literature review. Computers in Industry, 123, 103316.CrossRef Errandonea, I., Beltrán, S., & Arrizabalaga, S. (2020). Digital Twin for maintenance: A literature review. Computers in Industry, 123, 103316.CrossRef
29.
go back to reference Tao, F., Qi, Q., Wang, L., & Nee, A. Y. C. (2019). Digital Twins and Cyber–Physical systems toward Smart Manufacturing and Industry 4.0: Correlation and comparison. Engineering, 5, 653–661.CrossRef Tao, F., Qi, Q., Wang, L., & Nee, A. Y. C. (2019). Digital Twins and Cyber–Physical systems toward Smart Manufacturing and Industry 4.0: Correlation and comparison. Engineering, 5, 653–661.CrossRef
30.
go back to reference Tao, F., Liu, W., Zhang, M., Hu, T., Qi, Q., Zhang, H., Sui, F., Wang, T., Xu, H., Huang, Z., et al. (2019). Five-dimension digital twin model and its ten applications. Jisuanji Jicheng Zhizao Xitong/Comput Integr Manuf Syst CIMS, 25, 1–18. Tao, F., Liu, W., Zhang, M., Hu, T., Qi, Q., Zhang, H., Sui, F., Wang, T., Xu, H., Huang, Z., et al. (2019). Five-dimension digital twin model and its ten applications. Jisuanji Jicheng Zhizao Xitong/Comput Integr Manuf Syst CIMS, 25, 1–18.
31.
go back to reference Fuller, A., Fan, Z., Day, C., & Barlow, C. (2020). Digital Twin: Enabling technologies, challenges and Open Research. IEEE Access: Practical Innovations, Open Solutions, 8, 108952–108971.CrossRef Fuller, A., Fan, Z., Day, C., & Barlow, C. (2020). Digital Twin: Enabling technologies, challenges and Open Research. IEEE Access: Practical Innovations, Open Solutions, 8, 108952–108971.CrossRef
32.
go back to reference Li, G., Caponetto, F., Del Bianco, E., Katsageorgiou, V., Sarakoglou, I., & Tsagarakis, N. G. (2020). Incomplete orientation mapping for Teleoperation with one DoF Master-Slave asymmetry. IEEE Robot Autom Lett, 5, 5167–5174.CrossRef Li, G., Caponetto, F., Del Bianco, E., Katsageorgiou, V., Sarakoglou, I., & Tsagarakis, N. G. (2020). Incomplete orientation mapping for Teleoperation with one DoF Master-Slave asymmetry. IEEE Robot Autom Lett, 5, 5167–5174.CrossRef
33.
go back to reference Bejczy, B., Bozyil, R., Vaiekauskas, E., Petersen, S. B. K., Bogh, S., Hjorth, S. S., & Hansen, E. B. (2020). Mixed reality interface for improving Mobile Manipulator Teleoperation in Contamination critical applications. Procedia Manuf, 51, 620–626.CrossRef Bejczy, B., Bozyil, R., Vaiekauskas, E., Petersen, S. B. K., Bogh, S., Hjorth, S. S., & Hansen, E. B. (2020). Mixed reality interface for improving Mobile Manipulator Teleoperation in Contamination critical applications. Procedia Manuf, 51, 620–626.CrossRef
34.
go back to reference Triantafyllidis, E., McGreavy, C., Gu, J., & Li, Z. (2020). Study of Multimodal Interfaces, and the improvements on Teleoperation. IEEE Access: Practical Innovations, Open Solutions, 8, 78213–78227.CrossRef Triantafyllidis, E., McGreavy, C., Gu, J., & Li, Z. (2020). Study of Multimodal Interfaces, and the improvements on Teleoperation. IEEE Access: Practical Innovations, Open Solutions, 8, 78213–78227.CrossRef
Metadata
Title
Physical Integrated Digital twin-based Interaction Mechanism of Artificial Intelligence Rehabilitation Robots Combining Visual Cognition and Motion Control
Authors
Ke Tao
Jincan Lei
Jing Huang
Publication date
02-05-2024
Publisher
Springer US
Published in
Wireless Personal Communications
Print ISSN: 0929-6212
Electronic ISSN: 1572-834X
DOI
https://doi.org/10.1007/s11277-024-11108-0