Skip to main content
Top
Published in: Universal Access in the Information Society 1/2024

14-10-2022 | Review Paper

Research and prospects of virtual reality systems applying exoskeleton technology

Authors: Wenqian Qi, Shouqian Sun, Tongzhi Niu, Dongwei Zhao

Published in: Universal Access in the Information Society | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As a typical application of human–machine fusion intelligence, the exoskeleton is an indispensable intelligent interaction device for virtual reality. At present, there are an increasing number of studies on virtual reality systems using exoskeleton technology, especially in the field of medical rehabilitation. In this paper, for the first time, a virtual reality system with the application of exoskeleton technology is considered as the research object. We refer to three key human–machine interaction processes: recognition, perception, and feedback. The virtual reality system that uses exoskeleton technology is divided into positioning technology, multisensory interaction, and feedback technology. First, this study conducts literature research and then summarizes the technical characteristics, system architecture, and research status for key content such as positioning technology, multisensory interaction, and feedback technology. Finally, the three research aspects of the virtual reality system applying exoskeleton technology are summarized, considered, and prospected.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
4.
go back to reference Luisier, Y.D.: Perceptions of Thai aviation students on consumer grade VR flight experiences. Proceedings 39, 888 (2019) Luisier, Y.D.: Perceptions of Thai aviation students on consumer grade VR flight experiences. Proceedings 39, 888 (2019)
6.
go back to reference Zhiyong, Z., Hesong, L., Guojun, Q., et al.: Research on the defense education mode of immersive colleges and universities based on virtual reality technology. Univ. Educ. 2, 11 (2018) Zhiyong, Z., Hesong, L., Guojun, Q., et al.: Research on the defense education mode of immersive colleges and universities based on virtual reality technology. Univ. Educ. 2, 11 (2018)
7.
go back to reference Miaozong, D., Junmin, D.: Research status and problems of exoskeleton robots. Modern Manuf. Eng. 3, 855 (2019) Miaozong, D., Junmin, D.: Research status and problems of exoskeleton robots. Modern Manuf. Eng. 3, 855 (2019)
12.
go back to reference Wei, D.: Lower limb exoskeleton robot based on human-robot cooperation strategy. In: University of Science and Technology of China (2011) Wei, D.: Lower limb exoskeleton robot based on human-robot cooperation strategy. In: University of Science and Technology of China (2011)
14.
go back to reference Ferrero, L., Ortíz, M., Quiles, V., et al.: Improving motor imagery of gait on a brain-computer interface by means of virtual reality: a case of study. IEEE Access 9, 49121–49130 (2021)CrossRef Ferrero, L., Ortíz, M., Quiles, V., et al.: Improving motor imagery of gait on a brain-computer interface by means of virtual reality: a case of study. IEEE Access 9, 49121–49130 (2021)CrossRef
16.
go back to reference Lee, Y., Ryoo, Y. J., Choi, J., et al.: Intelligent machine space for interacting with human in Ubiquitous Virtual Reality. In: International Conference on Distributed, Ambient, and Pervasive Interactions, pp. 459–465. Springer, Berlin, Heidelberg. (2013) https://doi.org/10.1007/978-3-642-39351-8_50 Lee, Y., Ryoo, Y. J., Choi, J., et al.: Intelligent machine space for interacting with human in Ubiquitous Virtual Reality. In: International Conference on Distributed, Ambient, and Pervasive Interactions, pp. 459–465. Springer, Berlin, Heidelberg. (2013) https://​doi.​org/​10.​1007/​978-3-642-39351-8_​50
17.
go back to reference Gancet, J., Ilzkovitz, M., Motard, E., et al.: MINDWALKER: Going one step further with assistive lower limbs exoskeleton for SCI condition subjects. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1794–1800. IEEE. (2012) https://doi.org/10.1109/BioRob.2012.6290688 Gancet, J., Ilzkovitz, M., Motard, E., et al.: MINDWALKER: Going one step further with assistive lower limbs exoskeleton for SCI condition subjects. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1794–1800. IEEE. (2012) https://​doi.​org/​10.​1109/​BioRob.​2012.​6290688
19.
go back to reference Analytics, C.: Web of Science. Trust the Difference, Web of Science Fact Book (2017) Analytics, C.: Web of Science. Trust the Difference, Web of Science Fact Book (2017)
21.
go back to reference Bastian, M., Heymann, S., Jacomy, M.: Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the International AAAI Conference on Web and Social Media (2009) Bastian, M., Heymann, S., Jacomy, M.: Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the International AAAI Conference on Web and Social Media (2009)
22.
go back to reference Wei, S.: Research of virtual reality training system for robot-assisted upper limb rehabilitation. In: Shanghai Jiao Tong University (2012) Wei, S.: Research of virtual reality training system for robot-assisted upper limb rehabilitation. In: Shanghai Jiao Tong University (2012)
23.
go back to reference Zhang, Y.: Development of an exoskeleton system for children’s exercise capacity promotion and its experimental study. In: Zhejiang University (2013) Zhang, Y.: Development of an exoskeleton system for children’s exercise capacity promotion and its experimental study. In: Zhejiang University (2013)
25.
go back to reference Secco, E.L., Tadesse, A.M.: A wearable exoskeleton for hand kinesthetic feedback in virtual reality. In: International Conference on Wireless Mobile Communication and Healthcare. Springer, pp. 186–200 (2019) Secco, E.L., Tadesse, A.M.: A wearable exoskeleton for hand kinesthetic feedback in virtual reality. In: International Conference on Wireless Mobile Communication and Healthcare. Springer, pp. 186–200 (2019)
26.
go back to reference Mubin, O., Jishtu, N., Alsinglawi, B., et al.: Exoskeletons with virtual reality, augmented reality or gamification for stroke patients’ rehabilitation. JMIR Rehabil. Assistive Technol. 6, 555 (2018) Mubin, O., Jishtu, N., Alsinglawi, B., et al.: Exoskeletons with virtual reality, augmented reality or gamification for stroke patients’ rehabilitation. JMIR Rehabil. Assistive Technol. 6, 555 (2018)
27.
go back to reference Jiang, Y., Qiao, B., Zhao, Y.: Review of reduced gravity simulation for astronaut training. Manned Spaceflight 2, 744 (2018) Jiang, Y., Qiao, B., Zhao, Y.: Review of reduced gravity simulation for astronaut training. Manned Spaceflight 2, 744 (2018)
30.
go back to reference Wang, Y., Lin, J.: Indoor location technique based on RFID. China Instrum. 2, 54–57 (2011) Wang, Y., Lin, J.: Indoor location technique based on RFID. China Instrum. 2, 54–57 (2011)
31.
go back to reference NaturalPoint, Motion Capture Systems-OptiTrack Webpage., https://optitrack.com/ NaturalPoint, Motion Capture Systems-OptiTrack Webpage., https://​optitrack.​com/​
33.
go back to reference Büyüksalih, G., Kan, T., Özkan, G.E., et al.: Preserving the knowledge of the past through virtual visits: from 3D laser scanning to virtual reality visualisation at the Istanbul Çatalca İnceğiz Caves. PFG-J. Photogramm. Remote Sens. Geoinform. Sci. 88:133-146, (2020) https://doi.org/10.1007/s41064-020-00091-3 Büyüksalih, G., Kan, T., Özkan, G.E., et al.: Preserving the knowledge of the past through virtual visits: from 3D laser scanning to virtual reality visualisation at the Istanbul Çatalca İnceğiz Caves. PFG-J. Photogramm. Remote Sens. Geoinform. Sci. 88:133-146, (2020) https://​doi.​org/​10.​1007/​s41064-020-00091-3
39.
go back to reference Lange, B., Rizzo, A., Chang, C.-Y., et al.: Markerless full body tracking: depth-sensing technology within virtual environments. In: Interservice/industry Training, Simulation, and Education Conference (I/ITSEC). Citeseer (2011) Lange, B., Rizzo, A., Chang, C.-Y., et al.: Markerless full body tracking: depth-sensing technology within virtual environments. In: Interservice/industry Training, Simulation, and Education Conference (I/ITSEC). Citeseer (2011)
41.
go back to reference Dijaya, R., Kom, S., Kom, M., et al.: Virtual reality markerless based on 3D for the representation of heart and circulatory system. J. Adv. Res. Dyn. Control Syst. 2, 888 (2021) Dijaya, R., Kom, S., Kom, M., et al.: Virtual reality markerless based on 3D for the representation of heart and circulatory system. J. Adv. Res. Dyn. Control Syst. 2, 888 (2021)
43.
44.
go back to reference Chen, Y.: Active vision positioning technology for immersive virtual reality. In: Chongqing University of Posts and Telecommunications (2017) Chen, Y.: Active vision positioning technology for immersive virtual reality. In: Chongqing University of Posts and Telecommunications (2017)
45.
go back to reference Lee, J., Sinclair, M., Gonzalez-Franco, M., et al.: TORC: A virtual reality controller for in-hand high-dexterity finger interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13, (2019) https://doi.org/10.1145/3290605.3300301 Lee, J., Sinclair, M., Gonzalez-Franco, M., et al.: TORC: A virtual reality controller for in-hand high-dexterity finger interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13, (2019) https://​doi.​org/​10.​1145/​3290605.​3300301
48.
go back to reference Ping, Y.: The application of list method in the teaching of “Psychology’’-a brief table of “Psychology’’. J. Fuqing Branch Fujian Normal Univ. 2, 555 (1990) Ping, Y.: The application of list method in the teaching of “Psychology’’-a brief table of “Psychology’’. J. Fuqing Branch Fujian Normal Univ. 2, 555 (1990)
49.
go back to reference Jie, X.: Study on propagation of visual culture and the routinization of ideology. Soc. Stud. 5, 68–74 (2016) Jie, X.: Study on propagation of visual culture and the routinization of ideology. Soc. Stud. 5, 68–74 (2016)
50.
go back to reference Guan, H.: The research and implementation of the silk road virtual reality system catering to multi-sensory experience. In: Zhejiang University (2015) Guan, H.: The research and implementation of the silk road virtual reality system catering to multi-sensory experience. In: Zhejiang University (2015)
51.
go back to reference Zhao, H., Swanson, A.R., Weitlauf, A.S., et al.: Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans. Hum.-Mach. Syst. 48, 136–148 (2018)CrossRefPubMedPubMedCentral Zhao, H., Swanson, A.R., Weitlauf, A.S., et al.: Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans. Hum.-Mach. Syst. 48, 136–148 (2018)CrossRefPubMedPubMedCentral
52.
go back to reference Shi, P., Zheng, J., Yu, H.: A virtual reality training system based on upper limb exoskeleton rehabilitation robot. In: Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, pp. 138–141 (2018) Shi, P., Zheng, J., Yu, H.: A virtual reality training system based on upper limb exoskeleton rehabilitation robot. In: Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, pp. 138–141 (2018)
55.
go back to reference Zhou, J.-L.: The local characteristics tableware design based on the consumer tactile experience and memory. Packag. Eng. 38, 71–74 (2017) Zhou, J.-L.: The local characteristics tableware design based on the consumer tactile experience and memory. Packag. Eng. 38, 71–74 (2017)
58.
go back to reference Bailey, D.E.: The potential for immersive technology combined with online dating. J. Telecommun. Dig. Econ. 5, 125 (2017) Bailey, D.E.: The potential for immersive technology combined with online dating. J. Telecommun. Dig. Econ. 5, 125 (2017)
61.
go back to reference Pirkkalainen, H., Torro, O.: Emerging Technology Adoption and Use: Consolidated Assignments from Spring 2020, (2020) http://urn.fi/URN:ISBN:978-952-03-1572-6 Pirkkalainen, H., Torro, O.: Emerging Technology Adoption and Use: Consolidated Assignments from Spring 2020, (2020) http://​urn.​fi/​URN:ISBN:978-952-03-1572-6
67.
go back to reference Liu, Y.: Social interaction design of appliance brand under new retail background. In: Jiangnan University (2019) Liu, Y.: Social interaction design of appliance brand under new retail background. In: Jiangnan University (2019)
68.
go back to reference Qian, G.: Research on the periodicity of user experience in the time dimension. Theor. Res. 2, 12 (2017) Qian, G.: Research on the periodicity of user experience in the time dimension. Theor. Res. 2, 12 (2017)
69.
go back to reference Zhao, Y., Xu, C., Zhang, et al.: Key technological analysis and study on exoskeleton of human-body lower limbs. J. Mach. Des. 25, 1–5 (2008) Zhao, Y., Xu, C., Zhang, et al.: Key technological analysis and study on exoskeleton of human-body lower limbs. J. Mach. Des. 25, 1–5 (2008)
74.
go back to reference Li, J., Qi, Y., Wang, X., et al.: A review of the research and applications of force feedback devices based on virtual reality. Mech. Sci. Technol. Aerosp. Eng. 30, 1107–1111 (2011) Li, J., Qi, Y., Wang, X., et al.: A review of the research and applications of force feedback devices based on virtual reality. Mech. Sci. Technol. Aerosp. Eng. 30, 1107–1111 (2011)
75.
go back to reference Lei, X.: Research on system stability for haptic interaction. In: Nanchang University (2015) Lei, X.: Research on system stability for haptic interaction. In: Nanchang University (2015)
76.
go back to reference Massie, T.H., Salisbury, J.K.: The phantom haptic interface: a device for probing virtual objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Chicago, IL, pp. 295–300 (1994) Massie, T.H., Salisbury, J.K.: The phantom haptic interface: a device for probing virtual objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Chicago, IL, pp. 295–300 (1994)
77.
go back to reference Van Der Linde, R.Q., Lammertse, P., Frederiksen, E., et al.: The HapticMaster, a new high-performance haptic interface. In: Proceedings of Eurohaptics. Edinburgh University, pp. 1–5, (2002) Van Der Linde, R.Q., Lammertse, P., Frederiksen, E., et al.: The HapticMaster, a new high-performance haptic interface. In: Proceedings of Eurohaptics. Edinburgh University, pp. 1–5, (2002)
79.
go back to reference Verner, L.N., Okamura, A.M.: Force & torque feedback vs force only feedback. In: World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, pp. 406–410, (2009) https://doi.org/10.1109/WHC.2009.4810880 Verner, L.N., Okamura, A.M.: Force & torque feedback vs force only feedback. In: World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, pp. 406–410, (2009) https://​doi.​org/​10.​1109/​WHC.​2009.​4810880
83.
go back to reference Xu, Y., Dai, Y.: Review of hand gesture recognition study and application. Contemp. Eng. Sci. 10, 375–384 (2017)CrossRef Xu, Y., Dai, Y.: Review of hand gesture recognition study and application. Contemp. Eng. Sci. 10, 375–384 (2017)CrossRef
84.
go back to reference Han, Y., Wu, J., Xiong, Z.: A framework of multi-channel touch sensing with multiple trackpoints. In: 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE, pp. 644–649, (2017) https://doi.org/10.1109/ICCIS.2017.8274853 Han, Y., Wu, J., Xiong, Z.: A framework of multi-channel touch sensing with multiple trackpoints. In: 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE, pp. 644–649, (2017) https://​doi.​org/​10.​1109/​ICCIS.​2017.​8274853
86.
92.
go back to reference Xu, W., Zeng, H., Yang, P., et al.: Numerical analysis on tractive performance of off-road tire on gravel road using a calibrated finite element method-discrete element method model and experimental validation. Proc. Inst. Mech. Eng. Part D J. Autom. Eng. 234, 3440–3457 (2020). https://doi.org/10.1177/0954407020930175CrossRef Xu, W., Zeng, H., Yang, P., et al.: Numerical analysis on tractive performance of off-road tire on gravel road using a calibrated finite element method-discrete element method model and experimental validation. Proc. Inst. Mech. Eng. Part D J. Autom. Eng. 234, 3440–3457 (2020). https://​doi.​org/​10.​1177/​0954407020930175​CrossRef
102.
go back to reference Yang, Y., Yang, P., Zeng, F., et al.: Research on interactive operation considered physical attributes by using force feedback device. In: 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC). IEEE, pp. 737–742, (2017) https://doi.org/10.1109/SPAC.2017.8304371 Yang, Y., Yang, P., Zeng, F., et al.: Research on interactive operation considered physical attributes by using force feedback device. In: 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC). IEEE, pp. 737–742, (2017) https://​doi.​org/​10.​1109/​SPAC.​2017.​8304371
103.
go back to reference Kim, T., Kim, C., Song, H., et al.: Intuition accuracy and immersiveness analysis of 3D visualization methods for haptic virtual reality. Int. J. Adv. Comput. Sci. Appl. 10, 30–37 (2019) Kim, T., Kim, C., Song, H., et al.: Intuition accuracy and immersiveness analysis of 3D visualization methods for haptic virtual reality. Int. J. Adv. Comput. Sci. Appl. 10, 30–37 (2019)
105.
go back to reference Françoise, J., Chapuis, O., Hanneton, S., et al.: Soundguides: adapting continuous auditory feedback to users. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2829–2836, (2016) https://doi.org/10.1145/2851581.2892420 Françoise, J., Chapuis, O., Hanneton, S., et al.: Soundguides: adapting continuous auditory feedback to users. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2829–2836, (2016) https://​doi.​org/​10.​1145/​2851581.​2892420
Metadata
Title
Research and prospects of virtual reality systems applying exoskeleton technology
Authors
Wenqian Qi
Shouqian Sun
Tongzhi Niu
Dongwei Zhao
Publication date
14-10-2022
Publisher
Springer Berlin Heidelberg
Published in
Universal Access in the Information Society / Issue 1/2024
Print ISSN: 1615-5289
Electronic ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-022-00929-0

Other articles of this Issue 1/2024

Universal Access in the Information Society 1/2024 Go to the issue

Premium Partner