Skip to main content
Erschienen in: Universal Access in the Information Society 1/2024

14.10.2022 | Review Paper

Research and prospects of virtual reality systems applying exoskeleton technology

verfasst von: Wenqian Qi, Shouqian Sun, Tongzhi Niu, Dongwei Zhao

Erschienen in: Universal Access in the Information Society | Ausgabe 1/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

As a typical application of human–machine fusion intelligence, the exoskeleton is an indispensable intelligent interaction device for virtual reality. At present, there are an increasing number of studies on virtual reality systems using exoskeleton technology, especially in the field of medical rehabilitation. In this paper, for the first time, a virtual reality system with the application of exoskeleton technology is considered as the research object. We refer to three key human–machine interaction processes: recognition, perception, and feedback. The virtual reality system that uses exoskeleton technology is divided into positioning technology, multisensory interaction, and feedback technology. First, this study conducts literature research and then summarizes the technical characteristics, system architecture, and research status for key content such as positioning technology, multisensory interaction, and feedback technology. Finally, the three research aspects of the virtual reality system applying exoskeleton technology are summarized, considered, and prospected.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
4.
Zurück zum Zitat Luisier, Y.D.: Perceptions of Thai aviation students on consumer grade VR flight experiences. Proceedings 39, 888 (2019) Luisier, Y.D.: Perceptions of Thai aviation students on consumer grade VR flight experiences. Proceedings 39, 888 (2019)
6.
Zurück zum Zitat Zhiyong, Z., Hesong, L., Guojun, Q., et al.: Research on the defense education mode of immersive colleges and universities based on virtual reality technology. Univ. Educ. 2, 11 (2018) Zhiyong, Z., Hesong, L., Guojun, Q., et al.: Research on the defense education mode of immersive colleges and universities based on virtual reality technology. Univ. Educ. 2, 11 (2018)
7.
Zurück zum Zitat Miaozong, D., Junmin, D.: Research status and problems of exoskeleton robots. Modern Manuf. Eng. 3, 855 (2019) Miaozong, D., Junmin, D.: Research status and problems of exoskeleton robots. Modern Manuf. Eng. 3, 855 (2019)
12.
Zurück zum Zitat Wei, D.: Lower limb exoskeleton robot based on human-robot cooperation strategy. In: University of Science and Technology of China (2011) Wei, D.: Lower limb exoskeleton robot based on human-robot cooperation strategy. In: University of Science and Technology of China (2011)
13.
14.
Zurück zum Zitat Ferrero, L., Ortíz, M., Quiles, V., et al.: Improving motor imagery of gait on a brain-computer interface by means of virtual reality: a case of study. IEEE Access 9, 49121–49130 (2021)CrossRef Ferrero, L., Ortíz, M., Quiles, V., et al.: Improving motor imagery of gait on a brain-computer interface by means of virtual reality: a case of study. IEEE Access 9, 49121–49130 (2021)CrossRef
16.
Zurück zum Zitat Lee, Y., Ryoo, Y. J., Choi, J., et al.: Intelligent machine space for interacting with human in Ubiquitous Virtual Reality. In: International Conference on Distributed, Ambient, and Pervasive Interactions, pp. 459–465. Springer, Berlin, Heidelberg. (2013) https://doi.org/10.1007/978-3-642-39351-8_50 Lee, Y., Ryoo, Y. J., Choi, J., et al.: Intelligent machine space for interacting with human in Ubiquitous Virtual Reality. In: International Conference on Distributed, Ambient, and Pervasive Interactions, pp. 459–465. Springer, Berlin, Heidelberg. (2013) https://​doi.​org/​10.​1007/​978-3-642-39351-8_​50
17.
Zurück zum Zitat Gancet, J., Ilzkovitz, M., Motard, E., et al.: MINDWALKER: Going one step further with assistive lower limbs exoskeleton for SCI condition subjects. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1794–1800. IEEE. (2012) https://doi.org/10.1109/BioRob.2012.6290688 Gancet, J., Ilzkovitz, M., Motard, E., et al.: MINDWALKER: Going one step further with assistive lower limbs exoskeleton for SCI condition subjects. In: 2012 4th IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics (BioRob), pp. 1794–1800. IEEE. (2012) https://​doi.​org/​10.​1109/​BioRob.​2012.​6290688
19.
Zurück zum Zitat Analytics, C.: Web of Science. Trust the Difference, Web of Science Fact Book (2017) Analytics, C.: Web of Science. Trust the Difference, Web of Science Fact Book (2017)
21.
Zurück zum Zitat Bastian, M., Heymann, S., Jacomy, M.: Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the International AAAI Conference on Web and Social Media (2009) Bastian, M., Heymann, S., Jacomy, M.: Gephi: an open source software for exploring and manipulating networks. In: Proceedings of the International AAAI Conference on Web and Social Media (2009)
22.
Zurück zum Zitat Wei, S.: Research of virtual reality training system for robot-assisted upper limb rehabilitation. In: Shanghai Jiao Tong University (2012) Wei, S.: Research of virtual reality training system for robot-assisted upper limb rehabilitation. In: Shanghai Jiao Tong University (2012)
23.
Zurück zum Zitat Zhang, Y.: Development of an exoskeleton system for children’s exercise capacity promotion and its experimental study. In: Zhejiang University (2013) Zhang, Y.: Development of an exoskeleton system for children’s exercise capacity promotion and its experimental study. In: Zhejiang University (2013)
25.
Zurück zum Zitat Secco, E.L., Tadesse, A.M.: A wearable exoskeleton for hand kinesthetic feedback in virtual reality. In: International Conference on Wireless Mobile Communication and Healthcare. Springer, pp. 186–200 (2019) Secco, E.L., Tadesse, A.M.: A wearable exoskeleton for hand kinesthetic feedback in virtual reality. In: International Conference on Wireless Mobile Communication and Healthcare. Springer, pp. 186–200 (2019)
26.
Zurück zum Zitat Mubin, O., Jishtu, N., Alsinglawi, B., et al.: Exoskeletons with virtual reality, augmented reality or gamification for stroke patients’ rehabilitation. JMIR Rehabil. Assistive Technol. 6, 555 (2018) Mubin, O., Jishtu, N., Alsinglawi, B., et al.: Exoskeletons with virtual reality, augmented reality or gamification for stroke patients’ rehabilitation. JMIR Rehabil. Assistive Technol. 6, 555 (2018)
27.
Zurück zum Zitat Jiang, Y., Qiao, B., Zhao, Y.: Review of reduced gravity simulation for astronaut training. Manned Spaceflight 2, 744 (2018) Jiang, Y., Qiao, B., Zhao, Y.: Review of reduced gravity simulation for astronaut training. Manned Spaceflight 2, 744 (2018)
30.
Zurück zum Zitat Wang, Y., Lin, J.: Indoor location technique based on RFID. China Instrum. 2, 54–57 (2011) Wang, Y., Lin, J.: Indoor location technique based on RFID. China Instrum. 2, 54–57 (2011)
31.
Zurück zum Zitat NaturalPoint, Motion Capture Systems-OptiTrack Webpage., https://optitrack.com/ NaturalPoint, Motion Capture Systems-OptiTrack Webpage., https://​optitrack.​com/​
33.
Zurück zum Zitat Büyüksalih, G., Kan, T., Özkan, G.E., et al.: Preserving the knowledge of the past through virtual visits: from 3D laser scanning to virtual reality visualisation at the Istanbul Çatalca İnceğiz Caves. PFG-J. Photogramm. Remote Sens. Geoinform. Sci. 88:133-146, (2020) https://doi.org/10.1007/s41064-020-00091-3 Büyüksalih, G., Kan, T., Özkan, G.E., et al.: Preserving the knowledge of the past through virtual visits: from 3D laser scanning to virtual reality visualisation at the Istanbul Çatalca İnceğiz Caves. PFG-J. Photogramm. Remote Sens. Geoinform. Sci. 88:133-146, (2020) https://​doi.​org/​10.​1007/​s41064-020-00091-3
39.
Zurück zum Zitat Lange, B., Rizzo, A., Chang, C.-Y., et al.: Markerless full body tracking: depth-sensing technology within virtual environments. In: Interservice/industry Training, Simulation, and Education Conference (I/ITSEC). Citeseer (2011) Lange, B., Rizzo, A., Chang, C.-Y., et al.: Markerless full body tracking: depth-sensing technology within virtual environments. In: Interservice/industry Training, Simulation, and Education Conference (I/ITSEC). Citeseer (2011)
41.
Zurück zum Zitat Dijaya, R., Kom, S., Kom, M., et al.: Virtual reality markerless based on 3D for the representation of heart and circulatory system. J. Adv. Res. Dyn. Control Syst. 2, 888 (2021) Dijaya, R., Kom, S., Kom, M., et al.: Virtual reality markerless based on 3D for the representation of heart and circulatory system. J. Adv. Res. Dyn. Control Syst. 2, 888 (2021)
43.
Zurück zum Zitat Bicho, D., Girão, P., Paulo, J., et al.: Markerless multi-view-based multi-user head tracking system for virtual reality applications. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). IEEE, pp. 2645–2652, (2019) https://doi.org/10.1109/SMC.2019.8914350 Bicho, D., Girão, P., Paulo, J., et al.: Markerless multi-view-based multi-user head tracking system for virtual reality applications. In: 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). IEEE, pp. 2645–2652, (2019) https://​doi.​org/​10.​1109/​SMC.​2019.​8914350
44.
Zurück zum Zitat Chen, Y.: Active vision positioning technology for immersive virtual reality. In: Chongqing University of Posts and Telecommunications (2017) Chen, Y.: Active vision positioning technology for immersive virtual reality. In: Chongqing University of Posts and Telecommunications (2017)
45.
Zurück zum Zitat Lee, J., Sinclair, M., Gonzalez-Franco, M., et al.: TORC: A virtual reality controller for in-hand high-dexterity finger interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13, (2019) https://doi.org/10.1145/3290605.3300301 Lee, J., Sinclair, M., Gonzalez-Franco, M., et al.: TORC: A virtual reality controller for in-hand high-dexterity finger interaction. In: Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, pp. 1–13, (2019) https://​doi.​org/​10.​1145/​3290605.​3300301
48.
Zurück zum Zitat Ping, Y.: The application of list method in the teaching of “Psychology’’-a brief table of “Psychology’’. J. Fuqing Branch Fujian Normal Univ. 2, 555 (1990) Ping, Y.: The application of list method in the teaching of “Psychology’’-a brief table of “Psychology’’. J. Fuqing Branch Fujian Normal Univ. 2, 555 (1990)
49.
Zurück zum Zitat Jie, X.: Study on propagation of visual culture and the routinization of ideology. Soc. Stud. 5, 68–74 (2016) Jie, X.: Study on propagation of visual culture and the routinization of ideology. Soc. Stud. 5, 68–74 (2016)
50.
Zurück zum Zitat Guan, H.: The research and implementation of the silk road virtual reality system catering to multi-sensory experience. In: Zhejiang University (2015) Guan, H.: The research and implementation of the silk road virtual reality system catering to multi-sensory experience. In: Zhejiang University (2015)
51.
Zurück zum Zitat Zhao, H., Swanson, A.R., Weitlauf, A.S., et al.: Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans. Hum.-Mach. Syst. 48, 136–148 (2018)CrossRefPubMedPubMedCentral Zhao, H., Swanson, A.R., Weitlauf, A.S., et al.: Hand-in-hand: a communication-enhancement collaborative virtual reality system for promoting social interaction in children with autism spectrum disorders. IEEE Trans. Hum.-Mach. Syst. 48, 136–148 (2018)CrossRefPubMedPubMedCentral
52.
Zurück zum Zitat Shi, P., Zheng, J., Yu, H.: A virtual reality training system based on upper limb exoskeleton rehabilitation robot. In: Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, pp. 138–141 (2018) Shi, P., Zheng, J., Yu, H.: A virtual reality training system based on upper limb exoskeleton rehabilitation robot. In: Proceedings of the 12th International Convention on Rehabilitation Engineering and Assistive Technology, pp. 138–141 (2018)
55.
Zurück zum Zitat Zhou, J.-L.: The local characteristics tableware design based on the consumer tactile experience and memory. Packag. Eng. 38, 71–74 (2017) Zhou, J.-L.: The local characteristics tableware design based on the consumer tactile experience and memory. Packag. Eng. 38, 71–74 (2017)
58.
Zurück zum Zitat Bailey, D.E.: The potential for immersive technology combined with online dating. J. Telecommun. Dig. Econ. 5, 125 (2017) Bailey, D.E.: The potential for immersive technology combined with online dating. J. Telecommun. Dig. Econ. 5, 125 (2017)
61.
Zurück zum Zitat Pirkkalainen, H., Torro, O.: Emerging Technology Adoption and Use: Consolidated Assignments from Spring 2020, (2020) http://urn.fi/URN:ISBN:978-952-03-1572-6 Pirkkalainen, H., Torro, O.: Emerging Technology Adoption and Use: Consolidated Assignments from Spring 2020, (2020) http://​urn.​fi/​URN:ISBN:978-952-03-1572-6
66.
67.
Zurück zum Zitat Liu, Y.: Social interaction design of appliance brand under new retail background. In: Jiangnan University (2019) Liu, Y.: Social interaction design of appliance brand under new retail background. In: Jiangnan University (2019)
68.
Zurück zum Zitat Qian, G.: Research on the periodicity of user experience in the time dimension. Theor. Res. 2, 12 (2017) Qian, G.: Research on the periodicity of user experience in the time dimension. Theor. Res. 2, 12 (2017)
69.
Zurück zum Zitat Zhao, Y., Xu, C., Zhang, et al.: Key technological analysis and study on exoskeleton of human-body lower limbs. J. Mach. Des. 25, 1–5 (2008) Zhao, Y., Xu, C., Zhang, et al.: Key technological analysis and study on exoskeleton of human-body lower limbs. J. Mach. Des. 25, 1–5 (2008)
74.
Zurück zum Zitat Li, J., Qi, Y., Wang, X., et al.: A review of the research and applications of force feedback devices based on virtual reality. Mech. Sci. Technol. Aerosp. Eng. 30, 1107–1111 (2011) Li, J., Qi, Y., Wang, X., et al.: A review of the research and applications of force feedback devices based on virtual reality. Mech. Sci. Technol. Aerosp. Eng. 30, 1107–1111 (2011)
75.
Zurück zum Zitat Lei, X.: Research on system stability for haptic interaction. In: Nanchang University (2015) Lei, X.: Research on system stability for haptic interaction. In: Nanchang University (2015)
76.
Zurück zum Zitat Massie, T.H., Salisbury, J.K.: The phantom haptic interface: a device for probing virtual objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Chicago, IL, pp. 295–300 (1994) Massie, T.H., Salisbury, J.K.: The phantom haptic interface: a device for probing virtual objects. In: Proceedings of the ASME Winter Annual Meeting, Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. Chicago, IL, pp. 295–300 (1994)
77.
Zurück zum Zitat Van Der Linde, R.Q., Lammertse, P., Frederiksen, E., et al.: The HapticMaster, a new high-performance haptic interface. In: Proceedings of Eurohaptics. Edinburgh University, pp. 1–5, (2002) Van Der Linde, R.Q., Lammertse, P., Frederiksen, E., et al.: The HapticMaster, a new high-performance haptic interface. In: Proceedings of Eurohaptics. Edinburgh University, pp. 1–5, (2002)
79.
Zurück zum Zitat Verner, L.N., Okamura, A.M.: Force & torque feedback vs force only feedback. In: World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, pp. 406–410, (2009) https://doi.org/10.1109/WHC.2009.4810880 Verner, L.N., Okamura, A.M.: Force & torque feedback vs force only feedback. In: World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, pp. 406–410, (2009) https://​doi.​org/​10.​1109/​WHC.​2009.​4810880
83.
Zurück zum Zitat Xu, Y., Dai, Y.: Review of hand gesture recognition study and application. Contemp. Eng. Sci. 10, 375–384 (2017)CrossRef Xu, Y., Dai, Y.: Review of hand gesture recognition study and application. Contemp. Eng. Sci. 10, 375–384 (2017)CrossRef
84.
Zurück zum Zitat Han, Y., Wu, J., Xiong, Z.: A framework of multi-channel touch sensing with multiple trackpoints. In: 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE, pp. 644–649, (2017) https://doi.org/10.1109/ICCIS.2017.8274853 Han, Y., Wu, J., Xiong, Z.: A framework of multi-channel touch sensing with multiple trackpoints. In: 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM). IEEE, pp. 644–649, (2017) https://​doi.​org/​10.​1109/​ICCIS.​2017.​8274853
86.
92.
Zurück zum Zitat Xu, W., Zeng, H., Yang, P., et al.: Numerical analysis on tractive performance of off-road tire on gravel road using a calibrated finite element method-discrete element method model and experimental validation. Proc. Inst. Mech. Eng. Part D J. Autom. Eng. 234, 3440–3457 (2020). https://doi.org/10.1177/0954407020930175CrossRef Xu, W., Zeng, H., Yang, P., et al.: Numerical analysis on tractive performance of off-road tire on gravel road using a calibrated finite element method-discrete element method model and experimental validation. Proc. Inst. Mech. Eng. Part D J. Autom. Eng. 234, 3440–3457 (2020). https://​doi.​org/​10.​1177/​0954407020930175​CrossRef
102.
Zurück zum Zitat Yang, Y., Yang, P., Zeng, F., et al.: Research on interactive operation considered physical attributes by using force feedback device. In: 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC). IEEE, pp. 737–742, (2017) https://doi.org/10.1109/SPAC.2017.8304371 Yang, Y., Yang, P., Zeng, F., et al.: Research on interactive operation considered physical attributes by using force feedback device. In: 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC). IEEE, pp. 737–742, (2017) https://​doi.​org/​10.​1109/​SPAC.​2017.​8304371
103.
Zurück zum Zitat Kim, T., Kim, C., Song, H., et al.: Intuition accuracy and immersiveness analysis of 3D visualization methods for haptic virtual reality. Int. J. Adv. Comput. Sci. Appl. 10, 30–37 (2019) Kim, T., Kim, C., Song, H., et al.: Intuition accuracy and immersiveness analysis of 3D visualization methods for haptic virtual reality. Int. J. Adv. Comput. Sci. Appl. 10, 30–37 (2019)
105.
Zurück zum Zitat Françoise, J., Chapuis, O., Hanneton, S., et al.: Soundguides: adapting continuous auditory feedback to users. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2829–2836, (2016) https://doi.org/10.1145/2851581.2892420 Françoise, J., Chapuis, O., Hanneton, S., et al.: Soundguides: adapting continuous auditory feedback to users. In: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems, pp. 2829–2836, (2016) https://​doi.​org/​10.​1145/​2851581.​2892420
Metadaten
Titel
Research and prospects of virtual reality systems applying exoskeleton technology
verfasst von
Wenqian Qi
Shouqian Sun
Tongzhi Niu
Dongwei Zhao
Publikationsdatum
14.10.2022
Verlag
Springer Berlin Heidelberg
Erschienen in
Universal Access in the Information Society / Ausgabe 1/2024
Print ISSN: 1615-5289
Elektronische ISSN: 1615-5297
DOI
https://doi.org/10.1007/s10209-022-00929-0

Weitere Artikel der Ausgabe 1/2024

Universal Access in the Information Society 1/2024 Zur Ausgabe

Premium Partner