Abstract
Combining image information fusion theory with machine learning for biometric recognition is an important field in computer vision research in recent years. Based on this, a gesture recognition algorithm based on image information fusion in virtual reality is proposed. Firstly, it introduces the basic concepts and principles of virtual reality and information fusion technology, analyzes the characteristics and basic components of virtual environment system, points out the relationship between human and virtual environment and the impact of virtual environment on people, and gives a virtual reality. Then, the multi-sensor information fusion model of the virtual environment for gesture recognition is proposed. The membership degree and template matching algorithm are further selected for data correlation and gesture recognition in the fusion model. Finally, the design comparison experiment verifies the proposed method. The results show that the proposed multi-sensor information fusion model in the interactive virtual environment achieves the highest recognition success rate of 96.17% and is better than several comparison machine learning methods in recognition time.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Huang L, Wu Q, Chen Y, et al.2015 Gesture recognition based on fusion features from multiple spiking neural networks Fifth international conference on communication systems & network technologies.
Yu L, Cheng Y M, Song L, et al.2014 Underwater acoustic multi-target recognition algorithm based on hierarchical information fusion structure International Conference on Information Fusion
Yan X, Deng F, Kang W.2015Palm vein recognition based on multi-algorithm and score-level fusion Seventh International Symposium on Computational Intelligence & Design
Wu H, Wang J (2016) A visual attention-based method to address the Midas touch problem existing in gesture-based interaction. Vis Comput 32(1):123–136
Zhu Y, Yi B, Simple GTA (2016) Outdoor environment obstacle detection method based on information fusion of depth and infrared. Journal of Robotics 2016(9):1–10
Shi H, Mu X, Wang S.2016 BVCNN: a multi-object image recognition method based on the convolutional neural networks International Conference on Virtual Reality & Visualization.
Gao B, Guo S, Hu K.2014 Diagnosis and treatment of navigation technology based on the multi-modality image fusion for angioneoplasm IEEE International Conference on Mechatronics & Automation
Long Y, Zhang T, Xu C (2015) Multi-object tracking via MHT with multiple information fusion in surveillance video. Multimedia Systems 21(3):313–326
Sun W, Zhang X, Peeta S, He X, Li Y, Zhu S (2015) A self-adaptive dynamic recognition model for fatigue driving based on multi-source information and two levels of fusion. Sensors 15(9):24191–24213
Bai X, Yu Z, Zhou F et al (2015) Quadtree-based multi-focus image fusion using a weighted focus-measure. Information Fusion 22:105–118
Liu CH, Qi Y, Ding WR (2017) Infrared and visible image fusion method based on saliency detection in sparse domain. Infrared Phys Technol 83:94–102
Ning L, Yan C, Feng X, et al.2018 Virtual reality realization technology and its application based on augmented reality IEEE Global Conference on Signal & Information Processing
Aliakbarpour H, Prasath VBS, Palaniappan K, Seetharaman G, Dias J (2016) Heterogeneous multi-view information fusion: review of 3-D reconstruction methods and a new registration with uncertainty modeling. IEEE Access 4(1):8264–8285
Fricoteaux L, Thouvenin I, Mestre D (2014) GULLIVER: a decision-making system based on user observation for an adaptive training in informed virtual environments. Eng Appl Artif Intell 33(1):47–57
Kundra L, Ekler P, Charaf H (2015) Orientation estimation in modern wearables with visual feature tracking. Journal on Multimodal User Interfaces 9(4):313–322
Gao L (2018) Research on application of data mining in virtual community of foreign language learning. International Conference on Intelligent Transportation
Pan H, Wang Y, Liu Q. A2016 Part-based and feature fusion method for clothing classification Pacific-rim Conference on Advances in Multimedia Information Processing
Cho Y, Pyeon M, Kim D et al (2014) Video image based hyper live spatial data construction. Lecture Notes in Electrical Engineering 274:371–376
Ye Y, Xiao-ping L, Pbuckles B et al (2014) Residential building reconstruction based on data fusion. Acta Electron Sin 42(2):250–256
Rapetti L, Crivellaro S, De Momi E, et al. 2017 Virtual reality navigation system for prostate biopsy Acm Symposium on Virtual Reality Software & Technology
Shi X, Guo Z, Zhang D, et al (2016) Multiple features fusion based inverted multi-index for image retrieval. International Conference on Virtual Reality & Visualization
Yang Z, Fei Y, Lin X, et al.2015Micro-IMU-based motion tracking system for virtual training Control Conference.
Xia X, Fang S, Yan X (2014) High resolution image fusion algorithm based on multi-focused region extraction. Pattern Recogn Lett 45(1):115–120
Funding
This work was supported by the Shanxi Soft Science Research Program (No. 2017041023-3).
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Li, F., Fei, J. Gesture recognition algorithm based on image information fusion in virtual reality. Pers Ubiquit Comput 23, 487–497 (2019). https://doi.org/10.1007/s00779-019-01225-0
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00779-019-01225-0