Research and Development of Virtual Assembly and Machining System for Metal Cutting Petroleum Machinery Based on Kinect v2

Based on building the overall architecture of virtual assembly and processing on the Unity3D platform, to make the operation more immersive, this paper adds the related functions of Kinect somatosensory equipment on the basis of the original functions, realizes some functions of this system through gesture operation, and develops a virtual simulation system for metal cutting petroleum machinery assembly and processing based on this. The application results show that the application of human-computer interaction technology has significantly improved. Through several groups of experimental data, it is verified that the accuracy of gesture recognition is not 100%. Through SVM algorithm, it is verified that the angle between the middle finger and the thumb is detected with error, especially when the hand is moving.