A Gesture Interactive and Immersive System for Space Liquid Bridge Experiment

• 1、School of Mechanical Engineering and Automation BUAA, Beijing, 100191

Abstract： Space telescience experiment has the ability to synchronize the interaction between the human beings and remote space laboratory equipment, which has higher requirements in real-time interactivity. Space liquid bridge experiment is a typical space telescience experiment. Aimed at space liquid bridge experiment, the task needs to use servo method to control bridge pulling, clearance process, etc. In order to achieve the interactive effect of natural and immersive, a control strategy based on Leap Motion gesture interaction control and Oculus Rift DK2 headset three-dimensional display is developed. Different from previous studies based on unity3D platform, the Oculus Rift DK2 and Leap Motion using C ++ integrated in the same system. A gesture recognition algorithm and fuzzy control algorithm based on position control are developed, and the experimental results show that the algorithms have a small memory load and a high recognition accuracy of 97.68%, and the average operating accuracy of the operator is about 95%, which meets the operational requirements. A new system is proposed which combines Leap Motion multi-finger recognition and Oculus three-dimensional display, which achieved the goal of natural interaction for space telescience experiment.

Keywords： space telescience experiment space liquid bridge experiment Oculus Rift DK2 leap motion gesture recognition algorithm