Currently, in virtual reality simulations and laboratories much attention is focused on the development of a userinteraction controller for better immersion and student experience. Of course, the visual experience is a base for thelaboratory study of any students, but direct contact with the visualized environment is also important. This paper presentsa virtual scalpel technique that simulates the experience of medical discipline student education using virtual reality(VR) and augmented reality (AR) laboratory software. User's hands and a pencil with a tracker marker are the maintracking system components.Due to the high sensitivity of hand sign recognition, the Leap Motion camera was chosen as the base device for trackingthe interaction of the user's virtual scalpel and hand models. We used Unreal Engine to create and visualize such virtuallaboratory. During the recognition "hand-pencil" system, the 3D scalpel model is activated in our VR and scene, with acollision in the proposed virtual blade area. The user manipulates such “hand-scalpel” system in VR and AR simulationprocess, where the collision area of blade interacts with an imitating an organic 3D object. In this paper we presented thesensitivity and efficiency of “hand-pencil” system inside the virtual scene. In addition, the comparison and application ofthe methodology were highlighted for VR and AR prototypes of the laboratory scene.
展开▼
