Virtual scalpel simulation in the VR and AR environments

Larisa A. Zherdeva; Konstantin V. Cherepanov; Denis A. Zherdev

doi:10.1117/12.2546369

19 February 2020 Virtual scalpel simulation in the VR and AR environments

Larisa A. Zherdeva, Konstantin V. Cherepanov, Denis A. Zherdev

Proceedings Volume 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR); 113101G (2020) https://doi.org/10.1117/12.2546369
Event: SPIE AR VR MR, 2020, San Francisco, California, United States

Abstract

Currently, in virtual reality simulations and laboratories much attention is focused on the development of a user interaction controller for better immersion and student experience. Of course, the visual experience is a base for the laboratory study of any students, but direct contact with the visualized environment is also important. This paper presents a virtual scalpel technique that simulates the experience of medical discipline student education using virtual reality (VR) and augmented reality (AR) laboratory software. User's hands and a pencil with a tracker marker are the main tracking system components. Due to the high sensitivity of hand sign recognition, the Leap Motion camera was chosen as the base device for tracking the interaction of the user's virtual scalpel and hand models. We used Unreal Engine to create and visualize such virtual laboratory. During the recognition "hand-pencil" system, the 3D scalpel model is activated in our VR and scene, with a collision in the proposed virtual blade area. The user manipulates such “hand-scalpel” system in VR and AR simulation process, where the collision area of blade interacts with an imitating an organic 3D object. In this paper we presented the sensitivity and efficiency of “hand-pencil” system inside the virtual scene. In addition, the comparison and application of the methodology were highlighted for VR and AR prototypes of the laboratory scene.

Citation Download Citation

Larisa A. Zherdeva, Konstantin V. Cherepanov, and Denis A. Zherdev "Virtual scalpel simulation in the VR and AR environments", Proc. SPIE 11310, Optical Architectures for Displays and Sensing in Augmented, Virtual, and Mixed Reality (AR, VR, MR), 113101G (19 February 2020); https://doi.org/10.1117/12.2546369

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available