Real-time self-calibration of a tracked augmented reality display

Zachary Baum; Andras Lasso; Tamas Ungi; Gabor Fichtinger

doi:10.1117/12.2217270

18 March 2016 Real-time self-calibration of a tracked augmented reality display

Zachary Baum, Andras Lasso, Tamas Ungi, Gabor Fichtinger

Proceedings Volume 9786, Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling; 97860F (2016) https://doi.org/10.1117/12.2217270
Event: SPIE Medical Imaging, 2016, San Diego, California, United States

Abstract

PURPOSE: Augmented reality systems have been proposed for image-guided needle interventions but they have not become widely used in clinical practice due to restrictions such as limited portability, low display refresh rates, and tedious calibration procedures. We propose a handheld tablet-based self-calibrating image overlay system.

METHODS: A modular handheld augmented reality viewbox was constructed from a tablet computer and a semi-transparent mirror. A consistent and precise self-calibration method, without the use of any temporary markers, was designed to achieve an accurate calibration of the system. Markers attached to the viewbox and patient are simultaneously tracked using an optical pose tracker to report the position of the patient with respect to a displayed image plane that is visualized in real-time. The software was built using the open-source 3D Slicer application platform's SlicerIGT extension and the PLUS toolkit.

RESULTS: The accuracy of the image overlay with image-guided needle interventions yielded a mean absolute position error of 0.99 mm (95^th percentile 1.93 mm) in-plane of the overlay and a mean absolute position error of 0.61 mm (95^th percentile 1.19 mm) out-of-plane. This accuracy is clinically acceptable for tool guidance during various procedures, such as musculoskeletal injections.

CONCLUSION: A self-calibration method was developed and evaluated for a tracked augmented reality display. The results show potential for the use of handheld image overlays in clinical studies with image-guided needle interventions.

Citation Download Citation

Zachary Baum, Andras Lasso, Tamas Ungi, and Gabor Fichtinger "Real-time self-calibration of a tracked augmented reality display", Proc. SPIE 9786, Medical Imaging 2016: Image-Guided Procedures, Robotic Interventions, and Modeling, 97860F (18 March 2016); https://doi.org/10.1117/12.2217270

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available