Augmented reality system for CT-guided interventions: system description and initial phantom trials

Frank Sauer; Uwe Joseph Schoepf; Ali Khamene; Sebastian Vogt; Marco Das; Stuart G. Silverman

doi:10.1117/12.480383

Translator Disclaimer

30 May 2003 Augmented reality system for CT-guided interventions: system description and initial phantom trials

Frank Sauer, Uwe Joseph Schoepf, Ali Khamene, Sebastian Vogt, Marco Das, Stuart G. Silverman

Author Affiliations +

Proceedings Volume 5029, Medical Imaging 2003: Visualization, Image-Guided Procedures, and Display; (2003) https://doi.org/10.1117/12.480383
Event: Medical Imaging 2003, 2003, San Diego, California, United States

Abstract

We are developing an augmented reality (AR) image guidance system, in which information derived from medical images is overlaid onto a video view of the patient. The interventionalist wears a head-mounted display (HMD) that presents him with the augmented stereo view. The HMD is custom fitted with two miniature color video cameras that capture the stereo view of the scene. A third video camera, operating in the near IR, is also attached to the HMD and is used for head tracking. The system achieves real-time performance of 30 frames per second. The graphics appears firmly anchored in the scne, without any noticeable swimming or jitter or time lag. For the application of CT-guided interventions, we extended our original prototype system to include tracking of a biopsy needle to which we attached a set of optical markers. The AR visualization provides very intuitive guidance for planning and placement of the needle and reduces radiation to patient and radiologist. We used an interventional abdominal phantom with simulated liver lesions to perform an inital set of experiments. The users were consistently able to locate the target lesion with the first needle pass. These results provide encouragement to move the system towards clinical trials.

Citation Download Citation

Frank Sauer, Uwe Joseph Schoepf, Ali Khamene, Sebastian Vogt, Marco Das, and Stuart G. Silverman "Augmented reality system for CT-guided interventions: system description and initial phantom trials", Proc. SPIE 5029, Medical Imaging 2003: Visualization, Image-Guided Procedures, and Display, (30 May 2003); https://doi.org/10.1117/12.480383

ACCESS THE FULL ARTICLE