Mapping of endoscopic images to object surfaces via ray-traced texture mapping for image guidance in neurosurgery

Damini Dey; David G. Gobbi; Kathleen J. M. Surry; Piotr J. Slomka; Terence M. Peters

doi:10.1117/12.383051

18 April 2000 Mapping of endoscopic images to object surfaces via ray-traced texture mapping for image guidance in neurosurgery

Damini Dey, David G. Gobbi, Kathleen J. M. Surry, Piotr J. Slomka, Terence M. Peters

Author Affiliations +

Proceedings Volume 3976, Medical Imaging 2000: Image Display and Visualization; (2000) https://doi.org/10.1117/12.383051
Event: Medical Imaging 2000, 2000, San Diego, CA, United States

Abstract

A major limitation of the use of endoscopes in minimally invasive surgery is the lack of relative context between the endoscope and its surroundings. The purpose of this work is to map endoscopic images to surfaces obtained from 3D preoperative MR or CT data, for assistance in surgical planning and guidance. To test our methods, we acquired pre- operative CT images of a standard brain phantom from which object surfaces were extracted. Endoscopic images were acquired using a neuro-endoscope tracked with an optical tracking system, and the optical properties of the endoscope were characterized using a simple calibration procedure. Registration of the phantom and CT images was accomplished using markers that could be identified both on the physical object and in the pre-operative images. The endoscopic images were rectified for radial lens distortion, and then mapped onto the extracted surfaces via a ray-traced texture- mapping algorithm, which explicitly accounts for surface obliquity. The optical tracker has an accuracy of about 0.3 mm, which allows the endoscope tip to be localized to within mm. The mapping operation allows the endoscopic images to be effectively 'painted' onto the surfaces as they are acquired. Panoramic and stereoscopic visualization and navigation of the painted surfaces may then be reformed from arbitrary orientations, that were not necessarily those from which the original endoscopic views were acquired.

Citation Download Citation

Damini Dey, David G. Gobbi, Kathleen J. M. Surry, Piotr J. Slomka, and Terence M. Peters "Mapping of endoscopic images to object surfaces via ray-traced texture mapping for image guidance in neurosurgery", Proc. SPIE 3976, Medical Imaging 2000: Image Display and Visualization, (18 April 2000); https://doi.org/10.1117/12.383051

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available