Fusion of stereoscopic video and laparoscopic ultrasound for minimally invasive partial nephrectomy

Carling L. Cheung; Christopher Wedlake; John Moore; Stephen E. Pautler; Anis Ahmad; Terry M. Peters

doi:10.1117/12.813741

13 March 2009 Fusion of stereoscopic video and laparoscopic ultrasound for minimally invasive partial nephrectomy

Carling L. Cheung, Christopher Wedlake, John Moore, Stephen E. Pautler, Anis Ahmad, Terry M. Peters

Proceedings Volume 7261, Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling; 726109 (2009) https://doi.org/10.1117/12.813741
Event: SPIE Medical Imaging, 2009, Lake Buena Vista (Orlando Area), Florida, United States

Abstract

The development of an augmented reality environment that combines laparoscopic video and ultrasound imaging for image-guided minimally invasive abdominal surgical procedures, such as partial nephrectomy and radical prostatectomy, is an ongoing project in our laboratory. Our system overlays magnetically tracked ultrasound images onto endoscopic video to create a more intuitive visualization for mapping lesions intraoperatively and to give the ultrasound image context in 3D space. By presenting data in a common environment, this system will allow surgeons to visualize the multimodality information without having to switch between different images. A stereoscopic laparoscope from Visionsense Limited enhances our current system by providing surgeons with additional visual information through improved depth perception. In this paper, we develop and validate a calibration method that determines the transformation between the images from the stereoscopic laparoscope and the 3D locations of structures represented by a tracked laparoscopic ultrasound probe. We first calibrate the laparoscope with a checkerboard pattern and measure how accurate the transformation from image space to tracking space is. We then perform a target localization task using our fused environment. Our initial experience has demonstrated an RMS registration accuracy in 3D of 2.21mm for the laparoscope and 1.16mm for the ultrasound in a working volume of 0.125m³, indicating that magnetically tracked stereoscopic laparoscope and ultrasound images may be appropriately combined using magnetic tracking as long as steps are taken to ensure that the magnetic field generated by the system is not distorted by surrounding objects close to the working volume.

Citation Download Citation

Carling L. Cheung, Christopher Wedlake, John Moore, Stephen E. Pautler, Anis Ahmad, and Terry M. Peters "Fusion of stereoscopic video and laparoscopic ultrasound for minimally invasive partial nephrectomy", Proc. SPIE 7261, Medical Imaging 2009: Visualization, Image-Guided Procedures, and Modeling, 726109 (13 March 2009); https://doi.org/10.1117/12.813741

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available