Augmented reality image guidance for minimally invasive coronary artery bypass

Michael Figl; Daniel Rueckert; David Hawkes; Roberto Casula; Mingxing Hu; Ose Pedro; Dong Ping Zhang; Graeme Penney; Fernando Bello; Philip Edwards

doi:10.1117/12.774788

Translator Disclaimer

17 March 2008 Augmented reality image guidance for minimally invasive coronary artery bypass

Michael Figl, Daniel Rueckert, David Hawkes, Roberto Casula, Mingxing Hu, Ose Pedro, Dong Ping Zhang, Graeme Penney, Fernando Bello, Philip Edwards

Author Affiliations +

Proceedings Volume 6918, Medical Imaging 2008: Visualization, Image-Guided Procedures, and Modeling; 69180P (2008) https://doi.org/10.1117/12.774788
Event: Medical Imaging, 2008, San Diego, California, United States

Abstract

We propose a novel system for image guidance in totally endoscopic coronary artery bypass (TECAB). A key requirement is the availability of 2D-3D registration techniques that can deal with non-rigid motion and deformation. Image guidance for TECAB is mainly required before the mechanical stabilization of the heart, thus the most dominant source of non-rigid deformation is the motion of the beating heart. To augment the images in the endoscope of the da Vinci robot, we have to find the transformation from the coordinate system of the preoperative imaging modality to the system of the endoscopic cameras. In a first step we build a 4D motion model of the beating heart. Intraoperatively we can use the ECG or video processing to determine the phase of the cardiac cycle. We can then take the heart surface from the motion model and register it to the stereo-endoscopic images of the da Vinci robot using 2D-3D registration methods. We are investigating robust feature tracking and intensity-based methods for this purpose. Images of the vessels available in the preoperative coordinate system can then be transformed to the camera system and projected into the calibrated endoscope view using two video mixers with chroma keying. It is hoped that the augmented view can improve the efficiency of TECAB surgery and reduce the conversion rate to more conventional procedures.

Citation Download Citation

Michael Figl, Daniel Rueckert, David Hawkes, Roberto Casula, Mingxing Hu, Ose Pedro, Dong Ping Zhang, Graeme Penney, Fernando Bello, and Philip Edwards "Augmented reality image guidance for minimally invasive coronary artery bypass", Proc. SPIE 6918, Medical Imaging 2008: Visualization, Image-Guided Procedures, and Modeling, 69180P (17 March 2008); https://doi.org/10.1117/12.774788

ACCESS THE FULL ARTICLE