Surgical tool detection and tracking in retinal microsurgery

Mohamed Alsheakhali; Mehmet Yigitsoy; Abouzar Eslami; Nassir Navab

doi:10.1117/12.2082335

18 March 2015 Surgical tool detection and tracking in retinal microsurgery

Mohamed Alsheakhali, Mehmet Yigitsoy, Abouzar Eslami, Nassir Navab

Proceedings Volume 9415, Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling; 941511 (2015) https://doi.org/10.1117/12.2082335
Event: SPIE Medical Imaging, 2015, Orlando, Florida, United States

Abstract

Visual tracking of surgical instruments is an essential part of eye surgery, and plays an important role for the surgeons as well as it is a key component of robotics assistance during the operation time. The difficulty of detecting and tracking medical instruments in-vivo images comes from its deformable shape, changes in brightness, and the presence of the instrument shadow. This paper introduces a new approach to detect the tip of surgical tool and its width regardless of its head shape and the presence of the shadows or vessels. The approach relies on integrating structural information about the strong edges from the RGB color model, and the tool location-based information from L*a*b color model. The probabilistic Hough transform was applied to get the strongest straight lines in the RGB-images, and based on information from the L* and a*, one of these candidates lines is selected as the edge of the tool shaft. Based on that line, the tool slope, the tool centerline and the tool tip could be detected. The tracking is performed by keeping track of the last detected tool tip and the tool slope, and filtering the Hough lines within a box around the last detected tool tip based on the slope differences. Experimental results demonstrate the high accuracy achieved in term of detecting the tool tip position, the tool joint point position, and the tool centerline. The approach also meets the real time requirements.

Citation Download Citation

Mohamed Alsheakhali, Mehmet Yigitsoy, Abouzar Eslami, and Nassir Navab "Surgical tool detection and tracking in retinal microsurgery", Proc. SPIE 9415, Medical Imaging 2015: Image-Guided Procedures, Robotic Interventions, and Modeling, 941511 (18 March 2015); https://doi.org/10.1117/12.2082335

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available