Improved visual SLAM for bronchoscope tracking and registration with pre-operative CT images

Cheng Wang; Masahiro Oda; Yuichiro Hayashi; Takayuki Kitasaka; Hirotoshi Honma; Hirotsugu Takabatake; Masaki Mori; Hiroshi Natori; Kensaku Mori

doi:10.1117/12.2549949

16 March 2020 Improved visual SLAM for bronchoscope tracking and registration with pre-operative CT images

Cheng Wang, Masahiro Oda, Yuichiro Hayashi, Takayuki Kitasaka, Hirotoshi Honma, Hirotsugu Takabatake, Masaki Mori, Hiroshi Natori, Kensaku Mori

Author Affiliations +

Proceedings Volume 11315, Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling; 1131518 (2020) https://doi.org/10.1117/12.2549949
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

We present an improved patient-specific bronchoscopic navigation scheme by using visual SLAM for bronchoscope tracking. Bronchoscopic navigation system is used to assist physicians during the bronchoscopy examination. Conventional navigation system obtain the camera pose of bronchoscope based on image similarity of real bron- choscopic (RB) and virtual bronchoscopic (VB) images or the pose information from the additional sensor. We propose to use visual SLAM for bronchoscope tracking. The tracking procedure of visual SLAM is improved for processing bronchoscopic scene by considering the inter-frame displacement to filter 2D-3D matches used for pose optimization. The tracking result is registered to CT images to find the relationship between RB and CT the coordinate system. Virtual bronchoscopic views are generated corresponding to real bronchoscopic views by using the registration result and camera pose. Experimental results showed that our proposed method track more frames with higher accuracy on average than the the previous method. The virtual bronchoscopic views have high similarity with real bronchoscopic views.

Conference Presentation

Citation Download Citation

Cheng Wang, Masahiro Oda, Yuichiro Hayashi, Takayuki Kitasaka, Hirotoshi Honma, Hirotsugu Takabatake, Masaki Mori, Hiroshi Natori, and Kensaku Mori "Improved visual SLAM for bronchoscope tracking and registration with pre-operative CT images", Proc. SPIE 11315, Medical Imaging 2020: Image-Guided Procedures, Robotic Interventions, and Modeling, 1131518 (16 March 2020); https://doi.org/10.1117/12.2549949

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available