Cross modality registration of video and magnetic tracker data for 3D appearance and structure modeling

Dusty Sargent; Chao-I Chen; Yuan-Fang Wang

doi:10.1117/12.839514

12 March 2010 Cross modality registration of video and magnetic tracker data for 3D appearance and structure modeling

Dusty Sargent, Chao-I Chen, Yuan-Fang Wang

Proceedings Volume 7625, Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling; 76251N (2010) https://doi.org/10.1117/12.839514
Event: SPIE Medical Imaging, 2010, San Diego, California, United States

Abstract

The paper reports a fully-automated, cross-modality sensor data registration scheme between video and magnetic tracker data. This registration scheme is intended for use in computerized imaging systems to model the appearance, structure, and dimension of human anatomy in three dimensions (3D) from endoscopic videos, particularly colonoscopic videos, for cancer research and clinical practices. The proposed cross-modality calibration procedure operates this way: Before a colonoscopic procedure, the surgeon inserts a magnetic tracker into the working channel of the endoscope or otherwise fixes the tracker's position on the scope. The surgeon then maneuvers the scope-tracker assembly to view a checkerboard calibration pattern from a few different viewpoints for a few seconds. The calibration procedure is then completed, and the relative pose (translation and rotation) between the reference frames of the magnetic tracker and the scope is determined. During the colonoscopic procedure, the readings from the magnetic tracker are used to automatically deduce the pose (both position and orientation) of the scope's reference frame over time, without complicated image analysis. Knowing the scope movement over time then allows us to infer the 3D appearance and structure of the organs and tissues in the scene. While there are other well-established mechanisms for inferring the movement of the camera (scope) from images, they are often sensitive to mistakes in image analysis, error accumulation, and structure deformation. The proposed method using a magnetic tracker to establish the camera motion parameters thus provides a robust and efficient alternative for 3D model construction. Furthermore, the calibration procedure does not require special training nor use expensive calibration equipment (except for a camera calibration pattern-a checkerboard pattern-that can be printed on any laser or inkjet printer).

Citation Download Citation

Dusty Sargent, Chao-I Chen, and Yuan-Fang Wang "Cross modality registration of video and magnetic tracker data for 3D appearance and structure modeling", Proc. SPIE 7625, Medical Imaging 2010: Visualization, Image-Guided Procedures, and Modeling, 76251N (12 March 2010); https://doi.org/10.1117/12.839514

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available