Inertial and optical sensor fusion to compensate for partial occlusions in surgical tracking systems

Changyu He; Yue Liu

doi:10.1117/12.2192807

5 August 2015 Inertial and optical sensor fusion to compensate for partial occlusions in surgical tracking systems

Changyu He, Yue Liu

Proceedings Volume 9618, 2015 International Conference on Optical Instruments and Technology: Optical Systems and Modern Optoelectronic Instruments; 961802 (2015) https://doi.org/10.1117/12.2192807
Event: International Conference on Optical Instruments and Technology 2015, 2015, Beijing, China

Abstract

To solve the occlusion problem in optical tracking system (OTS) for surgical navigation, this paper proposes a sensor fusion approach and an adaptive display method to handle cases where partial or total occlusion occurs. In the sensor fusion approach, the full 6D pose information provided by the optical tracker is used to estimate the bias of the inertial sensors when all of the markers are visible. When partial occlusion occurs, the optical system can track the position of at least one marker which can be combined with the orientation estimated from the inertial measurements to recover the full 6D pose information. When all the markers are invisible, the position tracking will be realized based on outputs of the Inertial Measurement Unit (IMU) which may generate increasing drifting error. To alert the user when the drifting error is great enough to influence the navigation, the images adaptive to the drifting error are displayed in the field of the user’s view. The experiments are performed with an augmented reality HMD which displays the AR images and the hybrid tracking system (HTS) which consists of an OTS and an IMU. Experimental result shows that with proposed sensor fusion approach the 6D pose of the head with respect to the reference frame can be estimated even under partial occlusion conditions. With the help of the proposed adaptive display method, the users can recover the scene of markers when the error is considered to be relatively high.

Citation Download Citation

Changyu He and Yue Liu "Inertial and optical sensor fusion to compensate for partial occlusions in surgical tracking systems", Proc. SPIE 9618, 2015 International Conference on Optical Instruments and Technology: Optical Systems and Modern Optoelectronic Instruments, 961802 (5 August 2015); https://doi.org/10.1117/12.2192807

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Optical tracking

Autoregressive models

Navigation systems

Sensor fusion

Sensors

Surgery

Cameras

Show All Keywords

Keywords/Phrases

Search In:

Publication Years