Real-time EO/IR sensor fusion on a portable computer and head-mounted display

Zhanfeng Yue; Pankaj Topiwala

doi:10.1117/12.719600

9 April 2007 Real-time EO/IR sensor fusion on a portable computer and head-mounted display

Zhanfeng Yue, Pankaj Topiwala

Proceedings Volume 6571, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2007; 657106 (2007) https://doi.org/10.1117/12.719600
Event: Defense and Security Symposium, 2007, Orlando, Florida, United States

Abstract

Multi-sensor platforms are widely used in surveillance video systems for both military and civilian applications. The complimentary nature of different types of sensors (e.g. EO and IR sensors) makes it possible to observe the scene under almost any condition (day/night/fog/smoke). In this paper, we propose an innovative EO/IR sensor registration and fusion algorithm which runs real-time on a portable computing unit with head-mounted display. The EO/IR sensor suite is mounted on a helmet for a dismounted soldier and the fused scene is shown in the goggle display upon the processing on a portable computing unit. The linear homography transformation between images from the two sensors is precomputed for the mid-to-far scene, which reduces the computational cost for the online calibration of the sensors. The system is implemented in a highly optimized C++ code, with MMX/SSE, and performing a real-time registration. The experimental results on real captured video show the system works very well both in speed and in performance.

Citation Download Citation

Zhanfeng Yue and Pankaj Topiwala "Real-time EO/IR sensor fusion on a portable computer and head-mounted display", Proc. SPIE 6571, Multisensor, Multisource Information Fusion: Architectures, Algorithms, and Applications 2007, 657106 (9 April 2007); https://doi.org/10.1117/12.719600

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available