Multi-sensor fusion of electro-optic and infrared signals for high resolution visible images: part I

Xiaopeng Huang; Ravi Netravali; Hong Man; Victor Lawrence

doi:10.1117/12.2027014

10 June 2013 Multi-sensor fusion of electro-optic and infrared signals for high resolution visible images: part I

Xiaopeng Huang, Ravi Netravali, Hong Man, Victor Lawrence

Proceedings Volume 8706, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIV; 87060P (2013) https://doi.org/10.1117/12.2027014
Event: SPIE Defense, Security, and Sensing, 2013, Baltimore, Maryland, United States

Abstract

Electro-Optic (EO) image sensors exhibit the properties of high resolution and low noise level, but they cannot reflect information about the temperature of objects and do not work in dark environments. On the other hand, infrared (IR) image sensors exhibit the properties of low resolution and high noise level, but IR images can reflect information about the temperature of objects all the time. Therefore, in this paper, we propose a novel framework to enhance the resolution of EO images using the information (e.g., temperature) from IR images, which helps distinguish temperature variation of objects in the daytime via high-resolution EO images. The proposed novel framework involves four main steps: (1) select target objects with temperature variation in original IR images; (2) fuse original RGB color (EO) images and IR images based on image fusion algorithms; (3) blend the fused images of target objects in proportion with original gray-scale EO images; (4) superimpose the target objects’ temperature information, onto original EO images via the modified NTSC color space transformation. Therein, the image fusion step will be conducted by qualitative (frame pipeline) approach. Revealing temperature information in EO images for the first time is the most significant contribution of this paper. Simulation results will show the transformed EO images with the targets’ temperature information.

Citation Download Citation

Xiaopeng Huang, Ravi Netravali, Hong Man, and Victor Lawrence "Multi-sensor fusion of electro-optic and infrared signals for high resolution visible images: part I", Proc. SPIE 8706, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XXIV, 87060P (10 June 2013); https://doi.org/10.1117/12.2027014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Infrared imaging

Expectation maximization algorithms

Image resolution

RGB color model

Image sensors

Infrared sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years