Image fusion in infrared image and visual image using normalized mutual information

Changhan Park; Kyung-hoon Bae; Sungnam Choi; Jik-Han Jung

doi:10.1117/12.777990

17 April 2008 Image fusion in infrared image and visual image using normalized mutual information

Changhan Park, Kyung-hoon Bae, Sungnam Choi, Jik-Han Jung

Proceedings Volume 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII; 69681Q (2008) https://doi.org/10.1117/12.777990
Event: SPIE Defense and Security Symposium, 2008, Orlando, Florida, United States

Abstract

In this paper, we propose an image fusion for open and unknown environments using normalized mutual information (NMI) in an infrared (IR) and visual vision system. Image fusion is a field of study of image processing, and it creates a new image to extract information from various different sensors. And also it gets effective information for a special object. This can get object types, sensitive characteristic, and information which it not to get characteristic of object from a single sensor. Image fusion in multi-sensors is two advantages. First, multi-sensor image has inherent redundancy for each sensor because it can be fused each image from a various multi-band sensor. Second, multi-sensor differs from a single sensor because it is included information of each sensor and is separated information of object easily in real environments. Proposed method consists of extraction and comparison of feature point, image registration, and pseudo color for display. Extraction of feature point is stage which it looks for a similar feature points between each sensor. Then, the extraction of a similar feature point uses a corner detector. A detected correspondence point from multi-sensor is compared feature point by using NMI. An acquired image in multi-sensor needs an image registration between two images. Because it needs transformation from reference image to a coordinated system of sensed image. And this represents each coordinated system independently between two images. Image registration use transformation of H matrix. Method for overlay between two images uses blending based on HSV. Based on experimental results, the proposed method shows high precision for fused pseudo image in multi-sensor, and can be represented image registration by using probability-based method.

Citation Download Citation

Changhan Park, Kyung-hoon Bae, Sungnam Choi, and Jik-Han Jung "Image fusion in infrared image and visual image using normalized mutual information", Proc. SPIE 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII, 69681Q (17 April 2008); https://doi.org/10.1117/12.777990

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available