Pixel-level image fusion: the case of image sequences

Oliver Rockinger; Thomas Fechner

doi:10.1117/12.327135

17 July 1998 Pixel-level image fusion: the case of image sequences

Oliver Rockinger, Thomas Fechner

Proceedings Volume 3374, Signal Processing, Sensor Fusion, and Target Recognition VII; (1998) https://doi.org/10.1117/12.327135
Event: Aerospace/Defense Sensing and Controls, 1998, Orlando, FL, United States

Abstract

In pixel-level image sequence fusion, a composite image sequence has to be built of several spatially registered input image sequences. One of the primary goals in image sequence fusion is the temporal stability and consistency of the fused image sequence. To fulfill the preceding desiderata, we propose a novel approach based on a shift invariant extension of the 2D discrete wavelet transform, which yields an overcomplete and thus shift invariant multiresolution signal representation. The advantage of the shift invariant fusion method is the improved temporal stability and consistency of the fused sequence, compared to other multiresolution fusion methods. To evaluate temporal stability and consistency of the fused sequence we introduce a quality measure based on the mutual information between the inter-frame-differences (IFD) of the input sequences and the fused image sequence. If the mutual information is high, the information in the IFD of the fused sequence is low with respect to the information present in the IFDs of the input sequences, indicating a stable and consistent fused image sequence. We evaluate the performance of several multiresolution fusion schemes on a real word image sequence pair and show that the shift invariant fusion method outperforms the other multiresolution fusion methods with respect to temporal stability and consistency.

Citation Download Citation

Oliver Rockinger and Thomas Fechner "Pixel-level image fusion: the case of image sequences", Proc. SPIE 3374, Signal Processing, Sensor Fusion, and Target Recognition VII, (17 July 1998); https://doi.org/10.1117/12.327135

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available