An advanced image fusion algorithm based on wavelet transform: incorporation with PCA and morphological processing

Yufeng Zheng; Edward A. Essock; Bruce C. Hansen

doi:10.1117/12.523966

28 May 2004 An advanced image fusion algorithm based on wavelet transform: incorporation with PCA and morphological processing

Yufeng Zheng, Edward A. Essock, Bruce C. Hansen

Author Affiliations +

Proceedings Volume 5298, Image Processing: Algorithms and Systems III; (2004) https://doi.org/10.1117/12.523966
Event: Electronic Imaging 2004, 2004, San Jose, California, United States

Abstract

There are numerous applications for image fusion, some of which include medical imaging, remote sensing, nighttime operations and multi-spectral imaging. In general, the discrete wavelet transform (DWT) and various pyramids (such as Laplacian, ratio, contrast, gradient and morphological pyramids) are the most common and effective methods. For quantitative evaluation of the quality of fused imagery, the root mean square error (RMSE) is the most suitable measure of quality if there is a “ground truth” image available; otherwise, the entropy, spatial frequency or image quality index of the input images and the fused images can be calculated and compared. Here, after analyzing the pyramids’ performance with the four measures mentioned, an advanced wavelet transform (aDWT) method that incorporates principal component analysis (PCA) and morphological processing into a regular DWT fusion algorithm is presented. Specifically, at each scale of the wavelet transformed images, a principle vector was derived from two input images and then applied to two of the images’ approximation coefficients (i.e., they were fused by using the principal eigenvector). For the detail coefficients (i.e., three quarters of the coefficients), the larger absolute values were chosen and subjected to a neighborhood morphological processing procedure which served to verify the selected pixels by using a “filling” and “cleaning” operation (this operation filled or removed isolated pixels in a 3-by-3 local region). The fusion performance of the advanced DWT (aDWT) method proposed here was compared with six other common methods, and, based on the four quantitative measures, was found to perform the best when tested on the four input image types. Since the different image sources used here varied with respect to intensity, contrast, noise, and intrinsic characteristics, the aDWT is a promising image fusion procedure for inhomogeneous imagery.

Citation Download Citation

Yufeng Zheng, Edward A. Essock, and Bruce C. Hansen "An advanced image fusion algorithm based on wavelet transform: incorporation with PCA and morphological processing", Proc. SPIE 5298, Image Processing: Algorithms and Systems III, (28 May 2004); https://doi.org/10.1117/12.523966

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available