29 July 2022 DAFuse: a fusion for infrared and visible images based on generative adversarial network
Xueyan Gao, Shiguang Liu
Author Affiliations +
Abstract

Infrared and visible image fusion is a popular research hotspot in the field of image processing. However, the existing fusion methods still have some limitations, such as insufficient use of intermediate information and inability to focus on features that are meaningful for fusion. To solve these problems, we propose an infrared and visible image fusion method based on generative adversarial networks with dense connection and attention mechanism (DAFuse). Since infrared and visible image are different modalities, we design two branches to extract the features in infrared and visible image, respectively. To make full use of the features extracted from the middle layer and make the model focus on useful information, we introduce the dense block, channel attention mechanism, and spatial attention mechanism into the generator. The self-attention model is incorporated into the discriminator. The proposed method not only retains rich texture detail features and sufficient contrast information but also conforms to human visual perception. Extensive qualitative and quantitative experimental results show that the proposed method has better performance in visual perception and quantitative evaluation than the existing state-of-the-art methods.

© 2022 SPIE and IS&T
Xueyan Gao and Shiguang Liu "DAFuse: a fusion for infrared and visible images based on generative adversarial network," Journal of Electronic Imaging 31(4), 043023 (29 July 2022). https://doi.org/10.1117/1.JEI.31.4.043023
Received: 23 March 2022; Accepted: 18 July 2022; Published: 29 July 2022
Lens.org Logo
CITATIONS
Cited by 9 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image fusion

Infrared imaging

Infrared radiation

Visible radiation

Feature extraction

Convolution

Network architectures

Back to Top