Infrared visible color night vision image fusion based on deep learning

Yan Zou; Linfei Zhang; Chengqian Liu; Bowen Wang; Yan Hu; Qian Chen

doi:10.1117/12.2592791

5 March 2021 Infrared visible color night vision image fusion based on deep learning

Yan Zou, Linfei Zhang, Chengqian Liu, Bowen Wang, Yan Hu, Qian Chen

Proceedings Volume 11703, AI and Optical Data Sciences II; 117031S (2021) https://doi.org/10.1117/12.2592791
Event: SPIE OPTO, 2021, Online Only

Conference Poster

Abstract

In recent decades, with the rapid development of image sensor technology, image acquisition has gradually evolved from a single sensor mode to a multi-sensor mode. The data information obtained by a single sensor is limited, and the use of multi-source data fusion can provide a more accurate understanding of the observation scene. This paper proposes a network structure of infrared visible color night vision image fusion based on deep learning. The network adopts a fusion-encoding-decoding structure for end-to-end learning to achieve the purpose of color night vision image fusion, making the image more in line with human visual effects. The fusion structure contains a multi-scale feature extraction block and a channel attention block, which perform feature extraction on low-resolution infrared images and visible images respectively. The multi-scale feature block can expand the receptive field and avoid losing too much feature information. The channel attention block can improve the sensitivity of the network to channel characteristics. A certain number of convolutional layers and deconvolutional layers are used in the network to realize the encoding and decoding of the feature map to achieve the purpose of restoring the color fusion image. After experimental verification, our method has a good fusion effect, rich colors, and conforms to the human visual effect.

Citation Download Citation

Yan Zou, Linfei Zhang, Chengqian Liu, Bowen Wang, Yan Hu, and Qian Chen "Infrared visible color night vision image fusion based on deep learning", Proc. SPIE 11703, AI and Optical Data Sciences II, 117031S (5 March 2021); https://doi.org/10.1117/12.2592791

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available