Fusion of hyperspectral and multispectral image by dual residual dense networks

Kang Qiu; Benshun Yi; Mian Xiang; Zheng Xiao

doi:10.1117/1.OE.58.2.023110

21 February 2019 Fusion of hyperspectral and multispectral image by dual residual dense networks

Kang Qiu, Benshun Yi, Mian Xiang, Zheng Xiao

Author Affiliations +

Optical Engineering, Vol. 58, Issue 2, 023110 (February 2019). https://doi.org/10.1117/1.OE.58.2.023110

Abstract

The spatial resolution of hyperspectral image (HSI) is severely limited as a cost for higher spectral resolution. We propose a deep learning-based HSI super resolution method named dual residual dense networks (DRDNs) to overcome the resolution limitation by fusing low-resolution (LR) HSI and high-resolution (HR) multispectral image (MSI). The proposed model uses two symmetric subnets based on residual dense block to fully exploit deep features from HR-MSI and LR-HSI, respectively. Then the features are fused through a feature fusion subnet to generate the final reconstructed HR-HSI. Our DRDNs have realized end-to-end mapping from the original input of LR-HSI and HR-MSI to the desired HR-HSI directly. All the parameters are trained through a unified framework. Some experiments are also carried out to evaluate the performance of our proposed method. The results show that our proposed method gains significant improvement in simultaneously enhancing spatial resolution and preserving spectral consistency when compared to other HSI/MSI fusion methods proposed recently.

Citation Download Citation

Kang Qiu, Benshun Yi, Mian Xiang, and Zheng Xiao "Fusion of hyperspectral and multispectral image by dual residual dense networks," Optical Engineering 58(2), 023110 (21 February 2019). https://doi.org/10.1117/1.OE.58.2.023110

Received: 9 August 2018; Accepted: 29 January 2019; Published: 21 February 2019

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available