Translator Disclaimer
21 February 2019 Fusion of hyperspectral and multispectral image by dual residual dense networks
Author Affiliations +
The spatial resolution of hyperspectral image (HSI) is severely limited as a cost for higher spectral resolution. We propose a deep learning-based HSI super resolution method named dual residual dense networks (DRDNs) to overcome the resolution limitation by fusing low-resolution (LR) HSI and high-resolution (HR) multispectral image (MSI). The proposed model uses two symmetric subnets based on residual dense block to fully exploit deep features from HR-MSI and LR-HSI, respectively. Then the features are fused through a feature fusion subnet to generate the final reconstructed HR-HSI. Our DRDNs have realized end-to-end mapping from the original input of LR-HSI and HR-MSI to the desired HR-HSI directly. All the parameters are trained through a unified framework. Some experiments are also carried out to evaluate the performance of our proposed method. The results show that our proposed method gains significant improvement in simultaneously enhancing spatial resolution and preserving spectral consistency when compared to other HSI/MSI fusion methods proposed recently.
© 2019 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2019/$25.00 © 2019 SPIE
Kang Qiu, Benshun Yi, Mian Xiang, and Zheng Xiao "Fusion of hyperspectral and multispectral image by dual residual dense networks," Optical Engineering 58(2), 023110 (21 February 2019).
Received: 9 August 2018; Accepted: 29 January 2019; Published: 21 February 2019

Back to Top