15 May 2023 HFC-SST: improved spatial-spectral transformer for hyperspectral few-shot classification
Zhiquan Huang, Haojin Tang, Yanshan Li, Weixin Xie
Author Affiliations +
Abstract

Owing to the complex environment of hyperspectral image (HSI) collecting area, it is difficult to obtain an extensive number of labeled samples for HSI. Recently, many few-shot learning (FSL) algorithms based on convolutional neural network (CNN) have been employed for HSI classification in the scenery of small-scale training samples. However, a CNN-based model is unsuitable for modeling the spatial-spectral information with long-range dependency. The transformer has proved its superiority in modeling the long-range dependency. Inspired by this, an improved spatial-spectral transformer for HSI few-shot classification (HFC-SST) is proposed to deeply extract the local spatial-spectral information with only a few labeled samples. The contribution of this letter is twofold. First, a local spatial-spectral sequence generation method based on spatial-spectral correlation analysis and adjacent position information is proposed to generate the input sequence for transformer. Second, a local spatial-spectral feature extraction network based on the transformer is proposed to further exploit the spatial-spectral feature information on the input sequence. Experimental results on HFC with four datasets confirm that our proposed HFC-SST algorithm can achieve higher classification accuracy than the traditional CNN algorithms and the HSI FSL algorithms.

© 2023 Society of Photo-Optical Instrumentation Engineers (SPIE)
Zhiquan Huang, Haojin Tang, Yanshan Li, and Weixin Xie "HFC-SST: improved spatial-spectral transformer for hyperspectral few-shot classification," Journal of Applied Remote Sensing 17(2), 026509 (15 May 2023). https://doi.org/10.1117/1.JRS.17.026509
Received: 3 May 2022; Accepted: 25 April 2023; Published: 15 May 2023
Lens.org Logo
CITATIONS
Cited by 4 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Transformers

Autocorrelation

Feature extraction

Education and training

Detection and tracking algorithms

Modeling

Statistical modeling

Back to Top