Projects per year
Abstract
Recently, transformers have achieved great success in a number of computer vision tasks due to their excellent ability to capture long-range feature dependencies. In contrast, convolutional neural networks (CNNs) are good at extracting local features. Given that the capture of short- and long-range band dependencies are both important for hyperspectral data classification, we propose MCE-ST, a convolution-transformer (conformer) based framework capable of exploiting the complementary strengths of transformers and CNNs. In contrast to the conventional transformer, which uses a linear projection for tokenization, the proposed MCE-ST uses a convolution-based tokenization method to extract local dependency between spectral bands. Moreover, since different hyperspectral samples may have different spans of local relationships, a multiscale conformer encoder (MCE) comprising two separate branches of depth-wise dilated convolution with different kernel sizes is used to extract the different spans of the local interactions between tokens. We conducted experiments on four salt stress datasets and one cassava disease dataset. The results show that the proposed MCE-ST outperforms the state-of-the-art techniques for crop stress classification using hyperspectral data. The code for MCE-ST is publicly available at https://github.com/Weejaa04/MCE-ST-GitHub.
Original language | English |
---|---|
Article number | 103286 |
Journal | International Journal of Applied Earth Observation and Geoinformation |
Volume | 118 |
DOIs | |
Publication status | Published - Apr 2023 |
Fingerprint
Dive into the research topics of 'MCE-ST: Classifying crop stress using hyperspectral data with a multiscale conformer encoder and spectral-based tokens'. Together they form a unique fingerprint.Projects
- 1 Active
-
Intelligent Virtual Human Companions
Bennamoun, M. (Investigator 01), Laga, H. (Investigator 02) & Boussaid, F. (Investigator 03)
ARC Australian Research Council
31/12/21 → 30/12/25
Project: Research