End-to-end Hyperspectral Image Change Detection Network Based on Band
Selection
- URL: http://arxiv.org/abs/2307.12327v2
- Date: Thu, 16 Nov 2023 13:06:47 GMT
- Title: End-to-end Hyperspectral Image Change Detection Network Based on Band
Selection
- Authors: Qingren Yao, Yuan Zhou, Chang Tang and Wei Xiang
- Abstract summary: We propose an end-to-end hyperspectral image change detection network with band selection (ECDBS)
The main ingredients of the network are a deep learning based band selection module and cascading band-specific spatial attention blocks.
Experimental evaluations conducted on three widely used HSI-CD datasets demonstrate the effectiveness and superiority of our proposed method.
- Score: 22.7908026248101
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: For hyperspectral image change detection (HSI-CD), one key challenge is to
reduce band redundancy, as only a few bands are crucial for change detection
while other bands may be adverse to it. However, most existing HSI-CD methods
directly extract change feature from full-dimensional HSIs, suffering from a
degradation of feature discrimination. To address this issue, we propose an
end-to-end hyperspectral image change detection network with band selection
(ECDBS), which effectively retains the critical bands to promote change
detection. The main ingredients of the network are a deep learning based band
selection module and cascading band-specific spatial attention (BSA) blocks.
The band selection module can be seamlessly integrated with subsequent CD
models for joint optimization and end-to-end reasoning, rather than as a step
separate from change detection. The BSA block extracts features from each band
using a tailored strategy. Unlike the typically used feature extraction
strategy that uniformly processes all bands, the BSA blocks considers the
differences in feature distributions among widely spaced bands, thereupon
extracting more sufficient change feature. Experimental evaluations conducted
on three widely used HSI-CD datasets demonstrate the effectiveness and
superiority of our proposed method over other state-of-the-art techniques.
Related papers
- STeInFormer: Spatial-Temporal Interaction Transformer Architecture for Remote Sensing Change Detection [5.4610555622532475]
We present STeInFormer, a spatial-temporal interaction Transformer architecture for multi-temporal feature extraction.
We also propose a parameter-free multi-frequency token mixer to integrate frequency-domain features that provide spectral information for RSCD.
arXiv Detail & Related papers (2024-12-23T03:40:04Z) - Wavelet-based Bi-dimensional Aggregation Network for SAR Image Change Detection [53.842568573251214]
Experimental results on three SAR datasets demonstrate that our WBANet significantly outperforms contemporary state-of-the-art methods.
Our WBANet achieves 98.33%, 96.65%, and 96.62% of percentage of correct classification (PCC) on the respective datasets.
arXiv Detail & Related papers (2024-07-18T04:36:10Z) - Unsupervised Band Selection Using Fused HSI and LiDAR Attention Integrating With Autoencoder [16.742768644585684]
Band selection in hyperspectral imaging (HSI) is critical for optimising data processing and enhancing analytical accuracy.
Traditional approaches have predominantly concentrated on analysing spectral and pixel characteristics within individual bands independently.
This paper introduces a novel unsupervised band selection framework that incorporates attention mechanisms and an Autoencoder for reconstruction-based band selection.
arXiv Detail & Related papers (2024-04-08T07:47:28Z) - Dropout Concrete Autoencoder for Band Selection on HSI Scenes [17.318853428846847]
This work proposes a novel end-to-end network for informative band selection on hyperspectral images.
The proposed network is inspired by the advances in concrete autoencoder (CAE) and dropout feature ranking strategy.
Experimental results on four HSI scenes show that the proposed dropout CAE achieves substantial and effective performance levels.
arXiv Detail & Related papers (2024-01-29T19:53:17Z) - Embedded Hyperspectral Band Selection with Adaptive Optimization for
Image Semantic Segmentation [0.0]
We introduce a pioneering approach for hyperspectral band selection that offers an embedded solution.
Our proposed method, embedded Hyperspectral Band Selection (EHBS), excels in selecting the best bands without the need for prior processing.
The adaptability of our approach to other tasks opens up promising avenues for broader applications.
arXiv Detail & Related papers (2024-01-21T07:48:39Z) - Frequency Domain Modality-invariant Feature Learning for
Visible-infrared Person Re-Identification [79.9402521412239]
We propose a novel Frequency Domain modality-invariant feature learning framework (FDMNet) to reduce modality discrepancy from the frequency domain perspective.
Our framework introduces two novel modules, namely the Instance-Adaptive Amplitude Filter (IAF) and the Phrase-Preserving Normalization (PPNorm)
arXiv Detail & Related papers (2024-01-03T17:11:27Z) - One-shot neural band selection for spectral recovery [15.565913045545066]
We present a novel one-shot Neural Band Selection (NBS) framework for spectral recovery.
Our NBS is based on the continuous relaxation of the band selection process, thus allowing efficient band search using gradient descent.
Our code will be publicly available.
arXiv Detail & Related papers (2023-05-16T07:34:03Z) - ADPS: Asymmetric Distillation Post-Segmentation for Image Anomaly
Detection [75.68023968735523]
Knowledge Distillation-based Anomaly Detection (KDAD) methods rely on the teacher-student paradigm to detect and segment anomalous regions.
We propose an innovative approach called Asymmetric Distillation Post-Segmentation (ADPS)
Our ADPS employs an asymmetric distillation paradigm that takes distinct forms of the same image as the input of the teacher-student networks.
We show that ADPS significantly improves Average Precision (AP) metric by 9% and 20% on the MVTec AD and KolektorSDD2 datasets.
arXiv Detail & Related papers (2022-10-19T12:04:47Z) - Coarse-to-Fine Sparse Transformer for Hyperspectral Image Reconstruction [138.04956118993934]
We propose a novel Transformer-based method, coarse-to-fine sparse Transformer (CST)
CST embedding HSI sparsity into deep learning for HSI reconstruction.
In particular, CST uses our proposed spectra-aware screening mechanism (SASM) for coarse patch selecting. Then the selected patches are fed into our customized spectra-aggregation hashing multi-head self-attention (SAH-MSA) for fine pixel clustering and self-similarity capturing.
arXiv Detail & Related papers (2022-03-09T16:17:47Z) - Hyperspectral Band Selection for Multispectral Image Classification with
Convolutional Networks [0.0]
We propose a novel band selection method to select a reduced set of wavelengths from hyperspectral images.
We show that our method produces more suitable results for a multispectral sensor design.
arXiv Detail & Related papers (2021-06-01T17:24:35Z) - Dual-Cross Central Difference Network for Face Anti-Spoofing [54.81222020394219]
Face anti-spoofing (FAS) plays a vital role in securing face recognition systems.
Central difference convolution (CDC) has shown its excellent representation capacity for the FAS task.
We propose two Cross Central Difference Convolutions (C-CDC), which exploit the difference of the center and surround sparse local features.
arXiv Detail & Related papers (2021-05-04T05:11:47Z) - RGB-D Salient Object Detection with Cross-Modality Modulation and
Selection [126.4462739820643]
We present an effective method to progressively integrate and refine the cross-modality complementarities for RGB-D salient object detection (SOD)
The proposed network mainly solves two challenging issues: 1) how to effectively integrate the complementary information from RGB image and its corresponding depth map, and 2) how to adaptively select more saliency-related features.
arXiv Detail & Related papers (2020-07-14T14:22:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.