EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detection

• URL: http://arxiv.org/abs/2303.13753v1
• Date: Fri, 24 Mar 2023 02:11:22 GMT
• Title: EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detection
• Authors: Meiqi Hu, Chen Wu, Bo Du
• Abstract summary: We have proposed an original Efficient Multi-temporal Self-attention Network (EMS-Net) for hyperspectral change detection. EMS-Net cuts redundancy of those similar and containing-no-changes feature maps, computing efficient multi-temporal change information for precise binary change map. Experiments implemented on two hyperspectral change detection datasets manifests the out-standing performance and validity of proposed method.
• Score: 32.23764287942984
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Hyperspectral change detection plays an essential role of monitoring the dynamic urban development and detecting precise fine object evolution and alteration. In this paper, we have proposed an original Efficient Multi-temporal Self-attention Network (EMS-Net) for hyperspectral change detection. The designed EMS module cuts redundancy of those similar and containing-no-changes feature maps, computing efficient multi-temporal change information for precise binary change map. Besides, to explore the clustering characteristics of the change detection, a novel supervised contrastive loss is provided to enhance the compactness of the unchanged. Experiments implemented on two hyperspectral change detection datasets manifests the out-standing performance and validity of proposed method.

Related papers

• Enhancing Perception of Key Changes in Remote Sensing Image Change Captioning [49.24306593078429]
  We propose a novel framework for remote sensing image change captioning, guided by Key Change Features and Instruction-tuned (KCFI) KCFI includes a ViTs encoder for extracting bi-temporal remote sensing image features, a key feature perceiver for identifying critical change areas, and a pixel-level change detection decoder. To validate the effectiveness of our approach, we compare it against several state-of-the-art change captioning methods on the LEVIR-CC dataset.
  arXiv  Detail & Related papers  (2024-09-19T09:33:33Z)
• ChangeViT: Unleashing Plain Vision Transformers for Change Detection [3.582733645632794]
  ChangeViT is a framework that adopts a plain ViT backbone to enhance the performance of large-scale changes. The framework achieves state-of-the-art performance on three popular high-resolution datasets.
  arXiv  Detail & Related papers  (2024-06-18T17:59:08Z)
• HANet: A Hierarchical Attention Network for Change Detection With Bitemporal Very-High-Resolution Remote Sensing Images [6.890268321645873]
  We propose a progressive foreground-balanced sampling strategy on the basis of not adding change information. This strategy helps the model accurately learn the features of the changed pixels during the early training process. We also design a discriminative Siamese network, hierarchical attention network (HANet), which can integrate multiscale features and refine detailed features.
  arXiv  Detail & Related papers  (2024-04-14T08:01:27Z)
• Segment Any Change [64.23961453159454]
  We propose a new type of change detection model that supports zero-shot prediction and generalization on unseen change types and data distributions. AnyChange is built on the segment anything model (SAM) via our training-free adaptation method, bitemporal latent matching. We also propose a point query mechanism to enable AnyChange's zero-shot object-centric change detection capability.
  arXiv  Detail & Related papers  (2024-02-02T07:17:39Z)
• MS-Former: Memory-Supported Transformer for Weakly Supervised Change Detection with Patch-Level Annotations [50.79913333804232]
  We propose a memory-supported transformer (MS-Former) for weakly supervised change detection. MS-Former consists of a bi-directional attention block (BAB) and a patch-level supervision scheme (PSS) Experimental results on three benchmark datasets demonstrate the effectiveness of our proposed method in the change detection task.
  arXiv  Detail & Related papers  (2023-11-16T09:57:29Z)
• Cal-DETR: Calibrated Detection Transformer [67.75361289429013]
  We propose a mechanism for calibrated detection transformers (Cal-DETR), particularly for Deformable-DETR, UP-DETR and DINO. We develop an uncertainty-guided logit modulation mechanism that leverages the uncertainty to modulate the class logits. Results corroborate the effectiveness of Cal-DETR against the competing train-time methods in calibrating both in-domain and out-domain detections.
  arXiv  Detail & Related papers  (2023-11-06T22:13:10Z)
• Transformer-based Multimodal Change Detection with Multitask Consistency Constraints [10.906283981247796]
  Current change detection methods struggle with the multitask conflicts between semantic and height change detection tasks. We propose an efficient Transformer-based network that learns shared representation between cross-dimensional inputs through cross-attention. Compared to five state-of-the-art change detection methods, our model demonstrates consistent multitask superiority in terms of semantic and height change detection.
  arXiv  Detail & Related papers  (2023-10-13T17:38:45Z)
• Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
  Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs) The performance of existing RS-CD methods is attributed to training on large annotated datasets. This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
  arXiv  Detail & Related papers  (2023-03-16T17:52:45Z)
• Binary Change Guided Hyperspectral Multiclass Change Detection [40.225584259198634]
  We propose an unsupervised Binary Change Guided hyperspectral multiclass change detection Network (BCG-Net) for HMCD. In BCG-Net, a novel partial-siamese united-unmixing module is designed for multi-temporal spectral unmixing. An innovative binary change detection rule is put forward to deal with the problem that traditional rule is susceptible to numerical values.
  arXiv  Detail & Related papers  (2021-12-08T13:17:24Z)
• Semantic Change Detection with Asymmetric Siamese Networks [71.28665116793138]
  Given two aerial images, semantic change detection aims to locate the land-cover variations and identify their change types with pixel-wise boundaries. This problem is vital in many earth vision related tasks, such as precise urban planning and natural resource management. We present an asymmetric siamese network (ASN) to locate and identify semantic changes through feature pairs obtained from modules of widely different structures.
  arXiv  Detail & Related papers  (2020-10-12T13:26:30Z)
• DASNet: Dual attentive fully convolutional siamese networks for change detection of high resolution satellite images [17.839181739760676]
  The research objective is to identity the change information of interest and filter out the irrelevant change information as interference factors. Recently, the rise of deep learning has provided new tools for change detection, which have yielded impressive results. We propose a new method, namely, dual attentive fully convolutional Siamese networks (DASNet) for change detection in high-resolution images.
  arXiv  Detail & Related papers  (2020-03-07T16:57:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.