ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model

• URL: http://arxiv.org/abs/2404.08892v1
• Date: Sat, 13 Apr 2024 03:46:35 GMT
• Title: ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model
• Authors: Kai Tang, Jin Chen,
• Abstract summary: ChangeAnywhere is a novel CD sample generation method using the semantic latent diffusion model and single-temporal images. ChangeAnywhere captures the two essentials of CD samples, i.e. change implies semantically different, and non-change implies reasonable change under the same semantic constraints. The ChangeAnywhere-100K significantly improved both zero-shot and few-shot performance on two CD benchmark datasets for various deep learning-based CD models.
• Score: 4.677012401985776
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Remote sensing change detection (CD) is a pivotal technique that pinpoints changes on a global scale based on multi-temporal images. With the recent expansion of deep learning, supervised deep learning-based CD models have shown satisfactory performance. However, CD sample labeling is very time-consuming as it is densely labeled and requires expert knowledge. To alleviate this problem, we introduce ChangeAnywhere, a novel CD sample generation method using the semantic latent diffusion model and single-temporal images. Specifically, ChangeAnywhere leverages the relative ease of acquiring large single-temporal semantic datasets to generate large-scale, diverse, and semantically annotated bi-temporal CD datasets. ChangeAnywhere captures the two essentials of CD samples, i.e., change implies semantically different, and non-change implies reasonable change under the same semantic constraints. We generated ChangeAnywhere-100K, the largest synthesis CD dataset with 100,000 pairs of CD samples based on the proposed method. The ChangeAnywhere-100K significantly improved both zero-shot and few-shot performance on two CD benchmark datasets for various deep learning-based CD models, as demonstrated by transfer experiments. This paper delineates the enormous potential of ChangeAnywhere for CD sample generation and demonstrates the subsequent enhancement of model performance. Therefore, ChangeAnywhere offers a potent tool for remote sensing CD. All codes and pre-trained models will be available at https://github.com/tangkai-RS/ChangeAnywhere.

Related papers

• SeFi-CD: A Semantic First Change Detection Paradigm That Can Detect Any Change You Want [3.8287068443608567]
  This paper introduces a new CD paradigm, the semantic-first CD (SeFi-CD) paradigm. The core idea of SeFi-CD is to first perceive the dynamic semantics of interest and then visually search for change features related to the semantics. Experiments on public datasets demonstrate that the AUWCD outperforms the current state-of-the-art CD methods.
  arXiv  Detail & Related papers  (2024-07-13T12:49:58Z)
• Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model [62.337749660637755]
  We present change data generators based on generative models which are cheap and automatic. Changen2 is a generative change foundation model that can be trained at scale via self-supervision. The resulting model possesses inherent zero-shot change detection capabilities and excellent transferability.
  arXiv  Detail & Related papers  (2024-06-26T01:03:39Z)
• A New Learning Paradigm for Foundation Model-based Remote Sensing Change Detection [54.01158175996638]
  Change detection (CD) is a critical task to observe and analyze dynamic processes of land cover. We propose a Bi-Temporal Adapter Network (BAN), which is a universal foundation model-based CD adaptation framework.
  arXiv  Detail & Related papers  (2023-12-02T15:57:17Z)
• TransY-Net:Learning Fully Transformer Networks for Change Detection of Remote Sensing Images [64.63004710817239]
  We propose a novel Transformer-based learning framework named TransY-Net for remote sensing image CD. It improves the feature extraction from a global view and combines multi-level visual features in a pyramid manner. Our proposed method achieves a new state-of-the-art performance on four optical and two SAR image CD benchmarks.
  arXiv  Detail & Related papers  (2023-10-22T07:42:19Z)
• GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM [7.922421805234563]
  Deep learning methods have recently shown great promise in bitemporal change detection (CD) This work proposes a generative change detection model called GCD-DDPM to directly generate CD maps. Experiments on four high-resolution CD datasets confirm the superior performance of the proposed GCD-DDPM.
  arXiv  Detail & Related papers  (2023-06-06T05:51:50Z)
• Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
  Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs) The performance of existing RS-CD methods is attributed to training on large annotated datasets. This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
  arXiv  Detail & Related papers  (2023-03-16T17:52:45Z)
• SoftMatch Distance: A Novel Distance for Weakly-Supervised Trend Change Detection in Bi-Temporal Images [45.138953422578574]
  General change detection (GCD) and semantic change detection (SCD) are common methods for identifying changes and distinguishing object categories involved in those changes, respectively. We propose a novel solution that intuitively dividing changes into three trends (appear'', disappear'' and transform'') instead of semantic categories, named it trend change detection (TCD) in this paper. It offers more detailed change information than GCD, while requiring less manual annotation cost than SCD.
  arXiv  Detail & Related papers  (2023-03-08T17:23:18Z)
• Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images [60.89777029184023]
  We propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss. Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD.
  arXiv  Detail & Related papers  (2022-04-18T17:59:01Z)
• DSDANet: Deep Siamese Domain Adaptation Convolutional Neural Network for Cross-domain Change Detection [44.05317423742678]
  We propose a novel deep siamese domain adaptation convolutional neural network architecture for cross-domain change detection. To the best of our knowledge, it is the first time that such a domain adaptation-based deep network is proposed for change detection.
  arXiv  Detail & Related papers  (2020-06-16T15:00:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.