SeFi-CD: A Semantic First Change Detection Paradigm That Can Detect Any Change You Want

• URL: http://arxiv.org/abs/2407.09874v1
• Date: Sat, 13 Jul 2024 12:49:58 GMT
• Title: SeFi-CD: A Semantic First Change Detection Paradigm That Can Detect Any Change You Want
• Authors: Ling Zhao, Zhenyang Huang, Dongsheng Kuang, Chengli Peng, Jun Gan, Haifeng Li,
• Abstract summary: This paper introduces a new CD paradigm, the semantic-first CD (SeFi-CD) paradigm. The core idea of SeFi-CD is to first perceive the dynamic semantics of interest and then visually search for change features related to the semantics. Experiments on public datasets demonstrate that the AUWCD outperforms the current state-of-the-art CD methods.
• Score: 3.8287068443608567
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The existing change detection(CD) methods can be summarized as the visual-first change detection (ViFi-CD) paradigm, which first extracts change features from visual differences and then assigns them specific semantic information. However, CD is essentially dependent on change regions of interest (CRoIs), meaning that the CD results are directly determined by the semantics changes of interest, making its primary image factor semantic of interest rather than visual. The ViFi-CD paradigm can only assign specific semantics of interest to specific change features extracted from visual differences, leading to the inevitable omission of potential CRoIs and the inability to adapt to different CRoI CD tasks. In other words, changes in other CRoIs cannot be detected by the ViFi-CD method without retraining the model or significantly modifying the method. This paper introduces a new CD paradigm, the semantic-first CD (SeFi-CD) paradigm. The core idea of SeFi-CD is to first perceive the dynamic semantics of interest and then visually search for change features related to the semantics. Based on the SeFi-CD paradigm, we designed Anything You Want Change Detection (AUWCD). Experiments on public datasets demonstrate that the AUWCD outperforms the current state-of-the-art CD methods, achieving an average F1 score 5.01\% higher than that of these advanced supervised baselines on the SECOND dataset, with a maximum increase of 13.17\%. The proposed SeFi-CD offers a novel CD perspective and approach.

Related papers

• ChangeAnywhere: Sample Generation for Remote Sensing Change Detection via Semantic Latent Diffusion Model [4.677012401985776]
  ChangeAnywhere is a novel CD sample generation method using the semantic latent diffusion model and single-temporal images. ChangeAnywhere captures the two essentials of CD samples, i.e. change implies semantically different, and non-change implies reasonable change under the same semantic constraints. The ChangeAnywhere-100K significantly improved both zero-shot and few-shot performance on two CD benchmark datasets for various deep learning-based CD models.
  arXiv  Detail & Related papers  (2024-04-13T03:46:35Z)
• Cross-Domain Few-Shot Object Detection via Enhanced Open-Set Object Detector [72.05791402494727]
  This paper studies the challenging cross-domain few-shot object detection (CD-FSOD) It aims to develop an accurate object detector for novel domains with minimal labeled examples.
  arXiv  Detail & Related papers  (2024-02-05T15:25:32Z)
• Pixel-Level Change Detection Pseudo-Label Learning for Remote Sensing Change Captioning [28.3763053922823]
  Methods for Remote Sensing Image Change Captioning (RSICC) perform well in simple scenes but exhibit poorer performance in complex scenes. We believe pixel-level CD is significant for describing the differences between images through language. Our method achieves state-of-the-art performance and validate that learning pixel-level CD pseudo-labels significantly contributes to change captioning.
  arXiv  Detail & Related papers  (2023-12-23T17:58:48Z)
• Changes-Aware Transformer: Learning Generalized Changes Representation [56.917000244470174]
  We propose a novel Changes-Aware Transformer (CAT) for refining difference features. The generalized representation of various changes is learned straightforwardly in the difference feature space. After refinement, the changed pixels in the difference feature space are closer to each other, which facilitates change detection.
  arXiv  Detail & Related papers  (2023-09-24T12:21:57Z)
• GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM [7.922421805234563]
  Deep learning methods have recently shown great promise in bitemporal change detection (CD) This work proposes a generative change detection model called GCD-DDPM to directly generate CD maps. Experiments on four high-resolution CD datasets confirm the superior performance of the proposed GCD-DDPM.
  arXiv  Detail & Related papers  (2023-06-06T05:51:50Z)
• Remote Sensing Change Detection With Transformers Trained from Scratch [62.96911491252686]
  transformer-based change detection (CD) approaches either employ a pre-trained model trained on large-scale image classification ImageNet dataset or rely on first pre-training on another CD dataset and then fine-tuning on the target benchmark. We develop an end-to-end CD approach with transformers that is trained from scratch and yet achieves state-of-the-art performance on four public benchmarks.
  arXiv  Detail & Related papers  (2023-04-13T17:57:54Z)
• Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
  Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs) The performance of existing RS-CD methods is attributed to training on large annotated datasets. This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
  arXiv  Detail & Related papers  (2023-03-16T17:52:45Z)
• SoftMatch Distance: A Novel Distance for Weakly-Supervised Trend Change Detection in Bi-Temporal Images [45.138953422578574]
  General change detection (GCD) and semantic change detection (SCD) are common methods for identifying changes and distinguishing object categories involved in those changes, respectively. We propose a novel solution that intuitively dividing changes into three trends (appear'', disappear'' and transform'') instead of semantic categories, named it trend change detection (TCD) in this paper. It offers more detailed change information than GCD, while requiring less manual annotation cost than SCD.
  arXiv  Detail & Related papers  (2023-03-08T17:23:18Z)
• How to Reduce Change Detection to Semantic Segmentation [27.82117563417494]
  Change detection (CD) aims to identify changes that occur in an image pair taken different times. We propose a new paradigm that reduces CD to semantic segmentation. We also propose C-3PO, a network to detect changes at pixel-level.
  arXiv  Detail & Related papers  (2022-06-15T14:16:30Z)
• Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images [60.89777029184023]
  We propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss. Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD.
  arXiv  Detail & Related papers  (2022-04-18T17:59:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.