Exploring Effective Priors and Efficient Models for Weakly-Supervised Change Detection

• URL: http://arxiv.org/abs/2307.10853v4
• Date: Thu, 11 Apr 2024 01:56:38 GMT
• Title: Exploring Effective Priors and Efficient Models for Weakly-Supervised Change Detection
• Authors: Zhenghui Zhao, Lixiang Ru, Chen Wu,
• Abstract summary: Weakly-supervised change detection (WSCD) aims to detect pixel-level changes with only image-level annotations. We propose two components: a Dilated Prior (DP) decoder and a Label Gated (LG) constraint. Our proposed TransWCD and TransWCD-DL achieve significant +6.33% and +9.55% F1 score improvements over the state-of-the-art methods on the WHU-CD dataset.
• Score: 9.229278131265124
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Weakly-supervised change detection (WSCD) aims to detect pixel-level changes with only image-level annotations. Owing to its label efficiency, WSCD is drawing increasing attention recently. However, current WSCD methods often encounter the challenge of change missing and fabricating, i.e., the inconsistency between image-level annotations and pixel-level predictions. Specifically, change missing refer to the situation that the WSCD model fails to predict any changed pixels, even though the image-level label indicates changed, and vice versa for change fabricating. To address this challenge, in this work, we leverage global-scale and local-scale priors in WSCD and propose two components: a Dilated Prior (DP) decoder and a Label Gated (LG) constraint. The DP decoder decodes samples with the changed image-level label, skips samples with the unchanged label, and replaces them with an all-unchanged pixel-level label. The LG constraint is derived from the correspondence between changed representations and image-level labels, penalizing the model when it mispredicts the change status. Additionally, we develop TransWCD, a simple yet powerful transformer-based model, showcasing the potential of weakly-supervised learning in change detection. By integrating the DP decoder and LG constraint into TransWCD, we form TransWCD-DL. Our proposed TransWCD and TransWCD-DL achieve significant +6.33% and +9.55% F1 score improvements over the state-of-the-art methods on the WHU-CD dataset, respectively. Some performance metrics even exceed several fully-supervised change detection (FSCD) competitors. Code will be available at https://github.com/zhenghuizhao/TransWCD.

Related papers

• SemiCD-VL: Visual-Language Model Guidance Makes Better Semi-supervised Change Detector [43.199838967666714]
  Change Detection (CD) aims to identify pixels with semantic changes between images. We propose a VLM guidance-based semi-supervised CD method, namely SemiCD-VL. In this paper, we propose a VLM-based mixed change event generation (CEG) strategy to yield pseudo labels for unlabeled CD data.
  arXiv  Detail & Related papers  (2024-05-08T03:43:58Z)
• Pixel-Level Change Detection Pseudo-Label Learning for Remote Sensing Change Captioning [28.3763053922823]
  Methods for Remote Sensing Image Change Captioning (RSICC) perform well in simple scenes but exhibit poorer performance in complex scenes. We believe pixel-level CD is significant for describing the differences between images through language. Our method achieves state-of-the-art performance and validate that learning pixel-level CD pseudo-labels significantly contributes to change captioning.
  arXiv  Detail & Related papers  (2023-12-23T17:58:48Z)
• Changes-Aware Transformer: Learning Generalized Changes Representation [56.917000244470174]
  We propose a novel Changes-Aware Transformer (CAT) for refining difference features. The generalized representation of various changes is learned straightforwardly in the difference feature space. After refinement, the changed pixels in the difference feature space are closer to each other, which facilitates change detection.
  arXiv  Detail & Related papers  (2023-09-24T12:21:57Z)
• UCDFormer: Unsupervised Change Detection Using a Transformer-driven Image Translation [20.131754484570454]
  Change detection (CD) by comparing two bi-temporal images is a crucial task in remote sensing. We propose a change detection with domain shift setting for remote sensing images. We present a novel unsupervised CD method using a light-weight transformer, called UCDFormer.
  arXiv  Detail & Related papers  (2023-08-02T13:39:08Z)
• GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature Guided DDPM [7.922421805234563]
  Deep learning methods have recently shown great promise in bitemporal change detection (CD) This work proposes a generative change detection model called GCD-DDPM to directly generate CD maps. Experiments on four high-resolution CD datasets confirm the superior performance of the proposed GCD-DDPM.
  arXiv  Detail & Related papers  (2023-06-06T05:51:50Z)
• Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
  Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs) The performance of existing RS-CD methods is attributed to training on large annotated datasets. This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
  arXiv  Detail & Related papers  (2023-03-16T17:52:45Z)
• SoftMatch Distance: A Novel Distance for Weakly-Supervised Trend Change Detection in Bi-Temporal Images [45.138953422578574]
  General change detection (GCD) and semantic change detection (SCD) are common methods for identifying changes and distinguishing object categories involved in those changes, respectively. We propose a novel solution that intuitively dividing changes into three trends (appear'', disappear'' and transform'') instead of semantic categories, named it trend change detection (TCD) in this paper. It offers more detailed change information than GCD, while requiring less manual annotation cost than SCD.
  arXiv  Detail & Related papers  (2023-03-08T17:23:18Z)
• Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images [60.89777029184023]
  We propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss. Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD.
  arXiv  Detail & Related papers  (2022-04-18T17:59:01Z)
• DSNet: A Dual-Stream Framework for Weakly-Supervised Gigapixel Pathology Image Analysis [78.78181964748144]
  We present a novel weakly-supervised framework for classifying whole slide images (WSIs) WSIs are commonly processed by patch-wise classification with patch-level labels. With image-level labels only, patch-wise classification would be sub-optimal due to inconsistency between the patch appearance and image-level label.
  arXiv  Detail & Related papers  (2021-09-13T09:10:43Z)
• A Weakly Supervised Convolutional Network for Change Segmentation and Classification [91.3755431537592]
  We present W-CDNet, a novel weakly supervised change detection network that can be trained with image-level semantic labels. W-CDNet can be trained with two different types of datasets, either containing changed image pairs only or a mixture of changed and unchanged image pairs.
  arXiv  Detail & Related papers  (2020-11-06T20:20:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.