Revisiting Consistency Regularization for Semi-supervised Change
Detection in Remote Sensing Images
- URL: http://arxiv.org/abs/2204.08454v3
- Date: Thu, 21 Apr 2022 15:10:56 GMT
- Title: Revisiting Consistency Regularization for Semi-supervised Change
Detection in Remote Sensing Images
- Authors: Wele Gedara Chaminda Bandara and Vishal M. Patel
- Abstract summary: We propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss.
Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD.
- Score: 60.89777029184023
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Remote-sensing (RS) Change Detection (CD) aims to detect "changes of
interest" from co-registered bi-temporal images. The performance of existing
deep supervised CD methods is attributed to the large amounts of annotated data
used to train the networks. However, annotating large amounts of remote sensing
images is labor-intensive and expensive, particularly with bi-temporal images,
as it requires pixel-wise comparisons by a human expert. On the other hand, we
often have access to unlimited unlabeled multi-temporal RS imagery thanks to
ever-increasing earth observation programs. In this paper, we propose a simple
yet effective way to leverage the information from unlabeled bi-temporal images
to improve the performance of CD approaches. More specifically, we propose a
semi-supervised CD model in which we formulate an unsupervised CD loss in
addition to the supervised Cross-Entropy (CE) loss by constraining the output
change probability map of a given unlabeled bi-temporal image pair to be
consistent under the small random perturbations applied on the deep feature
difference map that is obtained by subtracting their latent feature
representations. Experiments conducted on two publicly available CD datasets
show that the proposed semi-supervised CD method can reach closer to the
performance of supervised CD even with access to as little as 10% of the
annotated training data. Code available at https://github.com/wgcban/SemiCD
Related papers
- SemiCD-VL: Visual-Language Model Guidance Makes Better Semi-supervised Change Detector [43.199838967666714]
Change Detection (CD) aims to identify pixels with semantic changes between images.
We propose a VLM guidance-based semi-supervised CD method, namely SemiCD-VL.
In this paper, we propose a VLM-based mixed change event generation (CEG) strategy to yield pseudo labels for unlabeled CD data.
arXiv Detail & Related papers (2024-05-08T03:43:58Z) - Toward distortion-aware change detection in realistic scenarios [16.192695430837443]
We propose a reusable self-supervised framework for bitemporal geometric distortion in CD tasks.
The framework is composed of Pretext Representation Pre-training, Bitemporal Image Alignment, and Down-stream Decoder Fine-Tuning.
With only single-stage pre-training, the key components of the framework can be reused for assistance in the bitemporal image alignment.
arXiv Detail & Related papers (2024-01-10T13:43:06Z) - UCDFormer: Unsupervised Change Detection Using a Transformer-driven
Image Translation [20.131754484570454]
Change detection (CD) by comparing two bi-temporal images is a crucial task in remote sensing.
We propose a change detection with domain shift setting for remote sensing images.
We present a novel unsupervised CD method using a light-weight transformer, called UCDFormer.
arXiv Detail & Related papers (2023-08-02T13:39:08Z) - Remote Sensing Change Detection With Transformers Trained from Scratch [62.96911491252686]
transformer-based change detection (CD) approaches either employ a pre-trained model trained on large-scale image classification ImageNet dataset or rely on first pre-training on another CD dataset and then fine-tuning on the target benchmark.
We develop an end-to-end CD approach with transformers that is trained from scratch and yet achieves state-of-the-art performance on four public benchmarks.
arXiv Detail & Related papers (2023-04-13T17:57:54Z) - Deep Metric Learning for Unsupervised Remote Sensing Change Detection [60.89777029184023]
Remote Sensing Change Detection (RS-CD) aims to detect relevant changes from Multi-Temporal Remote Sensing Images (MT-RSIs)
The performance of existing RS-CD methods is attributed to training on large annotated datasets.
This paper proposes an unsupervised CD method based on deep metric learning that can deal with both of these issues.
arXiv Detail & Related papers (2023-03-16T17:52:45Z) - D-Unet: A Dual-encoder U-Net for Image Splicing Forgery Detection and
Localization [108.8592577019391]
Image splicing forgery detection is a global binary classification task that distinguishes the tampered and non-tampered regions by image fingerprints.
We propose a novel network called dual-encoder U-Net (D-Unet) for image splicing forgery detection, which employs an unfixed encoder and a fixed encoder.
In an experimental comparison study of D-Unet and state-of-the-art methods, D-Unet outperformed the other methods in image-level and pixel-level detection.
arXiv Detail & Related papers (2020-12-03T10:54:02Z) - Anchor-free Small-scale Multispectral Pedestrian Detection [88.7497134369344]
We propose a method for effective and efficient multispectral fusion of the two modalities in an adapted single-stage anchor-free base architecture.
We aim at learning pedestrian representations based on object center and scale rather than direct bounding box predictions.
Results show our method's effectiveness in detecting small-scaled pedestrians.
arXiv Detail & Related papers (2020-08-19T13:13:01Z) - Gradient-Induced Co-Saliency Detection [81.54194063218216]
Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images.
In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection method.
arXiv Detail & Related papers (2020-04-28T08:40:55Z) - A Novel Inspection System For Variable Data Printing Using Deep Learning [0.9176056742068814]
We present a novel approach for inspecting variable data prints (VDP) with an ultra-low false alarm rate (0.005%)
The system is based on a comparison between two images: a reference image and an image captured by low-cost scanners.
arXiv Detail & Related papers (2020-01-13T15:07:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.