Specialized Change Detection using Segment Anything

• URL: http://arxiv.org/abs/2408.06644v1
• Date: Tue, 13 Aug 2024 05:27:23 GMT
• Title: Specialized Change Detection using Segment Anything
• Authors: Tahir Ahmad, Sudipan Saha,
• Abstract summary: Change detection (CD) is a fundamental task in Earth observation. There is a growing need for specialized methods targeting specific changes relevant to particular applications while discarding the other changes. We propose a focused CD approach using the Segment Anything Model (SAM), a versatile vision foundation model.
• Score: 5.586191108738564
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Change detection (CD) is a fundamental task in Earth observation. While most change detection methods detect all changes, there is a growing need for specialized methods targeting specific changes relevant to particular applications while discarding the other changes. For instance, urban management might prioritize detecting the disappearance of buildings due to natural disasters or other reasons. Furthermore, while most supervised change detection methods require large-scale training datasets, in many applications only one or two training examples might be available instead of large datasets. Addressing such needs, we propose a focused CD approach using the Segment Anything Model (SAM), a versatile vision foundation model. Our method leverages a binary mask of the object of interest in pre-change images to detect their disappearance in post-change images. By using SAM's robust segmentation capabilities, we create prompts from the pre-change mask, use those prompts to segment the post-change image, and identify missing objects. This unsupervised approach demonstrated for building disappearance detection, is adaptable to various domains requiring specialized CD. Our contributions include defining a novel CD problem, proposing a method using SAM, and demonstrating its effectiveness. The proposed method also has benefits related to privacy preservation.

Related papers

• Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change Detection [82.65760006883248]
  We introduce a new task named Change Detection Question Answering and Grounding (CDQAG) CDQAG extends the traditional change detection task by providing interpretable textual answers and intuitive visual evidence. We construct the first CDQAG benchmark dataset, termed QAG-360K, comprising over 360K triplets of questions, textual answers, and corresponding high-quality visual masks.
  arXiv  Detail & Related papers  (2024-10-31T11:20:13Z)
• ZeroSCD: Zero-Shot Street Scene Change Detection [2.3020018305241337]
  Scene Change Detection is a challenging task in computer vision and robotics. Traditional change detection methods rely on training models that take these image pairs as input and estimate the changes. We propose ZeroSCD, a zero-shot scene change detection framework that eliminates the need for training.
  arXiv  Detail & Related papers  (2024-09-23T17:53:44Z)
• Rethinking Remote Sensing Change Detection With A Mask View [6.3921187411592655]
  Remote sensing change detection aims to compare two or more images recorded for the same area but taken at different stamps time to assess changes in geographical entities and environmental factors. To address this shortcoming, this paper rethinks the change detection with the mask view, and further proposes the corresponding: 1) meta-architecture CDMask and 2) instance network CDMaskFormer.
  arXiv  Detail & Related papers  (2024-06-21T17:27:58Z)
• MaskCD: A Remote Sensing Change Detection Network Based on Mask Classification [29.15203530375882]
  Change (CD) from remote sensing (RS) images using deep learning has been widely investigated in the literature. We propose MaskCD to detect changed areas by adaptively generating categorized masks from input image pairs. It reconstructs the desired changed objects by decoding the pixel-wise representations into learnable mask proposals.
  arXiv  Detail & Related papers  (2024-04-18T11:05:15Z)
• Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM) [20.985372561774415]
  We explore unsupervised multimodal change detection between two key remote sensing data sources: optical high-resolution imagery and OpenStreetMap (OSM) data. We introduce two strategies for guiding SAM's segmentation process: the 'no-prompt' and 'box/mask prompt' methods. Experimental results on three datasets indicate that the proposed approach can achieve more competitive results.
  arXiv  Detail & Related papers  (2024-01-17T07:30:52Z)
• MMNet: Multi-Collaboration and Multi-Supervision Network for Sequential Deepfake Detection [81.59191603867586]
  Sequential deepfake detection aims to identify forged facial regions with the correct sequence for recovery. The recovery of forged images requires knowledge of the manipulation model to implement inverse transformations. We propose Multi-Collaboration and Multi-Supervision Network (MMNet) that handles various spatial scales and sequential permutations in forged face images.
  arXiv  Detail & Related papers  (2023-07-06T02:32:08Z)
• CamoFormer: Masked Separable Attention for Camouflaged Object Detection [94.2870722866853]
  We present a simple masked separable attention (MSA) for camouflaged object detection. We first separate the multi-head self-attention into three parts, which are responsible for distinguishing the camouflaged objects from the background using different mask strategies. We propose to capture high-resolution semantic representations progressively based on a simple top-down decoder with the proposed MSA to attain precise segmentation results.
  arXiv  Detail & Related papers  (2022-12-10T10:03:27Z)
• ObjectFormer for Image Manipulation Detection and Localization [118.89882740099137]
  We propose ObjectFormer to detect and localize image manipulations. We extract high-frequency features of the images and combine them with RGB features as multimodal patch embeddings. We conduct extensive experiments on various datasets and the results verify the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2022-03-28T12:27:34Z)
• AF$_2$: Adaptive Focus Framework for Aerial Imagery Segmentation [86.44683367028914]
  Aerial imagery segmentation has some unique challenges, the most critical one among which lies in foreground-background imbalance. We propose Adaptive Focus Framework (AF$), which adopts a hierarchical segmentation procedure and focuses on adaptively utilizing multi-scale representations. AF$ has significantly improved the accuracy on three widely used aerial benchmarks, as fast as the mainstream method.
  arXiv  Detail & Related papers  (2022-02-18T10:14:45Z)
• Unsupervised Domain Adaption of Object Detectors: A Survey [87.08473838767235]
  Recent advances in deep learning have led to the development of accurate and efficient models for various computer vision applications. Learning highly accurate models relies on the availability of datasets with a large number of annotated images. Due to this, model performance drops drastically when evaluated on label-scarce datasets having visually distinct images.
  arXiv  Detail & Related papers  (2021-05-27T23:34:06Z)
• Task-related self-supervised learning for remote sensing image change detection [8.831857715361624]
  Change detection for remote sensing images is widely applied for urban change detection, disaster assessment and other fields. Most of the existing CNN-based change detection methods still suffer from the problem of inadequate pseudo-changes suppression and insufficient feature representation. In this work, an unsupervised change detection method based on Task-related Self-supervised Learning Change Detection network with smooth mechanism is proposed to eliminate it.
  arXiv  Detail & Related papers  (2021-05-11T11:44:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.