Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models

• URL: http://arxiv.org/abs/2404.12667v1
• Date: Fri, 19 Apr 2024 07:07:36 GMT
• Title: Detecting Out-Of-Distribution Earth Observation Images with Diffusion Models
• Authors: Georges Le Bellier, Nicolas Audebert,
• Abstract summary: We show that the reconstruction error of diffusion models can effectively serve as unsupervised out-of-distribution detectors for remote sensing images. We introduce ODEED, a novel reconstruction-based scorer using the probability-flow ODE of diffusion models. We aim to pave the way towards better use of generative models for anomaly detection in remote sensing.
• Score: 2.1178416840822027
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Earth Observation imagery can capture rare and unusual events, such as disasters and major landscape changes, whose visual appearance contrasts with the usual observations. Deep models trained on common remote sensing data will output drastically different features for these out-of-distribution samples, compared to those closer to their training dataset. Detecting them could therefore help anticipate changes in the observations, either geographical or environmental. In this work, we show that the reconstruction error of diffusion models can effectively serve as unsupervised out-of-distribution detectors for remote sensing images, using them as a plausibility score. Moreover, we introduce ODEED, a novel reconstruction-based scorer using the probability-flow ODE of diffusion models. We validate it experimentally on SpaceNet 8 with various scenarios, such as classical OOD detection with geographical shift and near-OOD setups: pre/post-flood and non-flooded/flooded image recognition. We show that our ODEED scorer significantly outperforms other diffusion-based and discriminative baselines on the more challenging near-OOD scenarios of flood image detection, where OOD images are close to the distribution tail. We aim to pave the way towards better use of generative models for anomaly detection in remote sensing.

Related papers

• Can Your Generative Model Detect Out-of-Distribution Covariate Shift? [2.0144831048903566]
  We propose a novel method for detecting Out-of-Distribution (OOD) sensory data using conditional Normalizing Flows (cNFs) Our results on CIFAR10 vs. CIFAR10-C and ImageNet200 vs. ImageNet200-C demonstrate the effectiveness of the method.
  arXiv  Detail & Related papers  (2024-09-04T19:27:56Z)
• Exploiting Diffusion Prior for Out-of-Distribution Detection [11.11093497717038]
  Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models. We present a novel approach for OOD detection that leverages the generative ability of diffusion models and the powerful feature extraction capabilities of CLIP.
  arXiv  Detail & Related papers  (2024-06-16T23:55:25Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Projection Regret: Reducing Background Bias for Novelty Detection via Diffusion Models [72.07462371883501]
  We propose emphProjection Regret (PR), an efficient novelty detection method that mitigates the bias of non-semantic information. PR computes the perceptual distance between the test image and its diffusion-based projection to detect abnormality. Extensive experiments demonstrate that PR outperforms the prior art of generative-model-based novelty detection methods by a significant margin.
  arXiv  Detail & Related papers  (2023-12-05T09:44:47Z)
• Learning a Cross-modality Anomaly Detector for Remote Sensing Imagery [21.444315419064882]
  A remote sensing anomaly detector can find objects deviating from the background as potential targets for Earth monitoring. Current anomaly detectors aim to learn the certain background distribution, the trained model cannot be transferred to unseen images. This study exploits the learning target conversion from the varying background distribution to the consistent deviation metric.
  arXiv  Detail & Related papers  (2023-10-11T14:07:05Z)
• Detecting Images Generated by Deep Diffusion Models using their Local Intrinsic Dimensionality [8.968599131722023]
  Diffusion models have been successfully applied for the visual synthesis of strikingly realistic appearing images. This raises strong concerns about their potential for malicious purposes. We propose using the lightweight multi Local Intrinsic Dimensionality (multiLID) for the automatic detection of synthetic images.
  arXiv  Detail & Related papers  (2023-07-05T15:03:10Z)
• Deceptive-NeRF/3DGS: Diffusion-Generated Pseudo-Observations for High-Quality Sparse-View Reconstruction [60.52716381465063]
  We introduce Deceptive-NeRF/3DGS to enhance sparse-view reconstruction with only a limited set of input images. Specifically, we propose a deceptive diffusion model turning noisy images rendered from few-view reconstructions into high-quality pseudo-observations. Our system progressively incorporates diffusion-generated pseudo-observations into the training image sets, ultimately densifying the sparse input observations by 5 to 10 times.
  arXiv  Detail & Related papers  (2023-05-24T14:00:32Z)
• DIRE for Diffusion-Generated Image Detection [128.95822613047298]
  We propose a novel representation called DIffusion Reconstruction Error (DIRE) DIRE measures the error between an input image and its reconstruction counterpart by a pre-trained diffusion model. It provides a hint that DIRE can serve as a bridge to distinguish generated and real images.
  arXiv  Detail & Related papers  (2023-03-16T13:15:03Z)
• Why Normalizing Flows Fail to Detect Out-of-Distribution Data [51.552870594221865]
  Normalizing flows fail to distinguish between in- and out-of-distribution data. We demonstrate that flows learn local pixel correlations and generic image-to-latent-space transformations. We show that by modifying the architecture of flow coupling layers we can bias the flow towards learning the semantic structure of the target data.
  arXiv  Detail & Related papers  (2020-06-15T17:00:01Z)
• Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
  We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction. We put forward an alternative measure of anomaly score to replace the reconstruction-based metric. Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
  arXiv  Detail & Related papers  (2020-03-24T08:26:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.