Revisiting Deep Ensemble Uncertainty for Enhanced Medical Anomaly Detection

• URL: http://arxiv.org/abs/2409.17485v1
• Date: Thu, 26 Sep 2024 02:47:41 GMT
• Title: Revisiting Deep Ensemble Uncertainty for Enhanced Medical Anomaly Detection
• Authors: Yi Gu, Yi Lin, Kwang-Ting Cheng, Hao Chen,
• Abstract summary: We propose a Dual-space Uncertainty Estimation framework for medical anomaly detection. To balance agreement and disagreement for anomaly detection, we propose Redundancy-Aware Repulsion (RAR) We also develop Dual-Space Uncertainty (DSU) which utilizes the ensemble's uncertainty in input and output spaces.
• Score: 34.14012444375776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Medical anomaly detection (AD) is crucial in pathological identification and localization. Current methods typically rely on uncertainty estimation in deep ensembles to detect anomalies, assuming that ensemble learners should agree on normal samples while exhibiting disagreement on unseen anomalies in the output space. However, these methods may suffer from inadequate disagreement on anomalies or diminished agreement on normal samples. To tackle these issues, we propose D2UE, a Diversified Dual-space Uncertainty Estimation framework for medical anomaly detection. To effectively balance agreement and disagreement for anomaly detection, we propose Redundancy-Aware Repulsion (RAR), which uses a similarity kernel that remains invariant to both isotropic scaling and orthogonal transformations, explicitly promoting diversity in learners' feature space. Moreover, to accentuate anomalous regions, we develop Dual-Space Uncertainty (DSU), which utilizes the ensemble's uncertainty in input and output spaces. In input space, we first calculate gradients of reconstruction error with respect to input images. The gradients are then integrated with reconstruction outputs to estimate uncertainty for inputs, enabling effective anomaly discrimination even when output space disagreement is minimal. We conduct a comprehensive evaluation of five medical benchmarks with different backbones. Experimental results demonstrate the superiority of our method to state-of-the-art methods and the effectiveness of each component in our framework. Our code is available at https://github.com/Rubiscol/D2UE.

Related papers

• GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection [60.78684630040313]
  Diffusion models tend to reconstruct normal counterparts of test images with certain noises added. From the global perspective, the difficulty of reconstructing images with different anomalies is uneven. We propose a global and local adaptive diffusion model (abbreviated to GLAD) for unsupervised anomaly detection.
  arXiv  Detail & Related papers  (2024-06-11T17:27:23Z)
• Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
  We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images. SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images. Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-21T15:41:34Z)
• AnoDODE: Anomaly Detection with Diffusion ODE [0.0]
  Anomaly detection is the process of identifying atypical data samples that significantly deviate from the majority of the dataset. We propose a new anomaly detection method based on diffusion ODEs by estimating the density of features extracted from medical images. Our proposed method not only identifie anomalies but also provides interpretability at both the image and pixel levels.
  arXiv  Detail & Related papers  (2023-10-10T08:44:47Z)
• cOOpD: Reformulating COPD classification on chest CT scans as anomaly detection using contrastive representations [0.6733204971296001]
  We propose cOOpD: heterogeneous pathological regions are detected as Out-of-Distribution (OOD) from normal homogeneous lung regions. A generative model then learns the distribution of healthy representations and identifies abnormalities (stemming from COPD) as deviations. We show that cOOpD achieves the best performance on two public datasets, with an increase of 8.2% and 7.7% in terms of AUROC.
  arXiv  Detail & Related papers  (2023-07-14T10:05:37Z)
• Diversity-Measurable Anomaly Detection [106.07413438216416]
  We propose Diversity-Measurable Anomaly Detection (DMAD) framework to enhance reconstruction diversity. PDM essentially decouples deformation from embedding and makes the final anomaly score more reliable.
  arXiv  Detail & Related papers  (2023-03-09T05:52:42Z)
• The role of noise in denoising models for anomaly detection in medical images [62.0532151156057]
  Pathological brain lesions exhibit diverse appearance in brain images. Unsupervised anomaly detection approaches have been proposed using only normal data for training. We show that optimization of the spatial resolution and magnitude of the noise improves the performance of different model training regimes.
  arXiv  Detail & Related papers  (2023-01-19T21:39:38Z)
• Are we certain it's anomalous? [57.729669157989235]
  Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations. Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD) HypAD learns self-supervisedly to reconstruct the input signal.
  arXiv  Detail & Related papers  (2022-11-16T21:31:39Z)
• Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images [29.57501199670898]
  We introduce one-class semi-supervised learning (OC-SSL) to utilize known normal and unlabeled images for training. Ensembles of reconstruction networks are designed to model the distribution of normal images and the distribution of both normal and unlabeled images. We propose a new perspective on self-supervised learning, which is designed to refine the anomaly scores rather than detect anomalies directly.
  arXiv  Detail & Related papers  (2022-10-09T11:18:45Z)
• Hierarchical Semi-Supervised Contrastive Learning for Contamination-Resistant Anomaly Detection [81.07346419422605]
  Anomaly detection aims at identifying deviant samples from the normal data distribution. Contrastive learning has provided a successful way to sample representation that enables effective discrimination on anomalies. We propose a novel hierarchical semi-supervised contrastive learning framework, for contamination-resistant anomaly detection.
  arXiv  Detail & Related papers  (2022-07-24T18:49:26Z)
• Augment to Detect Anomalies with Continuous Labelling [10.646747658653785]
  Anomaly detection is to recognize samples that differ in some respect from the training observations. Recent state-of-the-art deep learning-based anomaly detection methods suffer from high computational cost, complexity, unstable training procedures, and non-trivial implementation. We leverage a simple learning procedure that trains a lightweight convolutional neural network, reaching state-of-the-art performance in anomaly detection.
  arXiv  Detail & Related papers  (2022-07-03T20:11:51Z)
• PANDA : Perceptually Aware Neural Detection of Anomalies [20.838700258121197]
  We propose a novel fine-grained VAE-GAN architecture trained in a semi-supervised manner to detect both visually distinct and subtle anomalies. With the use of a residually connected dual-feature extractor, a fine-grained discriminator and a perceptual loss function, we are able to detect subtle, low inter-class (anomaly vs. normal) variant anomalies.
  arXiv  Detail & Related papers  (2021-04-28T11:03:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.