Enhancing Reconstruction-Based Out-of-Distribution Detection in Brain MRI with Model and Metric Ensembles

• URL: http://arxiv.org/abs/2412.17586v1
• Date: Mon, 23 Dec 2024 13:58:52 GMT
• Title: Enhancing Reconstruction-Based Out-of-Distribution Detection in Brain MRI with Model and Metric Ensembles
• Authors: Evi M. C. Huijben, Sina Amirrajab, Josien P. W. Pluim,
• Abstract summary: Out-of-distribution (OOD) detection is crucial for safely deploying automated medical image analysis systems. We investigated the effectiveness of a reconstruction-based autoencoder for unsupervised detection of synthetic artifacts in brain MRI.
• Score: 2.6123133623254193
• License:
• Abstract: Out-of-distribution (OOD) detection is crucial for safely deploying automated medical image analysis systems, as abnormal patterns in images could hamper their performance. However, OOD detection in medical imaging remains an open challenge, and we address three gaps: the underexplored potential of a simple OOD detection model, the lack of optimization of deep learning strategies specifically for OOD detection, and the selection of appropriate reconstruction metrics. In this study, we investigated the effectiveness of a reconstruction-based autoencoder for unsupervised detection of synthetic artifacts in brain MRI. We evaluated the general reconstruction capability of the model, analyzed the impact of the selected training epoch and reconstruction metrics, assessed the potential of model and/or metric ensembles, and tested the model on a dataset containing a diverse range of artifacts. Among the metrics assessed, the contrast component of SSIM and LPIPS consistently outperformed others in detecting homogeneous circular anomalies. By combining two well-converged models and using LPIPS and contrast as reconstruction metrics, we achieved a pixel-level area under the Precision-Recall curve of 0.66. Furthermore, with the more realistic OOD dataset, we observed that the detection performance varied between artifact types; local artifacts were more difficult to detect, while global artifacts showed better detection results. These findings underscore the importance of carefully selecting metrics and model configurations, and highlight the need for tailored approaches, as standard deep learning approaches do not always align with the unique needs of OOD detection.

Related papers

• Object Detection for Medical Image Analysis: Insights from the RT-DETR Model [40.593685087097995]
  This paper focuses on the application of a novel detection framework based on the RT-DETR model for analyzing intricate image data. The proposed RT-DETR model, built on a Transformer-based architecture, excels at processing high-dimensional and complex visual data with enhanced robustness and accuracy.
  arXiv  Detail & Related papers  (2025-01-27T20:02:53Z)
• Understanding and Improving Training-Free AI-Generated Image Detections with Vision Foundation Models [68.90917438865078]
  Deepfake techniques for facial synthesis and editing pose serious risks for generative models. In this paper, we investigate how detection performance varies across model backbones, types, and datasets. We introduce Contrastive Blur, which enhances performance on facial images, and MINDER, which addresses noise type bias, balancing performance across domains.
  arXiv  Detail & Related papers  (2024-11-28T13:04:45Z)
• Exploring Out-of-distribution Detection for Sparse-view Computed Tomography with Diffusion Models [1.6704428692159]
  We study the use of a diffusion model, trained to capture the target distribution for CT reconstruction as an in-distribution prior. We employ the model to reconstruct partially diffused input images and assess OOD-ness through multiple reconstruction errors. Our findings suggest that effective OOD detection can be achieved by comparing measurements with forward-projected reconstructions.
  arXiv  Detail & Related papers  (2024-11-09T23:17:42Z)
• Unsupervised Hybrid framework for ANomaly Detection (HAND) -- applied to Screening Mammogram [5.387300498478745]
  Out-of-distribution (OOD) detection is crucial for enhancing the generalization of AI models used in mammogram screening. We developed a novel backbone - HAND - for detecting OOD from large-scale digital screening mammogram studies. Hand pipeline offers an automated efficient computational solution for domain-specific quality checks in external screening mammograms.
  arXiv  Detail & Related papers  (2024-09-17T20:12:50Z)
• Optimizing OOD Detection in Molecular Graphs: A Novel Approach with Diffusion Models [71.39421638547164]
  We propose to detect OOD molecules by adopting an auxiliary diffusion model-based framework, which compares similarities between input molecules and reconstructed graphs. Due to the generative bias towards reconstructing ID training samples, the similarity scores of OOD molecules will be much lower to facilitate detection. Our research pioneers an approach of Prototypical Graph Reconstruction for Molecular OOD Detection, dubbed as PGR-MOOD and hinges on three innovations.
  arXiv  Detail & Related papers  (2024-04-24T03:25:53Z)
• Guided Reconstruction with Conditioned Diffusion Models for Unsupervised Anomaly Detection in Brain MRIs [35.46541584018842]
  Unsupervised Anomaly Detection (UAD) aims to identify any anomaly as an outlier from a healthy training distribution. generative models are used to learn the reconstruction of healthy brain anatomy for a given input image. We propose conditioning the denoising process of diffusion models with additional information derived from a latent representation of the input image.
  arXiv  Detail & Related papers  (2023-12-07T11:03:42Z)
• Detecting Out-of-Distribution Through the Lens of Neural Collapse [7.04686607977352]
  Out-of-distribution (OOD) detection is essential for safe deployment. Existing detectors exhibit generalization discrepancies and cost concerns. We propose a highly versatile and efficient OOD detector inspired by the trend of Neural Collapse.
  arXiv  Detail & Related papers  (2023-11-02T05:18:28Z)
• Energy-based Out-of-Distribution Detection for Graph Neural Networks [76.0242218180483]
  We propose a simple, powerful and efficient OOD detection model for GNN-based learning on graphs, which we call GNNSafe. GNNSafe achieves up to $17.0%$ AUROC improvement over state-of-the-arts and it could serve as simple yet strong baselines in such an under-developed area.
  arXiv  Detail & Related papers  (2023-02-06T16:38:43Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Unsupervised Anomaly Detection with Adversarial Mirrored AutoEncoders [51.691585766702744]
  We propose a variant of Adversarial Autoencoder which uses a mirrored Wasserstein loss in the discriminator to enforce better semantic-level reconstruction. We put forward an alternative measure of anomaly score to replace the reconstruction-based metric. Our method outperforms the current state-of-the-art methods for anomaly detection on several OOD detection benchmarks.
  arXiv  Detail & Related papers  (2020-03-24T08:26:58Z)
• Robust Out-of-distribution Detection for Neural Networks [51.19164318924997]
  We show that existing detection mechanisms can be extremely brittle when evaluating on in-distribution and OOD inputs. We propose an effective algorithm called ALOE, which performs robust training by exposing the model to both adversarially crafted inlier and outlier examples.
  arXiv  Detail & Related papers  (2020-03-21T17:46:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.