A Benchmark of Medical Out of Distribution Detection

• URL: http://arxiv.org/abs/2007.04250v2
• Date: Wed, 5 Aug 2020 02:05:43 GMT
• Title: A Benchmark of Medical Out of Distribution Detection
• Authors: Tianshi Cao, Chin-Wei Huang, David Yu-Tung Hui, Joseph Paul Cohen
• Abstract summary: It is unclear which Out-of-Distribution Detection (OoDD) methods should be used in practice. This paper defines 3 categories of OoD examples and benchmarks popular OoDD methods in three domains of medical imaging.
• Score: 12.128234521287977
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Motivation: Deep learning models deployed for use on medical tasks can be equipped with Out-of-Distribution Detection (OoDD) methods in order to avoid erroneous predictions. However it is unclear which OoDD method should be used in practice. Specific Problem: Systems trained for one particular domain of images cannot be expected to perform accurately on images of a different domain. These images should be flagged by an OoDD method prior to diagnosis. Our approach: This paper defines 3 categories of OoD examples and benchmarks popular OoDD methods in three domains of medical imaging: chest X-ray, fundus imaging, and histology slides. Results: Our experiments show that despite methods yielding good results on some categories of out-of-distribution samples, they fail to recognize images close to the training distribution. Conclusion: We find a simple binary classifier on the feature representation has the best accuracy and AUPRC on average. Users of diagnostic tools which employ these OoDD methods should still remain vigilant that images very close to the training distribution yet not in it could yield unexpected results.

Related papers

• Rethinking Score Distillation as a Bridge Between Image Distributions [97.27476302077545]
  We show that our method seeks to transport corrupted images (source) to the natural image distribution (target) Our method can be easily applied across many domains, matching or beating the performance of specialized methods. We demonstrate its utility in text-to-2D, text-based NeRF optimization, translating paintings to real images, optical illusion generation, and 3D sketch-to-real.
  arXiv  Detail & Related papers  (2024-06-13T17:59:58Z)
• Position-Guided Prompt Learning for Anomaly Detection in Chest X-Rays [46.78926066405227]
  Anomaly detection in chest X-rays is a critical task. Recently, CLIP-based methods, pre-trained on a large number of medical images, have shown impressive performance on zero/few-shot downstream tasks. We propose a position-guided prompt learning method to adapt the task data to the frozen CLIP-based model.
  arXiv  Detail & Related papers  (2024-05-20T12:11:41Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• BMAD: Benchmarks for Medical Anomaly Detection [51.22159321912891]
  Anomaly detection (AD) is a fundamental research problem in machine learning and computer vision. In medical imaging, AD is especially vital for detecting and diagnosing anomalies that may indicate rare diseases or conditions. We introduce a comprehensive evaluation benchmark for assessing anomaly detection methods on medical images.
  arXiv  Detail & Related papers  (2023-06-20T20:23:46Z)
• Solving Sample-Level Out-of-Distribution Detection on 3D Medical Images [0.06117371161379209]
  Out-of-distribution (OOD) detection helps to identify data samples, increasing the model's reliability. Recent works have developed DL-based OOD detection that achieves promising results on 2D medical images. However, scaling most of these approaches on 3D images is computationally intractable. We propose a histogram-based method that requires no DL and achieves almost perfect results in this domain.
  arXiv  Detail & Related papers  (2022-12-13T11:42:23Z)
• PCA: Semi-supervised Segmentation with Patch Confidence Adversarial Training [52.895952593202054]
  We propose a new semi-supervised adversarial method called Patch Confidence Adrial Training (PCA) for medical image segmentation. PCA learns the pixel structure and context information in each patch to get enough gradient feedback, which aids the discriminator in convergent to an optimal state. Our method outperforms the state-of-the-art semi-supervised methods, which demonstrates its effectiveness for medical image segmentation.
  arXiv  Detail & Related papers  (2022-07-24T07:45:47Z)
• Unsupervised Domain Adaptation Using Feature Disentanglement And GCNs For Medical Image Classification [5.6512908295414]
  We propose an unsupervised domain adaptation approach that uses graph neural networks and, disentangled semantic and domain invariant structural features. We test the proposed method for classification on two challenging medical image datasets with distribution shifts. Experiments show our method achieves state-of-the-art results compared to other domain adaptation methods.
  arXiv  Detail & Related papers  (2022-06-27T09:02:16Z)
• Self-supervised Pseudo Multi-class Pre-training for Unsupervised Anomaly Detection and Segmentation in Medical Images [31.676609117780114]
  Unsupervised anomaly detection (UAD) methods are trained with normal (or healthy) images only, but during testing, they are able to classify normal and abnormal images. We propose a new self-supervised pre-training method for MIA UAD applications, named Pseudo Multi-class Strong Augmentation via Contrastive Learning (PMSACL)
  arXiv  Detail & Related papers  (2021-09-03T04:25:57Z)
• Implicit field learning for unsupervised anomaly detection in medical images [0.8122270502556374]
  An auto-decoder feed-forward neural network learns the distribution of healthy images in the form of a mapping between spatial coordinates and probabilities over a proxy for tissue types. Anomalies are localized using the voxel-wise probability predicted by our model for the restored image. We tested our approach in the task of unsupervised localization of gliomas on brain MR images and compared it to several other VAE-based anomaly detection methods.
  arXiv  Detail & Related papers  (2021-06-09T16:57:22Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Unsupervised Anomaly Detection for X-Ray Images [4.353258086186526]
  We investigate how unsupervised methods trained on images without anomalies can be used to assist doctors in evaluating X-ray images of hands. We adopt state-of-the-art approaches for unsupervised learning to detect anomalies and show how the outputs of these methods can be explained. We provide an extensive evaluation of different approaches and demonstrate empirically that even without labels it is possible to achieve satisfying results on a real-world dataset of X-ray images of hands.
  arXiv  Detail & Related papers  (2020-01-29T15:14:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.