Unsupervised anomaly localization in high-resolution breast scans using deep pluralistic image completion

• URL: http://arxiv.org/abs/2305.03098v2
• Date: Mon, 22 Jul 2024 19:41:11 GMT
• Title: Unsupervised anomaly localization in high-resolution breast scans using deep pluralistic image completion
• Authors: Nicholas Konz, Haoyu Dong, Maciej A. Mazurowski,
• Abstract summary: Automated tumor detection in Digital Breast Tomosynthesis (DBT) is a difficult task due to natural tumor rarity, breast tissue variability, and high resolution. Most anomaly localization research in machine learning focuses on non-medical datasets.
• Score: 5.911215493148418
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Automated tumor detection in Digital Breast Tomosynthesis (DBT) is a difficult task due to natural tumor rarity, breast tissue variability, and high resolution. Given the scarcity of abnormal images and the abundance of normal images for this problem, an anomaly detection/localization approach could be well-suited. However, most anomaly localization research in machine learning focuses on non-medical datasets, and we find that these methods fall short when adapted to medical imaging datasets. The problem is alleviated when we solve the task from the image completion perspective, in which the presence of anomalies can be indicated by a discrepancy between the original appearance and its auto-completion conditioned on the surroundings. However, there are often many valid normal completions given the same surroundings, especially in the DBT dataset, making this evaluation criterion less precise. To address such an issue, we consider pluralistic image completion by exploring the distribution of possible completions instead of generating fixed predictions. This is achieved through our novel application of spatial dropout on the completion network during inference time only, which requires no additional training cost and is effective at generating diverse completions. We further propose minimum completion distance (MCD), a new metric for detecting anomalies, thanks to these stochastic completions. We provide theoretical as well as empirical support for the superiority over existing methods of using the proposed method for anomaly localization. On the DBT dataset, our model outperforms other state-of-the-art methods by at least 10\% AUROC for pixel-level detection.

Related papers

• Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
  We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images. SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images. Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-21T15:41:34Z)
• Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
  This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection. Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels. Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
  arXiv  Detail & Related papers  (2024-03-19T09:28:19Z)
• DiAD: A Diffusion-based Framework for Multi-class Anomaly Detection [55.48770333927732]
  We propose a Difusion-based Anomaly Detection (DiAD) framework for multi-class anomaly detection. It consists of a pixel-space autoencoder, a latent-space Semantic-Guided (SG) network with a connection to the stable diffusion's denoising network, and a feature-space pre-trained feature extractor. Experiments on MVTec-AD and VisA datasets demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2023-12-11T18:38:28Z)
• Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach [49.995833831087175]
  This work proposes a novel method for generating generic Video-temporal PAs by inpainting a masked out region of an image. In addition, we present a simple unified framework to detect real-world anomalies under the OCC setting. Our method performs on par with other existing state-of-the-art PAs generation and reconstruction based methods under the OCC setting.
  arXiv  Detail & Related papers  (2023-11-27T13:14:06Z)
• AnoDODE: Anomaly Detection with Diffusion ODE [0.0]
  Anomaly detection is the process of identifying atypical data samples that significantly deviate from the majority of the dataset. We propose a new anomaly detection method based on diffusion ODEs by estimating the density of features extracted from medical images. Our proposed method not only identifie anomalies but also provides interpretability at both the image and pixel levels.
  arXiv  Detail & Related papers  (2023-10-10T08:44:47Z)
• Stain-invariant self supervised learning for histopathology image analysis [74.98663573628743]
  We present a self-supervised algorithm for several classification tasks within hematoxylin and eosin stained images of breast cancer. Our method achieves the state-of-the-art performance on several publicly available breast cancer datasets.
  arXiv  Detail & Related papers  (2022-11-14T18:16:36Z)
• Dual-distribution discrepancy with self-supervised refinement for anomaly detection in medical images [29.57501199670898]
  We introduce one-class semi-supervised learning (OC-SSL) to utilize known normal and unlabeled images for training. Ensembles of reconstruction networks are designed to model the distribution of normal images and the distribution of both normal and unlabeled images. We propose a new perspective on self-supervised learning, which is designed to refine the anomaly scores rather than detect anomalies directly.
  arXiv  Detail & Related papers  (2022-10-09T11:18:45Z)
• DR{\AE}M -- A discriminatively trained reconstruction embedding for surface anomaly detection [14.234783431842542]
  We propose a discriminatively trained reconstruction anomaly embedding model (DRAEM) DRAEM learns a joint representation of an anomalous image and its anomaly-free reconstruction, while simultaneously learning a decision boundary between normal and anomalous examples. On the challenging MVTec anomaly detection dataset, DRAEM outperforms the current state-of-the-art unsupervised methods by a large margin.
  arXiv  Detail & Related papers  (2021-08-17T13:17:29Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)
• Anomaly Detection in Medical Imaging with Deep Perceptual Autoencoders [1.7277957019593995]
  We introduce a new powerful method of image anomaly detection. It relies on the classical autoencoder approach with a re-designed training pipeline. It outperforms state-of-the-art approaches in complex medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-06-23T18:45:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.