Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images

• URL: http://arxiv.org/abs/2307.07534v1
• Date: Fri, 14 Jul 2023 09:13:28 GMT
• Title: Masked Autoencoders for Unsupervised Anomaly Detection in Medical Images
• Authors: Mariana-Iuliana Georgescu
• Abstract summary: We tackle anomaly detection in medical images training our framework using only healthy samples. We train the anomaly classifier in a supervised manner using as negative samples the reconstruction of the healthy scans. We compare our method with four state-of-the-art anomaly detection frameworks, namely AST, RD4AD, AnoVAEGAN and f-AnoGAN.
• Score: 5.457150493905064
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pathological anomalies exhibit diverse appearances in medical imaging, making it difficult to collect and annotate a representative amount of data required to train deep learning models in a supervised setting. Therefore, in this work, we tackle anomaly detection in medical images training our framework using only healthy samples. We propose to use the Masked Autoencoder model to learn the structure of the normal samples, then train an anomaly classifier on top of the difference between the original image and the reconstruction provided by the masked autoencoder. We train the anomaly classifier in a supervised manner using as negative samples the reconstruction of the healthy scans, while as positive samples, we use pseudo-abnormal scans obtained via our novel pseudo-abnormal module. The pseudo-abnormal module alters the reconstruction of the normal samples by changing the intensity of several regions. We conduct experiments on two medical image data sets, namely BRATS2020 and LUNA16 and compare our method with four state-of-the-art anomaly detection frameworks, namely AST, RD4AD, AnoVAEGAN and f-AnoGAN.

Related papers

• Spatial-aware Attention Generative Adversarial Network for Semi-supervised Anomaly Detection in Medical Image [63.59114880750643]
  We introduce a novel Spatial-aware Attention Generative Adrialversa Network (SAGAN) for one-class semi-supervised generation of health images. SAGAN generates high-quality health images corresponding to unlabeled data, guided by the reconstruction of normal images and restoration of pseudo-anomaly images. Extensive experiments on three medical datasets demonstrate that the proposed SAGAN outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-05-21T15:41:34Z)
• Unsupervised Anomaly Detection via Masked Diffusion Posterior Sampling [8.887775968482208]
  diffusion models have shown promising applications for anomaly detection due to their powerful generative ability. This paper proposes a novel and highly-interpretable method named Masked Diffusion Posterior Sampling (MDPS) MDPS can achieve state-of-the-art performance in normal image reconstruction quality as well as anomaly detection and localization.
  arXiv  Detail & Related papers  (2024-04-27T13:13:27Z)
• MAEDiff: Masked Autoencoder-enhanced Diffusion Models for Unsupervised Anomaly Detection in Brain Images [40.89943932086941]
  We propose a novel Masked Autoencoder-enhanced Diffusion Model (MAEDiff) for unsupervised anomaly detection in brain images. The MAEDiff involves a hierarchical patch partition. It generates healthy images by overlapping upper-level patches and implements a mechanism based on the masked autoencoders operating on the sub-level patches to enhance the condition on the unnoised regions.
  arXiv  Detail & Related papers  (2024-01-19T08:54:54Z)
• AMAE: Adaptation of Pre-Trained Masked Autoencoder for Dual-Distribution Anomaly Detection in Chest X-Rays [17.91123470181453]
  We propose AMAE, a two-stage algorithm for adaptation of the pre-trained masked autoencoder (MAE) AMAE leads to consistent performance gains over competing self-supervised and dual distribution anomaly detection methods.
  arXiv  Detail & Related papers  (2023-07-24T12:03:50Z)
• On Sensitivity and Robustness of Normalization Schemes to Input Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
  Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input. DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases. We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
  arXiv  Detail & Related papers  (2023-06-23T03:09:03Z)
• Diversity-Measurable Anomaly Detection [106.07413438216416]
  We propose Diversity-Measurable Anomaly Detection (DMAD) framework to enhance reconstruction diversity. PDM essentially decouples deformation from embedding and makes the final anomaly score more reliable.
  arXiv  Detail & Related papers  (2023-03-09T05:52:42Z)
• Self-Supervised Masked Convolutional Transformer Block for Anomaly Detection [122.4894940892536]
  We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level. In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
  arXiv  Detail & Related papers  (2022-09-25T04:56:10Z)
• Self-Supervised Predictive Convolutional Attentive Block for Anomaly Detection [97.93062818228015]
  We propose to integrate the reconstruction-based functionality into a novel self-supervised predictive architectural building block. Our block is equipped with a loss that minimizes the reconstruction error with respect to the masked area in the receptive field. We demonstrate the generality of our block by integrating it into several state-of-the-art frameworks for anomaly detection on image and video.
  arXiv  Detail & Related papers  (2021-11-17T13:30:31Z)
• Image Anomaly Detection by Aggregating Deep Pyramidal Representations [16.246831343527052]
  Anomaly detection consists in identifying, within a dataset, those samples that significantly differ from the majority of the data. This paper focuses on image anomaly detection using a deep neural network with multiple pyramid levels to analyze the image features at different scales.
  arXiv  Detail & Related papers  (2020-11-12T09:58:27Z)
• Label-Free Segmentation of COVID-19 Lesions in Lung CT [17.639558085838583]
  We present a label-free approach for segmenting COVID-19 lesions in CT via pixel-level anomaly modeling. Our modeling is inspired by the observation that the parts of tracheae and vessels, which lay in the high-intensity range where lesions belong, exhibit strong patterns. Our experiments on three different datasets validate the effectiveness of NormNet.
  arXiv  Detail & Related papers  (2020-09-08T12:38:34Z)
• Improved Slice-wise Tumour Detection in Brain MRIs by Computing Dissimilarities between Latent Representations [68.8204255655161]
  Anomaly detection for Magnetic Resonance Images (MRIs) can be solved with unsupervised methods. We have proposed a slice-wise semi-supervised method for tumour detection based on the computation of a dissimilarity function in the latent space of a Variational AutoEncoder. We show that by training the models on higher resolution images and by improving the quality of the reconstructions, we obtain results which are comparable with different baselines.
  arXiv  Detail & Related papers  (2020-07-24T14:02:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.