Self-Supervised Out-of-Distribution Detection in Brain CT Scans
- URL: http://arxiv.org/abs/2011.05428v1
- Date: Tue, 10 Nov 2020 22:21:48 GMT
- Title: Self-Supervised Out-of-Distribution Detection in Brain CT Scans
- Authors: Abinav Ravi Venkatakrishnan, Seong Tae Kim, Rami Eisawy, Franz
Pfister, Nassir Navab
- Abstract summary: We propose a novel self-supervised learning technique for anomaly detection.
Our architecture largely consists of two parts: 1) Reconstruction and 2) predicting geometric transformations.
In the test time, the geometric transformation predictor can assign the anomaly score by calculating the error between geometric transformation and prediction.
- Score: 46.78055929759839
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Medical imaging data suffers from the limited availability of annotation
because annotating 3D medical data is a time-consuming and expensive task.
Moreover, even if the annotation is available, supervised learning-based
approaches suffer highly imbalanced data. Most of the scans during the
screening are from normal subjects, but there are also large variations in
abnormal cases. To address these issues, recently, unsupervised deep anomaly
detection methods that train the model on large-sized normal scans and detect
abnormal scans by calculating reconstruction error have been reported. In this
paper, we propose a novel self-supervised learning technique for anomaly
detection. Our architecture largely consists of two parts: 1) Reconstruction
and 2) predicting geometric transformations. By training the network to predict
geometric transformations, the model could learn better image features and
distribution of normal scans. In the test time, the geometric transformation
predictor can assign the anomaly score by calculating the error between
geometric transformation and prediction. Moreover, we further use
self-supervised learning with context restoration for pretraining our model. By
comparative experiments on clinical brain CT scans, the effectiveness of the
proposed method has been verified.
Related papers
- Image anomaly detection and prediction scheme based on SSA optimized ResNet50-BiGRU model [6.95262627755758]
This paper introduces a network combining Residual Network (ResNet) and Bidirectional Gated Recurrent Unit (BiGRU)
It can predict potential injury types and provide early warnings by analyzing changes in muscle and bone poses from video images.
Experiments conducted on four datasets demonstrated that our model has the smallest error in image anomaly detection compared to other models.
arXiv Detail & Related papers (2024-06-20T04:26:45Z) - Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection.
Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels.
Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
arXiv Detail & Related papers (2024-03-19T09:28:19Z) - Evaluation of pseudo-healthy image reconstruction for anomaly detection
with deep generative models: Application to brain FDG PET [3.5250480324981406]
We propose an evaluation procedure based on the simulation of realistic abnormal images to validate pseudo-healthy reconstruction methods.
We apply this framework to the reconstruction of 3D brain FDG PET using a convolutional variational autoencoder.
arXiv Detail & Related papers (2024-01-29T18:02:22Z) - Position Regression for Unsupervised Anomaly Detection [0.8999666725996974]
We propose a novel anomaly detection approach based on coordinate regression.
Our method estimates the position of patches within a volume, and is trained only on data of healthy subjects.
We show that our method requires less memory than comparable approaches that involve image reconstruction.
arXiv Detail & Related papers (2023-01-19T13:22:11Z) - Supervised Anomaly Detection Method Combining Generative Adversarial
Networks and Three-Dimensional Data in Vehicle Inspections [0.0]
The external visual inspections of rolling stock's underfloor equipment are currently being performed via human visual inspection.
In this study, we propose a new method that uses style conversion via generative adversarial networks on three-dimensional computer graphics.
arXiv Detail & Related papers (2022-12-22T06:39:52Z) - Self-Supervised Masked Convolutional Transformer Block for Anomaly
Detection [122.4894940892536]
We present a novel self-supervised masked convolutional transformer block (SSMCTB) that comprises the reconstruction-based functionality at a core architectural level.
In this work, we extend our previous self-supervised predictive convolutional attentive block (SSPCAB) with a 3D masked convolutional layer, a transformer for channel-wise attention, as well as a novel self-supervised objective based on Huber loss.
arXiv Detail & Related papers (2022-09-25T04:56:10Z) - 3D unsupervised anomaly detection and localization through virtual
multi-view projection and reconstruction: Clinical validation on low-dose
chest computed tomography [2.2302915692528367]
We propose a method based on a deep neural network for computer-aided diagnosis called virtual multi-view projection and reconstruction.
The proposed method improves the patient-level anomaly detection by 10% compared with a gold standard based on supervised learning.
It localizes the anomaly region with 93% accuracy, demonstrating its high performance.
arXiv Detail & Related papers (2022-06-18T13:22:00Z) - SQUID: Deep Feature In-Painting for Unsupervised Anomaly Detection [76.01333073259677]
We propose the use of Space-aware Memory Queues for In-painting and Detecting anomalies from radiography images (abbreviated as SQUID)
We show that SQUID can taxonomize the ingrained anatomical structures into recurrent patterns; and in the inference, it can identify anomalies (unseen/modified patterns) in the image.
arXiv Detail & Related papers (2021-11-26T13:47:34Z) - Explainable multiple abnormality classification of chest CT volumes with
AxialNet and HiResCAM [89.2175350956813]
We introduce the challenging new task of explainable multiple abnormality classification in volumetric medical images.
We propose a multiple instance learning convolutional neural network, AxialNet, that allows identification of top slices for each abnormality.
We then aim to improve the model's learning through a novel mask loss that leverages HiResCAM and 3D allowed regions.
arXiv Detail & Related papers (2021-11-24T01:14:33Z) - CutPaste: Self-Supervised Learning for Anomaly Detection and
Localization [59.719925639875036]
We propose a framework for building anomaly detectors using normal training data only.
We first learn self-supervised deep representations and then build a generative one-class classifier on learned representations.
Our empirical study on MVTec anomaly detection dataset demonstrates the proposed algorithm is general to be able to detect various types of real-world defects.
arXiv Detail & Related papers (2021-04-08T19:04:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.