Cross Attention Transformers for Multi-modal Unsupervised Whole-Body PET
Anomaly Detection
- URL: http://arxiv.org/abs/2304.07147v1
- Date: Fri, 14 Apr 2023 14:15:27 GMT
- Title: Cross Attention Transformers for Multi-modal Unsupervised Whole-Body PET
Anomaly Detection
- Authors: Ashay Patel, Petru-Danial Tudiosu, Walter H.L. Pinaya, Gary Cook,
Vicky Goh, Sebastien Ourselin, M. Jorge Cardoso
- Abstract summary: 18F-fluorodeoxyglucose is an imaging modality commonly used to detect cancer.
It is challenging to train general-purpose discriminative cancer detection models.
Unsupervised anomaly detection models have been suggested as a putative solution.
- Score: 1.0098107825681861
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Cancer is a highly heterogeneous condition that can occur almost anywhere in
the human body. 18F-fluorodeoxyglucose is an imaging modality commonly used to
detect cancer due to its high sensitivity and clear visualisation of the
pattern of metabolic activity. Nonetheless, as cancer is highly heterogeneous,
it is challenging to train general-purpose discriminative cancer detection
models, with data availability and disease complexity often cited as a limiting
factor. Unsupervised anomaly detection models have been suggested as a putative
solution. These models learn a healthy representation of tissue and detect
cancer by predicting deviations from the healthy norm, which requires models
capable of accurately learning long-range interactions between organs and their
imaging patterns with high levels of expressivity. Such characteristics are
suitably satisfied by transformers, which have been shown to generate
state-of-the-art results in unsupervised anomaly detection by training on
normal data. This work expands upon such approaches by introducing multi-modal
conditioning of the transformer via cross-attention i.e. supplying anatomical
reference from paired CT. Using 294 whole-body PET/CT samples, we show that our
anomaly detection method is robust and capable of achieving accurate cancer
localization results even in cases where normal training data is unavailable.
In addition, we show the efficacy of this approach on out-of-sample data
showcasing the generalizability of this approach with limited training data.
Lastly, we propose to combine model uncertainty with a new kernel density
estimation approach, and show that it provides clinically and statistically
significant improvements when compared to the classic residual-based anomaly
maps. Overall, a superior performance is demonstrated against leading
state-of-the-art alternatives, drawing attention to the potential of these
approaches.
Related papers
- Pancreatic Tumor Segmentation as Anomaly Detection in CT Images Using Denoising Diffusion Models [4.931603088067152]
This study presents a novel approach to pancreatic tumor detection, employing weak supervision anomaly detection through denoising diffusion algorithms.
The method enables seamless translation of images between diseased and healthy subjects, resulting in detailed anomaly maps without requiring complex training protocols and segmentation masks.
Recognizing the low survival rates of pancreatic cancer, this study emphasizes the need for continued research to leverage diffusion models' efficiency in medical segmentation tasks.
arXiv Detail & Related papers (2024-06-04T16:38:11Z) - Adapting Visual-Language Models for Generalizable Anomaly Detection in Medical Images [68.42215385041114]
This paper introduces a novel lightweight multi-level adaptation and comparison framework to repurpose the CLIP model for medical anomaly detection.
Our approach integrates multiple residual adapters into the pre-trained visual encoder, enabling a stepwise enhancement of visual features across different levels.
Our experiments on medical anomaly detection benchmarks demonstrate that our method significantly surpasses current state-of-the-art models.
arXiv Detail & Related papers (2024-03-19T09:28:19Z) - AnomalyDiffusion: Few-Shot Anomaly Image Generation with Diffusion Model [59.08735812631131]
Anomaly inspection plays an important role in industrial manufacture.
Existing anomaly inspection methods are limited in their performance due to insufficient anomaly data.
We propose AnomalyDiffusion, a novel diffusion-based few-shot anomaly generation model.
arXiv Detail & Related papers (2023-12-10T05:13:40Z) - AutoPaint: A Self-Inpainting Method for Unsupervised Anomaly Detection [34.007468043336274]
We propose a robust inpainting model to learn the details of healthy anatomies and reconstruct high-resolution images.
We also propose an autoinpainting pipeline to automatically detect tumors, replace their appearance with the learned healthy anatomies, and based on that segment the tumoral volumes.
arXiv Detail & Related papers (2023-05-21T05:45:38Z) - Prototypical Residual Networks for Anomaly Detection and Localization [80.5730594002466]
We propose a framework called Prototypical Residual Network (PRN)
PRN learns feature residuals of varying scales and sizes between anomalous and normal patterns to accurately reconstruct the segmentation maps of anomalous regions.
We present a variety of anomaly generation strategies that consider both seen and unseen appearance variance to enlarge and diversify anomalies.
arXiv Detail & Related papers (2022-12-05T05:03:46Z) - Fast Unsupervised Brain Anomaly Detection and Segmentation with
Diffusion Models [1.6352599467675781]
We propose a method based on diffusion models to detect and segment anomalies in brain imaging.
Our diffusion models achieve competitive performance compared with autoregressive approaches across a series of experiments with 2D CT and MRI data.
arXiv Detail & Related papers (2022-06-07T17:30:43Z) - Debiasing pipeline improves deep learning model generalization for X-ray
based lung nodule detection [11.228544549618068]
Lung cancer is the leading cause of cancer death worldwide and a good prognosis depends on early diagnosis.
We show that an image pre-processing pipeline that homogenizes and debiases chest X-ray images can improve both internal classification and external generalization.
An evolutionary pruning mechanism is used to train a nodule detection deep learning model on the most informative images from a publicly available lung nodule X-ray dataset.
arXiv Detail & Related papers (2022-01-24T10:08:07Z) - Explainable Deep Few-shot Anomaly Detection with Deviation Networks [123.46611927225963]
We introduce a novel weakly-supervised anomaly detection framework to train detection models.
The proposed approach learns discriminative normality by leveraging the labeled anomalies and a prior probability.
Our model is substantially more sample-efficient and robust, and performs significantly better than state-of-the-art competing methods in both closed-set and open-set settings.
arXiv Detail & Related papers (2021-08-01T14:33:17Z) - Image Synthesis as a Pretext for Unsupervised Histopathological
Diagnosis [3.7692411550925673]
Anomaly detection in visual data refers to the problem of differentiating abnormal appearances from normal cases.
Recent advances in deep generative-based models have sparked interest in applying such methods for unsupervised anomaly detection.
arXiv Detail & Related papers (2021-04-28T14:37:23Z) - Many-to-One Distribution Learning and K-Nearest Neighbor Smoothing for
Thoracic Disease Identification [83.6017225363714]
deep learning has become the most powerful computer-aided diagnosis technology for improving disease identification performance.
For chest X-ray imaging, annotating large-scale data requires professional domain knowledge and is time-consuming.
In this paper, we propose many-to-one distribution learning (MODL) and K-nearest neighbor smoothing (KNNS) methods to improve a single model's disease identification performance.
arXiv Detail & Related papers (2021-02-26T02:29:30Z) - Manifolds for Unsupervised Visual Anomaly Detection [79.22051549519989]
Unsupervised learning methods that don't necessarily encounter anomalies in training would be immensely useful.
We develop a novel hyperspherical Variational Auto-Encoder (VAE) via stereographic projections with a gyroplane layer.
We present state-of-the-art results on visual anomaly benchmarks in precision manufacturing and inspection, demonstrating real-world utility in industrial AI scenarios.
arXiv Detail & Related papers (2020-06-19T20:41:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.