Lesion-Specific Prediction with Discriminator-Based Supervised Guided
Attention Module Enabled GANs in Multiple Sclerosis
- URL: http://arxiv.org/abs/2208.14533v1
- Date: Tue, 30 Aug 2022 20:37:38 GMT
- Title: Lesion-Specific Prediction with Discriminator-Based Supervised Guided
Attention Module Enabled GANs in Multiple Sclerosis
- Authors: Jueqi Wang, Derek Berger, Erin Mazerolle, Jean-Alexis Delamer and
Jacob Levman
- Abstract summary: Multiple Sclerosis (MS) is a chronic neurological condition characterized by the development of lesions in the white matter of the brain.
In this study, we propose a novel modification to generative adversarial networks (GANs) to predict future lesion-specific FLAIR MRI for MS at fixed time intervals.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Multiple Sclerosis (MS) is a chronic neurological condition characterized by
the development of lesions in the white matter of the brain. T2-fluid
attenuated inversion recovery (FLAIR) brain magnetic resonance imaging (MRI)
provides superior visualization and characterization of MS lesions, relative to
other MRI modalities. Follow-up brain FLAIR MRI in MS provides helpful
information for clinicians towards monitoring disease progression. In this
study, we propose a novel modification to generative adversarial networks
(GANs) to predict future lesion-specific FLAIR MRI for MS at fixed time
intervals. We use supervised guided attention and dilated convolutions in the
discriminator, which supports making an informed prediction of whether the
generated images are real or not based on attention to the lesion area, which
in turn has potential to help improve the generator to predict the lesion area
of future examinations more accurately. We compared our method to several
baselines and one state-of-art CF-SAGAN model [1]. In conclusion, our results
indicate that the proposed method achieves higher accuracy and reduces the
standard deviation of the prediction errors in the lesion area compared with
other models with similar overall performance.
Related papers
- TADM: Temporally-Aware Diffusion Model for Neurodegenerative Progression on Brain MRI [4.414541804340033]
Temporally-Aware Diffusion Model (TADM) learns the distribution of structural changes in terms of intensity differences between scans.
During training, we propose to leverage a pre-trained Brain-Age Estimator (BAE) to refine the model's training process.
Our approach will benefit applications, such as predicting patient outcomes or improving treatments for patients.
arXiv Detail & Related papers (2024-06-18T09:00:49Z) - Spatiotemporal Graph Neural Network Modelling Perfusion MRI [12.712005118761516]
Per vascular MRI (pMRI) offers valuable insights into tumority and promises to predict tumor genotypes.
Yet effective models tailored to 4D pMRI are still lacking.
This study presents the first attempt to model 4D pMRI using a GNN-based model.
arXiv Detail & Related papers (2024-06-10T16:24:46Z) - Cross-modality Guidance-aided Multi-modal Learning with Dual Attention
for MRI Brain Tumor Grading [47.50733518140625]
Brain tumor represents one of the most fatal cancers around the world, and is very common in children and the elderly.
We propose a novel cross-modality guidance-aided multi-modal learning with dual attention for addressing the task of MRI brain tumor grading.
arXiv Detail & Related papers (2024-01-17T07:54:49Z) - Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and
Dynamic PROPELLER MRI [76.60362295758596]
Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information.
We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
arXiv Detail & Related papers (2023-11-22T05:44:51Z) - Diffusion Models for Counterfactual Generation and Anomaly Detection in
Brain Images [59.85702949046042]
We present a weakly supervised method to generate a healthy version of a diseased image and then use it to obtain a pixel-wise anomaly map.
We employ a diffusion model trained on healthy samples and combine Denoising Diffusion Probabilistic Model (DDPM) and Denoising Implicit Model (DDIM) at each step of the sampling process.
We verify that when our method is applied to healthy samples, the input images are reconstructed without significant modifications.
arXiv Detail & Related papers (2023-08-03T21:56:50Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - Temporally Adjustable Longitudinal Fluid-Attenuated Inversion Recovery
MRI Estimation / Synthesis for Multiple Sclerosis [0.0]
Multiple Sclerosis (MS) is a chronic progressive neurological disease characterized by the development of lesions in the white matter of the brain.
FLAIR brain magnetic resonance imaging (MRI) provides superior visualization and characterization of MS lesions, relative to other MRI modalities.
Longitudinal brain FLAIR MRI in MS, involving repetitively imaging a patient over time, provides helpful information for clinicians towards monitoring disease progression.
Predicting future whole brain MRI examinations with variable time lag has only been attempted in limited applications, such as healthy aging and structural degeneration in Alzheimer's Disease.
arXiv Detail & Related papers (2022-09-09T12:42:00Z) - Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and
Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods.
We will detail the research in coupling physics and data driven models for MRI acceleration.
Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
arXiv Detail & Related papers (2022-04-01T22:48:08Z) - Interpretability Aware Model Training to Improve Robustness against
Out-of-Distribution Magnetic Resonance Images in Alzheimer's Disease
Classification [8.050897403457995]
We propose an interpretability aware adversarial training regime to improve robustness against out-of-distribution samples originating from different MRI hardware.
We present preliminary results showing promising performance on out-of-distribution samples.
arXiv Detail & Related papers (2021-11-15T04:42:47Z) - Multiple Sclerosis Lesion Analysis in Brain Magnetic Resonance Images:
Techniques and Clinical Applications [22.410543483471915]
Multiple sclerosis (MS) is a chronic inflammatory and degenerative disease of the central nervous system.
Traditionally, MS lesions have been manually annotated on 2D MRI slices.
Deep learning techniques have achieved remarkable breakthroughs in the MS lesion segmentation task.
arXiv Detail & Related papers (2021-04-20T15:08:51Z) - A Graph Gaussian Embedding Method for Predicting Alzheimer's Disease
Progression with MEG Brain Networks [59.15734147867412]
Characterizing the subtle changes of functional brain networks associated with Alzheimer's disease (AD) is important for early diagnosis and prediction of disease progression.
We developed a new deep learning method, termed multiple graph Gaussian embedding model (MG2G)
We used MG2G to detect the intrinsic latent dimensionality of MEG brain networks, predict the progression of patients with mild cognitive impairment (MCI) to AD, and identify brain regions with network alterations related to MCI.
arXiv Detail & Related papers (2020-05-08T02:29:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.