Generative AI for Rapid Diffusion MRI with Improved Image Quality,
Reliability and Generalizability
- URL: http://arxiv.org/abs/2303.05686v2
- Date: Fri, 6 Oct 2023 12:35:11 GMT
- Title: Generative AI for Rapid Diffusion MRI with Improved Image Quality,
Reliability and Generalizability
- Authors: Amir Sadikov, Xinlei Pan, Hannah Choi, Lanya T. Cai, Pratik Mukherjee
- Abstract summary: We employ a Swin UNEt Transformers model, trained on augmented Human Connectome Project data, to perform generalized denoising of dMRI.
We demonstrate super-resolution with artificially downsampled HCP data in normal adult volunteers.
We exceed current state-of-the-art denoising methods in accuracy and test-retest reliability of rapid diffusion tensor imaging requiring only 90 seconds of scan time.
- Score: 3.6119644566822484
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Diffusion MRI is a non-invasive, in-vivo biomedical imaging method for
mapping tissue microstructure. Applications include structural connectivity
imaging of the human brain and detecting microstructural neural changes.
However, acquiring high signal-to-noise ratio dMRI datasets with high angular
and spatial resolution requires prohibitively long scan times, limiting usage
in many important clinical settings, especially for children, the elderly, and
in acute neurological disorders that may require conscious sedation or general
anesthesia. We employ a Swin UNEt Transformers model, trained on augmented
Human Connectome Project data and conditioned on registered T1 scans, to
perform generalized denoising of dMRI. We also qualitatively demonstrate
super-resolution with artificially downsampled HCP data in normal adult
volunteers. Remarkably, Swin UNETR can be fine-tuned for an out-of-domain
dataset with a single example scan, as we demonstrate on dMRI of children with
neurodevelopmental disorders and of adults with acute evolving traumatic brain
injury, each cohort scanned on different models of scanners with different
imaging protocols at different sites. We exceed current state-of-the-art
denoising methods in accuracy and test-retest reliability of rapid diffusion
tensor imaging requiring only 90 seconds of scan time. Applied to tissue
microstructural modeling of dMRI, Swin UNETR denoising achieves dramatic
improvements over the state-of-the-art for test-retest reliability of
intracellular volume fraction and free water fraction measurements and can
remove heavy-tail noise, improving biophysical modeling fidelity. Swin UNeTR
enables rapid diffusion MRI with unprecedented accuracy and reliability,
especially for probing biological tissues for scientific and clinical
applications. The code and model are publicly available at
https://github.com/ucsfncl/dmri-swin.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models [0.0]
This research introduces a novel architecture that is able to generate multiple, related PET-CT-tumour mask pairs using paired networks and conditional encoders.
Our approach includes innovative, time step-controlled mechanisms and a noise-seeding' strategy to improve DDPM sampling consistency.
arXiv Detail & Related papers (2024-03-26T14:21:49Z) - Style transfer between Microscopy and Magnetic Resonance Imaging via
Generative Adversarial Network in small sample size settings [49.84018914962972]
Cross-modal augmentation of Magnetic Resonance Imaging (MRI) and microscopic imaging based on the same tissue samples is promising.
We tested a method for generating microscopic histological images from MRI scans of the corpus callosum using conditional generative adversarial network (cGAN) architecture.
arXiv Detail & Related papers (2023-10-16T13:58:53Z) - One for Multiple: Physics-informed Synthetic Data Boosts Generalizable
Deep Learning for Fast MRI Reconstruction [20.84830225817378]
Deep Learning (DL) has proven effective for fast MRI image reconstruction, but its broader applicability has been constrained.
We present a novel Physics-Informed Synthetic data learning framework for Fast MRI, called PISF.
PISF marks a breakthrough by enabling generalized DL for multi-scenario MRI reconstruction through a single trained model.
arXiv Detail & Related papers (2023-07-25T03:11:24Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Automatic Diagnosis of Myocarditis Disease in Cardiac MRI Modality using
Deep Transformers and Explainable Artificial Intelligence [20.415917092103033]
Myocarditis is a significant cardiovascular disease (CVD) that poses a threat to the health of many individuals.
The occurrence of microbes and viruses, including the likes of HIV, plays a crucial role in the development of myocarditis disease (MCD)
The proposed CADS consists of several steps, including dataset, preprocessing, feature extraction, classification, and post-processing.
arXiv Detail & Related papers (2022-10-26T10:34:20Z) - Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and
Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods.
We will detail the research in coupling physics and data driven models for MRI acceleration.
Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
arXiv Detail & Related papers (2022-04-01T22:48:08Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z) - FREA-Unet: Frequency-aware U-net for Modality Transfer [9.084926957557842]
We propose a new frequency-aware attention U-net for generating synthetic PET images from MRI data.
Our attention Unet computes the attention scores for feature maps in low/high frequency layers and use it to help the model focus more on the most important regions.
arXiv Detail & Related papers (2020-12-31T01:58:44Z) - Microvascular Dynamics from 4D Microscopy Using Temporal Segmentation [81.30750944868142]
We are able to track changes in cerebral blood volume over time and identify spontaneous arterial dilations that propagate towards the pial surface.
This new imaging capability is a promising step towards characterizing the hemodynamic response function upon which functional magnetic resonance imaging (fMRI) is based.
arXiv Detail & Related papers (2020-01-14T22:55:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.