MRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model

• URL: http://arxiv.org/abs/2402.10609v2
• Date: Fri, 5 Jul 2024 07:49:01 GMT
• Title: MRPD: Undersampled MRI reconstruction by prompting a large latent diffusion model
• Authors: Ziqi Gao, S. Kevin Zhou,
• Abstract summary: We propose a novel framework for undersampled MRI Reconstruction by Prompting a large latent Diffusion model (MRPD) For unsupervised reconstruction, MRSampler guides LLDM with a random-phase-modulated hard-to-soft control. Experiments on FastMRI and IXI show that MRPD is the only model that supports both MRI database-free and database-available scenarios.
• Score: 18.46762698682188
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Implicit visual knowledge in a large latent diffusion model (LLDM) pre-trained on natural images is rich and hypothetically universal to natural and medical images. To test this hypothesis from a practical perspective, we propose a novel framework for undersampled MRI Reconstruction by Prompting a large latent Diffusion model (MRPD). While the existing methods trained on MRI datasets are typically of limited generalizability toward diverse data acquisition scenarios, MRPD supports unsupervised and universally adaptive MRI reconstruction. For unsupervised reconstruction, MRSampler guides LLDM with a random-phase-modulated hard-to-soft control. With any single- or multiple-source MRI dataset, MRPD's performance is boosted universally by a lightweight MRAdapter that only finetunes the LLDM's autoencoder. Experiments on FastMRI and IXI show that MRPD is the only model that supports both MRI database-free and database-available scenarios and attains the best generalizability towards out-of-domain (OOD) samplings, contrasts, and organs among compared unsupervised, supervised, and MRI diffusion methods. To our knowledge, MRPD is the first method that empirically shows the universal prowess of an LLDM pre-trained on vast natural images for MRI. Our official implementation is at https://github.com/Z7Gao/MRPD.

Related papers

• LDPM: Towards undersampled MRI reconstruction with MR-VAE and Latent Diffusion Prior [2.3007720628527104]
  A Latent Diffusion Prior based undersampled MRI reconstruction (LDPM) method is proposed. A sketcher module is utilized to provide appropriate control and balance the quality and fidelity of the reconstructed MR images. A VAE adapted for MRI tasks (MR-VAE) is explored, which can serve as the backbone for future MR-related tasks.
  arXiv  Detail & Related papers  (2024-11-05T09:51:59Z)
• Towards General Text-guided Image Synthesis for Customized Multimodal Brain MRI Generation [51.28453192441364]
  Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. Current MR image synthesis approaches are typically trained on independent datasets for specific tasks. We present TUMSyn, a Text-guided Universal MR image Synthesis model, which can flexibly generate brain MR images.
  arXiv  Detail & Related papers  (2024-09-25T11:14:47Z)
• NeuroPictor: Refining fMRI-to-Image Reconstruction via Multi-individual Pretraining and Multi-level Modulation [55.51412454263856]
  This paper proposes to directly modulate the generation process of diffusion models using fMRI signals. By training with about 67,000 fMRI-image pairs from various individuals, our model enjoys superior fMRI-to-image decoding capacity.
  arXiv  Detail & Related papers  (2024-03-27T02:42:52Z)
• Fast Controllable Diffusion Models for Undersampled MRI Reconstruction [9.257507373275288]
  This study introduces a new algorithm called Predictor-Projector-Noisor (PPN), which enhances controllable generation of diffusion models for undersampled MRI reconstruction. Our results demonstrate that PPN produces high-fidelity MR images that conform to undersampled k-space measurements with significantly shorter reconstruction time than other controllable sampling methods.
  arXiv  Detail & Related papers  (2023-11-20T05:58:05Z)
• InverseSR: 3D Brain MRI Super-Resolution Using a Latent Diffusion Model [1.4126798060929953]
  High-resolution (HR) MRI scans obtained from research-grade medical centers provide precise information about imaged tissues. routine clinical MRI scans are typically in low-resolution (LR) End-to-end deep learning methods for MRI super-resolution (SR) have been proposed, but they require re-training each time there is a shift in the input distribution. We propose a novel approach that leverages a state-of-the-art 3D brain generative model, the latent diffusion model (LDM) trained on UK BioBank.
  arXiv  Detail & Related papers  (2023-08-23T23:04:42Z)
• One for Multiple: Physics-informed Synthetic Data Boosts Generalizable Deep Learning for Fast MRI Reconstruction [20.84830225817378]
  Deep Learning (DL) has proven effective for fast MRI image reconstruction, but its broader applicability has been constrained. We present a novel Physics-Informed Synthetic data learning framework for Fast MRI, called PISF. PISF marks a breakthrough by enabling generalized DL for multi-scenario MRI reconstruction through a single trained model.
  arXiv  Detail & Related papers  (2023-07-25T03:11:24Z)
• Optimizing Sampling Patterns for Compressed Sensing MRI with Diffusion Generative Models [75.52575380824051]
  We present a learning method to optimize sub-sampling patterns for compressed sensing multi-coil MRI. We use a single-step reconstruction based on the posterior mean estimate given by the diffusion model and the MRI measurement process. Our method requires as few as five training images to learn effective sampling patterns.
  arXiv  Detail & Related papers  (2023-06-05T22:09:06Z)
• Iterative Data Refinement for Self-Supervised MR Image Reconstruction [18.02961646651716]
  We propose a data refinement framework for self-supervised MR image reconstruction. We first analyze the reason of the performance gap between self-supervised and supervised methods. Then, we design an effective self-supervised training data refinement method to reduce this data bias.
  arXiv  Detail & Related papers  (2022-11-24T06:57:16Z)
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction [68.80715727288514]
  We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix. In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
  arXiv  Detail & Related papers  (2022-09-15T03:58:30Z)
• A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction [50.1787181309337]
  We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
  arXiv  Detail & Related papers  (2022-03-28T14:03:45Z)
• Multi-institutional Collaborations for Improving Deep Learning-based Magnetic Resonance Image Reconstruction Using Federated Learning [62.17532253489087]
  Deep learning methods have been shown to produce superior performance on MR image reconstruction. These methods require large amounts of data which is difficult to collect and share due to the high cost of acquisition and medical data privacy regulations. We propose a federated learning (FL) based solution in which we take advantage of the MR data available at different institutions while preserving patients' privacy.
  arXiv  Detail & Related papers  (2021-03-03T03:04:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.