Training Physics-Driven Deep Learning Reconstruction without Raw Data Access for Equitable Fast MRI
- URL: http://arxiv.org/abs/2411.13022v1
- Date: Wed, 20 Nov 2024 03:53:41 GMT
- Title: Training Physics-Driven Deep Learning Reconstruction without Raw Data Access for Equitable Fast MRI
- Authors: Yaşar Utku Alçalar, Merve Gülle, Mehmet Akçakaya,
- Abstract summary: Physics-driven deep learning (PD-DL) approaches have become popular for improved reconstruction of fast magnetic resonance imaging (MRI) scans.
PD-DL offers higher acceleration rates compared to existing clinical fast MRI techniques, but their use has been limited outside specialized MRI centers.
One impediment for their deployment is the difficulties with generalization to pathologies or population groups that are not well-represented in training sets.
CUPID achieves similar quality compared to well-established PD-DL training strategies that require raw k-space data access.
- Score: 2.512491726995032
- License:
- Abstract: Physics-driven deep learning (PD-DL) approaches have become popular for improved reconstruction of fast magnetic resonance imaging (MRI) scans. Even though PD-DL offers higher acceleration rates compared to existing clinical fast MRI techniques, their use has been limited outside specialized MRI centers. One impediment for their deployment is the difficulties with generalization to pathologies or population groups that are not well-represented in training sets. This has been noted in several studies, and fine-tuning on target populations to improve reconstruction has been suggested. However, current approaches for PD-DL training require access to raw k-space measurements, which is typically only available at specialized MRI centers that have research agreements for such data access. This is especially an issue for rural and underserved areas, where commercial MRI scanners only provide access to a final reconstructed image. To tackle these challenges, we propose Compressibility-inspired Unsupervised Learning via Parallel Imaging Fidelity (CUPID) for high-quality PD-DL training, using only routine clinical reconstructed images exported from an MRI scanner. CUPID evaluates the goodness of the output with a compressibility-based approach, while ensuring that the output stays consistent with the clinical parallel imaging reconstruction through well-designed perturbations. Our results show that CUPID achieves similar quality compared to well-established PD-DL training strategies that require raw k-space data access, while outperforming conventional compressed sensing (CS) and state-of-the-art generative methods. We also demonstrate its effectiveness in a zero-shot training setup for retrospectively and prospectively sub-sampled acquisitions, attesting to its minimal training burden.
Related papers
- Deep Learning for Accelerated and Robust MRI Reconstruction: a Review [28.663292249133864]
Deep learning (DL) has emerged as a pivotal technology for enhancing magnetic resonance imaging (MRI)
This review paper provides a comprehensive overview of recent advances in DL for MRI reconstruction.
arXiv Detail & Related papers (2024-04-24T07:02:03Z) - fMRI-PTE: A Large-scale fMRI Pretrained Transformer Encoder for
Multi-Subject Brain Activity Decoding [54.17776744076334]
We propose fMRI-PTE, an innovative auto-encoder approach for fMRI pre-training.
Our approach involves transforming fMRI signals into unified 2D representations, ensuring consistency in dimensions and preserving brain activity patterns.
Our contributions encompass introducing fMRI-PTE, innovative data transformation, efficient training, a novel learning strategy, and the universal applicability of our approach.
arXiv Detail & Related papers (2023-11-01T07:24:22Z) - Unpaired MRI Super Resolution with Contrastive Learning [33.65350200042909]
Deep learning-based image super-resolution methods exhibit promise in improving MRI resolution without additional cost.
Due to lacking of aligned high-resolution (HR) and low-resolution (LR) MRI image pairs, unsupervised approaches are widely adopted for SR reconstruction with unpaired MRI images.
We propose an unpaired MRI SR approach that employs contrastive learning to enhance SR performance with limited HR data.
arXiv Detail & Related papers (2023-10-24T12:13:51Z) - CMRxRecon: An open cardiac MRI dataset for the competition of
accelerated image reconstruction [62.61209705638161]
There has been growing interest in deep learning-based CMR imaging algorithms.
Deep learning methods require large training datasets.
This dataset includes multi-contrast, multi-view, multi-slice and multi-coil CMR imaging data from 300 subjects.
arXiv Detail & Related papers (2023-09-19T15:14:42Z) - Disruptive Autoencoders: Leveraging Low-level features for 3D Medical
Image Pre-training [51.16994853817024]
This work focuses on designing an effective pre-training framework for 3D radiology images.
We introduce Disruptive Autoencoders, a pre-training framework that attempts to reconstruct the original image from disruptions created by a combination of local masking and low-level perturbations.
The proposed pre-training framework is tested across multiple downstream tasks and achieves state-of-the-art performance.
arXiv Detail & Related papers (2023-07-31T17:59:42Z) - One for Multiple: Physics-informed Synthetic Data Boosts Generalizable
Deep Learning for Fast MRI Reconstruction [20.84830225817378]
Deep Learning (DL) has proven effective for fast MRI image reconstruction, but its broader applicability has been constrained.
We present a novel Physics-Informed Synthetic data learning framework for Fast MRI, called PISF.
PISF marks a breakthrough by enabling generalized DL for multi-scenario MRI reconstruction through a single trained model.
arXiv Detail & Related papers (2023-07-25T03:11:24Z) - Domain Transfer Through Image-to-Image Translation for Uncertainty-Aware Prostate Cancer Classification [42.75911994044675]
We present a novel approach for unpaired image-to-image translation of prostate MRIs and an uncertainty-aware training approach for classifying clinically significant PCa.
Our approach involves a novel pipeline for translating unpaired 3.0T multi-parametric prostate MRIs to 1.5T, thereby augmenting the available training data.
Our experiments demonstrate that the proposed method significantly improves the Area Under ROC Curve (AUC) by over 20% compared to the previous work.
arXiv Detail & Related papers (2023-07-02T05:26:54Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - A Long Short-term Memory Based Recurrent Neural Network for
Interventional MRI Reconstruction [50.1787181309337]
We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling.
The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
arXiv Detail & Related papers (2022-03-28T14:03:45Z) - Multi-institutional Collaborations for Improving Deep Learning-based
Magnetic Resonance Image Reconstruction Using Federated Learning [62.17532253489087]
Deep learning methods have been shown to produce superior performance on MR image reconstruction.
These methods require large amounts of data which is difficult to collect and share due to the high cost of acquisition and medical data privacy regulations.
We propose a federated learning (FL) based solution in which we take advantage of the MR data available at different institutions while preserving patients' privacy.
arXiv Detail & Related papers (2021-03-03T03:04:40Z) - High-Fidelity Accelerated MRI Reconstruction by Scan-Specific
Fine-Tuning of Physics-Based Neural Networks [3.1498833540989413]
Long scan duration remains a challenge for high-resolution MRI.
Deep learning has emerged as a powerful means for accelerated MRI reconstruction by providing data-driven regularizers that are directly learned from data.
In this study, we propose to use a transfer learning approach to fine-tune these regularizers for new subjects using a self-supervision approach.
arXiv Detail & Related papers (2020-05-12T05:10:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.