Universal Undersampled MRI Reconstruction
- URL: http://arxiv.org/abs/2103.05214v1
- Date: Tue, 9 Mar 2021 04:25:22 GMT
- Title: Universal Undersampled MRI Reconstruction
- Authors: Xinwen Liu, Jing Wang, Feng Liu, and S.Kevin Zhou
- Abstract summary: We propose a framework to learn a universal deep neural network for undersampled MRI reconstruction.
Specifically, anatomy-specific instance normalization is proposed to compensate for statistical shift and allow easy generalization to new datasets.
Experimental results show the proposed universal model can reconstruct both brain and knee images with high image quality.
- Score: 12.731566667990315
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deep neural networks have been extensively studied for undersampled MRI
reconstruction. While achieving state-of-the-art performance, they are trained
and deployed specifically for one anatomy with limited generalization ability
to another anatomy. Rather than building multiple models, a universal model
that reconstructs images across different anatomies is highly desirable for
efficient deployment and better generalization. Simply mixing images from
multiple anatomies for training a single network does not lead to an ideal
universal model due to the statistical shift among datasets of various
anatomies, the need to retrain from scratch on all datasets with the addition
of a new dataset, and the difficulty in dealing with imbalanced sampling when
the new dataset is further of a smaller size. In this paper, for the first
time, we propose a framework to learn a universal deep neural network for
undersampled MRI reconstruction. Specifically, anatomy-specific instance
normalization is proposed to compensate for statistical shift and allow easy
generalization to new datasets. Moreover, the universal model is trained by
distilling knowledge from available independent models to further exploit
representations across anatomies. Experimental results show the proposed
universal model can reconstruct both brain and knee images with high image
quality. Also, it is easy to adapt the trained model to new datasets of smaller
size, i.e., abdomen, cardiac and prostate, with little effort and superior
performance.
Related papers
- A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements.
Our model is based on neural operators, a discretization-agnostic architecture.
Our inference speed is also 1,400x faster than diffusion methods.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - MASSM: An End-to-End Deep Learning Framework for Multi-Anatomy Statistical Shape Modeling Directly From Images [1.9029890402585894]
We introduce MASSM, a novel end-to-end deep learning framework that simultaneously localizes multiple anatomies, estimates population-level statistical representations, and delineates shape representations directly in image space.
Our results show that MASSM, which delineates anatomy in image space and handles multiple anatomies through a multitask network, provides superior shape information compared to segmentation networks for medical imaging tasks.
arXiv Detail & Related papers (2024-03-16T20:16:37Z) - Patched Diffusion Models for Unsupervised Anomaly Detection in Brain MRI [55.78588835407174]
We propose a method that reformulates the generation task of diffusion models as a patch-based estimation of healthy brain anatomy.
We evaluate our approach on data of tumors and multiple sclerosis lesions and demonstrate a relative improvement of 25.1% compared to existing baselines.
arXiv Detail & Related papers (2023-03-07T09:40:22Z) - Model-Guided Multi-Contrast Deep Unfolding Network for MRI
Super-resolution Reconstruction [68.80715727288514]
We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix.
In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
arXiv Detail & Related papers (2022-09-15T03:58:30Z) - Seeking Common Ground While Reserving Differences: Multiple Anatomy
Collaborative Framework for Undersampled MRI Reconstruction [49.16058553281751]
We present a novel deep MRI reconstruction framework with both anatomy-shared and anatomy-specific parameterized learners.
Experiments on brain, knee and cardiac MRI datasets demonstrate that three of these learners are able to enhance reconstruction performance via multiple anatomy collaborative learning.
arXiv Detail & Related papers (2022-06-15T08:19:07Z) - Transfer Learning Enhanced Generative Adversarial Networks for
Multi-Channel MRI Reconstruction [3.5765797841178597]
Deep learning based generative adversarial networks (GAN) can effectively perform image reconstruction with under-sampled MR data.
It is difficult to obtain tens of thousands of raw patient data to train the model since saving k-space data is not in the routine clinical flow.
In this study, three novel applications were explored based on parallel imaging combined with the GAN model (PI-GAN) and transfer learning.
arXiv Detail & Related papers (2021-05-17T21:28:00Z) - You Only Learn Once: Universal Anatomical Landmark Detection [8.116895827446088]
We develop a universal anatomical landmark detection model to realize multiple landmark detection tasks.
The model consists of a local network and a global network.
We evaluate our YOLO model on three X-ray datasets of 1,588 images on the head, hand, and chest, collectively contributing 62 landmarks.
arXiv Detail & Related papers (2021-03-08T10:38:52Z) - Progressively Volumetrized Deep Generative Models for Data-Efficient
Contextual Learning of MR Image Recovery [0.0]
We introduce a novel progressive volumetrization strategy for generative models (ProvoGAN)
ProvoGAN serially decomposes complex volumetric image recovery tasks into successive cross-sectional mappings task-optimally ordered across individual rectilinear dimensions.
Comprehensive demonstrations on mainstream MRI reconstruction and synthesis tasks show that ProvoGAN yields superior performance to state-of-the-art volumetric and cross-sectional models.
arXiv Detail & Related papers (2020-11-27T18:55:56Z) - Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization.
We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise.
We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
arXiv Detail & Related papers (2020-06-11T17:29:53Z) - MS-Net: Multi-Site Network for Improving Prostate Segmentation with
Heterogeneous MRI Data [75.73881040581767]
We propose a novel multi-site network (MS-Net) for improving prostate segmentation by learning robust representations.
Our MS-Net improves the performance across all datasets consistently, and outperforms state-of-the-art methods for multi-site learning.
arXiv Detail & Related papers (2020-02-09T14:11:50Z) - Multi-site fMRI Analysis Using Privacy-preserving Federated Learning and
Domain Adaptation: ABIDE Results [13.615292855384729]
To train a high-quality deep learning model, the aggregation of a significant amount of patient information is required.
Due to the need to protect the privacy of patient data, it is hard to assemble a central database from multiple institutions.
Federated learning allows for population-level models to be trained without centralizing entities' data.
arXiv Detail & Related papers (2020-01-16T04:49:33Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.