Nonlinear Equivariant Imaging: Learning Multi-Parametric Tissue Mapping
without Ground Truth for Compressive Quantitative MRI
- URL: http://arxiv.org/abs/2211.12786v1
- Date: Wed, 23 Nov 2022 09:04:14 GMT
- Title: Nonlinear Equivariant Imaging: Learning Multi-Parametric Tissue Mapping
without Ground Truth for Compressive Quantitative MRI
- Authors: Ketan Fatania, Kwai Y. Chau, Carolin M. Pirkl, Marion I. Menzel, Peter
Hall and Mohammad Golbabaee
- Abstract summary: Current state-of-the-art reconstruction for quantitative tissue maps from fast compressive Fingerprint, Magnetic Resonanceing (MRF)
Use supervised deep learning with the drawback of requiring high-fidelity ground truth tissue map training data which is limited.
This paper proposes a self-supervised learning approach to eliminate the need for ground truth deep MRF image reconstruction.
- Score: 4.576908868578682
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Current state-of-the-art reconstruction for quantitative tissue maps from
fast, compressive, Magnetic Resonance Fingerprinting (MRF), use supervised deep
learning, with the drawback of requiring high-fidelity ground truth tissue map
training data which is limited. This paper proposes NonLinear Equivariant
Imaging (NLEI), a self-supervised learning approach to eliminate the need for
ground truth for deep MRF image reconstruction. NLEI extends the recent
Equivariant Imaging framework to nonlinear inverse problems such as MRF. Only
fast, compressed-sampled MRF scans are used for training. NLEI learns tissue
mapping using spatiotemporal priors: spatial priors are obtained from the
invariance of MRF data to a group of geometric image transformations, while
temporal priors are obtained from a nonlinear Bloch response model approximated
by a pre-trained neural network. Tested retrospectively on two acquisition
settings, we observe that NLEI (self-supervised learning) closely approaches
the performance of supervised learning, despite not using ground truth during
training.
Related papers
- Improved Patch Denoising Diffusion Probabilistic Models for Magnetic Resonance Fingerprinting [7.379135816468852]
Magnetic Resonance Fingerprinting (MRF) is a time-efficient approach to quantitative MRI.
achieving accurate reconstructions remains challenging, particularly in highly accelerated and undersampled acquisitions.
We propose for the first time a conditional diffusion probabilistic model for MRF image reconstruction.
arXiv Detail & Related papers (2024-10-29T21:38:54Z) - StoDIP: Efficient 3D MRF image reconstruction with deep image priors and stochastic iterations [3.4453266252081645]
We introduce StoDIP, a new algorithm that extends the ground-truth-free Deep Image Prior (DIP) reconstruction to 3D MRF imaging.
tested on a dataset of whole-brain scans from healthy volunteers, StoDIP demonstrated superior performance over the ground-truth-free reconstruction baselines, both quantitatively and qualitatively.
arXiv Detail & Related papers (2024-08-05T10:32:06Z) - Optimizing Sampling Patterns for Compressed Sensing MRI with Diffusion
Generative Models [75.52575380824051]
We present a learning method to optimize sub-sampling patterns for compressed sensing multi-coil MRI.
We use a single-step reconstruction based on the posterior mean estimate given by the diffusion model and the MRI measurement process.
Our method requires as few as five training images to learn effective sampling patterns.
arXiv Detail & Related papers (2023-06-05T22:09:06Z) - Compressed Sensing MRI Reconstruction Regularized by VAEs with
Structured Image Covariance [7.544757765701024]
This paper investigates how generative models, trained on ground-truth images, can be used changesas priors for inverse problems.
We utilize variational autoencoders (VAEs) that generate not only an image but also a covariance uncertainty matrix for each image.
We compare our proposed learned regularization against other unlearned regularization approaches and unsupervised and supervised deep learning methods.
arXiv Detail & Related papers (2022-10-26T09:51:49Z) - Stable Deep MRI Reconstruction using Generative Priors [13.400444194036101]
We propose a novel deep neural network based regularizer which is trained in a generative setting on reference magnitude images only.
The results demonstrate competitive performance, on par with state-of-the-art end-to-end deep learning methods.
arXiv Detail & Related papers (2022-10-25T08:34:29Z) - PatchNR: Learning from Small Data by Patch Normalizing Flow
Regularization [57.37911115888587]
We introduce a regularizer for the variational modeling of inverse problems in imaging based on normalizing flows.
Our regularizer, called patchNR, involves a normalizing flow learned on patches of very few images.
arXiv Detail & Related papers (2022-05-24T12:14:26Z) - Unsupervised MRI Reconstruction via Zero-Shot Learned Adversarial
Transformers [0.0]
We introduce a novel unsupervised MRI reconstruction method based on zero-Shot Learned Adrial TransformERs (SLATER)
A zero-shot reconstruction is performed on undersampled test data, where inference is performed by optimizing network parameters.
Experiments on brain MRI datasets clearly demonstrate the superior performance of SLATER against several state-of-the-art unsupervised methods.
arXiv Detail & Related papers (2021-05-15T02:01:21Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction.
Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
arXiv Detail & Related papers (2020-10-05T14:18:52Z) - Data Consistent CT Reconstruction from Insufficient Data with Learned
Prior Images [70.13735569016752]
We investigate the robustness of deep learning in CT image reconstruction by showing false negative and false positive lesion cases.
We propose a data consistent reconstruction (DCR) method to improve their image quality, which combines the advantages of compressed sensing and deep learning.
The efficacy of the proposed method is demonstrated in cone-beam CT with truncated data, limited-angle data and sparse-view data, respectively.
arXiv Detail & Related papers (2020-05-20T13:30:49Z) - Compressive sensing with un-trained neural networks: Gradient descent
finds the smoothest approximation [60.80172153614544]
Un-trained convolutional neural networks have emerged as highly successful tools for image recovery and restoration.
We show that an un-trained convolutional neural network can approximately reconstruct signals and images that are sufficiently structured, from a near minimal number of random measurements.
arXiv Detail & Related papers (2020-05-07T15:57:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.