3D High-Quality Magnetic Resonance Image Restoration in Clinics Using
Deep Learning
- URL: http://arxiv.org/abs/2111.14259v1
- Date: Sun, 28 Nov 2021 22:58:00 GMT
- Title: 3D High-Quality Magnetic Resonance Image Restoration in Clinics Using
Deep Learning
- Authors: Hao Li, Jianan Liu
- Abstract summary: We employ a unified 2D deep learning neural network for both 3D MRI super resolution and motion artifact reduction.
We also analyzed several downsampling strategies based on the acceleration factor, and developed a controllable and quantifiable motion artifact generation method.
- Score: 8.200110925123965
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Shortening acquisition time and reducing the motion-artifact are two of the
most essential concerns in magnetic resonance imaging. As a promising solution,
deep learning-based high quality MR image restoration has been investigated to
generate higher resolution and motion artifact-free MR images from lower
resolution images acquired with shortened acquisition time, without costing
additional acquisition time or modifying the pulse sequences. However, numerous
problems still exist to prevent deep learning approaches from becoming
practical in the clinic environment. Specifically, most of the prior works
focus solely on the network model but ignore the impact of various downsampling
strategies on the acquisition time. Besides, the long inference time and high
GPU consumption are also the bottle neck to deploy most of the prior works in
clinics. Furthermore, prior studies employ random movement in retrospective
motion artifact generation, resulting in uncontrollable severity of motion
artifact. More importantly, doctors are unsure whether the generated MR images
are trustworthy, making diagnosis difficult. To overcome all these problems, we
employed a unified 2D deep learning neural network for both 3D MRI super
resolution and motion artifact reduction, demonstrating such a framework can
achieve better performance in 3D MRI restoration task compared to other states
of the art methods and remains the GPU consumption and inference time
significantly low, thus easier to deploy. We also analyzed several downsampling
strategies based on the acceleration factor, including multiple combinations of
in-plane and through-plane downsampling, and developed a controllable and
quantifiable motion artifact generation method. At last, the pixel-wise
uncertainty was calculated and used to estimate the accuracy of generated
image, providing additional information for reliable diagnosis.
Related papers
- Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and
Dynamic PROPELLER MRI [76.60362295758596]
Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information.
We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
arXiv Detail & Related papers (2023-11-22T05:44:51Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and
Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods.
We will detail the research in coupling physics and data driven models for MRI acceleration.
Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
arXiv Detail & Related papers (2022-04-01T22:48:08Z) - DDoS-UNet: Incorporating temporal information using Dynamic Dual-channel
UNet for enhancing super-resolution of dynamic MRI [0.27998963147546135]
Magnetic resonance imaging (MRI) provides high spatial resolution and excellent soft-tissue contrast without using harmful ionising radiation.
MRI with high temporal resolution suffers from limited spatial resolution.
Deep learning based super-resolution approaches have been proposed to mitigate this trade-off.
This research addresses the problem by creating a deep learning model which attempts to learn both spatial and temporal relationships.
arXiv Detail & Related papers (2022-02-10T22:20:58Z) - Multi-modal Aggregation Network for Fast MR Imaging [85.25000133194762]
We propose a novel Multi-modal Aggregation Network, named MANet, which is capable of discovering complementary representations from a fully sampled auxiliary modality.
In our MANet, the representations from the fully sampled auxiliary and undersampled target modalities are learned independently through a specific network.
Our MANet follows a hybrid domain learning framework, which allows it to simultaneously recover the frequency signal in the $k$-space domain.
arXiv Detail & Related papers (2021-10-15T13:16:59Z) - STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised
Learning [2.5581619987137048]
We propose STRESS, a self-supervised super-resolution framework for dynamic fetal MRI with interleaved slice acquisitions.
Our proposed method simulates an interleaved slice acquisition along the high-resolution axis on the originally acquired data to generate pairs of low- and high-resolution images.
Evaluations on both simulated and in utero data show that our proposed method outperforms other self-supervised super-resolution methods.
arXiv Detail & Related papers (2021-06-23T13:52:11Z) - Improved Simultaneous Multi-Slice Functional MRI Using Self-supervised
Deep Learning [0.487576911714538]
We extend self-supervised DL reconstruction to simultaneous multi-slice (SMS) imaging.
Our results show that self-supervised DL reduces reconstruction noise and suppresses residual artifacts.
Subsequent fMRI analysis remains unaltered by DL processing, while the improved temporal signal-to-noise ratio produces higher coherence estimates between task runs.
arXiv Detail & Related papers (2021-05-10T17:36:27Z) - Generative Adversarial Networks (GAN) Powered Fast Magnetic Resonance
Imaging -- Mini Review, Comparison and Perspectives [5.3148259096171175]
One drawback of MRI is its comparatively slow scanning and reconstruction compared to other image modalities.
Deep Neural Networks (DNNs) have been used in sparse MRI reconstruction models to recreate relatively high-quality images.
Generative Adversarial Networks (GAN) based methods are proposed to solve fast MRI with enhanced image perceptual quality.
arXiv Detail & Related papers (2021-05-04T23:59:00Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z) - Cine Cardiac MRI Motion Artifact Reduction Using a Recurrent Neural
Network [18.433956246011466]
We propose a recurrent neural network to simultaneously extract both spatial and temporal features from motion-blurred cine cardiac images.
The experimental results demonstrate substantially improved image quality on two clinical test datasets.
arXiv Detail & Related papers (2020-06-23T01:55:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.