STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised
Learning
- URL: http://arxiv.org/abs/2106.12407v1
- Date: Wed, 23 Jun 2021 13:52:11 GMT
- Title: STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised
Learning
- Authors: Junshen Xu, Esra Abaci Turk, P. Ellen Grant, Polina Golland, Elfar
Adalsteinsson
- Abstract summary: We propose STRESS, a self-supervised super-resolution framework for dynamic fetal MRI with interleaved slice acquisitions.
Our proposed method simulates an interleaved slice acquisition along the high-resolution axis on the originally acquired data to generate pairs of low- and high-resolution images.
Evaluations on both simulated and in utero data show that our proposed method outperforms other self-supervised super-resolution methods.
- Score: 2.5581619987137048
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Fetal motion is unpredictable and rapid on the scale of conventional MR scan
times. Therefore, dynamic fetal MRI, which aims at capturing fetal motion and
dynamics of fetal function, is limited to fast imaging techniques with
compromises in image quality and resolution. Super-resolution for dynamic fetal
MRI is still a challenge, especially when multi-oriented stacks of image slices
for oversampling are not available and high temporal resolution for recording
the dynamics of the fetus or placenta is desired. Further, fetal motion makes
it difficult to acquire high-resolution images for supervised learning methods.
To address this problem, in this work, we propose STRESS (Spatio-Temporal
Resolution Enhancement with Simulated Scans), a self-supervised
super-resolution framework for dynamic fetal MRI with interleaved slice
acquisitions. Our proposed method simulates an interleaved slice acquisition
along the high-resolution axis on the originally acquired data to generate
pairs of low- and high-resolution images. Then, it trains a super-resolution
network by exploiting both spatial and temporal correlations in the MR time
series, which is used to enhance the resolution of the original data.
Evaluations on both simulated and in utero data show that our proposed method
outperforms other self-supervised super-resolution methods and improves image
quality, which is beneficial to other downstream tasks and evaluations.
Related papers
- Inter-slice Super-resolution of Magnetic Resonance Images by Pre-training and Self-supervised Fine-tuning [49.197385954021456]
In clinical practice, 2D magnetic resonance (MR) sequences are widely adopted. While individual 2D slices can be stacked to form a 3D volume, the relatively large slice spacing can pose challenges for visualization and subsequent analysis tasks.
To reduce slice spacing, deep-learning-based super-resolution techniques are widely investigated.
Most current solutions require a substantial number of paired high-resolution and low-resolution images for supervised training, which are typically unavailable in real-world scenarios.
arXiv Detail & Related papers (2024-06-10T02:20:26Z) - Resolution- and Stimulus-agnostic Super-Resolution of Ultra-High-Field Functional MRI: Application to Visual Studies [1.8327547104097965]
High-resolution fMRI provides a window into the brain's mesoscale organization.
Yet, higher spatial resolution increases scan times, to compensate for the low signal and contrast-to-noise ratio.
This work introduces a deep learning-based 3D super-resolution (SR) method for fMRI.
arXiv Detail & Related papers (2023-11-25T03:33:36Z) - On Sensitivity and Robustness of Normalization Schemes to Input
Distribution Shifts in Automatic MR Image Diagnosis [58.634791552376235]
Deep Learning (DL) models have achieved state-of-the-art performance in diagnosing multiple diseases using reconstructed images as input.
DL models are sensitive to varying artifacts as it leads to changes in the input data distribution between the training and testing phases.
We propose to use other normalization techniques, such as Group Normalization and Layer Normalization, to inject robustness into model performance against varying image artifacts.
arXiv Detail & Related papers (2023-06-23T03:09:03Z) - Implicit Diffusion Models for Continuous Super-Resolution [65.45848137914592]
This paper introduces an Implicit Diffusion Model (IDM) for high-fidelity continuous image super-resolution.
IDM integrates an implicit neural representation and a denoising diffusion model in a unified end-to-end framework.
The scaling factor regulates the resolution and accordingly modulates the proportion of the LR information and generated features in the final output.
arXiv Detail & Related papers (2023-03-29T07:02:20Z) - DDoS-UNet: Incorporating temporal information using Dynamic Dual-channel
UNet for enhancing super-resolution of dynamic MRI [0.27998963147546135]
Magnetic resonance imaging (MRI) provides high spatial resolution and excellent soft-tissue contrast without using harmful ionising radiation.
MRI with high temporal resolution suffers from limited spatial resolution.
Deep learning based super-resolution approaches have been proposed to mitigate this trade-off.
This research addresses the problem by creating a deep learning model which attempts to learn both spatial and temporal relationships.
arXiv Detail & Related papers (2022-02-10T22:20:58Z) - High-Resolution Pelvic MRI Reconstruction Using a Generative Adversarial
Network with Attention and Cyclic Loss [3.4358954898228604]
Super-resolution methods have shown excellent performance in accelerating MRI.
In some circumstances, it is difficult to obtain high-resolution images even with prolonged scan time.
We proposed a novel super-resolution method that uses a generative adversarial network (GAN) with cyclic loss and attention mechanism.
arXiv Detail & Related papers (2021-07-21T10:07:22Z) - Adaptive Gradient Balancing for UndersampledMRI Reconstruction and
Image-to-Image Translation [60.663499381212425]
We enhance the image quality by using a Wasserstein Generative Adversarial Network combined with a novel Adaptive Gradient Balancing technique.
In MRI, our method minimizes artifacts, while maintaining a high-quality reconstruction that produces sharper images than other techniques.
arXiv Detail & Related papers (2021-04-05T13:05:22Z) - ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep
learning [47.68307909984442]
Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image.
Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
arXiv Detail & Related papers (2021-02-25T14:52:23Z) - Fine-tuning deep learning model parameters for improved super-resolution
of dynamic MRI with prior-knowledge [0.3914676152740142]
This research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information.
An U-Net based network with loss is trained on a benchmark and fine-tuned using one subject-specific static high resolution MRI as prior knowledge to obtain high resolution dynamic images.
arXiv Detail & Related papers (2021-02-04T16:11:53Z) - Multifold Acceleration of Diffusion MRI via Slice-Interleaved Diffusion
Encoding (SIDE) [50.65891535040752]
We propose a diffusion encoding scheme, called Slice-Interleaved Diffusion.
SIDE, that interleaves each diffusion-weighted (DW) image volume with slices encoded with different diffusion gradients.
We also present a method based on deep learning for effective reconstruction of DW images from the highly slice-undersampled data.
arXiv Detail & Related papers (2020-02-25T14:48:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.