Fine-tuning deep learning model parameters for improved super-resolution of dynamic MRI with prior-knowledge

• URL: http://arxiv.org/abs/2102.02711v1
• Date: Thu, 4 Feb 2021 16:11:53 GMT
• Title: Fine-tuning deep learning model parameters for improved super-resolution of dynamic MRI with prior-knowledge
• Authors: Chompunuch Sarasaen, Soumick Chatterjee, Mario Breitkopf, Georg Rose, Andreas N\"urnberger and Oliver Speck
• Abstract summary: This research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information. An U-Net based network with loss is trained on a benchmark and fine-tuned using one subject-specific static high resolution MRI as prior knowledge to obtain high resolution dynamic images.
• Score: 0.3914676152740142
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Dynamic imaging is a beneficial tool for interventions to assess physiological changes. Nonetheless during dynamic MRI, while achieving a high temporal resolution, the spatial resolution is compromised. To overcome this spatio-temporal trade-off, this research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information while preserving high temporal resolution of dynamic MRI. An U-Net based network with perceptual loss is trained on a benchmark dataset and fine-tuned using one subject-specific static high resolution MRI as prior knowledge to obtain high resolution dynamic images during the inference stage. 3D dynamic data for three subjects were acquired with different parameters to test the generalisation capabilities of the network. The method was tested for different levels of in-plane undersampling for dynamic MRI. The reconstructed dynamic SR results showed higher similarity with the high resolution ground-truth after fine-tuning. The average SSIM of the lowest resolution experimented during this research (6.25~\% of the k-space) before and after fine-tuning were 0.939 $\pm$ 0.008 and 0.957 $\pm$ 0.006 respectively. This could theoretically result in an acceleration factor of 16, which can potentially be acquired in less than half a second. The proposed approach shows that the super-resolution MRI reconstruction with prior-information can alleviate the spatio-temporal trade-off in dynamic MRI, even for high acceleration factors.

Related papers

• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  Deep neural networks have shown great potential for reconstructing high-fidelity images from undersampled measurements. Our model is based on neural operators, a discretization-agnostic architecture. Our inference speed is also 1,400x faster than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Resolution- and Stimulus-agnostic Super-Resolution of Ultra-High-Field Functional MRI: Application to Visual Studies [1.8327547104097965]
  High-resolution fMRI provides a window into the brain's mesoscale organization. Yet, higher spatial resolution increases scan times, to compensate for the low signal and contrast-to-noise ratio. This work introduces a deep learning-based 3D super-resolution (SR) method for fMRI.
  arXiv  Detail & Related papers  (2023-11-25T03:33:36Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• Robust Depth Linear Error Decomposition with Double Total Variation and Nuclear Norm for Dynamic MRI Reconstruction [15.444386058967579]
  There are still problems with dynamic MRI k-space reconstruction based on Compressed Sensing (CS) In this paper, we propose a novel robust lowrank dynamic MRI reconstruction optimization model via highly under-sampled Fourier Transform (DFT) Experiments on dynamic MRI data demonstrate the superior performance proposed method in terms of both reconstruction accuracy and time complexity.
  arXiv  Detail & Related papers  (2023-10-23T13:34:59Z)
• Spatiotemporal implicit neural representation for unsupervised dynamic MRI reconstruction [11.661657147506519]
  Implicit Neuraltruth (INR) has appeared as powerful DL-based tool for solving the inverse problem. In this work, we proposed an INR-based method to improve dynamic MRI reconstruction from highly undersampled k-space data. The proposed INR represents the dynamic MRI images as an implicit function and encodes them into neural networks.
  arXiv  Detail & Related papers  (2022-12-31T05:43:21Z)
• Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction [68.80715727288514]
  We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix. In this paper, we propose a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction.
  arXiv  Detail & Related papers  (2022-09-15T03:58:30Z)
• Data and Physics Driven Learning Models for Fast MRI -- Fundamentals and Methodologies from CNN, GAN to Attention and Transformers [72.047680167969]
  This article aims to introduce the deep learning based data driven techniques for fast MRI including convolutional neural network and generative adversarial network based methods. We will detail the research in coupling physics and data driven models for MRI acceleration. Finally, we will demonstrate through a few clinical applications, explain the importance of data harmonisation and explainable models for such fast MRI techniques in multicentre and multi-scanner studies.
  arXiv  Detail & Related papers  (2022-04-01T22:48:08Z)
• Cross-Modality High-Frequency Transformer for MR Image Super-Resolution [100.50972513285598]
  We build an early effort to build a Transformer-based MR image super-resolution framework. We consider two-fold domain priors including the high-frequency structure prior and the inter-modality context prior. We establish a novel Transformer architecture, called Cross-modality high-frequency Transformer (Cohf-T), to introduce such priors into super-resolving the low-resolution images.
  arXiv  Detail & Related papers  (2022-03-29T07:56:55Z)
• DDoS-UNet: Incorporating temporal information using Dynamic Dual-channel UNet for enhancing super-resolution of dynamic MRI [0.27998963147546135]
  Magnetic resonance imaging (MRI) provides high spatial resolution and excellent soft-tissue contrast without using harmful ionising radiation. MRI with high temporal resolution suffers from limited spatial resolution. Deep learning based super-resolution approaches have been proposed to mitigate this trade-off. This research addresses the problem by creating a deep learning model which attempts to learn both spatial and temporal relationships.
  arXiv  Detail & Related papers  (2022-02-10T22:20:58Z)
• STRESS: Super-Resolution for Dynamic Fetal MRI using Self-Supervised Learning [2.5581619987137048]
  We propose STRESS, a self-supervised super-resolution framework for dynamic fetal MRI with interleaved slice acquisitions. Our proposed method simulates an interleaved slice acquisition along the high-resolution axis on the originally acquired data to generate pairs of low- and high-resolution images. Evaluations on both simulated and in utero data show that our proposed method outperforms other self-supervised super-resolution methods.
  arXiv  Detail & Related papers  (2021-06-23T13:52:11Z)
• ShuffleUNet: Super resolution of diffusion-weighted MRIs using deep learning [47.68307909984442]
  Single Image Super-Resolution (SISR) is a technique aimed to obtain high-resolution (HR) details from one single low-resolution input image. Deep learning extracts prior knowledge from big datasets and produces superior MRI images from the low-resolution counterparts.
  arXiv  Detail & Related papers  (2021-02-25T14:52:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.