Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)

• URL: http://arxiv.org/abs/2604.06482v1
• Date: Tue, 07 Apr 2026 21:34:54 GMT
• Title: Spatiotemporal Gaussian representation-based dynamic reconstruction and motion estimation framework for time-resolved volumetric MR imaging (DREME-GSMR)
• Abstract summary: Time-resolved MR imaging that reconstructs a 3D MRI within sub-seconds to resolve deformable motion robustness is essential for motion-adaptive radiotherapy.<n>We developed a framework which enables time-resolved dynamic MRI reconstruction from a pre-resolved 3D MR scan without any anatomical/motion model.<n>DREME-R reconstructs MRIs of a 400ms temporal resolution, with an inference time of 10ms/time.
• Score: 6.0648709483311185
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Time-resolved volumetric MR imaging that reconstructs a 3D MRI within sub-seconds to resolve deformable motion is essential for motion-adaptive radiotherapy. Representing patient anatomy and associated motion fields as 3D Gaussians, we developed a spatiotemporal Gaussian representation-based framework (DREME-GSMR), which enables time-resolved dynamic MRI reconstruction from a pre-treatment 3D MR scan without any prior anatomical/motion model. DREME-GSMR represents a reference MRI volume and a corresponding low-rank motion model (as motion-basis components) using 3D Gaussians, and incorporates a dual-path MLP/CNN motion encoder to estimate temporal motion coefficients of the motion model from raw k-space-derived signals. Furthermore, using the solved motion model, DREME-GSMR can infer motion coefficients directly from new online k-space data, allowing subsequent intra-treatment volumetric MR imaging and motion tracking (real-time imaging). A motion-augmentation strategy is further introduced to improve robustness to unseen motion patterns during real-time imaging. DREME-GSMR was evaluated on the XCAT digital phantom, a physical motion phantom, and MR-LINAC datasets acquired from 6 healthy volunteers and 20 patients (with independent sequential scans for cross-evaluation). DREME-GSMR reconstructs MRIs of a ~400ms temporal resolution, with an inference time of ~10ms/volume. In XCAT experiments, DREME-GSMR achieved mean(s.d.) SSIM, tumor center-of-mass-error(COME), and DSC of 0.92(0.01)/0.91(0.02), 0.50(0.15)/0.65(0.19) mm, and 0.92(0.02)/0.92(0.03) for dynamic reconstruction/real-time imaging. For the physical phantom, the mean target COME was 1.19(0.94)/1.40(1.15) mm for dynamic/real-time imaging, while for volunteers and patients, the mean liver COME for real-time imaging was 1.31(0.82) and 0.96(0.64) mm, respectively.

Related papers

• Personalized 3D Myocardial Infarct Geometry Reconstruction from Cine MRI for Cardiac Digital Twins [7.407471411133294]
  We propose a novel explicit geometry-motion embedded model to reconstruct 3D MI directly from cine MRIs.<n> Experimental results on 225 cine MRIs demonstrated that the proposed 3D MI reconstruction achieved high performance with an average Dice score of 0.678 $pm$ 0.011.
  arXiv  Detail & Related papers  (2026-06-01T07:25:56Z)
• MotionDPS: Motion-Compensated 3D Brain MRI Reconstruction [39.243053176227065]
  We propose a motion-compensated 3D MRI that estimates the anatomical image, rigid-body motion parameters, and coil sensitivity maps directly from motion-corrupted k-space data.<n>Our approach integrates pretrained 3D complex-valued score-based diffusion models as expressive anatomical image priors within a physics-based forward model.<n> Experiments on simulated and real-motion brain MRI datasets demonstrate that the proposed method achieves improved image quality and motion robustness.
  arXiv  Detail & Related papers  (2026-05-21T07:53:06Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• Non-rigid Motion Correction for MRI Reconstruction via Coarse-To-Fine Diffusion Models [2.8189656701789816]
  Motion artifacts can compromise diagnostic utility, particularly for dynamic imaging.<n>We propose a novel alternating minimization framework that leverages a bespoke diffusion model to jointly reconstruct and correct motion-corrupted k-space data.<n>We demonstrate the performance of our approach on both real-world cine cardiac MRI datasets and complex simulated rigid and non-rigid deformations.
  arXiv  Detail & Related papers  (2025-05-21T03:27:21Z)
• A Unified Model for Compressed Sensing MRI Across Undersampling Patterns [69.19631302047569]
  We propose a unified MRI reconstruction model robust to various measurement undersampling patterns and image resolutions.<n>Our model improves SSIM by 11% and PSNR by 4 dB over a state-of-the-art CNN (End-to-End VarNet) with 600$times$ faster inference than diffusion methods.
  arXiv  Detail & Related papers  (2024-10-05T20:03:57Z)
• Towards General Text-guided Image Synthesis for Customized Multimodal Brain MRI Generation [51.28453192441364]
  Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. Current MR image synthesis approaches are typically trained on independent datasets for specific tasks. We present TUMSyn, a Text-guided Universal MR image Synthesis model, which can flexibly generate brain MR images.
  arXiv  Detail & Related papers  (2024-09-25T11:14:47Z)
• Deep-learning-based acceleration of MRI for radiotherapy planning of pediatric patients with brain tumors [39.58317527488534]
  We developed a deep learning-based method for MRI reconstruction from undersampled data acquired with RT-specific receiver coil arrangements. DeepMRIRec reduced scanning time by a factor of four producing a structural similarity score surpassing the evaluated state-of-the-art method.
  arXiv  Detail & Related papers  (2023-11-22T16:01:44Z)
• Volumetric Reconstruction Resolves Off-Resonance Artifacts in Static and Dynamic PROPELLER MRI [76.60362295758596]
  Off-resonance artifacts in magnetic resonance imaging (MRI) are visual distortions that occur when the actual resonant frequencies of spins within the imaging volume differ from the expected frequencies used to encode spatial information. We propose to resolve these artifacts by lifting the 2D MRI reconstruction problem to 3D, introducing an additional "spectral" dimension to model this off-resonance.
  arXiv  Detail & Related papers  (2023-11-22T05:44:51Z)
• A Long Short-term Memory Based Recurrent Neural Network for Interventional MRI Reconstruction [50.1787181309337]
  We propose a convolutional long short-term memory (Conv-LSTM) based recurrent neural network (RNN), or ConvLR, to reconstruct interventional images with golden-angle radial sampling. The proposed algorithm has the potential to achieve real-time i-MRI for DBS and can be used for general purpose MR-guided intervention.
  arXiv  Detail & Related papers  (2022-03-28T14:03:45Z)
• Performance of a GPU- and Time-Efficient Pseudo 3D Network for Magnetic Resonance Image Super-Resolution and Motion Artifact Reduction [7.532638301149741]
  Shortening acquisition time and reducing motion artifacts are the most critical challenges in magnetic resonance imaging (MRI) Deep learning-based image restoration has emerged as a promising solution capable of generating high-resolution and motion-artifact-free MRI images. In this study, we adopted a unified 2D deep learning framework for pseudo-3D MRI image super-resolution reconstruction (SRR) and motion artifact reduction (MAR) The accuracy of the network was evaluated through a pixel-wise uncertainty map, and performance was benchmarked against state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-11-28T22:58:00Z)
• Fine-tuning deep learning model parameters for improved super-resolution of dynamic MRI with prior-knowledge [0.3914676152740142]
  This research presents a super-resolution (SR) MRI reconstruction with prior knowledge based fine-tuning to maximise spatial information. An U-Net based network with loss is trained on a benchmark and fine-tuned using one subject-specific static high resolution MRI as prior knowledge to obtain high resolution dynamic images.
  arXiv  Detail & Related papers  (2021-02-04T16:11:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.