Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis

• URL: http://arxiv.org/abs/2606.26764v1
• Date: Thu, 25 Jun 2026 08:48:45 GMT
• Title: Anatomy-Guided Residual Motion Diffusion for Controllable 4D Cardiac MRI Synthesis
• Abstract summary: We propose a 4D controllable generative framework for anatomically consistent data augmentation.<n>A semi-supervised variational autoencoder learns a compact latent representation of anatomical volumes.<n>Anatomical structure is disentangled from temporal dynamics through a cascaded latent diffusion model.
• Score: 15.392128655814451
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Developing robust artificial intelligence models for 4D (3D + time) medical imaging is constrained by limited annotated data, inter-device domain shifts, and privacy restrictions. To address this, we propose a 4D controllable generative framework for anatomically consistent data augmentation. A semi-supervised variational autoencoder learns a compact latent representation of anatomical volumes while jointly predicting aligned segmentation masks in a unified framework. Anatomical structure is then disentangled from temporal dynamics through a cascaded latent diffusion model (LDM). A static LDM generates subject-specific anatomy conditioned on clinical priors (diagnosis and volumes measures) and a subsequent motion LDM estimates residual latent motions, ensuring strict temporal coherence across the 4D sequence. The proposed approach was evaluated on cine cardiac MRI as a representative 4D imaging application. Experiments across multiple datasets demonstrate high controllability of static anatomy (Pearson r > 0.8) and strong temporal coherence (FVD = 288.08). In cross-vendor generalization experiments, augmenting training sets with synthetic 4D sequences significantly improves downstream segmentation performance. Using nnU-Net, the proposed augmentation strategy improves the average Dice score by 1.4% and reduces the Hausdorff Distance by 3.0mm compared to training on real data alone, for the left ventricle, Dice improves by 2.8% with a 5.4mm reduction in boundary error. Overall, this framework provides a scalable and controllable solution for 4D medical image synthesis, supporting the development of more robust models with limited annotations and cross-vendor variability. Code available on https://github.com/cyiheng/4DCardiacMRISynthesis.

Related papers

• Anatomically-conditioned Latent Diffusion Model for Data-Efficient Few-Shot Cross-Domain 3D Glioma MRI Synthesis [1.4312099612976772]
  Anatomically-conditioned Latent Diffusion Model (ALDM) is a novel framework for data-efficient, few-shot 3D MRI synthesis.<n> evaluated in an extreme few-shot setting with only 16 target images.
  arXiv  Detail & Related papers  (2026-06-24T04:42:42Z)
• WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis [7.371811584771131]
  Large demographically balanced datasets are essential for reliable neuroimaging biomarkers.<n>WaveDiT is a conditional flow matching framework operating in the coefficient space of a 3D Haar Discrete Wavelet Transform.<n>It supports full-resolution 3D synthesis under practical and memory time constraints on a single modern GPU.
  arXiv  Detail & Related papers  (2026-06-07T15:21:02Z)
• D3Seg: Dependency-Aware Diffusion for Brain Tumor Segmentation with Missing Modalities [54.87947751720332]
  We propose a novel segmentation model D3Seg to maintain stable performance under missing-modality settings.<n>The proposed model achieves approximately 1.5-2.0% Dice improvement on enhancing tumor (ET) and around 1.0% on tumor core (TC) across multiple missing modality configurations.
  arXiv  Detail & Related papers  (2026-05-21T09:55:42Z)
• Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos [35.992365807108584]
  We propose Echo4DIR, a novel test-time 4D implicit reconstruction framework.<n>We learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF.<n>We show that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.
  arXiv  Detail & Related papers  (2026-05-21T07:01:23Z)
• CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis [30.824485997130925]
  CardioDiT is a fully 4D latent diffusion framework for short-axis cine CMR synthesis based on diffusion transformers.<n>Atemporal VQ-E encodes 2D+VAt slices into compact latents, which a diffusion transformer then models jointly as complete 3D+t volumes.<n>Results show improved inter-slice consistency, temporally coherent motion, anatomical context and realistic cardiac function distributions.
  arXiv  Detail & Related papers  (2026-03-26T08:59:07Z)
• MedPruner: Training-Free Hierarchical Token Pruning for Efficient 3D Medical Image Understanding in Vision-Language Models [59.180043227905294]
  We propose MedPruner, a training-free and model-agnostic hierarchical token pruning framework for efficient 3D medical image understanding.<n>We show that MedPruner enables models such as MedGemma to maintain or even exceed their original performance while retaining fewer than 5% of visual tokens.
  arXiv  Detail & Related papers  (2026-03-12T07:37:00Z)
• Orthogonal Spatial-temporal Distributional Transfer for 4D Generation [58.30004328671699]
  We propose a framework that transfers rich spatial priors from existing 3D diffusion models and temporal priors from video diffusion models to enhance 4D synthesis.<n>We develop a spatial-temporal-disentangled 4D (STD-4D) Diffusion model, which synthesizes 4D-aware videos through disentangled spatial and temporal latents.<n> Experiments demonstrate that our method significantly outperforms existing approaches, achieving superior spatial-temporal consistency and higher-quality 4D synthesis.
  arXiv  Detail & Related papers  (2026-03-05T11:52:21Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [64.2059940799033]
  Current methods discretize temporal resolution into fixed phases with respiratory gating devices.<n>X$2$-Gaussian, a novel framework, enables continuous-time 4DCT reconstruction by integrating dynamic radiative splatting with self-supervised respiratory motion learning.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• 4DRGS: 4D Radiative Gaussian Splatting for Efficient 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images [49.170407434313475]
  Existing methods often produce suboptimal results or require excessive computation time.<n>We propose 4D radiative Gaussian splatting (4DRGS) to achieve high-quality reconstruction efficiently.<n>4DRGS achieves impressive results in 5 minutes training, which is 32x faster than the state-of-the-art method.
  arXiv  Detail & Related papers  (2024-12-17T13:51:56Z)
• Coarse-Super-Resolution-Fine Network (CoSF-Net): A Unified End-to-End Neural Network for 4D-MRI with Simultaneous Motion Estimation and Super-Resolution [21.75329634476446]
  We develop a novel deep learning framework called the coarse-super-resolution-fine network (CoSF-Net) to achieve simultaneous motion estimation and excavating super-resolution in a unified model. Compared with existing networks and three state-of-the-art conventional algorithms, CoSF-Net not only accurately estimated the deformable vector fields between the respiratory phases of 4D-MRI but also simultaneously improved the spatial resolution of 4D-MRI with enhanced anatomic features.
  arXiv  Detail & Related papers  (2022-11-21T01:42:51Z)
• Revisiting 3D Context Modeling with Supervised Pre-training for Universal Lesion Detection in CT Slices [48.85784310158493]
  We propose a Modified Pseudo-3D Feature Pyramid Network (MP3D FPN) to efficiently extract 3D context enhanced 2D features for universal lesion detection in CT slices. With the novel pre-training method, the proposed MP3D FPN achieves state-of-the-art detection performance on the DeepLesion dataset. The proposed 3D pre-trained weights can potentially be used to boost the performance of other 3D medical image analysis tasks.
  arXiv  Detail & Related papers  (2020-12-16T07:11:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.