Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling

• URL: http://arxiv.org/abs/2606.14759v1
• Date: Mon, 08 Jun 2026 11:05:20 GMT
• Title: Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling
• Abstract summary: We propose a generative method for synthesizing temporally coherent and anatomically consistent cardiac sequences.<n>Our model generates anatomically and pathologically diverse sequences with high temporal coherence and strong fidelity to input prompts.<n>These experimental results highlight its potential to produce high-fidelity, on-demand medical data, offering a scalable solution to data scarcity.
• Score: 7.215198952705435
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cine cardiac magnetic resonance is the gold standard for assessing cardiac function, but the scarcity of public datasets limits the development of advanced data-driven models. To address this limitation, we propose a generative method for synthesizing temporally coherent and anatomically consistent cardiac sequences. Our text-to-video framework decouples cardiac spatial structure from temporal motion. First, a fine-tuned diffusion model synthesizes an initial frame from a clinical text prompt, controlling anatomical features. Then, a latent flow model conditioned on a cardiac phase embedding generates the complete cardiac motion, ensuring spatial consistency and temporal control. Our model generates anatomically and pathologically diverse sequences with high temporal coherence and strong fidelity to input prompts, achieving a FID of 31.68 for image realism and a CLIP score of 31.04 for text-image alignment. These experimental results highlight its potential to produce high-fidelity, on-demand medical data, offering a scalable solution to data scarcity.

Related papers

• Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis [29.123055769120246]
  Full-cycle biventricular motion synthesis from a single end-diastolic (ED) mesh.<n>A functional partition learned from reconstructed motion organizes the ventricular surface into regions with coherent dynamics.<n>Experiments on ACDC, M&Ms, and M&Ms-2 demonstrate consistent improvements in geometric accuracy and functional fidelity.
  arXiv  Detail & Related papers  (2026-08-20T07:37:44Z)
• HO-Flow: Generalizable Hand-Object Interaction Generation with Latent Flow Matching [113.81911881001905]
  HO-Flow is a framework for synthesizing realistic hand-object motion sequences from texts and canoncial 3D objects.<n>It first employs an interaction-aware variational autoencoder to encode sequences of hand and object motions into a unified latent manifold.<n>It then leverages a masked flow matching model that combines auto-regressive temporal reasoning with continuous latent generation.
  arXiv  Detail & Related papers  (2026-04-12T22:06:11Z)
• CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis [30.824485997130925]
  CardioDiT is a fully 4D latent diffusion framework for short-axis cine CMR synthesis based on diffusion transformers.<n>Atemporal VQ-E encodes 2D+VAt slices into compact latents, which a diffusion transformer then models jointly as complete 3D+t volumes.<n>Results show improved inter-slice consistency, temporally coherent motion, anatomical context and realistic cardiac function distributions.
  arXiv  Detail & Related papers  (2026-03-26T08:59:07Z)
• PhysNeXt: Next-Generation Dual-Branch Structured Attention Fusion Network for Remote Photoplethysmography Measurement [50.524262997433546]
  rmography enables measurement of heart rate and other vital signs by analyzing color variations in facial skin induced by cardiac pulsation.<n>Current methods are mainly based on either end-to-end modeling from raw videos or subtle heartbeat-related map (ST) representations.<n>We propose PhysMapXt, a dual-input deep learning framework that jointly exploits video frames and ST representations.
  arXiv  Detail & Related papers  (2026-03-20T08:37:02Z)
• TriC-Motion: Tri-Domain Causal Modeling Grounded Text-to-Motion Generation [61.94780858309546]
  Tri-Domain Causal Text-to-Motion Generation (TriC-Motion) is a novel diffusion-based framework integrating spatial-domain modeling with causal intervention.<n>TriC-Motion achieves superior performance compared to state-of-the-art methods, attaining an outstanding R@1 of 0.612 on the HumanML3D dataset.
  arXiv  Detail & Related papers  (2026-02-09T10:12:13Z)
• Scalable Spatio-Temporal SE(3) Diffusion for Long-Horizon Protein Dynamics [51.85385061275941]
  Molecular dynamics (MD) simulations remain the gold standard for studying protein dynamics.<n>Recent generative models have shown promise in accelerating simulations, yet they struggle with long-horizon generation.<n>We present STAR-MD, a scalable diffusion model that generates physically plausible protein trajectories over micro-scale timescales.
  arXiv  Detail & Related papers  (2026-02-02T14:13:28Z)
• Systole-Conditioned Generative Cardiac Motion [14.94166259218979]
  We present a novel approach that synthesizes realistically looking pairs of cardiac CT frames enriched with dense 3D flow field annotations.<n>Our method leverages a conditional Variational Autoencoder (CVAE), which incorporates a novel multi-scale feature conditioning mechanism.<n>Our data generation pipeline could enable the training and validation of more complex and accurate myocardium motion models.
  arXiv  Detail & Related papers  (2025-07-20T14:44:40Z)
• Temporal Differential Fields for 4D Motion Modeling via Image-to-Video Synthesis [43.47331808314336]
  Existing methods cannot simulate temporal motions unless high-dose imaging scans including starting and ending frames exist simultaneously.<n>We pioneeringly simulate the regular motion process via the image-to-video framework, which animates with the first frame to forecast future frames of a given length.<n>Our approach simulates 4D videos along the intrinsic motion trajectory, rivaling other competitive methods on perceptual similarity and temporal consistency.
  arXiv  Detail & Related papers  (2025-05-22T23:01:48Z)
• Articulated Kinematics Distillation from Video Diffusion Models [64.18346374534352]
  Articulated Kinematics Distillation (AKD) is a framework for generating high-fidelity character animations.<n>AKD uses a skeleton-based representation for rigged 3D assets, drastically reducing the Degrees of Freedom (DoFs)<n>AKD distills complex, articulated motions while maintaining structural integrity.
  arXiv  Detail & Related papers  (2025-04-01T21:37:57Z)
• A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamics [6.6350578770951385]
  We develop a conditional generative model, MeshHeart, to learn the distribution of shape and motion patterns for the left ventricles of the heart.<n>Based on MeshHeart, we investigate the latent space of 3D+t cardiac mesh sequences and propose a distance metric, latent delta, which quantifies the deviation of a real heart from its personalised normative pattern.
  arXiv  Detail & Related papers  (2024-09-20T18:08:37Z)
• Explainable and Controllable Motion Curve Guided Cardiac Ultrasound Video Generation [11.879436948659691]
  We propose an explainable and controllable method for echocardiography video generation. First, we extract motion information from each heart substructure to construct motion curves. Second, we propose the structure-to-motion alignment module, which can map semantic features onto motion curves. Third, The position-aware attention mechanism is designed to enhance video consistency utilizing Gaussian masks with structural position information.
  arXiv  Detail & Related papers  (2024-07-31T09:59:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.