Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis

• URL: http://arxiv.org/abs/2606.03827v1
• Date: Tue, 02 Jun 2026 16:10:00 GMT
• Title: Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis
• Abstract summary: In cardiovascular applications, virtual anatomy is typically represented as a 3D+t mesh sampled from a generative model.<n>We propose 4D F-MeshLDM, a conditional generative framework comprising a convolutional mesh VAE to encode meshes.<n>We demonstrate that 4D F-MeshLDM outperforms state-of-the-art baselines in anatomical fidelity and achieves near-zero cycle closure error.
• Score: 41.938132992227196
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In-silico trials of medical devices require the generation of virtual populations of anatomies. In cardiovascular applications, virtual anatomy is typically represented as a 3D+t mesh sampled from a generative model. However, most existing mesh generators focus on static anatomy, while sequence models often lack explicit periodicity. To this end, we propose 4D F-MeshLDM, a conditional generative framework comprising a convolutional mesh VAE to encode meshes, a structural latent space that parameterises motion using a truncated Fourier series, and a diffusion prior that learns the latent distribution over Fourier coefficient tokens. By conditioning the diffusion process on clinical covariates via affine modulation, we enable controllable synthesis. Sampling tokens and performing inverse Fourier synthesis yield cycle-consistent latent trajectories, which can be decoded into 3D+t cardiac mesh sequences. Experiments on 5,000 UK Biobank subjects demonstrate that 4D F-MeshLDM outperforms state-of-the-art baselines in anatomical fidelity and achieves near-zero cycle closure error. Furthermore, the generated cohorts accurately preserve clinical functional indices, highlighting the potential of our framework for reliable in-silico cardiac trials.

Related papers

• Learning to Beat: Phenotype-Guided Latent Flow with Regional Motion Priors for Biventricular Motion Synthesis [29.123055769120246]
  Full-cycle biventricular motion synthesis from a single end-diastolic (ED) mesh.<n>A functional partition learned from reconstructed motion organizes the ventricular surface into regions with coherent dynamics.<n>Experiments on ACDC, M&Ms, and M&Ms-2 demonstrate consistent improvements in geometric accuracy and functional fidelity.
  arXiv  Detail & Related papers  (2026-08-20T07:37:44Z)
• WaveDiT: Distribution-Aware Wavelet Flow Matching for Efficient 3D Brain MRI Synthesis [7.371811584771131]
  Large demographically balanced datasets are essential for reliable neuroimaging biomarkers.<n>WaveDiT is a conditional flow matching framework operating in the coefficient space of a 3D Haar Discrete Wavelet Transform.<n>It supports full-resolution 3D synthesis under practical and memory time constraints on a single modern GPU.
  arXiv  Detail & Related papers  (2026-06-07T15:21:02Z)
• Echo4DIR: 4D Implicit Heart Reconstruction from 2D Echocardiography Videos [35.992365807108584]
  We propose Echo4DIR, a novel test-time 4D implicit reconstruction framework.<n>We learn robust 3D shape priors from statistical shape models (SSMs) via a cardiac conditional SDF.<n>We show that Echo4DIR achieves state-of-the-art 4D cardiac mesh reconstruction, notably an impressive clinical overlap of up to 98.35% Dice and 96.75% IoU.
  arXiv  Detail & Related papers  (2026-05-21T07:01:23Z)
• CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis [30.824485997130925]
  CardioDiT is a fully 4D latent diffusion framework for short-axis cine CMR synthesis based on diffusion transformers.<n>Atemporal VQ-E encodes 2D+VAt slices into compact latents, which a diffusion transformer then models jointly as complete 3D+t volumes.<n>Results show improved inter-slice consistency, temporally coherent motion, anatomical context and realistic cardiac function distributions.
  arXiv  Detail & Related papers  (2026-03-26T08:59:07Z)
• The Adaptive Vekua Cascade: A Differentiable Spectral-Analytic Solver for Physics-Informed Representation [0.0]
  Adaptive-based neural networks have emerged as a powerful tool for representing continuous physical fields.<n>They face two fundamental pathologies: spectral bias and the curse of dimensionality.<n>We propose a hybrid architecture that bridges analytic analytic decouples manifold learning from function approximation.
  arXiv  Detail & Related papers  (2025-12-12T18:41:35Z)
• Scalable Diffusion Transformer for Conditional 4D fMRI Synthesis [13.638452834334982]
  We introduce the first diffusion transformer for voxelwise 4D fMRI conditional generation.<n>On task fMRI, our model reproduces task-evoked activation maps, preserves the inter-task representational structure, and achieves perfect condition specificity.<n>Performance improves predictably with scale, reaching task-evoked map correlation of 0.83 and RSA of 0.98.
  arXiv  Detail & Related papers  (2025-11-28T04:18:11Z)
• 3D Cardiac Anatomy Generation Using Mesh Latent Diffusion Models [9.749160335898255]
  We investigate the application of Latent Diffusion Models for generating 3D meshes of human cardiac anatomies.<n>We apply the proposed model on a dataset of 3D meshes of left ventricular cardiac anatomies from patients with acute myocardial infarction.<n>The MeshLDM successfully captures characteristics of the cardiac shapes at end-diastolic (relaxation) and end-systolic (contraction) cardiac phases, generating meshes with a 2.4% difference in population mean compared to the gold standard.
  arXiv  Detail & Related papers  (2025-08-18T16:53:20Z)
• Articulated Kinematics Distillation from Video Diffusion Models [64.18346374534352]
  Articulated Kinematics Distillation (AKD) is a framework for generating high-fidelity character animations.<n>AKD uses a skeleton-based representation for rigged 3D assets, drastically reducing the Degrees of Freedom (DoFs)<n>AKD distills complex, articulated motions while maintaining structural integrity.
  arXiv  Detail & Related papers  (2025-04-01T21:37:57Z)
• X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction [64.2059940799033]
  Current methods discretize temporal resolution into fixed phases with respiratory gating devices.<n>X$2$-Gaussian, a novel framework, enables continuous-time 4DCT reconstruction by integrating dynamic radiative splatting with self-supervised respiratory motion learning.
  arXiv  Detail & Related papers  (2025-03-27T17:59:57Z)
• Towards Unified and Lossless Latent Space for 3D Molecular Latent Diffusion Modeling [90.23688195918432]
  3D molecule generation is crucial for drug discovery and material science.<n>Existing approaches typically maintain separate latent spaces for invariant and equivariant modalities.<n>We propose textbfUAE-3D, a multi-modal VAE that compresses 3D molecules into latent sequences from a unified latent space.
  arXiv  Detail & Related papers  (2025-03-19T08:56:13Z)
• CryoFormer: Continuous Heterogeneous Cryo-EM Reconstruction using Transformer-based Neural Representations [49.49939711956354]
  Cryo-electron microscopy (cryo-EM) allows for the high-resolution reconstruction of 3D structures of proteins and other biomolecules. It is still challenging to reconstruct the continuous motions of 3D structures from noisy and randomly oriented 2D cryo-EM images. We propose CryoFormer, a new approach for continuous heterogeneous cryo-EM reconstruction.
  arXiv  Detail & Related papers  (2023-03-28T18:59:17Z)
• 3D Mitochondria Instance Segmentation with Spatio-Temporal Transformers [101.44668514239959]
  We propose a hybrid encoder-decoder framework that efficiently computes spatial and temporal attentions in parallel. We also introduce a semantic clutter-background adversarial loss during training that aids in the region of mitochondria instances from the background.
  arXiv  Detail & Related papers  (2023-03-21T17:58:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.