A Personalised 3D+t Mesh Generative Model for Unveiling Normal Heart Dynamics

• URL: http://arxiv.org/abs/2409.13825v1
• Date: Fri, 20 Sep 2024 18:08:37 GMT
• Title: A Personalised 3D+t Mesh Generative Model for Unveiling Normal Heart Dynamics
• Abstract summary: We develop a conditional generative model, MeshHeart, to learn the distribution of cardiac shape and motion patterns. MeshHeart is capable of generating 3D+t cardiac mesh sequences, taking into account clinical factors such as age, sex, weight and height. We propose a novel distance metric latent delta, which quantifies the deviation of a real heart from its personalised normative pattern in the latent space.
• Score: 6.6350578770951385
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding the structure and motion of the heart is crucial for diagnosing and managing cardiovascular diseases, the leading cause of global death. There is wide variation in cardiac shape and motion patterns, that are influenced by demographic, anthropometric and disease factors. Unravelling the normal patterns of shape and motion, as well as understanding how each individual deviates from the norm, would facilitate accurate diagnosis and personalised treatment strategies. To this end, we developed a novel conditional generative model, MeshHeart, to learn the distribution of cardiac shape and motion patterns. MeshHeart is capable of generating 3D+t cardiac mesh sequences, taking into account clinical factors such as age, sex, weight and height. To model the high-dimensional and complex spatio-temporal mesh data, MeshHeart employs a geometric encoder to represent cardiac meshes in a latent space, followed by a temporal Transformer to model the motion dynamics of latent representations. Based on MeshHeart, we investigate the latent space of 3D+t cardiac mesh sequences and propose a novel distance metric termed latent delta, which quantifies the deviation of a real heart from its personalised normative pattern in the latent space. In experiments using a large dataset of 38,309 subjects, MeshHeart demonstrates a high performance in cardiac mesh sequence reconstruction and generation. Features defined in the latent space are highly discriminative for cardiac disease classification, whereas the latent delta exhibits strong correlation with clinical phenotypes in phenome-wide association studies. The codes and models of this study will be released to benefit further research on digital heart modelling.

Related papers

• Self-Supervised Cardiac Phase Detection via Single-Parameter Latent Orbits [44.45620787098836]
  Accurate identification of end-diastole (ED) and end-systole (ES) in echocardiography underpins the quantification of ventricular function.<n>Recent self-supervised methods either prescribe strict periodic trajectories or learn an unconstrained low-dimensional motion subspace from reconstruction or registration objectives.<n>We learn an effective latent orbit, significantly improves upon the previous state of the art in ED localisation and matches it in ES localisation while using a more constrained representation and fewer training epochs.
  arXiv  Detail & Related papers  (2026-09-10T14:56:16Z)
• From Raw Segmentations to Simulation-Ready Cardiac Meshes: An Automated Framework for Anatomical Reconstruction and Virtual Cohort Generation [40.52388056968461]
  We present a semi-automatic pipeline that converts CT-based segmentations into simulation-ready cardiac meshes.<n>A Chamfer-distance morphing strategy deforms a high-quality template toward each segmented heart, matching individual chambers while preserving topology.<n>The pipeline is validated on 58 healthy cardiac CT scans, including all cardiac chambers and proximal vessel segments.
  arXiv  Detail & Related papers  (2026-06-29T09:07:05Z)
• Temporally Consistent and Controllable Video Generation of 2D Cine CMR via Latent Space Motion Modeling [7.215198952705435]
  We propose a generative method for synthesizing temporally coherent and anatomically consistent cardiac sequences.<n>Our model generates anatomically and pathologically diverse sequences with high temporal coherence and strong fidelity to input prompts.<n>These experimental results highlight its potential to produce high-fidelity, on-demand medical data, offering a scalable solution to data scarcity.
  arXiv  Detail & Related papers  (2026-06-08T11:05:20Z)
• Conditional Latent Diffusion Model with Fourier-based Motion Modelling for Virtual Population Synthesis [41.938132992227196]
  In cardiovascular applications, virtual anatomy is typically represented as a 3D+t mesh sampled from a generative model.<n>We propose 4D F-MeshLDM, a conditional generative framework comprising a convolutional mesh VAE to encode meshes.<n>We demonstrate that 4D F-MeshLDM outperforms state-of-the-art baselines in anatomical fidelity and achieves near-zero cycle closure error.
  arXiv  Detail & Related papers  (2026-06-02T16:10:00Z)
• Anatomically Constrained Transformers for Echocardiogram Analysis [38.280536446335056]
  ViACT represents a deforming anatomical structure as a point set and encodes both its spatial geometry and corresponding image patches into transformer tokens.<n>During pre-training, ViACT follows a masked autoencoding strategy that masks and reconstructs only anatomical patches.<n>ViACTs generalize to myocardium point tracking without requiring task-specific components.
  arXiv  Detail & Related papers  (2025-11-02T22:52:30Z)
• 3D Cardiac Anatomy Generation Using Mesh Latent Diffusion Models [9.749160335898255]
  We investigate the application of Latent Diffusion Models for generating 3D meshes of human cardiac anatomies.<n>We apply the proposed model on a dataset of 3D meshes of left ventricular cardiac anatomies from patients with acute myocardial infarction.<n>The MeshLDM successfully captures characteristics of the cardiac shapes at end-diastolic (relaxation) and end-systolic (contraction) cardiac phases, generating meshes with a 2.4% difference in population mean compared to the gold standard.
  arXiv  Detail & Related papers  (2025-08-18T16:53:20Z)
• Patient-Specific Dynamic Digital-Physical Twin for Coronary Intervention Training: An Integrated Mixed Reality Approach [33.92599418560439]
  Existing training systems lack accurate simulation of cardiac physiological dynamics.<n>This study develops a comprehensive dynamic cardiac model research framework based on 4D-CTA.
  arXiv  Detail & Related papers  (2025-05-16T06:13:55Z)
• Leveraging Cardiovascular Simulations for In-Vivo Prediction of Cardiac Biomarkers [43.17768785084301]
  We train an amortized neural posterior estimator on a newly built large dataset of cardiac simulations.<n>We incorporate elements modeling effects to better align simulated data with real-world measurements.<n>The proposed framework can further integrate in-vivo data sources to refine its predictive capabilities on real-world data.
  arXiv  Detail & Related papers  (2024-12-23T13:05:17Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data. Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging. We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysis [46.56667527672019]
  We introduce a Cross-Modal Temporal Pattern Discovery (CTPD) framework, designed to efficiently extract meaningful cross-modal temporal patterns from multimodal EHR data.<n>Our approach introduces shared initial temporal pattern representations which are refined using slot attention to generate temporal semantic embeddings.
  arXiv  Detail & Related papers  (2024-11-01T15:54:07Z)
• Sequence-aware Pre-training for Echocardiography Probe Guidance [66.35766658717205]
  Cardiac ultrasound faces two major challenges: (1) the inherently complex structure of the heart, and (2) significant individual variations. Previous works have only learned the population-averaged 2D and 3D structures of the heart rather than personalized cardiac structural features. We propose a sequence-aware self-supervised pre-training method to learn personalized 2D and 3D cardiac structural features.
  arXiv  Detail & Related papers  (2024-08-27T12:55:54Z)
• Spatio-temporal neural distance fields for conditional generative modeling of the heart [0.10481793104300056]
  We introduce a conditional generative model, where the shape and movement is modeled implicitly in the form of atemporal neural field and conditioned on clinical demography. It is tested on the left atrium, where it outperforms current methods for sequence anatomical completion synthetic sequences. This means we can infer functional measurements from a static image, generate synthetic populations with specified demography or disease and investigate how non-imaging clinical data effect the shape and motion of cardiac anatomies.
  arXiv  Detail & Related papers  (2024-07-15T12:26:52Z)
• Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model [66.35766658717205]
  There is a severe shortage of experienced cardiac sonographers, due to the heart's complex structure and significant operational challenges. We present a Cardiac Copilot system capable of providing real-time probe movement guidance. The core innovation lies in proposing a data-driven world model, named Cardiac Dreamer, for representing cardiac spatial structures. We train our model with real-world ultrasound data and corresponding probe motion from 110 routine clinical scans with 151K sample pairs by three certified sonographers.
  arXiv  Detail & Related papers  (2024-06-19T02:42:29Z)
• Continuous 3D Myocardial Motion Tracking via Echocardiography [30.19879953016694]
  Myocardial motion tracking is an essential clinical tool in the prevention and detection of cardiovascular diseases. Current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions. This paper introduces the Neural Cardiac Motion Field (NeuralCMF) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart.
  arXiv  Detail & Related papers  (2023-10-04T13:11:20Z)
• Digital twinning of cardiac electrophysiology models from the surface ECG: a geodesic backpropagation approach [39.36827689390718]
  We introduce a novel method, Geodesic-BP, to solve the inverse eikonal problem. We show that Geodesic-BP can reconstruct a simulated cardiac activation with high accuracy in a synthetic test case. Given the future shift towards personalized medicine, Geodesic-BP has the potential to help in future functionalizations of cardiac models.
  arXiv  Detail & Related papers  (2023-08-16T14:57:12Z)
• Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature [47.59734181424857]
  The Circle of Willis (CoW) is the part of cerebral vasculature responsible for delivering blood to the brain. We propose a novel generative approach utilising a conditional latent diffusion model with shape and anatomical guidance to generate realistic 3D CoW segmentations.
  arXiv  Detail & Related papers  (2023-08-13T14:27:28Z)
• Modeling 3D cardiac contraction and relaxation with point cloud deformation networks [4.65840670565844]
  We propose the Point Cloud Deformation Network (PCD-Net) as a novel geometric deep learning approach to model 3D cardiac contraction and relaxation. We evaluate our approach on a large dataset of over 10,000 cases from the UK Biobank study.
  arXiv  Detail & Related papers  (2023-07-20T14:56:29Z)
• Understanding of Normal and Abnormal Hearts by Phase Space Analysis and Convolutional Neural Networks [0.0]
  His-Purkinje network is used to analyze a normal human heart's power spectra. CNNs method is applied to 44 records via the MIT-BIH database recorded with MLII. Binary CNN classification is used to determine healthy or unhealthy hearts.
  arXiv  Detail & Related papers  (2023-05-16T19:52:40Z)
• A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras [52.33206865588584]
  We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
  arXiv  Detail & Related papers  (2022-10-04T13:36:52Z)
• Generative Modelling of the Ageing Heart with Cross-Sectional Imaging and Clinical Data [13.819131884449881]
  We propose a novel conditional generative model to describe the changes of 3D anatomy of the heart during ageing. We train the model on a large-scale cross-sectional dataset of cardiac anatomies and evaluate on both cross-sectional and longitudinal datasets.
  arXiv  Detail & Related papers  (2022-08-28T06:14:39Z)
• Three-dimensional micro-structurally informed in silico myocardium -- towards virtual imaging trials in cardiac diffusion weighted MRI [58.484353709077034]
  We propose a novel method to generate a realistic numerical phantom of myocardial microstructure. In-silico tissue models enable evaluating quantitative models of magnetic resonance imaging.
  arXiv  Detail & Related papers  (2022-08-22T22:01:44Z)
• Learning Dynamic and Personalized Comorbidity Networks from Event Data using Deep Diffusion Processes [102.02672176520382]
  Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals. In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition. We develop deep diffusion processes to model "dynamic comorbidity networks"
  arXiv  Detail & Related papers  (2020-01-08T15:47:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.