A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamics

• URL: http://arxiv.org/abs/2409.13825v3
• Date: Mon, 02 Jun 2025 09:43:09 GMT
• Title: A personalized time-resolved 3D mesh generative model for unveiling normal heart dynamics
• Authors: Mengyun Qiao, Kathryn A McGurk, Shuo Wang, Paul M. Matthews, Declan P O Regan, Wenjia Bai,
• Abstract summary: We develop a conditional generative model, MeshHeart, to learn the distribution of shape and motion patterns for the left ventricles of the heart.<n>Based on MeshHeart, we investigate the latent space of 3D+t cardiac mesh sequences and propose a distance metric, latent delta, which quantifies the deviation of a real heart from its personalised normative pattern.
• Score: 6.6350578770951385
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding the structure and motion of the heart is crucial for diagnosing and managing cardiovascular diseases, the leading cause of global death. There is wide variation in cardiac shape and motion patterns, influenced by demographic, anthropometric and disease factors. Unravelling normal patterns of shape and motion, and understanding how each individual deviates from the norm, would facilitate accurate diagnosis and personalised treatment strategies. To this end, we developed a conditional generative model, MeshHeart, to learn the distribution of shape and motion patterns for the left and right ventricles of the heart. To model the high-dimensional spatio-temporal mesh data, MeshHeart employs a geometric encoder to represent cardiac meshes in a latent space, and a temporal Transformer to model the motion dynamics of latent representations. Based on MeshHeart, we investigate the latent space of 3D+t cardiac mesh sequences and propose a distance metric, latent delta, which quantifies the deviation of a real heart from its personalised normative pattern. In experiments using a large cardiac magnetic resonance image dataset of 38,309 subjects from the UK Biobank, MeshHeart demonstrates high performance in cardiac mesh sequence reconstruction and generation. Latent space features are discriminative for cardiac disease classification, whereas latent delta exhibits strong correlations with clinical phenotypes in phenome-wide association studies. The code and the trained model are released to support further research.

Related papers

• Leveraging Cardiovascular Simulations for In-Vivo Prediction of Cardiac Biomarkers [43.17768785084301]
  We train an amortized neural posterior estimator on a newly built large dataset of cardiac simulations.<n>We incorporate elements modeling effects to better align simulated data with real-world measurements.<n>The proposed framework can further integrate in-vivo data sources to refine its predictive capabilities on real-world data.
  arXiv  Detail & Related papers  (2024-12-23T13:05:17Z)
• MedTet: An Online Motion Model for 4D Heart Reconstruction [59.74234226055964]
  We present a novel approach to reconstruction of 3D cardiac motion from sparse intraoperative data. Existing methods can accurately reconstruct 3D organ geometries from full 3D volumetric imaging. We propose a versatile framework for reconstructing 3D motion from such partial data.
  arXiv  Detail & Related papers  (2024-12-03T17:18:33Z)
• CTPD: Cross-Modal Temporal Pattern Discovery for Enhanced Multimodal Electronic Health Records Analysis [46.56667527672019]
  We introduce a Cross-Modal Temporal Pattern Discovery (CTPD) framework, designed to efficiently extract meaningful cross-modal temporal patterns from multimodal EHR data.<n>Our approach introduces shared initial temporal pattern representations which are refined using slot attention to generate temporal semantic embeddings.
  arXiv  Detail & Related papers  (2024-11-01T15:54:07Z)
• Sequence-aware Pre-training for Echocardiography Probe Guidance [66.35766658717205]
  Cardiac ultrasound faces two major challenges: (1) the inherently complex structure of the heart, and (2) significant individual variations. Previous works have only learned the population-averaged 2D and 3D structures of the heart rather than personalized cardiac structural features. We propose a sequence-aware self-supervised pre-training method to learn personalized 2D and 3D cardiac structural features.
  arXiv  Detail & Related papers  (2024-08-27T12:55:54Z)
• Spatio-temporal neural distance fields for conditional generative modeling of the heart [0.10481793104300056]
  We introduce a conditional generative model, where the shape and movement is modeled implicitly in the form of atemporal neural field and conditioned on clinical demography. It is tested on the left atrium, where it outperforms current methods for sequence anatomical completion synthetic sequences. This means we can infer functional measurements from a static image, generate synthetic populations with specified demography or disease and investigate how non-imaging clinical data effect the shape and motion of cardiac anatomies.
  arXiv  Detail & Related papers  (2024-07-15T12:26:52Z)
• Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model [66.35766658717205]
  There is a severe shortage of experienced cardiac sonographers, due to the heart's complex structure and significant operational challenges. We present a Cardiac Copilot system capable of providing real-time probe movement guidance. The core innovation lies in proposing a data-driven world model, named Cardiac Dreamer, for representing cardiac spatial structures. We train our model with real-world ultrasound data and corresponding probe motion from 110 routine clinical scans with 151K sample pairs by three certified sonographers.
  arXiv  Detail & Related papers  (2024-06-19T02:42:29Z)
• Continuous 3D Myocardial Motion Tracking via Echocardiography [30.19879953016694]
  Myocardial motion tracking is an essential clinical tool in the prevention and detection of cardiovascular diseases. Current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions. This paper introduces the Neural Cardiac Motion Field (NeuralCMF) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart.
  arXiv  Detail & Related papers  (2023-10-04T13:11:20Z)
• Digital twinning of cardiac electrophysiology models from the surface ECG: a geodesic backpropagation approach [39.36827689390718]
  We introduce a novel method, Geodesic-BP, to solve the inverse eikonal problem. We show that Geodesic-BP can reconstruct a simulated cardiac activation with high accuracy in a synthetic test case. Given the future shift towards personalized medicine, Geodesic-BP has the potential to help in future functionalizations of cardiac models.
  arXiv  Detail & Related papers  (2023-08-16T14:57:12Z)
• Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature [47.59734181424857]
  The Circle of Willis (CoW) is the part of cerebral vasculature responsible for delivering blood to the brain. We propose a novel generative approach utilising a conditional latent diffusion model with shape and anatomical guidance to generate realistic 3D CoW segmentations.
  arXiv  Detail & Related papers  (2023-08-13T14:27:28Z)
• Modeling 3D cardiac contraction and relaxation with point cloud deformation networks [4.65840670565844]
  We propose the Point Cloud Deformation Network (PCD-Net) as a novel geometric deep learning approach to model 3D cardiac contraction and relaxation. We evaluate our approach on a large dataset of over 10,000 cases from the UK Biobank study.
  arXiv  Detail & Related papers  (2023-07-20T14:56:29Z)
• Understanding of Normal and Abnormal Hearts by Phase Space Analysis and Convolutional Neural Networks [0.0]
  His-Purkinje network is used to analyze a normal human heart's power spectra. CNNs method is applied to 44 records via the MIT-BIH database recorded with MLII. Binary CNN classification is used to determine healthy or unhealthy hearts.
  arXiv  Detail & Related papers  (2023-05-16T19:52:40Z)
• A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras [52.33206865588584]
  We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
  arXiv  Detail & Related papers  (2022-10-04T13:36:52Z)
• Generative Modelling of the Ageing Heart with Cross-Sectional Imaging and Clinical Data [13.819131884449881]
  We propose a novel conditional generative model to describe the changes of 3D anatomy of the heart during ageing. We train the model on a large-scale cross-sectional dataset of cardiac anatomies and evaluate on both cross-sectional and longitudinal datasets.
  arXiv  Detail & Related papers  (2022-08-28T06:14:39Z)
• Three-dimensional micro-structurally informed in silico myocardium -- towards virtual imaging trials in cardiac diffusion weighted MRI [58.484353709077034]
  We propose a novel method to generate a realistic numerical phantom of myocardial microstructure. In-silico tissue models enable evaluating quantitative models of magnetic resonance imaging.
  arXiv  Detail & Related papers  (2022-08-22T22:01:44Z)
• Learning Dynamic and Personalized Comorbidity Networks from Event Data using Deep Diffusion Processes [102.02672176520382]
  Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals. In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition. We develop deep diffusion processes to model "dynamic comorbidity networks"
  arXiv  Detail & Related papers  (2020-01-08T15:47:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.