A Personalised 3D+t Mesh Generative Model for Unveiling Normal Heart Dynamics

• URL: http://arxiv.org/abs/2409.13825v1
• Date: Fri, 20 Sep 2024 18:08:37 GMT
• Title: A Personalised 3D+t Mesh Generative Model for Unveiling Normal Heart Dynamics
• Authors: Mengyun Qiao, Kathryn A McGurk, Shuo Wang, Paul M. Matthews, Declan P O Regan, Wenjia Bai,
• Abstract summary: We develop a conditional generative model, MeshHeart, to learn the distribution of cardiac shape and motion patterns. MeshHeart is capable of generating 3D+t cardiac mesh sequences, taking into account clinical factors such as age, sex, weight and height. We propose a novel distance metric latent delta, which quantifies the deviation of a real heart from its personalised normative pattern in the latent space.
• Score: 6.6350578770951385
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Understanding the structure and motion of the heart is crucial for diagnosing and managing cardiovascular diseases, the leading cause of global death. There is wide variation in cardiac shape and motion patterns, that are influenced by demographic, anthropometric and disease factors. Unravelling the normal patterns of shape and motion, as well as understanding how each individual deviates from the norm, would facilitate accurate diagnosis and personalised treatment strategies. To this end, we developed a novel conditional generative model, MeshHeart, to learn the distribution of cardiac shape and motion patterns. MeshHeart is capable of generating 3D+t cardiac mesh sequences, taking into account clinical factors such as age, sex, weight and height. To model the high-dimensional and complex spatio-temporal mesh data, MeshHeart employs a geometric encoder to represent cardiac meshes in a latent space, followed by a temporal Transformer to model the motion dynamics of latent representations. Based on MeshHeart, we investigate the latent space of 3D+t cardiac mesh sequences and propose a novel distance metric termed latent delta, which quantifies the deviation of a real heart from its personalised normative pattern in the latent space. In experiments using a large dataset of 38,309 subjects, MeshHeart demonstrates a high performance in cardiac mesh sequence reconstruction and generation. Features defined in the latent space are highly discriminative for cardiac disease classification, whereas the latent delta exhibits strong correlation with clinical phenotypes in phenome-wide association studies. The codes and models of this study will be released to benefit further research on digital heart modelling.

Related papers

• Sequence-aware Pre-training for Echocardiography Probe Guidance [66.35766658717205]
  Cardiac ultrasound faces two major challenges: (1) the inherently complex structure of the heart, and (2) significant individual variations. Previous works have only learned the population-averaged 2D and 3D structures of the heart rather than personalized cardiac structural features. We propose a sequence-aware self-supervised pre-training method to learn personalized 2D and 3D cardiac structural features.
  arXiv  Detail & Related papers  (2024-08-27T12:55:54Z)
• Spatio-temporal neural distance fields for conditional generative modeling of the heart [0.10481793104300056]
  We introduce a conditional generative model, where the shape and movement is modeled implicitly in the form of atemporal neural field and conditioned on clinical demography. It is tested on the left atrium, where it outperforms current methods for sequence anatomical completion synthetic sequences. This means we can infer functional measurements from a static image, generate synthetic populations with specified demography or disease and investigate how non-imaging clinical data effect the shape and motion of cardiac anatomies.
  arXiv  Detail & Related papers  (2024-07-15T12:26:52Z)
• Cardiac Copilot: Automatic Probe Guidance for Echocardiography with World Model [66.35766658717205]
  There is a severe shortage of experienced cardiac sonographers, due to the heart's complex structure and significant operational challenges. We present a Cardiac Copilot system capable of providing real-time probe movement guidance. The core innovation lies in proposing a data-driven world model, named Cardiac Dreamer, for representing cardiac spatial structures. We train our model with real-world ultrasound data and corresponding probe motion from 110 routine clinical scans with 151K sample pairs by three certified sonographers.
  arXiv  Detail & Related papers  (2024-06-19T02:42:29Z)
• Continuous 3D Myocardial Motion Tracking via Echocardiography [30.19879953016694]
  Myocardial motion tracking is an essential clinical tool in the prevention and detection of cardiovascular diseases. Current techniques suffer from incomplete and inaccurate motion estimation of the myocardium in both spatial and temporal dimensions. This paper introduces the Neural Cardiac Motion Field (NeuralCMF) to model the 3D structure and the comprehensive 6D forward/backward motion of the heart.
  arXiv  Detail & Related papers  (2023-10-04T13:11:20Z)
• Shape-guided Conditional Latent Diffusion Models for Synthesising Brain Vasculature [47.59734181424857]
  The Circle of Willis (CoW) is the part of cerebral vasculature responsible for delivering blood to the brain. We propose a novel generative approach utilising a conditional latent diffusion model with shape and anatomical guidance to generate realistic 3D CoW segmentations.
  arXiv  Detail & Related papers  (2023-08-13T14:27:28Z)
• Modeling 3D cardiac contraction and relaxation with point cloud deformation networks [4.65840670565844]
  We propose the Point Cloud Deformation Network (PCD-Net) as a novel geometric deep learning approach to model 3D cardiac contraction and relaxation. We evaluate our approach on a large dataset of over 10,000 cases from the UK Biobank study.
  arXiv  Detail & Related papers  (2023-07-20T14:56:29Z)
• Understanding of Normal and Abnormal Hearts by Phase Space Analysis and Convolutional Neural Networks [0.0]
  His-Purkinje network is used to analyze a normal human heart's power spectra. CNNs method is applied to 44 records via the MIT-BIH database recorded with MLII. Binary CNN classification is used to determine healthy or unhealthy hearts.
  arXiv  Detail & Related papers  (2023-05-16T19:52:40Z)
• A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras [52.33206865588584]
  We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
  arXiv  Detail & Related papers  (2022-10-04T13:36:52Z)
• Generative Modelling of the Ageing Heart with Cross-Sectional Imaging and Clinical Data [13.819131884449881]
  We propose a novel conditional generative model to describe the changes of 3D anatomy of the heart during ageing. We train the model on a large-scale cross-sectional dataset of cardiac anatomies and evaluate on both cross-sectional and longitudinal datasets.
  arXiv  Detail & Related papers  (2022-08-28T06:14:39Z)
• Three-dimensional micro-structurally informed in silico myocardium -- towards virtual imaging trials in cardiac diffusion weighted MRI [58.484353709077034]
  We propose a novel method to generate a realistic numerical phantom of myocardial microstructure. In-silico tissue models enable evaluating quantitative models of magnetic resonance imaging.
  arXiv  Detail & Related papers  (2022-08-22T22:01:44Z)
• Learning Dynamic and Personalized Comorbidity Networks from Event Data using Deep Diffusion Processes [102.02672176520382]
  Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals. In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition. We develop deep diffusion processes to model "dynamic comorbidity networks"
  arXiv  Detail & Related papers  (2020-01-08T15:47:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.