CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy

• URL: http://arxiv.org/abs/2301.13098v3
• Date: Thu, 30 Nov 2023 19:20:37 GMT
• Title: CHeart: A Conditional Spatio-Temporal Generative Model for Cardiac Anatomy
• Authors: Mengyun Qiao, Shuo Wang, Huaqi Qiu, Antonio de Marvao, Declan P. O'Regan, Daniel Rueckert, Wenjia Bai
• Abstract summary: Two key questions in cardiac image analysis are to assess the anatomy and motion of the heart from images. We propose a conditional generative model to describe the 4D-temporal anatomy of the heart and its interaction with nonimaging clinical factors.
• Score: 16.84316344437967
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Two key questions in cardiac image analysis are to assess the anatomy and motion of the heart from images; and to understand how they are associated with non-imaging clinical factors such as gender, age and diseases. While the first question can often be addressed by image segmentation and motion tracking algorithms, our capability to model and to answer the second question is still limited. In this work, we propose a novel conditional generative model to describe the 4D spatio-temporal anatomy of the heart and its interaction with non-imaging clinical factors. The clinical factors are integrated as the conditions of the generative modelling, which allows us to investigate how these factors influence the cardiac anatomy. We evaluate the model performance in mainly two tasks, anatomical sequence completion and sequence generation. The model achieves a high performance in anatomical sequence completion, comparable to or outperforming other state-of-the-art generative models. In terms of sequence generation, given clinical conditions, the model can generate realistic synthetic 4D sequential anatomies that share similar distributions with the real data.

Related papers

• Longitudinal Causal Image Synthesis [19.07839779249869]
  Clinical decision-making relies heavily on causal reasoning and longitudinal analysis. How will the brain grey matter atrophy in a year if intervened on the A-beta level in cerebrospinal fluid?
  arXiv  Detail & Related papers  (2024-10-23T09:13:11Z)
• A Personalised 3D+t Mesh Generative Model for Unveiling Normal Heart Dynamics [6.6350578770951385]
  We develop a conditional generative model, MeshHeart, to learn the distribution of cardiac shape and motion patterns. MeshHeart is capable of generating 3D+t cardiac mesh sequences, taking into account clinical factors such as age, sex, weight and height. We propose a novel distance metric latent delta, which quantifies the deviation of a real heart from its personalised normative pattern in the latent space.
  arXiv  Detail & Related papers  (2024-09-20T18:08:37Z)
• Spatio-temporal neural distance fields for conditional generative modeling of the heart [0.10481793104300056]
  We introduce a conditional generative model, where the shape and movement is modeled implicitly in the form of atemporal neural field and conditioned on clinical demography. It is tested on the left atrium, where it outperforms current methods for sequence anatomical completion synthetic sequences. This means we can infer functional measurements from a static image, generate synthetic populations with specified demography or disease and investigate how non-imaging clinical data effect the shape and motion of cardiac anatomies.
  arXiv  Detail & Related papers  (2024-07-15T12:26:52Z)
• Interpretable Spatio-Temporal Embedding for Brain Structural-Effective Network with Ordinary Differential Equation [56.34634121544929]
  In this study, we first construct the brain-effective network via the dynamic causal model. We then introduce an interpretable graph learning framework termed Spatio-Temporal Embedding ODE (STE-ODE) This framework incorporates specifically designed directed node embedding layers, aiming at capturing the dynamic interplay between structural and effective networks.
  arXiv  Detail & Related papers  (2024-05-21T20:37:07Z)
• Robust and Interpretable Medical Image Classifiers via Concept Bottleneck Models [49.95603725998561]
  We propose a new paradigm to build robust and interpretable medical image classifiers with natural language concepts. Specifically, we first query clinical concepts from GPT-4, then transform latent image features into explicit concepts with a vision-language model.
  arXiv  Detail & Related papers  (2023-10-04T21:57:09Z)
• Shape of my heart: Cardiac models through learned signed distance functions [33.29148402516714]
  In this work, the cardiac shape is reconstructed by means of three-dimensional deep signed distance functions with Lipschitz regularity. For this purpose, the shapes of cardiac MRI reconstructions are learned to model the spatial relation of multiple chambers. We demonstrate that this approach is also capable of reconstructing anatomical models from partial data, such as point clouds from a single ventricle.
  arXiv  Detail & Related papers  (2023-08-31T09:02:53Z)
• Generative Modelling of the Ageing Heart with Cross-Sectional Imaging and Clinical Data [13.819131884449881]
  We propose a novel conditional generative model to describe the changes of 3D anatomy of the heart during ageing. We train the model on a large-scale cross-sectional dataset of cardiac anatomies and evaluate on both cross-sectional and longitudinal datasets.
  arXiv  Detail & Related papers  (2022-08-28T06:14:39Z)
• Three-dimensional micro-structurally informed in silico myocardium -- towards virtual imaging trials in cardiac diffusion weighted MRI [58.484353709077034]
  We propose a novel method to generate a realistic numerical phantom of myocardial microstructure. In-silico tissue models enable evaluating quantitative models of magnetic resonance imaging.
  arXiv  Detail & Related papers  (2022-08-22T22:01:44Z)
• Factored Attention and Embedding for Unstructured-view Topic-related Ultrasound Report Generation [70.7778938191405]
  We propose a novel factored attention and embedding model (termed FAE-Gen) for the unstructured-view topic-related ultrasound report generation. The proposed FAE-Gen mainly consists of two modules, i.e., view-guided factored attention and topic-oriented factored embedding, which capture the homogeneous and heterogeneous morphological characteristic across different views.
  arXiv  Detail & Related papers  (2022-03-12T15:24:03Z)
• Data-driven generation of plausible tissue geometries for realistic photoacoustic image synthesis [53.65837038435433]
  Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties. We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate" We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
  arXiv  Detail & Related papers  (2021-03-29T11:30:18Z)
• Modeling Shared Responses in Neuroimaging Studies through MultiView ICA [94.31804763196116]
  Group studies involving large cohorts of subjects are important to draw general conclusions about brain functional organization. We propose a novel MultiView Independent Component Analysis model for group studies, where data from each subject are modeled as a linear combination of shared independent sources plus noise. We demonstrate the usefulness of our approach first on fMRI data, where our model demonstrates improved sensitivity in identifying common sources among subjects.
  arXiv  Detail & Related papers  (2020-06-11T17:29:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.