A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras

• URL: http://arxiv.org/abs/2210.01607v2
• Date: Mon, 4 Mar 2024 17:52:04 GMT
• Title: A Generative Shape Compositional Framework to Synthesise Populations of Virtual Chimaeras
• Authors: Haoran Dou, Seppo Virtanen, Nishant Ravikumar, Alejandro F. Frangi
• Abstract summary: We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
• Score: 52.33206865588584
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Generating virtual populations of anatomy that capture sufficient variability while remaining plausible is essential for conducting in-silico trials of medical devices. However, not all anatomical shapes of interest are always available for each individual in a population. Hence, missing/partially-overlapping anatomical information is often available across individuals in a population. We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets. The proposed generative model can synthesise complete whole complex shape assemblies coined virtual chimaeras, as opposed to natural human chimaeras. We applied this framework to build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures. Specifically, we propose a generative shape compositional framework which comprises two components - a part-aware generative shape model which captures the variability in shape observed for each structure of interest in the training population; and a spatial composition network which assembles/composes the structures synthesised by the former into multi-part shape assemblies (viz. virtual chimaeras). We also propose a novel self supervised learning scheme that enables the spatial composition network to be trained with partially overlapping data and weak labels. We trained and validated our approach using shapes of cardiac structures derived from cardiac magnetic resonance images available in the UK Biobank. Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity. This demonstrates the superiority of the proposed approach as the synthesised cardiac virtual populations are more plausible and capture a greater degree of variability in shape than those generated by the PCA-based shape model.

Related papers

• Generative 3D Cardiac Shape Modelling for In-Silico Trials [0.0]
  We propose a deep learning method to model and generate synthetic aortic shapes. The network is trained on a dataset of aortic root meshes reconstructed from CT images. By sampling from the learned embedding vectors, we can generate novel shapes that resemble real patient anatomies.
  arXiv  Detail & Related papers  (2024-09-24T12:59:18Z)
• An End-to-End Deep Learning Generative Framework for Refinable Shape Matching and Generation [45.820901263103806]
  Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs) We develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space. We extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability.
  arXiv  Detail & Related papers  (2024-03-10T21:33:53Z)
• ReshapeIT: Reliable Shape Interaction with Implicit Template for Anatomical Structure Reconstruction [59.971808117043366]
  ReShapeIT represents an anatomical structure with an implicit template field shared within the same category. It ensures the implicit template field generates valid templates by strengthening the constraint of the correspondence between the instance shape and the template shape. A template Interaction Module is introduced to reconstruct unseen shapes by interacting the valid template shapes with the instance-wise latent codes.
  arXiv  Detail & Related papers  (2023-12-11T07:09:32Z)
• A Conditional Flow Variational Autoencoder for Controllable Synthesis of Virtual Populations of Anatomy [76.20367415712867]
  We propose a conditional variational autoencoder (cVAE) with normalising flows to boost the flexibility and complexity of the approximate posterior learnt. We demonstrate the performance of our conditional flow VAE using a data set of cardiac left ventricles acquired from 2360 patients.
  arXiv  Detail & Related papers  (2023-06-26T13:23:52Z)
• Statistical Shape Modeling of Biventricular Anatomy with Shared Boundaries [16.287876512923084]
  This paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries. Shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion.
  arXiv  Detail & Related papers  (2022-09-06T15:54:37Z)
• Learning Population-level Shape Statistics and Anatomy Segmentation From Images: A Joint Deep Learning Model [0.0]
  Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences. We propose a deep-learning-based framework that simultaneously learns these two coordinate spaces directly from the volumetric images. The proposed joint model serves a dual purpose; the world correspondences can directly be used for shape analysis applications, circumventing the heavy pre-processing and segmentation involved in traditional PDM models.
  arXiv  Detail & Related papers  (2022-01-10T17:24:35Z)
• SP-GAN: Sphere-Guided 3D Shape Generation and Manipulation [50.53931728235875]
  We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds. Compared with existing models, SP-GAN is able to synthesize diverse and high-quality shapes with fine details.
  arXiv  Detail & Related papers  (2021-08-10T06:49:45Z)
• Learning to Segment Human Body Parts with Synthetically Trained Deep Convolutional Networks [58.0240970093372]
  This paper presents a new framework for human body part segmentation based on Deep Convolutional Neural Networks trained using only synthetic data. The proposed approach achieves cutting-edge results without the need of training the models with real annotated data of human body parts.
  arXiv  Detail & Related papers  (2021-02-02T12:26:50Z)
• Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks [3.7814216736076434]
  We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task. Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks. We propose a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes.
  arXiv  Detail & Related papers  (2020-10-02T07:37:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.