A Generative Shape Compositional Framework to Synthesise Populations of
Virtual Chimaeras
- URL: http://arxiv.org/abs/2210.01607v2
- Date: Mon, 4 Mar 2024 17:52:04 GMT
- Title: A Generative Shape Compositional Framework to Synthesise Populations of
Virtual Chimaeras
- Authors: Haoran Dou, Seppo Virtanen, Nishant Ravikumar, Alejandro F. Frangi
- Abstract summary: We introduce a generative shape model for complex anatomical structures, learnable from datasets of unpaired datasets.
We build virtual chimaeras from databases of whole-heart shape assemblies that each contribute samples for heart substructures.
Our approach significantly outperforms a PCA-based shape model (trained with complete data) in terms of generalisability and specificity.
- Score: 52.33206865588584
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Generating virtual populations of anatomy that capture sufficient variability
while remaining plausible is essential for conducting in-silico trials of
medical devices. However, not all anatomical shapes of interest are always
available for each individual in a population. Hence,
missing/partially-overlapping anatomical information is often available across
individuals in a population. We introduce a generative shape model for complex
anatomical structures, learnable from datasets of unpaired datasets. The
proposed generative model can synthesise complete whole complex shape
assemblies coined virtual chimaeras, as opposed to natural human chimaeras. We
applied this framework to build virtual chimaeras from databases of whole-heart
shape assemblies that each contribute samples for heart substructures.
Specifically, we propose a generative shape compositional framework which
comprises two components - a part-aware generative shape model which captures
the variability in shape observed for each structure of interest in the
training population; and a spatial composition network which assembles/composes
the structures synthesised by the former into multi-part shape assemblies (viz.
virtual chimaeras). We also propose a novel self supervised learning scheme
that enables the spatial composition network to be trained with partially
overlapping data and weak labels. We trained and validated our approach using
shapes of cardiac structures derived from cardiac magnetic resonance images
available in the UK Biobank. Our approach significantly outperforms a PCA-based
shape model (trained with complete data) in terms of generalisability and
specificity. This demonstrates the superiority of the proposed approach as the
synthesised cardiac virtual populations are more plausible and capture a
greater degree of variability in shape than those generated by the PCA-based
shape model.
Related papers
- An End-to-End Deep Learning Generative Framework for Refinable Shape
Matching and Generation [45.820901263103806]
Generative modelling for shapes is a prerequisite for In-Silico Clinical Trials (ISCTs)
We develop a novel unsupervised geometric deep-learning model to establish refinable shape correspondences in a latent space.
We extend our proposed base model to a joint shape generative-clustering multi-atlas framework to incorporate further variability.
arXiv Detail & Related papers (2024-03-10T21:33:53Z) - Bayesian Intrinsic Groupwise Image Registration: Unsupervised
Disentanglement of Anatomy and Geometry [53.645443644821306]
This article presents a general Bayesian learning framework for groupwise registration on medical images.
We propose a novel hierarchical variational auto-encoding architecture to realize the inference procedure of the latent variables.
Experiments were conducted to validate the proposed framework, including four datasets from cardiac, brain and abdominal medical images.
arXiv Detail & Related papers (2024-01-04T08:46:39Z) - TailorMe: Self-Supervised Learning of an Anatomically Constrained
Volumetric Human Shape Model [4.474107938692397]
Human shape spaces have been extensively studied, as they are a core element of human shape and pose inference tasks.
We create an anatomical template, consisting of skeleton bones and soft tissue, to the surface scans of the CAESAR database.
This data is then used to learn an anthropo constrained volumetric human shape model in a self-supervised fashion.
arXiv Detail & Related papers (2023-11-03T07:42:19Z) - A Conditional Flow Variational Autoencoder for Controllable Synthesis of
Virtual Populations of Anatomy [76.20367415712867]
We propose a conditional variational autoencoder (cVAE) with normalising flows to boost the flexibility and complexity of the approximate posterior learnt.
We demonstrate the performance of our conditional flow VAE using a data set of cardiac left ventricles acquired from 2360 patients.
arXiv Detail & Related papers (2023-06-26T13:23:52Z) - Statistical Shape Modeling of Biventricular Anatomy with Shared
Boundaries [16.287876512923084]
This paper presents a general and flexible data-driven approach for building statistical shape models of multi-organ anatomies with shared boundaries.
Shape changes within these shared boundaries of the heart can indicate potential pathological changes that lead to uncoordinated contraction and poor end-organ perfusion.
arXiv Detail & Related papers (2022-09-06T15:54:37Z) - Learning Population-level Shape Statistics and Anatomy Segmentation From
Images: A Joint Deep Learning Model [0.0]
Point distribution models (PDMs) represent the anatomical surface via a dense set of correspondences.
We propose a deep-learning-based framework that simultaneously learns these two coordinate spaces directly from the volumetric images.
The proposed joint model serves a dual purpose; the world correspondences can directly be used for shape analysis applications, circumventing the heavy pre-processing and segmentation involved in traditional PDM models.
arXiv Detail & Related papers (2022-01-10T17:24:35Z) - SP-GAN: Sphere-Guided 3D Shape Generation and Manipulation [50.53931728235875]
We present SP-GAN, a new unsupervised sphere-guided generative model for direct synthesis of 3D shapes in the form of point clouds.
Compared with existing models, SP-GAN is able to synthesize diverse and high-quality shapes with fine details.
arXiv Detail & Related papers (2021-08-10T06:49:45Z) - Learning to Segment Human Body Parts with Synthetically Trained Deep
Convolutional Networks [58.0240970093372]
This paper presents a new framework for human body part segmentation based on Deep Convolutional Neural Networks trained using only synthetic data.
The proposed approach achieves cutting-edge results without the need of training the models with real annotated data of human body parts.
arXiv Detail & Related papers (2021-02-02T12:26:50Z) - Discriminative and Generative Models for Anatomical Shape Analysison
Point Clouds with Deep Neural Networks [3.7814216736076434]
We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task.
Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks.
We propose a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes.
arXiv Detail & Related papers (2020-10-02T07:37:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.