Deep Structural Causal Shape Models
- URL: http://arxiv.org/abs/2208.10950v1
- Date: Tue, 23 Aug 2022 13:18:20 GMT
- Title: Deep Structural Causal Shape Models
- Authors: Rajat Rasal, Daniel C. Castro, Nick Pawlowski, Ben Glocker
- Abstract summary: Causal reasoning provides a language to ask important interventional and counterfactual questions.
In medical imaging, we may want to study the causal effect of genetic, environmental, or lifestyle factors.
There is a lack of computational tooling to enable causal reasoning about morphological variations.
- Score: 21.591869329812283
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Causal reasoning provides a language to ask important interventional and
counterfactual questions beyond purely statistical association. In medical
imaging, for example, we may want to study the causal effect of genetic,
environmental, or lifestyle factors on the normal and pathological variation of
anatomical phenotypes. However, while anatomical shape models of 3D surface
meshes, extracted from automated image segmentation, can be reliably
constructed, there is a lack of computational tooling to enable causal
reasoning about morphological variations. To tackle this problem, we propose
deep structural causal shape models (CSMs), which utilise high-quality mesh
generation techniques, from geometric deep learning, within the expressive
framework of deep structural causal models. CSMs enable subject-specific
prognoses through counterfactual mesh generation ("How would this patient's
brain structure change if they were ten years older?"), which is in contrast to
most current works on purely population-level statistical shape modelling. We
demonstrate the capabilities of CSMs at all levels of Pearl's causal hierarchy
through a number of qualitative and quantitative experiments leveraging a large
dataset of 3D brain structures.
Related papers
- MindBridge: A Cross-Subject Brain Decoding Framework [60.58552697067837]
Brain decoding aims to reconstruct stimuli from acquired brain signals.
Currently, brain decoding is confined to a per-subject-per-model paradigm.
We present MindBridge, that achieves cross-subject brain decoding by employing only one model.
arXiv Detail & Related papers (2024-04-11T15:46:42Z) - S3M: Scalable Statistical Shape Modeling through Unsupervised
Correspondences [91.48841778012782]
We propose an unsupervised method to simultaneously learn local and global shape structures across population anatomies.
Our pipeline significantly improves unsupervised correspondence estimation for SSMs compared to baseline methods.
Our method is robust enough to learn from noisy neural network predictions, potentially enabling scaling SSMs to larger patient populations.
arXiv Detail & Related papers (2023-04-15T09:39:52Z) - Multimodal and multicontrast image fusion via deep generative models [3.431015735214097]
We propose a deep learning architecture based on generative models rooted in a modular approach and separable convolutional blocks to fuse multiple 3D neuroimaging modalities on a voxel-wise level.
This may be of aid in predicting disease evolution as well as drug response, hence supporting mechanistic understanding and empowering clinical trials.
arXiv Detail & Related papers (2023-03-28T13:31:27Z) - Distinguishing Healthy Ageing from Dementia: a Biomechanical Simulation
of Brain Atrophy using Deep Networks [5.411313268782566]
We present a deep learning framework for hyper-elastic strain modelling of brain atrophy, during healthy ageing and in Alzheimer's Disease.
The framework directly models the effects of age, disease status, and scan interval to regress regional patterns of atrophy, from which a strain-based model estimates deformations.
Results show that the framework can estimate realistic deformations, following the known course of Alzheimer's disease, that clearly differentiate between healthy and demented patterns of ageing.
arXiv Detail & Related papers (2021-08-18T15:58:53Z) - Systematic Evaluation of Causal Discovery in Visual Model Based
Reinforcement Learning [76.00395335702572]
A central goal for AI and causality is the joint discovery of abstract representations and causal structure.
Existing environments for studying causal induction are poorly suited for this objective because they have complicated task-specific causal graphs.
In this work, our goal is to facilitate research in learning representations of high-level variables as well as causal structures among them.
arXiv Detail & Related papers (2021-07-02T05:44:56Z) - The Causal Neural Connection: Expressiveness, Learnability, and
Inference [125.57815987218756]
An object called structural causal model (SCM) represents a collection of mechanisms and sources of random variation of the system under investigation.
In this paper, we show that the causal hierarchy theorem (Thm. 1, Bareinboim et al., 2020) still holds for neural models.
We introduce a special type of SCM called a neural causal model (NCM), and formalize a new type of inductive bias to encode structural constraints necessary for performing causal inferences.
arXiv Detail & Related papers (2021-07-02T01:55:18Z) - Elastic Shape Analysis of Brain Structures for Predictive Modeling of
PTSD [9.922132565411664]
We propose a comprehensive framework that overcomes limitations by representing brain substructures as continuous parameterized surfaces.
Using the elastic shape metric, we compute shape summaries of subcortical data and represent individual shapes by their principal scores.
We apply our method to data from the Grady Trauma Project, where the goal is to predict clinical measures of PTSD using shapes of brain substructures.
arXiv Detail & Related papers (2021-05-24T21:33:58Z) - Deep Learning Identifies Neuroimaging Signatures of Alzheimer's Disease
Using Structural and Synthesized Functional MRI Data [8.388888908045406]
We propose a potential solution by first learning a structural-to-functional transformation in brain MRI.
We then synthesize spatially matched functional images from large-scale structural scans.
We identify the temporal lobe to be the most predictive structural-region and the parieto-occipital lobe to be the most predictive functional-region of our model.
arXiv Detail & Related papers (2021-04-10T03:16:33Z) - Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [47.78425002879612]
3D delineation of anatomical structures is a cardinal goal in medical imaging analysis.
Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology.
We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of CNNs with the robustness of SSMs.
arXiv Detail & Related papers (2021-04-07T01:15:06Z) - Discriminative and Generative Models for Anatomical Shape Analysison
Point Clouds with Deep Neural Networks [3.7814216736076434]
We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task.
Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks.
We propose a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes.
arXiv Detail & Related papers (2020-10-02T07:37:40Z) - DeepRetinotopy: Predicting the Functional Organization of Human Visual
Cortex from Structural MRI Data using Geometric Deep Learning [125.99533416395765]
We developed a deep learning model capable of exploiting the structure of the cortex to learn the complex relationship between brain function and anatomy from structural and functional MRI data.
Our model was able to predict the functional organization of human visual cortex from anatomical properties alone, and it was also able to predict nuanced variations across individuals.
arXiv Detail & Related papers (2020-05-26T04:54:31Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.