Personalized Predictions of Glioblastoma Infiltration: Mathematical Models, Physics-Informed Neural Networks and Multimodal Scans
- URL: http://arxiv.org/abs/2311.16536v3
- Date: Fri, 16 Aug 2024 01:27:18 GMT
- Title: Personalized Predictions of Glioblastoma Infiltration: Mathematical Models, Physics-Informed Neural Networks and Multimodal Scans
- Authors: Ray Zirui Zhang, Ivan Ezhov, Michal Balcerak, Andy Zhu, Benedikt Wiestler, Bjoern Menze, John S. Lowengrub,
- Abstract summary: Predicting the infiltration of Glioblastoma (GBM) from medical MRI scans is crucial for understanding tumor growth dynamics.
Mathematical models of GBM growth can complement the data in the prediction of spatial distributions of tumor cells.
This work proposes a method that uses Physics-Informed Neural Networks (PINNs) to estimate patient-specific parameters of a reaction-diffusion PDE model of GBM growth from a single 3D structural MRI snapshot.
- Score: 1.696497161881026
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predicting the infiltration of Glioblastoma (GBM) from medical MRI scans is crucial for understanding tumor growth dynamics and designing personalized radiotherapy treatment plans.Mathematical models of GBM growth can complement the data in the prediction of spatial distributions of tumor cells. However, this requires estimating patient-specific parameters of the model from clinical data, which is a challenging inverse problem due to limited temporal data and the limited time between imaging and diagnosis. This work proposes a method that uses Physics-Informed Neural Networks (PINNs) to estimate patient-specific parameters of a reaction-diffusion PDE model of GBM growth from a single 3D structural MRI snapshot. PINNs embed both the data and the PDE into a loss function, thus integrating theory and data. Key innovations include the identification and estimation of characteristic non-dimensional parameters, a pre-training step that utilizes the non-dimensional parameters and a fine-tuning step to determine the patient specific parameters. Additionally, the diffuse domain method is employed to handle the complex brain geometry within the PINN framework. Our method is validated both on synthetic and patient datasets, and shows promise for real-time parametric inference in the clinical setting for personalized GBM treatment.
Related papers
- Unifying Subsampling Pattern Variations for Compressed Sensing MRI with Neural Operators [72.79532467687427]
Compressed Sensing MRI reconstructs images of the body's internal anatomy from undersampled and compressed measurements.
Deep neural networks have shown great potential for reconstructing high-quality images from highly undersampled measurements.
We propose a unified model that is robust to different subsampling patterns and image resolutions in CS-MRI.
arXiv Detail & Related papers (2024-10-05T20:03:57Z) - Physics-Regularized Multi-Modal Image Assimilation for Brain Tumor Localization [3.666412718346211]
We introduce a novel method that integrates data-driven and physics-based cost functions.
We propose a unique discretization scheme that quantifies how well the learned distributions of tumor and brain tissues adhere to their respective growth and elasticity equations.
arXiv Detail & Related papers (2024-09-30T15:36:14Z) - Spatiotemporal Graph Neural Network Modelling Perfusion MRI [12.712005118761516]
Per vascular MRI (pMRI) offers valuable insights into tumority and promises to predict tumor genotypes.
Yet effective models tailored to 4D pMRI are still lacking.
This study presents the first attempt to model 4D pMRI using a GNN-based model.
arXiv Detail & Related papers (2024-06-10T16:24:46Z) - Integration of Graph Neural Network and Neural-ODEs for Tumor Dynamic Prediction [4.850774880198265]
We propose a graph encoder that utilizes a bipartite Graph Convolutional Neural network (GCN) combined with Neural Ordinary Differential Equations (Neural-ODEs)
We first show that the methodology is able to discover a tumor dynamic model that significantly improves upon an empirical model.
Our findings indicate that the methodology holds significant promise and offers potential applications in pre-clinical settings.
arXiv Detail & Related papers (2023-10-02T06:39:08Z) - Validated respiratory drug deposition predictions from 2D and 3D medical
images with statistical shape models and convolutional neural networks [47.187609203210705]
We aim to develop and validate an automated computational framework for patient-specific deposition modelling.
An image processing approach is proposed that could produce 3D patient respiratory geometries from 2D chest X-rays and 3D CT images.
arXiv Detail & Related papers (2023-03-02T07:47:07Z) - Mixed Effects Neural ODE: A Variational Approximation for Analyzing the
Dynamics of Panel Data [50.23363975709122]
We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data.
We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem.
We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
arXiv Detail & Related papers (2022-02-18T22:41:51Z) - Deep Learning for Reaction-Diffusion Glioma Growth Modelling: Towards a
Fully Personalised Model? [0.2609639566830968]
Reaction-diffusion models have been proposed for decades to capture the growth of gliomas.
Deep convolutional neural networks (DCNNs) can address the pitfalls commonly encountered in the field.
This approach may open the perspective of a clinical application of reaction-diffusion growth models for tumour prognosis and treatment planning.
arXiv Detail & Related papers (2021-11-26T10:16:57Z) - Inverting brain grey matter models with likelihood-free inference: a
tool for trustable cytoarchitecture measurements [62.997667081978825]
characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in dMRI.
We propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells.
We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model.
arXiv Detail & Related papers (2021-11-15T09:08:27Z) - Data-driven generation of plausible tissue geometries for realistic
photoacoustic image synthesis [53.65837038435433]
Photoacoustic tomography (PAT) has the potential to recover morphological and functional tissue properties.
We propose a novel approach to PAT data simulation, which we refer to as "learning to simulate"
We leverage the concept of Generative Adversarial Networks (GANs) trained on semantically annotated medical imaging data to generate plausible tissue geometries.
arXiv Detail & Related papers (2021-03-29T11:30:18Z) - Physics-informed neural networks for myocardial perfusion MRI
quantification [3.318100528966778]
This study introduces physics-informed neural networks (PINNs) as a means to perform myocardial perfusion MR quantification.
PINNs can be trained to fit the observed perfusion MR data while respecting the underlying physical conservation laws.
arXiv Detail & Related papers (2020-11-25T16:02:52Z) - Learning Dynamic and Personalized Comorbidity Networks from Event Data
using Deep Diffusion Processes [102.02672176520382]
Comorbid diseases co-occur and progress via complex temporal patterns that vary among individuals.
In electronic health records we can observe the different diseases a patient has, but can only infer the temporal relationship between each co-morbid condition.
We develop deep diffusion processes to model "dynamic comorbidity networks"
arXiv Detail & Related papers (2020-01-08T15:47:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.