Prostate motion modelling using biomechanically-trained deep neural
networks on unstructured nodes
- URL: http://arxiv.org/abs/2007.04972v1
- Date: Thu, 9 Jul 2020 17:58:41 GMT
- Title: Prostate motion modelling using biomechanically-trained deep neural
networks on unstructured nodes
- Authors: Shaheer U. Saeed, Zeike A. Taylor, Mark A. Pinnock, Mark Emberton,
Dean C. Barratt, Yipeng Hu
- Abstract summary: We train deep neural networks with biomechanical simulations to predict prostate motion during ultrasound-guided interventions.
PointNet can be trained to predict the nodal displacements using finite element (FE) simulations as ground-truth data.
Based on 160,000 nonlinear FE simulations on clinical imaging data from 320 patients, we demonstrate that the trained networks generalise to unstructured point sets sampled directly from holdout patient segmentation.
- Score: 0.28470372019928303
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we propose to train deep neural networks with biomechanical
simulations, to predict the prostate motion encountered during
ultrasound-guided interventions. In this application, unstructured points are
sampled from segmented pre-operative MR images to represent the anatomical
regions of interest. The point sets are then assigned with point-specific
material properties and displacement loads, forming the un-ordered input
feature vectors. An adapted PointNet can be trained to predict the nodal
displacements, using finite element (FE) simulations as ground-truth data.
Furthermore, a versatile bootstrap aggregating mechanism is validated to
accommodate the variable number of feature vectors due to different patient
geometries, comprised of a training-time bootstrap sampling and a model
averaging inference. This results in a fast and accurate approximation to the
FE solutions without requiring subject-specific solid meshing. Based on 160,000
nonlinear FE simulations on clinical imaging data from 320 patients, we
demonstrate that the trained networks generalise to unstructured point sets
sampled directly from holdout patient segmentation, yielding a near real-time
inference and an expected error of 0.017 mm in predicted nodal displacement.
Related papers
- Compositional simulation-based inference for time series [21.9975782468709]
simulators frequently emulate real-world dynamics through thousands of single-state transitions over time.
We propose an SBI framework that can exploit such Markovian simulators by locally identifying parameters consistent with individual state transitions.
We then compose these local results to obtain a posterior over parameters that align with the entire time series observation.
arXiv Detail & Related papers (2024-11-05T01:55:07Z) - Domain Adaptive Synapse Detection with Weak Point Annotations [63.97144211520869]
We present AdaSyn, a framework for domain adaptive synapse detection with weak point annotations.
In the WASPSYN challenge at I SBI 2023, our method ranks the 1st place.
arXiv Detail & Related papers (2023-08-31T05:05:53Z) - Continuous time recurrent neural networks: overview and application to
forecasting blood glucose in the intensive care unit [56.801856519460465]
Continuous time autoregressive recurrent neural networks (CTRNNs) are a deep learning model that account for irregular observations.
We demonstrate the application of these models to probabilistic forecasting of blood glucose in a critical care setting.
arXiv Detail & Related papers (2023-04-14T09:39:06Z) - Non-rigid Medical Image Registration using Physics-informed Neural
Networks [8.7196937169933]
Biomechanical modelling of soft tissue provides a non-data-driven method for constraining medical image registration.
This work instantiates the recently-proposed physics-informed neural networks (PINNs) to a 3D linear elastic model for modelling prostate motion.
arXiv Detail & Related papers (2023-02-20T22:17:29Z) - Spherical convolutional neural networks can improve brain microstructure
estimation from diffusion MRI data [0.35998666903987897]
Diffusion magnetic resonance imaging is sensitive to the microstructural properties of brain tissue.
Estimate clinically and scientifically relevant microstructural properties from the measured signals remains a highly challenging inverse problem that machine learning may help solve.
We trained a spherical convolutional neural network to predict the ground-truth parameter values from efficiently simulated noisy data.
arXiv Detail & Related papers (2022-11-17T20:52:00Z) - Neural Posterior Estimation with Differentiable Simulators [58.720142291102135]
We present a new method to perform Neural Posterior Estimation (NPE) with a differentiable simulator.
We demonstrate how gradient information helps constrain the shape of the posterior and improves sample-efficiency.
arXiv Detail & Related papers (2022-07-12T16:08:04Z) - Mixed Effects Neural ODE: A Variational Approximation for Analyzing the
Dynamics of Panel Data [50.23363975709122]
We propose a probabilistic model called ME-NODE to incorporate (fixed + random) mixed effects for analyzing panel data.
We show that our model can be derived using smooth approximations of SDEs provided by the Wong-Zakai theorem.
We then derive Evidence Based Lower Bounds for ME-NODE, and develop (efficient) training algorithms.
arXiv Detail & Related papers (2022-02-18T22:41:51Z) - Inverting brain grey matter models with likelihood-free inference: a
tool for trustable cytoarchitecture measurements [62.997667081978825]
characterisation of the brain grey matter cytoarchitecture with quantitative sensitivity to soma density and volume remains an unsolved challenge in dMRI.
We propose a new forward model, specifically a new system of equations, requiring a few relatively sparse b-shells.
We then apply modern tools from Bayesian analysis known as likelihood-free inference (LFI) to invert our proposed model.
arXiv Detail & Related papers (2021-11-15T09:08:27Z) - Graph Convolutional Neural Networks for Body Force Prediction [0.0]
A graph based data-driven model is presented to perform inference on fields defined on an unstructured mesh.
The network can infer from field samples at different resolutions, and is invariant to the order in which the measurements within each sample are presented.
arXiv Detail & Related papers (2020-12-03T19:53:47Z) - Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals.
Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts.
We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
arXiv Detail & Related papers (2020-06-18T09:49:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.