Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registration
- URL: http://arxiv.org/abs/2508.13762v1
- Date: Tue, 19 Aug 2025 11:58:46 GMT
- Title: Deep Biomechanically-Guided Interpolation for Keypoint-Based Brain Shift Registration
- Authors: Tiago Assis, Ines P. Machado, Benjamin Zwick, Nuno C. Garcia, Reuben Dorent,
- Abstract summary: Keypoint-based registration methods offer robustness to large deformations and topological changes.<n>They typically rely on simple geometric interpolators that ignore tissue to create dense displacement fields.<n>We propose a novel deep learning framework that estimates dense, physically plausible brain deformations from sparse matched keypoints.
- Score: 0.9779710626805148
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Accurate compensation of brain shift is critical for maintaining the reliability of neuronavigation during neurosurgery. While keypoint-based registration methods offer robustness to large deformations and topological changes, they typically rely on simple geometric interpolators that ignore tissue biomechanics to create dense displacement fields. In this work, we propose a novel deep learning framework that estimates dense, physically plausible brain deformations from sparse matched keypoints. We first generate a large dataset of synthetic brain deformations using biomechanical simulations. Then, a residual 3D U-Net is trained to refine standard interpolation estimates into biomechanically guided deformations. Experiments on a large set of simulated displacement fields demonstrate that our method significantly outperforms classical interpolators, reducing by half the mean square error while introducing negligible computational overhead at inference time. Code available at: \href{https://github.com/tiago-assis/Deep-Biomechanical-Interpolator}{https://github.com/tiago-assis/Deep-Biomechanical-Interpolator}.
Related papers
- Autoregressive deep learning for real-time simulation of soft tissue dynamics during virtual neurosurgery [19.464888859778487]
Traditional numerical solvers often fall short in meeting real-time performance requirements.<n>We introduce a deep learning-based surrogate model that efficiently simulates transient brain deformation.<n>We further integrate the trained surrogate model into an interactive neurosurgical simulation environment, achieving runtimes below 10 ms per simulation step.
arXiv Detail & Related papers (2026-01-20T07:25:32Z) - VIKING: Deep variational inference with stochastic projections [48.946143517489496]
Variational mean field approximations tend to struggle with contemporary overparametrized deep neural networks.<n>We propose a simple variational family that considers two independent linear subspaces of the parameter space.<n>This allows us to build a fully-correlated approximate posterior reflecting the overparametrization.
arXiv Detail & Related papers (2025-10-27T15:38:35Z) - Neural-Augmented Kelvinlet for Real-Time Soft Tissue Deformation Modeling [13.94373407381203]
We present a novel physics-informed neural simulation framework that enables real-time prediction of soft-tissue deformations.<n>Our approach integrates Kelvinlet-based analytical priors with large-scale FEM data, capturing both linear and nonlinear tissue responses.<n>These results establish Kelvinlet-augmented learning as a principled and computationally efficient paradigm for real-time, physics-aware soft-tissue simulation in surgical AI.
arXiv Detail & Related papers (2025-06-06T19:22:49Z) - NOBLE -- Neural Operator with Biologically-informed Latent Embeddings to Capture Experimental Variability in Biological Neuron Models [68.89389652724378]
NOBLE is a neural operator framework that learns a mapping from a continuous frequency-modulated embedding of interpretable neuron features to the somatic voltage response induced by current injection.<n>It predicts distributions of neural dynamics accounting for the intrinsic experimental variability.<n>NOBLE is the first scaled-up deep learning framework validated on real experimental data.
arXiv Detail & Related papers (2025-06-05T01:01:18Z) - Delving Deeper Into Astromorphic Transformers [1.7595244858303718]
This paper seeks to delve deeper into various key aspects of neuron-synapse-astrocyte interactions to mimic self-attention mechanisms in Transformers.<n>Our analysis on sentiment and image classification tasks highlights the advantages of Astromorphic Transformers, offering improved accuracy and learning speed.
arXiv Detail & Related papers (2023-12-18T04:35:07Z) - General Neural Gauge Fields [100.35916421218101]
We develop a learning framework to jointly optimize gauge transformations and neural fields.
We derive an information-invariant gauge transformation which allows to preserve scene information inherently and yield superior performance.
arXiv Detail & Related papers (2023-05-05T12:08:57Z) - Neuromechanical Autoencoders: Learning to Couple Elastic and Neural
Network Nonlinearity [15.47367187516723]
We seek to develop machine learning analogs of.
mechanical intelligence.
We jointly learn the morphology of complex nonlinear elastic solids along with a.
deep neural network to control it.
arXiv Detail & Related papers (2023-01-31T19:04:28Z) - Data-driven emergence of convolutional structure in neural networks [83.4920717252233]
We show how fully-connected neural networks solving a discrimination task can learn a convolutional structure directly from their inputs.
By carefully designing data models, we show that the emergence of this pattern is triggered by the non-Gaussian, higher-order local structure of the inputs.
arXiv Detail & Related papers (2022-02-01T17:11:13Z) - Research on the Inverse Kinematics Prediction of a Soft Biomimetic
Actuator via BP Neural Network [5.694781677024249]
In this work, we address the inverse kinetics problem of motion planning of soft biomimetic actuators driven by three chambers.
We propose a back-propagation neural network learning the inverse kinetics of the soft biomimetic actuator moving in three-dimensional space.
The proposed algorithm is more precise than the analytical model.
arXiv Detail & Related papers (2021-10-26T05:24:39Z) - Deep Metric Learning with Locality Sensitive Angular Loss for
Self-Correcting Source Separation of Neural Spiking Signals [77.34726150561087]
We propose a methodology based on deep metric learning to address the need for automated post-hoc cleaning and robust separation filters.
We validate this method with an artificially corrupted label set based on source-separated high-density surface electromyography recordings.
This approach enables a neural network to learn to accurately decode neurophysiological time series using any imperfect method of labelling the signal.
arXiv Detail & Related papers (2021-10-13T21:51:56Z) - Mapping and Validating a Point Neuron Model on Intel's Neuromorphic
Hardware Loihi [77.34726150561087]
We investigate the potential of Intel's fifth generation neuromorphic chip - Loihi'
Loihi is based on the novel idea of Spiking Neural Networks (SNNs) emulating the neurons in the brain.
We find that Loihi replicates classical simulations very efficiently and scales notably well in terms of both time and energy performance as the networks get larger.
arXiv Detail & Related papers (2021-09-22T16:52:51Z) - Hyperbolic Neural Networks++ [66.16106727715061]
We generalize the fundamental components of neural networks in a single hyperbolic geometry model, namely, the Poincar'e ball model.
Experiments show the superior parameter efficiency of our methods compared to conventional hyperbolic components, and stability and outperformance over their Euclidean counterparts.
arXiv Detail & Related papers (2020-06-15T08:23:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.