Optimal navigation of magnetic artificial microswimmers in blood capillaries with deep reinforcement learning
- URL: http://arxiv.org/abs/2404.02171v2
- Date: Tue, 13 May 2025 19:26:11 GMT
- Title: Optimal navigation of magnetic artificial microswimmers in blood capillaries with deep reinforcement learning
- Abstract summary: We conduct numerical simulations of artificial bacterial flagella (ABFs) in retinal capillaries propelled by an external magnetic field.<n>The simulations are based on a validated blood model that predicts the dynamics of individual red blood cells and their hydrodynamic interactions with ABFs.<n>We show that the same policy robustly guides the ABF to a prescribed target in both the reduced-order model and the fine-grained blood simulations.
- Score: 1.3225694028747141
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Biomedical applications such as targeted drug delivery, microsurgery, and sensing rely on reaching precise areas within the body in a minimally invasive way. Artificial bacterial flagella (ABFs) have emerged as potential tools for this task by navigating through the circulatory system with the help of external magnetic fields. While their swimming characteristics are well understood in simple settings, their controlled navigation through realistic capillary networks remains a significant challenge due to the complexity of blood flow and the high computational cost of detailed simulations. We address this challenge by conducting numerical simulations of ABFs in retinal capillaries, propelled by an external magnetic field. The simulations are based on a validated blood model that predicts the dynamics of individual red blood cells and their hydrodynamic interactions with ABFs. The magnetic field follows a control policy that brings the ABF to a prescribed target. The control policy is learned with an actor-critic, off-policy reinforcement learning algorithm coupled with a reduced-order model of the system. We show that the same policy robustly guides the ABF to a prescribed target in both the reduced-order model and the fine-grained blood simulations. This approach is suitable for designing robust control policies for personalized medicine at moderate computational cost.
Related papers
- Attention-guided super-resolution of 4D flow MRI in carotid arteries [0.0]
We propose a deep learning-based framework that integrates multi-scale feature extraction and attention mechanisms to enhance the quality of 4D flow MRI data geometries.<n>The proposed architecture uses convolutional block attention modules (CBAM) to guide the network toward clinically relevant spatial features and to suppress noise in low-resolution inputs.
arXiv Detail & Related papers (2026-09-04T08:48:32Z) - Learning Unsteady Aneurysm Hemodynamics with Physics-Informed DeepONets [0.0]
M3PI-DeepONet simultaneously predicts unsteady 3D flow velocity and pressure fields with an average relative L2 velocity error below 4% and pressure error around 5%.<n>This work advances the application of deep learning in cardiovascular disease modeling, marking step toward real-time, non-invasive clinical diagnostics.
arXiv Detail & Related papers (2026-08-13T09:08:24Z) - Reinforcement Learning Enables Autonomous Microrobot Navigation and Intervention in Simulated Blood Capillaries [0.903934726553365]
We develop a physically grounded simulation of a blood capillary network.<n>We train deep reinforcement learning agents to navigate it via chemotaxis.<n>These results establish RL as a viable framework for developing autonomous microrobotic intervention strategies in complex biological environments.
arXiv Detail & Related papers (2026-06-23T12:21:18Z) - A physics-informed foundation model for quantitative diffusion MRI [46.74037857287099]
A physics-informed generative microstructure network (PIGMENT) learns a universal generative prior to human brain microstructure and adapts it zero-shot to each participant's measured data to recover subject-specific maps.<n>PIGMENT estimates demonstrated strong biological validity, preserving submillimeter cortical microarchitectural patterns and early-childhood white matter developmental trajectories from 10-fold accelerated scans.<n>These results establish PIGMENT as a physics-informed foundation model that extends quantitative diffusion MRI into regimes traditionally too sparse, heterogeneous, or clinically constrained for reliable analysis.
arXiv Detail & Related papers (2026-05-29T07:26:35Z) - Machine Learning Framework for Thrombosis Risk Prediction in Rotary Blood Pumps [0.9090050839144254]
Thrombosis in rotary blood pumps arises from complex flow conditions that remain difficult to translate into reliable and interpretable risk predictions.<n>This study introduces an interpretable machine learning framework for spatial thrombosis assessment based directly on computational fluid dynamics-derived flow features.
arXiv Detail & Related papers (2025-12-12T07:50:56Z) - Linearized Optimal Transport for Analysis of High-Dimensional Point-Cloud and Single-Cell Data [45.87606039212519]
Single-cell technologies generate high-dimensional point clouds of cells.<n>Each patient is represented by an irregular point cloud rather than a simple vector.<n>We adapt the Linear Optimal Transport framework to embed irregular point clouds into a fixed-dimensional Euclidean space.
arXiv Detail & Related papers (2025-10-24T21:33:12Z) - The-Bodega: A Matlab Toolbox for Biologically Dynamic Microbubble Simulations on Realistic Hemodynamic Microvascular Graphs [1.8686303208366433]
The-Bodega is a Matlab-based toolbox for simulating Ultrasound Microscopy datasets.<n>It supports consistent consistent micro-to-ultrasound simulations across domains ranging from mouse brains to human hearts.<n>We demonstrate its versatility in applications including image quality assessment, motion analysis, and the simulation of novel ULM modalities.
arXiv Detail & Related papers (2025-09-09T21:14:04Z) - Towards Digital Twins for Optimal Radioembolization [0.4893896929103368]
Radioembolization is a localized liver cancer treatment that delivers radioactive microspheres to tumors via a catheter inserted in the hepatic arterial tree.<n> optimization is challenging due to complex hepatic artery anatomy, variable blood flow, and uncertainty in microsphere transport.<n>This work outlines a framework for a liver radioembolization digital twin using high-fidelity computational fluid dynamics (CFD) and/or recent physics-informed machine learning approaches.
arXiv Detail & Related papers (2025-08-30T00:30:42Z) - FORT: Forward-Only Regression Training of Normalizing Flows [85.66894616735752]
We revisit classical normalizing flows as one-step generative models with exact likelihoods.<n>We propose a novel, scalable training objective that does not require computing the expensive change of variable formula used in conventional maximum likelihood training.
arXiv Detail & Related papers (2025-06-01T20:32:27Z) - Hybrid Neural-MPM for Interactive Fluid Simulations in Real-Time [57.30651532625017]
We present a novel hybrid method that integrates numerical simulation, neural physics, and generative control.<n>Our system demonstrates robust performance across diverse 2D/3D scenarios, material types, and obstacle interactions.<n>We promise to release both models and data upon acceptance.
arXiv Detail & Related papers (2025-05-25T01:27:18Z) - Aneumo: A Large-Scale Multimodal Aneurysm Dataset with Computational Fluid Dynamics Simulations and Deep Learning Benchmarks [16.753219355754222]
Intracranial aneurysms (IAs) are serious cerebrovascular lesions found in approximately 5% of the general population.<n>Their rupture may lead to high mortality.<n>Current methods for assessing IA risk focus on morphological and patient-specific factors, but the hemodynamic influences on IA development and rupture remain unclear.<n>This dataset aims to advance aneurysm research and promote data-driven approaches in biofluids, biomedical engineering, and clinical risk assessment.
arXiv Detail & Related papers (2025-05-19T09:32:09Z) - Threshold Adaptation in Spiking Networks Enables Shortest Path Finding and Place Disambiguation [17.979944005634337]
This work proposes a mechanism for activity back-tracing in arbitrary, uni-directional spiking neuron graphs.
We extend the existing replay mechanism of the spiking hierarchical temporal memory (S-HTM) by our spike timing-dependent threshold adaptation (STDTA)
We also present an ambiguity dependent threshold adaptation (ADTA) for identifying places in an environment with less ambiguity, enhancing the localization estimate of an agent.
arXiv Detail & Related papers (2025-03-22T03:18:44Z) - Enhanced Vascular Flow Simulations in Aortic Aneurysm via Physics-Informed Neural Networks and Deep Operator Networks [0.0]
PINNs, Deep Operator Networks (DeepONets), and their Physics-Informed extensions (PI-DeepONets) are studied.<n>We adapt the approaches to address the particular use case of AAA by integrating the 3D Navier-Stokes equations.<n> advantages and limitations of each approach are highlighted through a series of relevant application cases.
arXiv Detail & Related papers (2025-03-19T22:38:52Z) - AutoComb: Automated Comb Sign Detector for 3D CTE Scans [6.146230417980112]
Comb Sign is an important biomarker to detect multiple gastrointestinal diseases.
Current detection methods are manual, time-intensive, and prone to subjective interpretation.
We propose a fully automated technique for the detection of Comb Sign from CTE.
arXiv Detail & Related papers (2025-02-28T18:53:32Z) - Leveraging Cardiovascular Simulations for In-Vivo Prediction of Cardiac Biomarkers [43.17768785084301]
We train an amortized neural posterior estimator on a newly built large dataset of cardiac simulations.<n>We incorporate elements modeling effects to better align simulated data with real-world measurements.<n>The proposed framework can further integrate in-vivo data sources to refine its predictive capabilities on real-world data.
arXiv Detail & Related papers (2024-12-23T13:05:17Z) - Convolutional Deep Operator Networks for Learning Nonlinear Focused Ultrasound Wave Propagation in Heterogeneous Spinal Cord Anatomy [0.0]
Focused ultrasound therapy is a promising tool for optimally targeted treatment of spinal cord injuries.
Current approaches rely on computer simulations to solve the governing wave propagation equations.
We propose a convolutional deep operator network (DeepONet) to rapidly predict FUS pressure fields in patient spinal cords.
arXiv Detail & Related papers (2024-12-20T18:03:38Z) - Vascular Segmentation of Functional Ultrasound Images using Deep Learning [0.0]
We introduce the first deep learning-based segmentation tool for functional ultrasound (fUS) images.
We achieve competitive segmentation performance, with 90% accuracy, with 71% robustness and an IU of 0.59, using only 100 temporal frames from a fUS stack.
This work offers a non-invasive, cost-effective alternative to localization microscopy, enhancing fUS data interpretation and improving understanding of vessel function.
arXiv Detail & Related papers (2024-10-28T09:00:28Z) - Mesh-Informed Reduced Order Models for Aneurysm Rupture Risk Prediction [0.0]
Graph Neural Networks (GNNs) exploit the natural graph structure of the mesh obtained by the Finite Volume (FV) discretization.
Our experimental validation framework yields promising results, confirming our method as a valid alternative that overcomes the curse of dimensionality.
arXiv Detail & Related papers (2024-10-04T09:39:15Z) - KLDD: Kalman Filter based Linear Deformable Diffusion Model in Retinal Image Segmentation [51.03868117057726]
This paper proposes a novel Kalman filter based Linear Deformable Diffusion (KLDD) model for retinal vessel segmentation.
Our model employs a diffusion process that iteratively refines the segmentation, leveraging the flexible receptive fields of deformable convolutions.
Experiments are evaluated on retinal fundus image datasets (DRIVE, CHASE_DB1) and the 3mm and 6mm of the OCTA-500 dataset.
arXiv Detail & Related papers (2024-09-19T14:21:38Z) - Physics-informed graph neural networks for flow field estimation in carotid arteries [2.0437999068326276]
Hemodynamic quantities are valuable biomedical risk factors for cardiovascular pathology such as atherosclerosis.
In this work, we create a surrogate model for hemodynamic flow field estimation, powered by machine learning.
We train graph neural networks that include priors about the underlying symmetries and physics, limiting the amount of data required for training.
This shows that physics-informed graph neural networks can be trained using 4D flow MRI data to estimate blood flow in unseen carotid artery geometries.
arXiv Detail & Related papers (2024-08-13T13:09:28Z) - L-SFAN: Lightweight Spatially-focused Attention Network for Pain Behavior Detection [44.016805074560295]
Chronic Low Back Pain (CLBP) afflicts millions globally, significantly impacting individuals' well-being and imposing economic burdens on healthcare systems.
While artificial intelligence (AI) and deep learning offer promising avenues for analyzing pain-related behaviors to improve rehabilitation strategies, current models, including convolutional neural networks (CNNs), have limitations.
We introduce hbox EmoL-SFAN, a lightweight CNN architecture incorporating 2D filters designed to capture the spatial-temporal interplay of data from motion capture and surface electromyography sensors.
arXiv Detail & Related papers (2024-06-07T12:01:37Z) - Phy-Diff: Physics-guided Hourglass Diffusion Model for Diffusion MRI Synthesis [45.074243735766]
We propose a physics-guided diffusion model to generate high-quality dMRI.
Our model introduces the physical principles of dMRI in the noise evolution in the diffusion process.
Our experiment results show that our method outperforms other state-of-the-art methods.
arXiv Detail & Related papers (2024-06-05T07:09:19Z) - Regressor-free Molecule Generation to Support Drug Response Prediction [83.25894107956735]
Conditional generation based on the target IC50 score can obtain a more effective sampling space.
Regressor-free guidance combines a diffusion model's score estimation with a regression controller model's gradient based on number labels.
arXiv Detail & Related papers (2024-05-23T13:22:17Z) - Reconstructing Blood Flow in Data-Poor Regimes: A Vasculature Network Kernel for Gaussian Process Regression [2.9998889086656586]
We introduce a novel methodology to reconstruct the kernel within the vascular network, which is a non-Euclidean space.
The proposed kernel encodes bothtemporal and vessel-to-vessel correlations, thus enabling blood flow reconstruction in vessels that lack direct measurements.
We demonstrate the performance of the model on three test cases, namely, a simple Y-shaped bifurcation, abdominal aorta, and the Circle of Willis in the brain.
arXiv Detail & Related papers (2024-03-14T15:41:15Z) - Evolutionary algorithms as an alternative to backpropagation for
supervised training of Biophysical Neural Networks and Neural ODEs [12.357635939839696]
We investigate the use of "gradient-estimating" evolutionary algorithms for training biophysically based neural networks.
We find that EAs have several advantages making them desirable over direct BP.
Our findings suggest that biophysical neurons could provide useful benchmarks for testing the limits of BP methods.
arXiv Detail & Related papers (2023-11-17T20:59:57Z) - Collaborative Robotic Biopsy with Trajectory Guidance and Needle Tip
Force Feedback [49.32653090178743]
We present a collaborative robotic biopsy system that combines trajectory guidance with kinesthetic feedback to assist the physician in needle placement.
A needle design that senses forces at the needle tip based on optical coherence tomography and machine learning for real-time data processing.
We demonstrate that even smaller, deep target structures can be accurately sampled by performing post-mortem in situ biopsies of the pancreas.
arXiv Detail & Related papers (2023-06-12T14:07:53Z) - fMRI from EEG is only Deep Learning away: the use of interpretable DL to
unravel EEG-fMRI relationships [68.8204255655161]
We present an interpretable domain grounded solution to recover the activity of several subcortical regions from multichannel EEG data.
We recover individual spatial and time-frequency patterns of scalp EEG predictive of the hemodynamic signal in the subcortical nuclei.
arXiv Detail & Related papers (2022-10-23T15:11:37Z) - Fuzzy Attention Neural Network to Tackle Discontinuity in Airway
Segmentation [67.19443246236048]
Airway segmentation is crucial for the examination, diagnosis, and prognosis of lung diseases.
Some small-sized airway branches (e.g., bronchus and terminaloles) significantly aggravate the difficulty of automatic segmentation.
This paper presents an efficient method for airway segmentation, comprising a novel fuzzy attention neural network and a comprehensive loss function.
arXiv Detail & Related papers (2022-09-05T16:38:13Z) - Physics-informed machine learning with differentiable programming for
heterogeneous underground reservoir pressure management [64.17887333976593]
Avoiding over-pressurization in subsurface reservoirs is critical for applications like CO2 sequestration and wastewater injection.
Managing the pressures by controlling injection/extraction are challenging because of complex heterogeneity in the subsurface.
We use differentiable programming with a full-physics model and machine learning to determine the fluid extraction rates that prevent over-pressurization.
arXiv Detail & Related papers (2022-06-21T20:38:13Z) - Modeling and hexahedral meshing of cerebral arterial networks from
centerlines [0.0]
Centerline-based representation is widely used to model large vascular networks with small vessels.
We propose an automatic method to generate a structured hexahedral mesh suitable for CFD directly from centerlines.
We demonstrate the efficiency of our method by entirely meshing a dataset of 60 cerebral vascular networks.
arXiv Detail & Related papers (2022-01-20T16:30:17Z) - Deep Bayesian Active Learning for Accelerating Stochastic Simulation [74.58219903138301]
Interactive Neural Process (INP) is a deep active learning framework for simulations and with active learning approaches.
For active learning, we propose a novel acquisition function, Latent Information Gain (LIG), calculated in the latent space of NP based models.
The results demonstrate STNP outperforms the baselines in the learning setting and LIG achieves the state-of-the-art for active learning.
arXiv Detail & Related papers (2021-06-05T01:31:51Z) - Dynamic Mode Decomposition in Adaptive Mesh Refinement and Coarsening
Simulations [58.720142291102135]
Dynamic Mode Decomposition (DMD) is a powerful data-driven method used to extract coherent schemes.
This paper proposes a strategy to enable DMD to extract from observations with different mesh topologies and dimensions.
arXiv Detail & Related papers (2021-04-28T22:14:25Z) - Towards an Automatic Analysis of CHO-K1 Suspension Growth in
Microfluidic Single-cell Cultivation [63.94623495501023]
We propose a novel Machine Learning architecture, which allows us to infuse a neural deep network with human-powered abstraction on the level of data.
Specifically, we train a generative model simultaneously on natural and synthetic data, so that it learns a shared representation, from which a target variable, such as the cell count, can be reliably estimated.
arXiv Detail & Related papers (2020-10-20T08:36:51Z) - Microvascular Dynamics from 4D Microscopy Using Temporal Segmentation [81.30750944868142]
We are able to track changes in cerebral blood volume over time and identify spontaneous arterial dilations that propagate towards the pial surface.
This new imaging capability is a promising step towards characterizing the hemodynamic response function upon which functional magnetic resonance imaging (fMRI) is based.
arXiv Detail & Related papers (2020-01-14T22:55:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.