Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation

• URL: http://arxiv.org/abs/2602.20216v1
• Date: Mon, 23 Feb 2026 07:58:08 GMT
• Title: Sample-Efficient Learning with Online Expert Correction for Autonomous Catheter Steering in Endovascular Bifurcation Navigation
• Abstract summary: Reinforcement learning (RL) has emerged as a promising approach for autonomous catheter steering.<n>This paper introduces a sample-efficient RL framework with online expert correction for autonomous catheter steering.
• Score: 9.822810178672782
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robot-assisted endovascular intervention offers a safe and effective solution for remote catheter manipulation, reducing radiation exposure while enabling precise navigation. Reinforcement learning (RL) has recently emerged as a promising approach for autonomous catheter steering; however, conventional methods suffer from sparse reward design and reliance on static vascular models, limiting their sample efficiency and generalization to intraoperative variations. To overcome these challenges, this paper introduces a sample-efficient RL framework with online expert correction for autonomous catheter steering in endovascular bifurcation navigation. The proposed framework integrates three key components: (1) A segmentation-based pose estimation module for accurate real-time state feedback, (2) A fuzzy controller for bifurcation-aware orientation adjustment, and (3) A structured reward generator incorporating expert priors to guide policy learning. By leveraging online expert correction, the framework reduces exploration inefficiency and enhances policy robustness in complex vascular structures. Experimental validation on a robotic platform using a transparent vascular phantom demonstrates that the proposed approach achieves convergence in 123 training episodes -- a 25.9% reduction compared to the baseline Soft Actor-Critic (SAC) algorithm -- while reducing average positional error to 83.8% of the baseline. These results indicate that combining sample-efficient RL with online expert correction enables reliable and accurate catheter steering, particularly in anatomically challenging bifurcation scenarios critical for endovascular navigation.

Related papers

• Test-time Adaptation of Pelvic Bone Segmentation Models via Dynamic Reliability-Guided [62.10276009853225]
  Reliable pelvic bone segmentation from CT is essential for robot-assisted pelvic trauma surgery.<n>Existing methods show limited effectiveness for PBS.<n>We propose a novel closed-loop dynamic Reliability-Guided framework (ReGA) for PBS.
  arXiv  Detail & Related papers  (2026-08-01T08:13:20Z)
• Learning Expert Strategy for Autonomous Robotic Endovascular Intervention via Decoupled Procedural Execution [4.864807117604499]
  A learning-based expert strategy is introduced to enhance procedural consistency in endovascular intervention.<n>The framework achieves a high navigation success rate (> 96%) and a 29.3% reduction in operational steps.<n>These results underscore its potential to enhance the predictability, safety, and consistency of robotic endovascular interventions.
  arXiv  Detail & Related papers  (2026-06-30T13:45:23Z)
• BiliVLA: Scene-Aware Vision-Language-Action Model with Reinforcement Learning for Autonomous Biliary Endoscopic Navigation [6.2182538853159]
  Endoscopic retrograde cholangiopancreatography (ERCP) demands precise endoscopic navigation and stable biliary cannulation.<n>Recent robotic systems and vision-based assistance techniques improve operator ergonomics and provide perceptual cues.<n>We present BiliVLA, a scene-aware Vision-Language-Action framework that formulates biliary endoscopic navigation as an instruction-conditioned visuomotor learning problem.
  arXiv  Detail & Related papers  (2026-06-22T16:11:15Z)
• Beyond Prompt: Fine-grained Simulation of Cognitively Impaired Standardized Patients via Stochastic Steering [58.85421622061983]
  We propose StsPatient for the fine-grained simulation of cognitively impaired patients.<n>We capture domain-specific features by extracting steering vectors from contrastive pairs of instructions and responses.<n>StsPatient significantly outperforms baselines in both clinical authenticity and severity controllability.
  arXiv  Detail & Related papers  (2026-04-14T02:37:46Z)
• A Guideline-Aware AI Agent for Zero-Shot Target Volume Auto-Delineation [6.639622698899548]
  We introduce OncoAgent, a novel guideline-aware AI framework.<n>OncoAgent seamlessly converts textual clinical guidelines into three-dimensional target contours in a training-free manner.<n>The framework generalizes zero-shot to alternative esophageal guidelines and other anatomical sites.
  arXiv  Detail & Related papers  (2026-03-10T10:00:01Z)
• Diffusion Controller: Framework, Algorithms and Parameterization [54.82539154511621]
  We present a unified control-theoretic view that casts reverse diffusion sampling as state-only control within (generalized) linearly-solvable Markov Decision Processes.<n>Under this framework, control acts by reweighting the pretrained reverse-time transition kernels, balancing terminal objectives against an $f$-divergence cost.<n>Experiments on Stable Diffusion v1.4 show consistent gains in preference-alignment win rates and improved quality-efficiency trade-offs.
  arXiv  Detail & Related papers  (2026-03-07T01:49:59Z)
• Modeling and Control of a Pneumatic Soft Robotic Catheter Using Neural Koopman Operators [3.2642164905437503]
  We propose a neural network-enhanced Koopman operator framework for advancing soft robotic catheter systems.<n>Motivated by the need to minimize radiation exposure during X-ray fluoroscopy in cardiac ablation, we investigate open-loop control strategies.<n>Our approach achieves average errors of 2.1 +- 0.4 mm in position and 4.9 +- 0.6 degrees in orientation.
  arXiv  Detail & Related papers  (2026-03-04T14:36:22Z)
• Toward AI Autonomous Navigation for Mechanical Thrombectomy using Hierarchical Modular Multi-agent Reinforcement Learning (HM-MARL) [57.65363326406228]
  We propose a Hierarchical Modular Multi-Agent Reinforcement Learning framework for autonomous two-device navigation in vitro.<n>HM-MARL was developed to autonomously navigate a guide catheter and guidewire from the femoral artery to the internal carotid artery (ICA)<n>A modular multi-agent approach was used to decompose the complex navigation task into specialized subtasks, each trained using Soft Actor-Critic RL.<n>In vitro, both HM-MARL models successfully navigated 100% of trials from the femoral artery to the right common carotid artery and 80% to the right ICA but failed on the left-side vessel challenge
  arXiv  Detail & Related papers  (2026-02-20T23:50:35Z)
• Towards Autonomous Navigation in Endovascular Interventions [0.7100795934780609]
  This thesis presents an integrated AI-driven framework for autonomous guidewire navigation in complex vascular environments.<n>A high-fidelity, real-time simulation platform, CathSim, is introduced for reinforcement learning based catheter navigation.<n>The Expert Navigation Network is developed, a policy that fuses visual, kinematic, and force feedback for autonomous tool control.
  arXiv  Detail & Related papers  (2025-12-19T21:38:52Z)
• Human-in-the-loop Online Rejection Sampling for Robotic Manipulation [55.99788088622936]
  Hi-ORS stabilizes value estimation by filtering out negatively rewarded samples during online fine-tuning.<n>Hi-ORS fine-tunes a pi-base policy to master contact-rich manipulation in just 1.5 hours of real-world training.
  arXiv  Detail & Related papers  (2025-10-30T11:53:08Z)
• DINO-CVA: A Multimodal Goal-Conditioned Vision-to-Action Model for Autonomous Catheter Navigation [0.33727511459109777]
  This work moves towards autonomous catheter navigation by introducing DINO-CVA, a multimodal goal-conditioned behavior cloning framework.<n>The proposed model fuses visual observations and joystick kinematics into a joint embedding space, enabling policies that are both vision-aware and kinematic-aware.<n>Results show that DINO-CVA achieves high accuracy in predicting actions, matching the performance of a kinematics-only baseline.
  arXiv  Detail & Related papers  (2025-10-19T22:59:32Z)
• A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
  We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
  arXiv  Detail & Related papers  (2025-08-19T14:41:22Z)
• Efficient Test-time Adaptive Object Detection via Sensitivity-Guided Pruning [73.40364018029673]
  Continual test-time adaptive object detection (CTTA-OD) aims to online adapt a source pre-trained detector to ever-changing environments.<n>Our motivation stems from the observation that not all learned source features are beneficial.<n>Our method achieves superior adaptation performance while reducing computational overhead by 12% in FLOPs.
  arXiv  Detail & Related papers  (2025-06-03T05:27:56Z)
• Safe Navigation for Robotic Digestive Endoscopy via Human Intervention-based Reinforcement Learning [5.520042381826271]
  Existing automated reinforcement learning navigation algorithms often result in potentially risky collisions.<n>We propose a Human Intervention (HI)-based Proximal Policy Optimization framework, dubbed HI-PPO, which incorporates expert knowledge to enhance RDE's safety.<n>Results show that HI-PPO achieved a mean ATE of (8.02 textmm) and a Security Score of (0.862) demonstrating performance comparable to human experts.
  arXiv  Detail & Related papers  (2024-09-24T03:01:30Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• A Novel Sample-efficient Deep Reinforcement Learning with Episodic Policy Transfer for PID-Based Control in Cardiac Catheterization Robots [2.3939470784308914]
  The model was validated for axial motion control of a robotic system designed for intravascular catheterization. Performance comparison with conventional methods in average of 10 trials shows the agent tunes the gain better with error of 0.003 mm.
  arXiv  Detail & Related papers  (2021-10-28T08:18:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.