Reinforcement Learning for Follow-the-Leader Robotic Endoscopic Navigation via Synthetic Data

• URL: http://arxiv.org/abs/2601.02798v1
• Date: Tue, 06 Jan 2026 08:15:53 GMT
• Title: Reinforcement Learning for Follow-the-Leader Robotic Endoscopic Navigation via Synthetic Data
• Abstract summary: We present a follow-the-leader endoscopic robot based on a flexible continuum structure designed to minimize contact between the endoscope body and intestinal walls.<n>We propose a vision-based deep reinforcement learning framework guided by monocular depth estimation.
• Score: 21.611096590329343
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous navigation is crucial for both medical and industrial endoscopic robots, enabling safe and efficient exploration of narrow tubular environments without continuous human intervention, where avoiding contact with the inner walls has been a longstanding challenge for prior approaches. We present a follow-the-leader endoscopic robot based on a flexible continuum structure designed to minimize contact between the endoscope body and intestinal walls, thereby reducing patient discomfort. To achieve this objective, we propose a vision-based deep reinforcement learning framework guided by monocular depth estimation. A realistic intestinal simulation environment was constructed in \textit{NVIDIA Omniverse} to train and evaluate autonomous navigation strategies. Furthermore, thousands of synthetic intraluminal images were generated using NVIDIA Replicator to fine-tune the Depth Anything model, enabling dense three-dimensional perception of the intestinal environment with a single monocular camera. Subsequently, we introduce a geometry-aware reward and penalty mechanism to enable accurate lumen tracking. Compared with the original Depth Anything model, our method improves $δ_{1}$ depth accuracy by 39.2% and reduces the navigation J-index by 0.67 relative to the second-best method, demonstrating the robustness and effectiveness of the proposed approach.

Related papers

• Eversion-based robots can enable safe access,steering and endoscopic imaging within the spinal subarachnoid space [7.4000506819669845]
  We present a 2 mm diameter eversion-growing robotic platform that enables friction minimised extension and steering within the human spinal subarachnoid space.<n>The robot integrates a miniature endoscope for real time intrathecal visualisation and advances by pressure driven tip eversion.<n>In an intact human cadaver, the system achieved 150 mm of controlled intrathecal extension with concurrent fluoroscopic and endoscopic visualisation.
  arXiv  Detail & Related papers  (2026-07-21T16:46:00Z)
• Anatomical Landmark-Guided Deep Reinforcement Learning for Autonomous Gastric Navigation [9.172107354380117]
  Wireless capsule endoscopy (WCE) enables painless visualization of the gastrointestinal tract.<n>We propose a transferable, anatomical landmarkguided deep reinforcement learning framework for autonomous gastric navigation.
  arXiv  Detail & Related papers  (2026-05-08T03:11:21Z)
• Towards Autonomous Navigation in Endovascular Interventions [0.7100795934780609]
  This thesis presents an integrated AI-driven framework for autonomous guidewire navigation in complex vascular environments.<n>A high-fidelity, real-time simulation platform, CathSim, is introduced for reinforcement learning based catheter navigation.<n>The Expert Navigation Network is developed, a policy that fuses visual, kinematic, and force feedback for autonomous tool control.
  arXiv  Detail & Related papers  (2025-12-19T21:38:52Z)
• DualVision ArthroNav: Investigating Opportunities to Enhance Localization and Reconstruction in Image-based Arthroscopy Navigation via External Cameras [38.19996575955867]
  Vision-based alternatives, though less invasive, often rely solely on the monocular arthroscope camera.<n>We propose DualVision ArthroNav, a multi-camera arthroscopy navigation system that integrates an external camera rigidly mounted on the arthroscope.<n> Experiments demonstrate that our system effectively compensates for calibration errors, achieving an average absolute trajectory error of 1.09 mm.
  arXiv  Detail & Related papers  (2025-11-12T16:02:34Z)
• EndoUFM: Utilizing Foundation Models for Monocular depth estimation of endoscopic images [7.350425834778092]
  EndoUFM is an unsupervised monocular depth estimation framework.<n>It enhances the depth estimation performance by leveraging the powerful pre-learned priors.<n>This work contributes to augmenting surgeons' spatial perception during minimally invasive procedures.
  arXiv  Detail & Related papers  (2025-08-25T11:33:05Z)
• A Novel Attention-Augmented Wavelet YOLO System for Real-time Brain Vessel Segmentation on Transcranial Color-coded Doppler [49.03919553747297]
  We propose an AI-powered, real-time CoW auto-segmentation system capable of efficiently capturing cerebral arteries.<n>No prior studies have explored AI-driven cerebrovascular segmentation using Transcranial Color-coded Doppler (TCCD)<n>The proposed AAW-YOLO demonstrated strong performance in segmenting both ipsilateral and contralateral CoW vessels.
  arXiv  Detail & Related papers  (2025-08-19T14:41:22Z)
• Unifying Scale-Aware Depth Prediction and Perceptual Priors for Monocular Endoscope Pose Estimation and Tissue Reconstruction [3.251946340142663]
  A unified framework for monocular endoscopic tissue reconstruction is presented.<n>It integrates scale-aware depth prediction with temporally-constrained perceptual refinement.<n> Evaluations on HEVD and SCARED, with ablation and comparative analyses, demonstrate the framework's robustness and superiority over state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-08-15T07:41:17Z)
• Intraoperative Registration by Cross-Modal Inverse Neural Rendering [61.687068931599846]
  We present a novel approach for 3D/2D intraoperative registration during neurosurgery via cross-modal inverse neural rendering. Our approach separates implicit neural representation into two components, handling anatomical structure preoperatively and appearance intraoperatively. We tested our method on retrospective patients' data from clinical cases, showing that our method outperforms state-of-the-art while meeting current clinical standards for registration.
  arXiv  Detail & Related papers  (2024-09-18T13:40:59Z)
• Advancing Depth Anything Model for Unsupervised Monocular Depth Estimation in Endoscopy [2.906891207990726]
  We introduce a novel fine-tuning strategy for the Depth Anything Model.<n>We integrate it with an intrinsic-based unsupervised monocular depth estimation framework.<n>Our results show that our method achieves state-of-the-art performance while minimizing the number of trainable parameters.
  arXiv  Detail & Related papers  (2024-09-12T03:04:43Z)
• 3D Vessel Reconstruction from Sparse-View Dynamic DSA Images via Vessel Probability Guided Attenuation Learning [79.60829508459753]
  Current commercial Digital Subtraction Angiography (DSA) systems typically demand hundreds of scanning views to perform reconstruction. The dynamic blood flow and insufficient input of sparse-view DSA images present significant challenges to the 3D vessel reconstruction task. We propose to use a time-agnostic vessel probability field to solve this problem effectively.
  arXiv  Detail & Related papers  (2024-05-17T11:23:33Z)
• EyeLS: Shadow-Guided Instrument Landing System for Intraocular Target Approaching in Robotic Eye Surgery [51.05595735405451]
  Robotic ophthalmic surgery is an emerging technology to facilitate high-precision interventions such as retina penetration in subretinal injection and removal of floating tissues in retinal detachment. Current image-based methods cannot effectively estimate the needle tip's trajectory towards both retinal and floating targets. We propose to use the shadow positions of the target and the instrument tip to estimate their relative depth position. Our method succeeds target approaching on a retina model, and achieves an average depth error of 0.0127 mm and 0.3473 mm for floating and retinal targets respectively in the surgical simulator.
  arXiv  Detail & Related papers  (2023-11-15T09:11:37Z)
• Robotic Navigation Autonomy for Subretinal Injection via Intelligent Real-Time Virtual iOCT Volume Slicing [88.99939660183881]
  We propose a framework for autonomous robotic navigation for subretinal injection. Our method consists of an instrument pose estimation method, an online registration between the robotic and the i OCT system, and trajectory planning tailored for navigation to an injection target. Our experiments on ex-vivo porcine eyes demonstrate the precision and repeatability of the method.
  arXiv  Detail & Related papers  (2023-01-17T21:41:21Z)
• Towards Autonomous Atlas-based Ultrasound Acquisitions in Presence of Articulated Motion [48.52403516006036]
  This paper proposes a vision-based approach allowing autonomous robotic US limb scanning. To this end, an atlas MRI template of a human arm with annotated vascular structures is used to generate trajectories. In all cases, the system can successfully acquire the planned vascular structure on volunteers' limbs.
  arXiv  Detail & Related papers  (2022-08-10T15:39:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.