SplineFormer: An Explainable Transformer-Based Approach for Autonomous Endovascular Navigation

• URL: http://arxiv.org/abs/2501.04515v1
• Date: Wed, 08 Jan 2025 14:05:24 GMT
• Title: SplineFormer: An Explainable Transformer-Based Approach for Autonomous Endovascular Navigation
• Abstract summary: Traditional segmentation methods fail to provide accurate real-time shape predictions.<n>We propose SplineFormer, a new transformer-based architecture, designed specifically to predict the continuous, smooth shape of the guidewire.<n>We integrate our SplineFormer into an end-to-end robot navigation system by leveraging the condensed information.
• Score: 8.784945912952743
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Endovascular navigation is a crucial aspect of minimally invasive procedures, where precise control of curvilinear instruments like guidewires is critical for successful interventions. A key challenge in this task is accurately predicting the evolving shape of the guidewire as it navigates through the vasculature, which presents complex deformations due to interactions with the vessel walls. Traditional segmentation methods often fail to provide accurate real-time shape predictions, limiting their effectiveness in highly dynamic environments. To address this, we propose SplineFormer, a new transformer-based architecture, designed specifically to predict the continuous, smooth shape of the guidewire in an explainable way. By leveraging the transformer's ability, our network effectively captures the intricate bending and twisting of the guidewire, representing it as a spline for greater accuracy and smoothness. We integrate our SplineFormer into an end-to-end robot navigation system by leveraging the condensed information. The experimental results demonstrate that our SplineFormer is able to perform endovascular navigation autonomously and achieves a 50% success rate when cannulating the brachiocephalic artery on the real robot.

Related papers

• CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements [63.40365657068892]
  Transferring human hand demonstrations to robotic grippers has recently emerged as a cost-effective solution for robot learning.<n>Motivated by this gap, we adopt an implicit, data-driven approach guided by fine-grained hand-pose motions.<n>In both simulation and real-robot experiments, our framework enables stable and precise hand-to-gripper transfer of complex spatial manipulations.
  arXiv  Detail & Related papers  (2026-09-07T13:47:22Z)
• AutoPath: Learning Transferable Goal-Conditioned Stochastic Path Prior for Safe Navigation Without Human Demonstrations [103.61864552260316]
  Real-time navigation in dynamic environments requires collision-free and dynamically feasible motion under limited perception.<n>We formulate navigation as learning a transferable goal-aligned path prior that models a reusable distribution over goal-aligned geometry-consistent local paths conditioned on local observations.<n>We develop a structured prior learning framework that parameterizes local paths using a geometry-aware polar action manifold and incorporates risk-sensitive utility shaping with multi-goal distributional rollouts for stable and safety-aware planning.
  arXiv  Detail & Related papers  (2026-07-13T16:00:41Z)
• Taming Curvature: Architecture Warm-Up for Stable Transformer Training [52.6838951211596]
  We introduce a fast online estimator of the largest (preconditioned) Hessian eigenvalue (i.e., curvature) based on a warm-started variant for power with Hessian-vector products.<n>We find that training instabilities coincide with surges in preconditioned curvature and that curvature grows with depth.<n> Experiments on large Transformers validate that our approach enables efficient curvature tracking and reduces instabilities.
  arXiv  Detail & Related papers  (2026-06-15T14:16:56Z)
• Self-supervised Physics-Informed Manipulation of Deformable Linear Objects with Non-negligible Dynamics [14.801939035043352]
  SPiD is a physics-informed self-supervised learning framework for dynamic manipulation of deformable linear objects.<n>We train a neural controller using a task-oriented cost, enabling end-to-end optimization through interaction with the differentiable object model.<n>We develop an affordable markerless rope perception method and demonstrate that our controller maintains performance with noisy and low-frequency state updates.
  arXiv  Detail & Related papers  (2026-02-03T15:14:09Z)
• Towards Autonomous Navigation in Endovascular Interventions [0.7100795934780609]
  This thesis presents an integrated AI-driven framework for autonomous guidewire navigation in complex vascular environments.<n>A high-fidelity, real-time simulation platform, CathSim, is introduced for reinforcement learning based catheter navigation.<n>The Expert Navigation Network is developed, a policy that fuses visual, kinematic, and force feedback for autonomous tool control.
  arXiv  Detail & Related papers  (2025-12-19T21:38:52Z)
• ARCADE: Adaptive Robot Control with Online Changepoint-Aware Bayesian Dynamics Learning [21.923263785405194]
  Real-world robots must operate under evolving dynamics caused by changing operating conditions, external disturbances, and unmodeled effects.<n>We propose a framework for modeling the nonlinear dynamics of robotic systems that can be updated in real time from streaming data.
  arXiv  Detail & Related papers  (2025-12-16T11:57:42Z)
• NavigateDiff: Visual Predictors are Zero-Shot Navigation Assistants [24.689242976554482]
  Navigating unfamiliar environments presents significant challenges for household robots. Existing reinforcement learning methods cannot be directly transferred to new environments. We try to transfer the logical knowledge and the generalization ability of pre-trained foundation models to zero-shot navigation.
  arXiv  Detail & Related papers  (2025-02-19T17:27:47Z)
• CARE Transformer: Mobile-Friendly Linear Visual Transformer via Decoupled Dual Interaction [77.8576094863446]
  We propose a new detextbfCoupled dutextbfAl-interactive lineatextbfR atttextbfEntion (CARE) mechanism. We first propose an asymmetrical feature decoupling strategy that asymmetrically decouples the learning process for local inductive bias and long-range dependencies. By adopting a decoupled learning way and fully exploiting complementarity across features, our method can achieve both high efficiency and accuracy.
  arXiv  Detail & Related papers  (2024-11-25T07:56:13Z)
• Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks [93.38375271826202]
  We present a method to improve generalization and robustness to distribution shifts in sim-to-real visual quadrotor navigation tasks. We first build a simulator by integrating Gaussian splatting with quadrotor flight dynamics, and then, train robust navigation policies using Liquid neural networks. In this way, we obtain a full-stack imitation learning protocol that combines advances in 3D Gaussian splatting radiance field rendering, programming of expert demonstration training data, and the task understanding capabilities of Liquid networks.
  arXiv  Detail & Related papers  (2024-06-21T13:48:37Z)
• Is a Pure Transformer Effective for Separated and Online Multi-Object Tracking? [36.5272157173876]
  Multi-Object Tracking (MOT) has demonstrated success in short-term association within the separated tracking-by-detection online paradigm. In this paper, we review the concept of trajectory graphs and propose a novel perspective by representing them as directed acyclic graphs. We introduce a concise Pure Transformer (PuTR) to validate the effectiveness of Transformer in unifying short- and long-term tracking for separated online MOT.
  arXiv  Detail & Related papers  (2024-05-23T02:44:46Z)
• Machine Learning-Based Path Loss Modeling with Simplified Features [0.0]
  Obstacle depth offers a streamlined, yet surprisingly accurate, method for predicting wireless signal propagation. We propose a novel approach that uses environmental information for predictions.
  arXiv  Detail & Related papers  (2024-05-16T11:46:39Z)
• The Information Pathways Hypothesis: Transformers are Dynamic Self-Ensembles [24.52890377175555]
  We propose a general-purpose training strategy for transformers that can reduce both the memory and computational cost of self-attention by 4 to 8 times during training. We show that an ensemble of sub-models can be formed from the subsampled pathways within a network, which can achieve better performance than its densely attended counterpart.
  arXiv  Detail & Related papers  (2023-06-02T17:28:46Z)
• Autonomous Intraluminal Navigation of a Soft Robot using Deep-Learning-based Visual Servoing [13.268863900187025]
  We present a synergic solution for intraluminal navigation consisting of a 3D printed endoscopic soft robot. Visual servoing, based on Convolutional Neural Networks (CNNs), is used to achieve the autonomous navigation task. The proposed robot is validated in anatomical phantoms in different path configurations.
  arXiv  Detail & Related papers  (2022-07-01T13:17:45Z)
• Physics-Inspired Temporal Learning of Quadrotor Dynamics for Accurate Model Predictive Trajectory Tracking [76.27433308688592]
  Accurately modeling quadrotor's system dynamics is critical for guaranteeing agile, safe, and stable navigation. We present a novel Physics-Inspired Temporal Convolutional Network (PI-TCN) approach to learning quadrotor's system dynamics purely from robot experience. Our approach combines the expressive power of sparse temporal convolutions and dense feed-forward connections to make accurate system predictions.
  arXiv  Detail & Related papers  (2022-06-07T13:51:35Z)
• VAE-Loco: Versatile Quadruped Locomotion by Learning a Disentangled Gait Representation [78.92147339883137]
  We show that it is pivotal in increasing controller robustness by learning a latent space capturing the key stance phases constituting a particular gait. We demonstrate that specific properties of the drive signal map directly to gait parameters such as cadence, footstep height and full stance duration. The use of a generative model facilitates the detection and mitigation of disturbances to provide a versatile and robust planning framework.
  arXiv  Detail & Related papers  (2022-05-02T19:49:53Z)
• Transformers Solve the Limited Receptive Field for Monocular Depth Prediction [82.90445525977904]
  We propose TransDepth, an architecture which benefits from both convolutional neural networks and transformers. This is the first paper which applies transformers into pixel-wise prediction problems involving continuous labels.
  arXiv  Detail & Related papers  (2021-03-22T18:00:13Z)
• End-to-end Lane Shape Prediction with Transformers [13.103463647059634]
  Lane detection is widely used for lane departure warning and adaptive cruise control in autonomous vehicles. We propose an end-to-end method that directly outputs parameters of a lane shape model. The proposed method is validated on the TuSimple benchmark and shows state-of-the-art accuracy with the most lightweight model size and fastest speed.
  arXiv  Detail & Related papers  (2020-11-09T07:42:55Z)
• Haar Wavelet based Block Autoregressive Flows for Trajectories [129.37479472754083]
  Prediction of trajectories such as that of pedestrians is crucial to the performance of autonomous agents. We introduce a novel Haar wavelet based block autoregressive model leveraging split couplings. We illustrate the advantages of our approach for generating diverse and accurate trajectories on two real-world datasets.
  arXiv  Detail & Related papers  (2020-09-21T13:57:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.