Shaft-integrated Force Sensing with Transformer-based Dynamics Compensation for Telesurgery

• URL: http://arxiv.org/abs/2605.31434v2
• Date: Tue, 02 Jun 2026 13:13:03 GMT
• Title: Shaft-integrated Force Sensing with Transformer-based Dynamics Compensation for Telesurgery
• Abstract summary: Robot-Assisted Minimally Invasive Surgery (RAMIS) enhances surgeon dexterity, with newer platforms leveraging haptic feedback to further improve performance.<n>Force information has broader potential to inform performance assessment, tactile localization, and surgical autonomy.<n>This work presents a method for integrating a six-axis commercial force sensor into the distal end of a standard cable-driven surgical instrument.
• Score: 9.235166181120494
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robot-Assisted Minimally Invasive Surgery (RAMIS) enhances surgeon dexterity, with newer platforms leveraging haptic feedback to further improve performance. Such force information has broader potential to inform performance assessment, tactile localization, and surgical autonomy. This motivates the need for accessible approaches to integrating force sensing into RAMIS tools. This work presents a method for integrating a six-axis commercial force sensor into the distal end of a standard cable-driven surgical instrument, enabling end-effector force measurement while preserving the original mechanical functionality of the device. The proposed design emphasizes reproducibility and accessibility for research applications, requiring no specialized manufacturing tools. A transformer neural network integrates force sensor measurements with robot state information to aid estimation of applied forces at the end-effector, compensating for internal cable forces arising from actuation. Our proposed approach achieved normalized errors below 6%, and generalized to unseen conditions better than purely proximal data-driven sensing approaches. High internal cable forces caused sensor saturation and reduced axial force observability, which can degrade performance along the tool's major axis and under higher load conditions. Given current levels of performance, the balance of system integrability and performance enables applications and research into timely topics of haptic feedback, skill assessment, and force-informed autonomy in RAMIS. Videos and code are available at https://enhanced-telerobotics.github.io/shaft_force_sensing/.

Related papers

• AetheRock: An Arm-Worn Robot Teaching System for Force-Guided Vision-Tactile Learning [56.20593626288444]
  AetheRock is an arm-worn device featuring a modular and easily manufactured visuo-tactile sensor, GelSlim-MiniFab, at the fingertip.<n>We propose ForceVT, a representation learning framework that uses force and vision to guide fidelity-agnostic tactile learning.
  arXiv  Detail & Related papers  (2026-06-08T17:38:57Z)
• Domain-Adaptive Communication-Rate Optimization for Sim-to-Real Humanoid-Robot Wireless XR Teleoperation [45.11184664928145]
  Wireless extended reality (XR) teleoperation provides embodied interaction capability for collecting humanoid robot demonstrations.<n>This paper develops a system framework that integrates sampling, transmission, the reconstruction and formulates a communication-rate optimization.
  arXiv  Detail & Related papers  (2026-05-19T03:13:09Z)
• An Experimental Modular Instrument With a Haptic Feedback Framework for Robotic Surgery Training [1.6206092886889898]
  The paper presents a modular experimental robotic laparoscopic instrument integrated with a real-time haptic feedback framework.<n>The proposed instrument employs a wrist-mounted force/torque (F/T) sensor to estimate tool-tissue interaction forces.<n>A haptic feedback framework is developed to extract the external contact forces, render them to the haptic device, and generate stable and perceptually meaningful feedback.
  arXiv  Detail & Related papers  (2026-04-30T03:55:05Z)
• Real-Time Non-Contact Force Compensation for Wrist-Mounted Force/Torque Sensors in Haptic-Enabled Robotic Surgery Training [1.6206092886889898]
  We extend our previously developed low-cost robotic surgery training setup, RoboScope, by incorporating a wrist-mounted force/torque (F/T) sensor for haptic feedback training.
  arXiv  Detail & Related papers  (2026-04-26T13:21:45Z)
• Hybrid Offline-Online Reinforcement Learning for Sensorless, High-Precision Force Regulation in Surgical Robotic Grasping [2.874057693956189]
  We present a sensorless control framework that combines physics-consistent modeling and hybrid reinforcement learning.<n>We develop a first-principles digital twin of the da Vinci Xi grasping mechanism that captures coupled electrical, transmission, and jaw dynamics.<n>In simulation, the controller maintains grasp force within 1% of the desired reference during multi-harmonic jaw motion.
  arXiv  Detail & Related papers  (2026-02-27T10:11:59Z)
• A Robotic Testing Platform for Pipelined Discovery of Resilient Soft Actuators [63.07587517846448]
  We propose an optimization pipeline enabled by a novel testing robot capable of scanning DEA lifetime.<n>The robot integrates electro-mechanical property measurement, programmable voltage input, and multi-channel testing capacity.<n>Using it, we scanned the lifetime of Elastosil-based linear actuators across parameters including input voltage magnitude, frequency, electrode material concentration, and electrical connection filler.
  arXiv  Detail & Related papers  (2026-02-24T14:41:28Z)
• UniForce: A Unified Latent Force Model for Robot Manipulation with Diverse Tactile Sensors [51.88112610411651]
  We propose a novel unified tactile representation learning framework that learns a shared latent force space across diverse tactile sensors.<n>UniForce reduces cross-sensor domain shift by jointly modeling inverse dynamics (image-to-force) and forward dynamics (force-to-image)<n>To avoid reliance on expensive external force/torque (F/T) sensors, we exploit static equilibrium and collect force-paired data via direct sensor--object--sensor interactions.
  arXiv  Detail & Related papers  (2026-02-01T11:03:01Z)
• Parametric Design of a Cable-Driven Coaxial Spherical Parallel Mechanism for Ultrasound Scans [1.9384419867620366]
  Haptic interfaces play a critical role in medical teleoperation by enabling surgeons to interact with remote environments through realistic force and motion feedback.<n>This paper presents the design methodology and analysis of a Cable-Driven Coaxial Spherical Parallel Mechanism (CDC-SPM) developed to address these challenges.<n>The proposed cable-driven interface design allows for reducing the mass placed at the robot arm end-effector, thereby minimizing inertial loads, enhancing stiffness, and improving dynamic responsiveness.
  arXiv  Detail & Related papers  (2025-12-07T20:58:41Z)
• Bayesian Imitation Learning for End-to-End Mobile Manipulation [80.47771322489422]
  Augmenting policies with additional sensor inputs, such as RGB + depth cameras, is a straightforward approach to improving robot perception capabilities. We show that using the Variational Information Bottleneck to regularize convolutional neural networks improves generalization to held-out domains. We demonstrate that our method is able to help close the sim-to-real gap and successfully fuse RGB and depth modalities.
  arXiv  Detail & Related papers  (2022-02-15T17:38:30Z)
• Learning Compliance Adaptation in Contact-Rich Manipulation [81.40695846555955]
  We propose a novel approach for learning predictive models of force profiles required for contact-rich tasks. The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller.
  arXiv  Detail & Related papers  (2020-05-01T05:23:34Z)
• Reinforcement Learning Approach to Vibration Compensation for Dynamic Feed Drive Systems [62.19441737665902]
  We present a reinforcement learning based approach to vibration compensation applied to a machine tool axis. The work describes the problem formulation, the solution, the implementation and experiments using industrial machine tool hardware and control system.
  arXiv  Detail & Related papers  (2020-04-14T14:22:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.