XRoboToolKit-T: Teleoperation with High Stability and Precision with Tactile Sensing for Contact-rich Manipulation

• URL: http://arxiv.org/abs/2609.16437v1
• Date: Mon, 14 Sep 2026 23:24:22 GMT
• Title: XRoboToolKit-T: Teleoperation with High Stability and Precision with Tactile Sensing for Contact-rich Manipulation
• Abstract summary: We propose a versatile teleoperation system with tactile-driven assistance to enable contact-rich manipulation.<n>The proposed XRoboToolKit-T teleoperation system incorporates a tactile-informed force control architecture.<n>The system achieves higher data collection efficiency and improved manipulation stability compared to state-of-the-art teleoperation without assistance.
• Score: 10.905283789732872
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Collecting high-quality robot data for contact-rich manipulation tasks is essential for enabling robots to acquire real-world skills. However, existing data collection solutions often lack the capability to obtain stable and high-frequency tactile feedback, limiting their effectiveness in contact-rich manipulation scenarios. In this work, we propose a versatile teleoperation system with tactile-driven assistance to enable high-frequency and stable contact-rich manipulation. The proposed XRoboToolKit-T teleoperation system incorporates a tactile-informed force control architecture, designed to ensure both stable and precise force control in contact-rich manipulation during teleoperation. The stabilizer haptic module rapidly analyzes the normal force distribution and infers pseudo shear force, enabling real-time tactile-based assistance during manipulation. The refiner haptic module integrates a vision-language-action model to predict and refine manipulation actions based on tactile sensing data and task descriptions. We apply the proposed teleoperation system to challenging contact-rich manipulation tasks, including grasping a deformable rubber pipette for liquid transfer and inserting a medical syringe into a vascular training pad, to demonstrate the effectiveness of tactile-informed force control. Furthermore, the system achieves higher data collection efficiency and improved manipulation stability compared to state-of-the-art teleoperation without tactile assistance.

Related papers

• AdaDexGrasp: Adaptive Dexterous Grasping via 3D Visuo-Tactile Representation Fusion [60.79507611737292]
  Humans achieve stable and adaptive grasps by seamlessly integrating visual perception and tactile feedback.<n>Existing robotic grasping approaches rely on visual inputs and lack mechanisms for tactile-guided adaptation after contact.<n>We propose a unified visuo-tactile-fusion grasping framework that integrates grasp generation, feasibility prediction, and adaptive refinement.
  arXiv  Detail & Related papers  (2026-08-06T16:29:11Z)
• Current as Touch: Proprioceptive Contact Feedback for Compliant Dexterous Manipulation [21.695801136739558]
  We propose a proprioception-driven framework that learns contact-aware compliance cues from motor current and joint states.<n>Our method predicts a compliance reference position: an ideal joint-position target for a standard PD controller.<n>Experiments show stable compliant grasping, safer and more efficient teleoperation, and improved downstream policy learning without external tactile or force sensors.
  arXiv  Detail & Related papers  (2026-07-03T17:59:50Z)
• DexTeleop-0: Force-Aware Bimanual Dexterous Teleoperation with Ego-Centric Perception towards Shared Autonomy [6.652421441096025]
  Fine-grained, bimanual dexterous manipulation remains a foundational challenge in robotics.<n>Traditional teleoperation systems fail in contact-rich tasks because embodiment gaps hinder accurate kinematic mapping.<n>We propose a tactile-driven adaptation strategy designed to enable fine-grained manipulation on top of teleoperation pipelines.
  arXiv  Detail & Related papers  (2026-06-22T14:48:58Z)
• T-Rex: Tactile-Reactive Dexterous Manipulation [139.71263755530654]
  We introduce a variable-rate Mixture-of-Transformers (MoT) architecture equipped with a novel temporal tactile VQ-VAE encoder.<n>We demonstrate the effectiveness of tactile-reactive policies on 12 manipulation tasks requiring delicate force control and deformable object manipulation.
  arXiv  Detail & Related papers  (2026-06-15T17:59:55Z)
• AetheRock: An Arm-Worn Robot Teaching System for Force-Guided Vision-Tactile Learning [56.20593626288444]
  AetheRock is an arm-worn device featuring a modular and easily manufactured visuo-tactile sensor, GelSlim-MiniFab, at the fingertip.<n>We propose ForceVT, a representation learning framework that uses force and vision to guide fidelity-agnostic tactile learning.
  arXiv  Detail & Related papers  (2026-06-08T17:38:57Z)
• TAMEn: Tactile-Aware Manipulation Engine for Closed-Loop Data Collection in Contact-Rich Tasks [16.262130849751312]
  TAMEn is a tactile-aware manipulation engine for closed-loop data collection in contact-rich tasks.<n>Our system features a cross-morphology wearable interface that enables rapid adaptation across heterogeneous grippers.<n>Our proposed visuo-tactile learning framework increases task success rates from 34% to 75% across diverse bimanual manipulation tasks.
  arXiv  Detail & Related papers  (2026-04-08T17:49:35Z)
• Feel Robot Feels: Tactile Feedback Array Glove for Dexterous Manipulation [29.061513339025026]
  We present TAG, a low-cost glove system that integrates precise hand motion capture with high-resolution tactile feedback.<n>For motion capture, TAG employs a non-contact magnetic sensing design that provides drift-free, electromagnetically robust 21-DoF joint tracking.<n>We show that TAG enables reliable real-time perception of contact geometry and dynamic force, improves success rates in contact-rich teleoperation tasks, and increases the reliability of demonstration data collection for learning-based manipulation.
  arXiv  Detail & Related papers  (2026-03-30T15:04:13Z)
• TEGA: A Tactile-Enhanced Grasping Assistant for Assistive Robotics via Sensor Fusion and Closed-Loop Haptic Feedback [1.3861223044153617]
  We present the tactile enhanced grasping assistant (TEGA)<n>A closed loop assistive teleoperation framework fuses EMG based intent2force inference with visuotactile sensing mapped into real time vibrotactile feedback.<n>A wearable haptic vest delivers real time tactile feedback, allowing users to dynamically refine grasp force during manipulation.
  arXiv  Detail & Related papers  (2026-03-05T04:12:55Z)
• TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
  TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
  arXiv  Detail & Related papers  (2026-01-28T04:22:47Z)
• ForceVLA: Enhancing VLA Models with a Force-aware MoE for Contact-rich Manipulation [62.58034332427291]
  ForceVLA is a novel end-to-end manipulation framework.<n>It treats external force sensing as a first-class modality within VLA systems.
  arXiv  Detail & Related papers  (2025-05-28T09:24:25Z)
• Learning Compliance Adaptation in Contact-Rich Manipulation [81.40695846555955]
  We propose a novel approach for learning predictive models of force profiles required for contact-rich tasks. The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller.
  arXiv  Detail & Related papers  (2020-05-01T05:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.