DexTeleop-0: Force-Aware Bimanual Dexterous Teleoperation with Ego-Centric Perception towards Shared Autonomy

• URL: http://arxiv.org/abs/2606.23431v1
• Date: Mon, 22 Jun 2026 14:48:58 GMT
• Title: DexTeleop-0: Force-Aware Bimanual Dexterous Teleoperation with Ego-Centric Perception towards Shared Autonomy
• Abstract summary: Fine-grained, bimanual dexterous manipulation remains a foundational challenge in robotics.<n>Traditional teleoperation systems fail in contact-rich tasks because embodiment gaps hinder accurate kinematic mapping.<n>We propose a tactile-driven adaptation strategy designed to enable fine-grained manipulation on top of teleoperation pipelines.
• Score: 6.652421441096025
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Fine-grained, bimanual dexterous manipulation remains a foundational challenge in robotics. Traditional teleoperation systems often fail in contact-rich tasks because embodiment gaps hinder accurate kinematic mapping, while tactile and force feedback remain absent. Consequently, data collection efficiency for high-precision tasks remains prohibitively low. To address these limitations, we propose a tactile-driven adaptation strategy designed to enable fine-grained manipulation on top of teleoperation pipelines. Instantiated within our bimanual dexterous framework, DexTeleop-0, this strategy introduces a real-time optimization loop that bridges the embodiment gap by translating coarse human tracking intents into precise, force-compliant robotic commands with tactile sensing. By estimating accurate contact points and leveraging a tactile-enabled fingertip force-sensing profile, the system dynamically computes localized corrections using the operational space Jacobian with respect to joint angle updates. We rigorously evaluate this tactile-driven adaptation strategy across both simulated environments and real-world hardware. Compared with representative baselines, the proposed method consistently achieves higher task success rates and improved execution efficiency in robust grasping, disturbance-resilient manipulation, and complex dexterous tasks.

Related papers

• XRoboToolKit-T: Teleoperation with High Stability and Precision with Tactile Sensing for Contact-rich Manipulation [10.905283789732872]
  We propose a versatile teleoperation system with tactile-driven assistance to enable contact-rich manipulation.<n>The proposed XRoboToolKit-T teleoperation system incorporates a tactile-informed force control architecture.<n>The system achieves higher data collection efficiency and improved manipulation stability compared to state-of-the-art teleoperation without assistance.
  arXiv  Detail & Related papers  (2026-09-14T23:24:22Z)
• CosmoH2G: A Hand-to-Gripper Transfer Dataset and Baseline Method for Object Manipulation with Complex Spatial Movements [63.40365657068892]
  Transferring human hand demonstrations to robotic grippers has recently emerged as a cost-effective solution for robot learning.<n>Motivated by this gap, we adopt an implicit, data-driven approach guided by fine-grained hand-pose motions.<n>In both simulation and real-robot experiments, our framework enables stable and precise hand-to-gripper transfer of complex spatial manipulations.
  arXiv  Detail & Related papers  (2026-09-07T13:47:22Z)
• Dual Process Motion Planning [53.570848178455776]
  We introduce a dual-process architecture that combines the strengths of robust reasoning and learning.<n>Our framework integrates state-of-the-art symbolic solvers as a System-2'' component with experience-driven System-1'' modules.
  arXiv  Detail & Related papers  (2026-09-01T13:52:12Z)
• Towards Human-level Dexterous Teleoperation [62.77371751776912]
  Human-level dexterous teleoperation requires precise control of object motion via dynamic hand-object contact.<n>We introduce TeleDexter, a hand-object co-tracking controller that maps operator intent into learned, low-level contact execution.<n>We evaluate TeleDexter on seven challenging dexterous teleoperation tasks spanning object reorientation and long-horizon tool use across two dexterous hands.
  arXiv  Detail & Related papers  (2026-07-13T12:36:47Z)
• TactiDex: A Real-World Tactile-Guided Benchmark for Human-Like Dexterous Manipulation [30.144946280089727]
  Current human-to-robot dexterous transfer pipelines rely on kinematic trajectories.<n>We introduce TactiDex, a real-world tactile-guided benchmark to move dexterous manipulation beyond kinematic mimicry.<n>We introduce TactiSkill, a framework built upon a novel tri-component tactile reward that innovatively uses tactile signals as structured supervision.
  arXiv  Detail & Related papers  (2026-07-10T08:32:19Z)
• T-Rex: Tactile-Reactive Dexterous Manipulation [139.71263755530654]
  We introduce a variable-rate Mixture-of-Transformers (MoT) architecture equipped with a novel temporal tactile VQ-VAE encoder.<n>We demonstrate the effectiveness of tactile-reactive policies on 12 manipulation tasks requiring delicate force control and deformable object manipulation.
  arXiv  Detail & Related papers  (2026-06-15T17:59:55Z)
• Real-Time and Accurate Collision-Free Teleoperation via Differentiable Constraint-Based Trajectory Planning [1.4699455652461726]
  A common strategy to mitigate this issue is to enhance the operator's input using optimal-control-based trajectory planning.<n>We adapt a recent formulation of differentiable collision-avoidance constraints, based on duality in convex optimization, to the teleoperation setting.<n>Results show that our approach achieves lower computation times while enabling more accurate obstacle modeling.
  arXiv  Detail & Related papers  (2026-06-07T16:39:56Z)
• X-OP: Cross-Morphology Whole-Body Teleoperation via MPC Retargeting [3.134050607080983]
  Whole-body teleoperation is essential for scalable robot data collection in loco-manipulation tasks.<n>We propose a hierarchical whole-body teleoperation framework driven by a single XR device.<n>We show higher success rates on whole-body control tasks for both a humanoid and a mobile manipulator.
  arXiv  Detail & Related papers  (2026-06-06T01:50:59Z)
• Direction Matters: Learning Force Direction Enables Sim-to-Real Contact-Rich Manipulation [28.707088673008172]
  We propose a framework that leverages expert-designed controller logic for transfer.<n>Inspired by the success of privileged supervision in tasks, we employ a human-designed finite state machine based position/force controller in simulation.<n>Unlike force magnitudes, which are highly sensitive to simulation inaccuracies, force directions encode high-level task geometry and remain robust across the sim-to-real gap.
  arXiv  Detail & Related papers  (2026-02-15T14:57:13Z)
• Closing the Reality Gap: Zero-Shot Sim-to-Real Deployment for Dexterous Force-Based Grasping and Manipulation [12.509181374985936]
  Human-like dexterous hands with multiple fingers offer human-level manipulation capabilities.<n>But training control policies that can directly deploy on real hardware remains difficult due to contact-rich physics.<n>We present a practical framework that utilizes dense tactile feedback combined with joint torque sensing to regulate physical interactions.
  arXiv  Detail & Related papers  (2026-01-06T07:26:39Z)
• DexHandDiff: Interaction-aware Diffusion Planning for Adaptive Dexterous Manipulation [78.60543357822957]
  Dexterous manipulation with contact-rich interactions is crucial for advanced robotics.<n>We introduce DexHandDiff, an interaction-aware diffusion planning framework for adaptive dexterous manipulation.<n>Our framework achieves an average of 70.7% success rate on goal adaptive dexterous tasks, highlighting its robustness and flexibility in contact-rich manipulation.
  arXiv  Detail & Related papers  (2024-11-27T18:03:26Z)
• Learning Compliance Adaptation in Contact-Rich Manipulation [81.40695846555955]
  We propose a novel approach for learning predictive models of force profiles required for contact-rich tasks. The approach combines an anomaly detection based on Bidirectional Gated Recurrent Units (Bi-GRU) and an adaptive force/impedance controller.
  arXiv  Detail & Related papers  (2020-05-01T05:23:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.