TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulation

• URL: http://arxiv.org/abs/2606.16272v2
• Date: Mon, 22 Jun 2026 06:37:31 GMT
• Title: TopoRetarget: Interaction-Preserving Retargeting for Dexterous Manipulation
• Abstract summary: Human hand-object demonstrations provide dense reference motions for training dexterous learning (RL) policies through reference tracking.<n>To use such demonstrations for RL policy learning, reinforcement must preserve hand pose and task-relevant hand-object contact structure.<n>We introduce TopoRetarget, an interaction-preserving framework that uses a single set of parameters across diverse conditions.<n>TopoRetarget achieves the best contact precision and alignment over all baselines on the ContactPose dataset.
• Score: 32.317349412479885
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Human hand-object demonstrations provide dense reference motions for training dexterous manipulation reinforcement learning (RL) policies through reference tracking. However, to use such demonstrations for RL policy learning, retargeting must preserve hand pose and task-relevant hand-object contact structure. Otherwise, contact and feasibility artifacts can degrade downstream RL policy performance. We introduce TopoRetarget, an interaction-preserving retargeting framework that uses a single set of parameters across diverse retargeting conditions while maintaining task-relevant hand-object interaction and adapting human demonstrations to dexterous robot hands. The method constructs a sparse interaction graph over hand and object keypoints and optimizes distance-weighted Laplacian deformation with directional consistency, kinematic constraints, and penetration handling. Evaluations show that the generated references improve both interaction fidelity and policy learning: TopoRetarget achieves the best contact precision and alignment over all baselines on the ContactPose Dataset, improves Pen-Spin training success by 40.6 percentage points over the existing baseline methods, and enables zero-shot transfer to Wuji Hand hardware on cube reorientation and pen spinning.

Related papers

• C2Dex: Contact-Consistent Reconstruction and Retargeting for Dexterous Manipulation from Monocular Video [47.458936125974226]
  C2Dex is a video-to-dexterous-manipulation framework built around a shared interaction.<n> stable object-side contacts recovered by noisy frame-wise observations in the canonical object space.<n>C2Dex achieves end-to-end trajectory success rates of 57.78% and 26.67%.
  arXiv  Detail & Related papers  (2026-08-07T09:54:00Z)
• A Minimalist Retargeting-Guided Reinforcement Learning Recipe for Dexterous Manipulation [7.656632235162218]
  Recent work in humanoid whole-body control has found success with a simple recipe: retarget human motion to robot references.<n>But how does this recipe transfer to dexterous manipulation?<n>We present REGRIND, a minimalist-guided RL pipeline that learns dexterous manipulation policies from a single human demonstration.
  arXiv  Detail & Related papers  (2026-07-13T17:56:08Z)
• SECOND-Grasp: Semantic Contact-guided Dexterous Grasping [60.1519218638742]
  Second-Grasp (SEmantic CONtact-guided Dexterous Grasping) is a unified framework that enables robotic hands to adjust grasping strategies based on semantic reasoning.<n>We show that our approach consistently outperforms baselines in lifting success rate on both seen and unseen categories.
  arXiv  Detail & Related papers  (2026-05-13T07:37:00Z)
• Generalizing from References using a Multi-Task Reference and Goal-Driven RL Framework [12.131501436717969]
  We introduce a unified multi-task Reinforcement Learning framework for learning humanoid behaviors from human motion.<n>A single goal-conditioned policy is trained jointly on two tasks that share the same observation and action spaces.<n>By co-optimizing these objectives within a shared formulation, the policy acquires structured, human-like motor skills from dense reference supervision.
  arXiv  Detail & Related papers  (2026-02-23T21:25:06Z)
• OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction [76.44108003274955]
  A dominant paradigm for teaching humanoid robots complex skills is to retarget human motions as kinematic references to train reinforcement learning policies.<n>We introduce OmniRetarget, an interaction-preserving data generation engine based on an interaction mesh.<n>By minimizing the Laplacian deformation between the human and robot meshes, OmniRetarget generates kinematically feasible trajectories.
  arXiv  Detail & Related papers  (2025-09-30T17:59:02Z)
• Geometric Retargeting: A Principled, Ultrafast Neural Hand Retargeting Algorithm [50.52643618961044]
  We introduce Geometric Retargeting (GeoRT), an ultrafast, principled hand algorithm for teleoperation.<n>GeoRT converts human finger keypoints to robot hand keypoints at 1KHz, achieving state-of-the-art speed and accuracy.
  arXiv  Detail & Related papers  (2025-03-10T17:10:21Z)
• COMBO-Grasp: Learning Constraint-Based Manipulation for Bimanual Occluded Grasping [56.907940167333656]
  Occluded robot grasping is where the desired grasp poses are kinematically infeasible due to environmental constraints such as surface collisions.<n>Traditional robot manipulation approaches struggle with the complexity of non-prehensile or bimanual strategies commonly used by humans.<n>We introduce Constraint-based Manipulation for Bimanual Occluded Grasping (COMBO-Grasp), a learning-based approach which leverages two coordinated policies.
  arXiv  Detail & Related papers  (2025-02-12T01:31:01Z)
• DexHandDiff: Interaction-aware Diffusion Planning for Adaptive Dexterous Manipulation [78.60543357822957]
  Dexterous manipulation with contact-rich interactions is crucial for advanced robotics.<n>We introduce DexHandDiff, an interaction-aware diffusion planning framework for adaptive dexterous manipulation.<n>Our framework achieves an average of 70.7% success rate on goal adaptive dexterous tasks, highlighting its robustness and flexibility in contact-rich manipulation.
  arXiv  Detail & Related papers  (2024-11-27T18:03:26Z)
• Contact-Aware Retargeting of Skinned Motion [49.71236739408685]
  This paper introduces a motion estimation method that preserves self-contacts and prevents interpenetration. The method identifies self-contacts and ground contacts in the input motion, and optimize the motion to apply to the output skeleton. In experiments, our results quantitatively outperform previous methods and we conduct a user study where our retargeted motions are rated as higher-quality than those produced by recent works.
  arXiv  Detail & Related papers  (2021-09-15T17:05:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.