ReForce: Learning Force-aware Retargeting for Dexterous Manipulation
- URL: http://arxiv.org/abs/2608.15560v1
- Date: Sun, 16 Aug 2026 06:13:14 GMT
- Title: ReForce: Learning Force-aware Retargeting for Dexterous Manipulation
- Abstract summary: ReForce is a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact.<n>It supports both online force-aware teleoperation and offline data translation.<n>It achieves lower force-tracking error and stronger multi-finger contact engagement on contact-rich tasks such as paper-cup grasping and tongs manipulation.
- Score: 9.525202879335618
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Human demonstrations offer a scalable data source for dexterous manipulation, but transferring them to robot actions remains challenging due to the embodiment gap. Today's retargeting is mostly kinematic, yet manipulation is decided by force, which governs how the hand interacts with the object and how the object moves. In this paper, we present ReForce, a Force-aware Retargeting method that turns human motion and forces into robot actions that reproduce the intended contact. ReForce predicts a residual on the kinematically retargeted action to reach the desired force, using a general force tracker trained on large-scale simulation interactions. It supports both online force-aware teleoperation and offline data translation. In simulation and on real hardware, ReForce achieves lower force-tracking error and stronger multi-finger contact engagement on contact-rich tasks such as paper-cup grasping and tongs manipulation.
Related papers
- Towards Human-level Dexterous Teleoperation [62.77371751776912]
Human-level dexterous teleoperation requires precise control of object motion via dynamic hand-object contact.<n>We introduce TeleDexter, a hand-object co-tracking controller that maps operator intent into learned, low-level contact execution.<n>We evaluate TeleDexter on seven challenging dexterous teleoperation tasks spanning object reorientation and long-horizon tool use across two dexterous hands.
arXiv Detail & Related papers (2026-07-13T12:36:47Z) - ObjRetarget: An Object-Aware Motion Retargeting Framework with Anthropomorphic Arm Constraints and Polyhedral Hand Modeling [9.378632224914458]
dexterous manipulation from human manipulation videos requires reliably human intent to executable robot actions.<n>Existing methods often ignore explicit contact modeling or reinforcement, resulting in limited accuracy and generalization.<n>We propose Retarget, a human-to-robot motion framework for learning robot dexterous manipulation from human videos.
arXiv Detail & Related papers (2026-07-04T11:31:23Z) - ForceBand: Learning Forceful Manipulation with sEMG [55.186900419710746]
We introduce ForceBand, a low-cost wrist-worn sEMG system that turns human muscle activity into force-enriched demonstrations.<n>We pre-train an EMG2Force model that predicts per-finger forces from sEMG and IMU signals.<n>Experiments show that ForceBand recovers fine-grained fingertip interactions with over 50% lower force prediction error than vision-based baselines.
arXiv Detail & Related papers (2026-06-24T17:59:35Z) - WT-UMI: Tactile-based Whole-Body Manipulation via Force-Supervised Contact-Aware Planning [7.150534189488604]
Whole-body humanoid manipulation of bulky, deformable, and shared-load objects requires distributed contact sensing and explicit force regulation.<n>This paper presents textbfWT-UMI, a wearable whole-body tactile interface worn by human operators or mounted on humanoids.
arXiv Detail & Related papers (2026-06-11T11:45:58Z) - ForceFlow: Learning to Feel and Act via Contact-Driven Flow Matching [53.30290192030814]
ForceFlow is a force-aware reactive framework built upon flow matching.<n>We show that ForceFlow achieves a 37% success rate improvement over the strong baseline ForceVLA.<n>It also exhibits accurate force signal prediction and superior performance in contact force self-regulation.
arXiv Detail & Related papers (2026-05-11T13:27:00Z) - Functional Force-Aware Retargeting from Virtual Human Demos to Soft Robot Policies [22.000828900701237]
We introduce SoftAct, a framework for teaching soft robot hands to perform human-like manipulation skills by explicitly reasoning about contact forces.<n>Unlike conventional approaches that retarget human joint trajectories, SoftAct employs two-stage, force-aware algorithm.
arXiv Detail & Related papers (2026-04-01T17:59:35Z) - ResMimic: From General Motion Tracking to Humanoid Whole-body Loco-Manipulation via Residual Learning [59.64325421657381]
Humanoid whole-body loco-manipulation promises transformative capabilities for daily service and warehouse tasks.<n>We introduce ResMimic, a two-stage residual learning framework for precise and expressive humanoid control from human motion data.<n>Results show substantial gains in task success, training efficiency, and robustness over strong baselines.
arXiv Detail & Related papers (2025-10-06T17:47:02Z) - OmniRetarget: Interaction-Preserving Data Generation for Humanoid Whole-Body Loco-Manipulation and Scene Interaction [76.44108003274955]
A dominant paradigm for teaching humanoid robots complex skills is to retarget human motions as kinematic references to train reinforcement learning policies.<n>We introduce OmniRetarget, an interaction-preserving data generation engine based on an interaction mesh.<n>By minimizing the Laplacian deformation between the human and robot meshes, OmniRetarget generates kinematically feasible trajectories.
arXiv Detail & Related papers (2025-09-30T17:59:02Z) - Feel the Force: Contact-Driven Learning from Humans [52.36160086934298]
Controlling fine-grained forces during manipulation remains a core challenge in robotics.<n>We present FeelTheForce, a robot learning system that models human tactile behavior to learn force-sensitive manipulation.<n>Our approach grounds robust low-level force control in scalable human supervision, achieving a 77% success rate across 5 force-sensitive manipulation tasks.
arXiv Detail & Related papers (2025-06-02T17:57:52Z) - ForceGrip: Reference-Free Curriculum Learning for Realistic Grip Force Control in VR Hand Manipulation [0.10995326465245926]
We present ForceGrip, a deep learning agent that synthesizes realistic hand manipulation motions.<n>We employ a three-phase curriculum learning framework comprising Finger Positioning, Intention Adaptation, and Dynamic Stabilization.<n>Our evaluations reveal ForceGrip's superior force controllability and plausibility compared to state-of-the-art methods.
arXiv Detail & Related papers (2025-03-11T05:39:07Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.