Transferring Contact, Not Just Motion: Compliant Grasping Across Dexterous Hands
- URL: http://arxiv.org/abs/2606.15516v2
- Date: Wed, 17 Jun 2026 19:44:13 GMT
- Title: Transferring Contact, Not Just Motion: Compliant Grasping Across Dexterous Hands
- Abstract summary: Dexterous grasping depends on contact regulation, not motion alone.<n>Existing cross-embodiment dexterous policies unify motion through retargeted hand poses or latent actions, but force feedback remains tied to each hand's sensing and actuation.<n>This work introduces a cross-embodiment force-position interface for contact-aware manipulation across heterogeneous dexterous hands.
- Score: 0.01268579273097071
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Dexterous grasping depends on contact regulation, not motion alone. Stable manipulation requires fingers to maintain appropriate object loading as contacts slip, deform, or become visually occluded. Existing cross-embodiment dexterous policies unify motion through retargeted hand poses or latent actions, but force feedback remains tied to each hand's sensing and actuation, limiting transfer. This work introduces a cross-embodiment force-position interface for contact-aware manipulation across heterogeneous dexterous hands. Motion intent is represented in a shared hand-pose latent, while each hand's effort signal is calibrated through system identification into physical joint torque in N.m. These torques are mapped to fingertip forces and compact per-finger load descriptors, giving the policy comparable observations of where the hand should move and how the object is loaded. Using this interface, a flow-matching visuomotor policy is trained on vision, proprioception, and calibrated contact, with structured visual masking that encourages reliance on force under grasp-relevant occlusion. The same calibrated signal drives a hybrid force-position controller for demonstration collection and execution, keeping force targets consistent across training and deployment. Experiments across structurally different hands show that calibrated contact feedback enables transferable compliant grasping, with learned primitives reusable in long-horizon manipulation pipelines.
Related papers
- Towards Human-level Dexterous Teleoperation [62.77371751776912]
Human-level dexterous teleoperation requires precise control of object motion via dynamic hand-object contact.<n>We introduce TeleDexter, a hand-object co-tracking controller that maps operator intent into learned, low-level contact execution.<n>We evaluate TeleDexter on seven challenging dexterous teleoperation tasks spanning object reorientation and long-horizon tool use across two dexterous hands.
arXiv Detail & Related papers (2026-07-13T12:36:47Z) - WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation [45.818624493082545]
Retargeting human object interaction demonstrations to physics based simulation requires reproducing body motion and contacts that make manipulation succeed.<n>We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation.
arXiv Detail & Related papers (2026-07-07T16:06:43Z) - Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation [74.87716678195099]
Visuo-Tactile policies leveraging optical tactile sensors have shown great promise in contact-rich manipulation.<n>Despite their advantages, extracting fine-grained contact states necessary for contact-rich manipulation remains an open challenge.<n>We propose a motion-aware tactile representation to facilitate contact-rich manipulation.
arXiv Detail & Related papers (2026-06-29T08:20:18Z) - DragMesh-2: Physically Plausible Dexterous Hand-Object Interaction with Articulated Objects [12.35353010124029]
Dexterous interaction with articulated objects is important for household, assistive, and humanoid manipulation.<n>We present DragMesh-2, a contact-driven framework for dexterous interaction with articulated objects.<n>We also propose PICA, a physically informed contact-aware training mechanism.
arXiv Detail & Related papers (2026-06-13T05:47:14Z) - ForceFlow: Learning to Feel and Act via Contact-Driven Flow Matching [53.30290192030814]
ForceFlow is a force-aware reactive framework built upon flow matching.<n>We show that ForceFlow achieves a 37% success rate improvement over the strong baseline ForceVLA.<n>It also exhibits accurate force signal prediction and superior performance in contact force self-regulation.
arXiv Detail & Related papers (2026-05-11T13:27:00Z) - Contact-Grounded Policy: Dexterous Visuotactile Policy with Generative Contact Grounding [5.936373185672394]
Contact-Grounded Policy (CGP) is a visuotactile policy that grounds multi-point contacts by predicting coupled trajectories of actual robot state and tactile feedback.<n>CGP consists of two components: (i) a conditional diffusion model that forecasts future robot state and tactile feedback in a compressed latent space, and (ii) a learned contact-consistency mapping.<n>We evaluate CGP using a physical four-finger Allegro V5 hand with Digit360 fingertip tactile sensors, and a simulated five-finger Tesollo DG-5F hand with dense whole-hand tactile arrays.
arXiv Detail & Related papers (2026-03-05T21:22:49Z) - WHED: A Wearable Hand Exoskeleton for Natural, High-Quality Demonstration Collection [7.615440875928701]
We present WHED, a wearable hand-exoskeleton system designed for in-the-wild demonstration capture.<n>We show feasibility on representative grasping and manipulation sequences spanning precision pinch and full-hand enclosure grasps.
arXiv Detail & Related papers (2026-02-20T00:12:45Z) - Rigidity-Based Multi-Finger Coordination for Precise In-Hand Manipulation of Force-Sensitive Objects [5.313029497667778]
Multi-fingered hands rely solely on fingertip point contacts and are not able to apply pull forces.<n>We propose a dual-layer framework for multi-finger coordination, enabling high-precision manipulation of force-sensitive objects.<n>We validate the framework on a custom dexterous hand, demonstrating the capability to manipulate fragile objects.
arXiv Detail & Related papers (2026-02-15T11:40:39Z) - PLATO Hand: Shaping Contact Behavior with Fingernails for Precise Manipulation [3.5374164303989204]
The PLATO Hand is a dexterous robotic hand with a hybrid fingertip that embeds a rigid fingernail within a compliant pulp.<n>We develop a strain-energy-based bending-indentation model to guide the fingertip design.<n> Experimental results show improved pinching stability, enhanced force observability, and successful execution of edge-sensitive manipulation tasks.
arXiv Detail & Related papers (2026-02-05T00:17:08Z) - TouchGuide: Inference-Time Steering of Visuomotor Policies via Touch Guidance [53.35296919674763]
TouchGuide is a novel cross-policy visuo-tactile fusion paradigm that fuses modalities within a low-dimensional action space.<n>touchGuide operates in two stages to guide a pre-trained diffusion or flow-matching visuomotor policy.<n>To facilitate TouchGuide training with high-quality and cost-effective data, we introduce TacUMI, a data collection system.
arXiv Detail & Related papers (2026-01-28T04:22:47Z) - FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion [49.026972478098266]
Hands are central to interacting with our surroundings and conveying gestures.<n>Existing human motion synthesis methods fall short.<n>Key obstacle is the lack of large-scale datasets that jointly capture diverse full-body motion.
arXiv Detail & Related papers (2026-01-07T14:18:59Z) - HandRefiner: Refining Malformed Hands in Generated Images by Diffusion-based Conditional Inpainting [72.95232302438207]
Diffusion models have achieved remarkable success in generating realistic images.
But they suffer from generating accurate human hands, such as incorrect finger counts or irregular shapes.
This paper introduces a lightweight post-processing solution called HandRefiner.
arXiv Detail & Related papers (2023-11-29T08:52:08Z) - Deformer: Dynamic Fusion Transformer for Robust Hand Pose Estimation [59.3035531612715]
Existing methods often struggle to generate plausible hand poses when the hand is heavily occluded or blurred.
In videos, the movements of the hand allow us to observe various parts of the hand that may be occluded or blurred in a single frame.
We propose the Deformer: a framework that implicitly reasons about the relationship between hand parts within the same image.
arXiv Detail & Related papers (2023-03-09T02:24:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.