WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation
- URL: http://arxiv.org/abs/2607.06438v2
- Date: Mon, 13 Jul 2026 05:01:31 GMT
- Title: WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation
- Abstract summary: Retargeting human object interaction demonstrations to physics based simulation requires reproducing body motion and contacts that make manipulation succeed.<n>We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation.
- Score: 45.818624493082545
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Retargeting human object interaction demonstrations to physics based simulation requires reproducing not only body motion but also the object motion and contacts that make manipulation succeed. However, position only hand trajectories do not specify the contact forces needed to manipulate objects, and directly tracking them can overconstrain contact rich finger behavior. We introduce WristMimic, a wrist guided whole body control framework that explicitly separates contact free body motion from contact rich hand manipulation. The contact free body and wrist are guided by kinematic pose targets, whereas the fingers are not directly supervised by human hand pose. Instead, they learn grasping and manipulation behaviors from object tracking and contact outcomes. Our key insight is that the wrist is the natural gate between these two regimes. It is largely free from contact and can be tracked kinematically, yet it determines the global hand configuration and places the fingers within reachable grasp affordances. To ensure reliable wrist placement during interaction, we introduce wrist specific reset constraints and reward prioritization. Experiments show that WristMimic matches or surpasses methods using full finger pose supervision while enabling finger agnostic retargeting across diverse hand embodiments.
Related papers
- Fingers as Legs: Learning Self-Supported Locomotion and Manipulation with an Anthropomorphic Hand [1.3799995789461068]
A walking robotic hand must use the same fingers to move its body, support its weight, and interact with the environment.<n>We show how an anthropomorphic hand can learn these skills while retaining its finger design and position controller.
arXiv Detail & Related papers (2026-09-15T13:34:40Z) - Beyond Gestures: Estimating Full Hand Pose and Contact Forces from Wrist-Worn Pressure Sensor Array [4.346598091476058]
Capturing hand motion and interaction forces is critical for interactive computing, VR, and high-fidelity tactile demonstrations for robot learning.<n>We introduce a wrist-worn pressure-sensing wristband that recovers continuous full-hand pose and distributed contact force on a single wearable.
arXiv Detail & Related papers (2026-09-15T02:08:21Z) - AnyDexRT: Calibration-Free Dexterous Hand Retargeting with Few-Shot Human Guidance [52.973947477815614]
AnyDexRT is a calibration-free method for intuitive dexterous teleoperation across human-like dexterous hands.<n>Experiments show that AnyDexRT improves quality, reduces manual tuning, and provides more intuitive and efficient control than prior methods.
arXiv Detail & Related papers (2026-07-09T10:29:53Z) - Transferring Contact, Not Just Motion: Compliant Grasping Across Dexterous Hands [0.01268579273097071]
Dexterous grasping depends on contact regulation, not motion alone.<n>Existing cross-embodiment dexterous policies unify motion through retargeted hand poses or latent actions, but force feedback remains tied to each hand's sensing and actuation.<n>This work introduces a cross-embodiment force-position interface for contact-aware manipulation across heterogeneous dexterous hands.
arXiv Detail & Related papers (2026-06-14T00:01:36Z) - Glove2Hand: Synthesizing Natural Hand-Object Interaction from Multi-Modal Sensing Gloves [29.4768155708928]
Glove2Hand is a framework that translates multi-modal sensing glove HOI videos into bare hands.<n>HandSense is the first multi-modal HOI dataset featuring glove-to-hand videos with synchronized tactile and IMU signals.
arXiv Detail & Related papers (2026-03-21T15:12:57Z) - FUSION: Full-Body Unified Motion Prior for Body and Hands via Diffusion [49.026972478098266]
Hands are central to interacting with our surroundings and conveying gestures.<n>Existing human motion synthesis methods fall short.<n>Key obstacle is the lack of large-scale datasets that jointly capture diverse full-body motion.
arXiv Detail & Related papers (2026-01-07T14:18:59Z) - Continuous Wrist Control on the Hannes Prosthesis: a Vision-based Shared Autonomy Framework [4.5540732576876986]
Most control techniques for prosthetic grasping focus on dexterous fingers control, but overlook the wrist motion.<n>This forces the user to perform compensatory movements with the elbow, shoulder and hip to adapt the wrist for grasping.<n>We propose a computer vision-based system that leverages the collaboration between the user and an automatic system in a shared autonomy framework.<n>Our pipeline allows to seamlessly control the prosthetic wrist to follow the target object and finally orient it for grasping according to the user intent.
arXiv Detail & Related papers (2025-02-24T15:48:25Z) - GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency [57.9920824261925]
Hands are dexterous and highly versatile manipulators that are central to how humans interact with objects and their environment.
modeling realistic hand-object interactions is critical for applications in computer graphics, computer vision, and mixed reality.
GRIP is a learning-based method that takes as input the 3D motion of the body and the object, and synthesizes realistic motion for both hands before, during, and after object interaction.
arXiv Detail & Related papers (2023-08-22T17:59:51Z) - GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping [47.49549115570664]
Existing methods focus on the major limbs of the body, ignoring the hands and head. Hands have been separately studied but the focus has been on generating realistic static grasps of objects.
We need to generate full-body motions and realistic hand grasps simultaneously.
For the first time, we address the problem of generating full-body, hand and head motions of an avatar grasping an unknown object.
arXiv Detail & Related papers (2021-12-21T18:59:34Z) - Physics-Based Dexterous Manipulations with Estimated Hand Poses and
Residual Reinforcement Learning [52.37106940303246]
We learn a model that maps noisy input hand poses to target virtual poses.
The agent is trained in a residual setting by using a model-free hybrid RL+IL approach.
We test our framework in two applications that use hand pose estimates for dexterous manipulations: hand-object interactions in VR and hand-object motion reconstruction in-the-wild.
arXiv Detail & Related papers (2020-08-07T17:34:28Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.