Cross-Embodiment Robot Manipulation via a Unified Hand Action Space

• URL: http://arxiv.org/abs/2607.03570v1
• Date: Fri, 03 Jul 2026 19:19:20 GMT
• Title: Cross-Embodiment Robot Manipulation via a Unified Hand Action Space
• Abstract summary: We propose a sphere-based unified action representation for cross-embodiment dexterous manipulation.<n>Our experiments show that the proposed UHAS representation enables stable dexterous control and cross-embodiment policy transfer across robotic hands.
• Score: 5.6990246782356735
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robot manipulation policies are typically tied to specific robotic hand embodiments, limiting the transfer of learned behaviors across platforms with different kinematic structures. In this work, we propose the Unified Hand Action Space (UHAS), a sphere-based unified action representation for cross-embodiment dexterous manipulation. UHAS represents robotic hand actions as geometric deformations of a canonical sphere and uses a Cascade Inverse Kinematics (CIK) algorithm to map the shared representation to embodiment-specific joint configurations. Using reinforcement learning, we train dexterous manipulation policies directly in the proposed action space for in-hand cube reorientation tasks. We evaluate our method in both simulation and real-world experiments across multiple robotic hands, including the Allegro Hand, LEAP Hand, Shadow Hand, and MANO Human Hand. Experimental results demonstrate effective dexterous manipulation, zero-shot transfer to unseen hands, rapid finetuning across embodiments, and successful real-world deployment. Our experiments show that the proposed UHAS representation enables stable dexterous control and cross-embodiment policy transfer across robotic hands.

Related papers

• X-WBC: A Cross-Embodiment Foundation Model for Humanoid Whole-Body Control [9.11598874129235]
  Scaling humanoid whole-body control requires large human motion corpora and training experience shared across robot bodies.<n>We introduce X-WBC, a cross-embodiment foundation framework that separates relatively shared human motion semantics from embodiment-specific physical execution.
  arXiv  Detail & Related papers  (2026-09-14T08:34:48Z)
• AdvDex: Learning Dexterous Manipulation from Human Demonstrations via Joint-Aligned Actions and Adversarial Learning [25.241504281004243]
  We present AdvDex, a framework for learning dexterous manipulation from human and robot demonstrations.<n>First, we introduce OmniShare, a large-scale multimodal dataset of human manipulation demonstrations.<n>Second, we propose the Joint-Aligned Action Space (JAAS), a canonical action representation comprising an $mathrmSE(3)$ wrist pose and 15 finger joints.<n>Third, we use domain-adversarial learning to reduce embodiment-specific information in the learned visual representation.
  arXiv  Detail & Related papers  (2026-08-14T07:19:06Z)
• Towards Human-level Dexterous Teleoperation [62.77371751776912]
  Human-level dexterous teleoperation requires precise control of object motion via dynamic hand-object contact.<n>We introduce TeleDexter, a hand-object co-tracking controller that maps operator intent into learned, low-level contact execution.<n>We evaluate TeleDexter on seven challenging dexterous teleoperation tasks spanning object reorientation and long-horizon tool use across two dexterous hands.
  arXiv  Detail & Related papers  (2026-07-13T12:36:47Z)
• AnyDexRT: Calibration-Free Dexterous Hand Retargeting with Few-Shot Human Guidance [52.973947477815614]
  AnyDexRT is a calibration-free method for intuitive dexterous teleoperation across human-like dexterous hands.<n>Experiments show that AnyDexRT improves quality, reduces manual tuning, and provides more intuitive and efficient control than prior methods.
  arXiv  Detail & Related papers  (2026-07-09T10:29:53Z)
• UniDex: A Robot Foundation Suite for Universal Dexterous Hand Control from Egocentric Human Videos [65.2981273885678]
  Dexterous manipulation remains challenging due to the cost of collecting real-robot teleoperation data.<n>We present UniDex, a robot foundation suite that couples a large-scale robot-centric dataset with a unified vision-language-action (VLA) policy.<n>UniDex-Dataset, UniDex-VLA, and UniDex-Cap provide a scalable foundation suite for universal dexterous manipulation.
  arXiv  Detail & Related papers  (2026-03-23T17:49:12Z)
• Cross-Hand Latent Representation for Vision-Language-Action Models [49.32460749933983]
  Training reliable vision-language-action models for dexterous manipulation requires large-scale demonstrations across many robotic hands.<n>We introduce XL-VLA, a vision-language-action framework integrated with a unified latent action space shared across diverse dexterous hands.
  arXiv  Detail & Related papers  (2026-03-10T18:50:57Z)
• DexFormer: Cross-Embodied Dexterous Manipulation via History-Conditioned Transformer [18.11650194615062]
  Dexterous manipulation remains one of the most challenging problems in robotics.<n>We present DexFormer, an end-to-end, dynamics-aware cross-embodiment policy.<n>Our results show that a single policy can generalize across heterogeneous hand embodiments.
  arXiv  Detail & Related papers  (2026-02-09T05:16:48Z)
• Trajectory Conditioned Cross-embodiment Skill Transfer [17.361383693716643]
  TrajSkill is a framework for Trajectory Conditioned Cross-embodiment Skill Transfer.<n>We show that TrajSkill reduces FVD by 39.6% and KVD by 36.6% compared with the state-of-the-art.
  arXiv  Detail & Related papers  (2025-10-09T04:26:06Z)
• Dexplore: Scalable Neural Control for Dexterous Manipulation from Reference-Scoped Exploration [58.4036440289082]
  Hand-object motion-capture (MoCap) offer large-scale, contact-rich demonstrations and hold promise for dexterous robotic scopes.<n>We introduce Dexplore, a unified single-loop optimization that performs repositories and tracking to learn robot control policies directly from MoCap at scale.
  arXiv  Detail & Related papers  (2025-09-11T17:59:07Z)
• Sim-to-Real Reinforcement Learning for Vision-Based Dexterous Manipulation on Humanoids [56.892520712892804]
  We introduce a practical sim-to-real RL recipe that trains a humanoid robot to perform three dexterous manipulation tasks.<n>We demonstrate high success rates on unseen objects and robust, adaptive policy behaviors.
  arXiv  Detail & Related papers  (2025-02-27T18:59:52Z)
• From Human Hands to Robotic Limbs: A Study in Motor Skill Embodiment for Telemanipulation [3.7482358401236398]
  We propose a GRU-based Variational Autoencoder to learn a latent representation of the manipulator's configuration space.<n>A fully connected neural network maps human arm configurations into this latent space, allowing the system to mimic and generate corresponding manipulator trajectories in real time.
  arXiv  Detail & Related papers  (2025-02-04T05:52:57Z)
• Learning to Transfer Human Hand Skills for Robot Manipulations [12.797862020095856]
  We present a method for teaching dexterous manipulation tasks to robots from human hand motion demonstrations.<n>Our approach learns a joint motion manifold that maps human hand movements, robot hand actions, and object movements in 3D, enabling us to infer one motion from others.
  arXiv  Detail & Related papers  (2025-01-07T22:33:47Z)
• Cross-Embodiment Dexterous Grasping with Reinforcement Learning [29.867524903691802]
  Dexterous hands exhibit significant potential for complex real-world grasping tasks. We study the learning of cross-embodiment dexterous grasping policies using reinforcement learning. Our approach demonstrates an 80% success rate in grasping objects from the YCB dataset.
  arXiv  Detail & Related papers  (2024-10-03T13:36:02Z)
• RealDex: Towards Human-like Grasping for Robotic Dexterous Hand [64.33746404551343]
  We introduce RealDex, a pioneering dataset capturing authentic dexterous hand grasping motions infused with human behavioral patterns.<n>RealDex holds immense promise in advancing humanoid robot for automated perception, cognition, and manipulation in real-world scenarios.
  arXiv  Detail & Related papers  (2024-02-21T14:59:46Z)
• Zero-Shot Robot Manipulation from Passive Human Videos [59.193076151832145]
  We develop a framework for extracting agent-agnostic action representations from human videos. Our framework is based on predicting plausible human hand trajectories. We deploy the trained model zero-shot for physical robot manipulation tasks.
  arXiv  Detail & Related papers  (2023-02-03T21:39:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.