KITE: Decoupling Kinematics and Interaction for Zero-Shot Cross-Embodiment Manipulation

• URL: http://arxiv.org/abs/2606.22113v1
• Date: Sat, 20 Jun 2026 15:51:30 GMT
• Title: KITE: Decoupling Kinematics and Interaction for Zero-Shot Cross-Embodiment Manipulation
• Abstract summary: Generalizing manipulation policies across robot embodiments remains difficult because standard policies entangle task reasoning with embodiment-specific motor control.<n>We introduce Kinematic Interaction Transfer across Embodiments (KITE), which decouples manipulation into embodiment-agnostic task reasoning and embodiment-specific motor control.<n>KITE consistently achieves zero-shot transfer to structurally different target embodiments, outperforming state-of-the-art baselines in transfer success and task-embodiment scope.
• Score: 2.532260218883922
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generalizing manipulation policies across robot embodiments remains difficult because standard policies entangle task reasoning with embodiment-specific motor control. We study zero-shot cross-embodiment manipulation, where a policy trained on source embodiments must be deployed on a structurally different target embodiment without additional task demonstrations. We introduce Kinematic Interaction Transfer across Embodiments (KITE), which decouples manipulation into embodiment-agnostic task reasoning and embodiment-specific motor control, connected through a learned latent representation of interaction intent based on contact patterns. Task reasoning is performed by a shared policy that predicts latent intents from source demonstrations, while motor control is performed by an intent-conditioned action decoder learned from each embodiment's kinematic model. With KITE, adaptation to a new embodiment requires only training a new action decoder using its kinematic model, without recollecting demonstration data. We evaluate KITE on three manipulation tasks spanning transfer between parallel grippers, dexterous hands, and composite embodiments. KITE consistently achieves zero-shot transfer to structurally different target embodiments, outperforming state-of-the-art baselines in transfer success and task-embodiment scope.

Related papers

• DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation [18.601805553878638]
  DyPES-VLA is a cross-embodiment VLA that learns shared Dynamics Priors and Embodiment-Specific control.<n>As a generalist policy, our ourmethod achieves state-of-the-art performance across simulation and real-world evaluations.
  arXiv  Detail & Related papers  (2026-08-06T17:59:20Z)
• iMaC: Translating Actions into Motion and Contact Images for Embodied World Models [77.395425755122]
  Embodied world models have emerged as a pivotal paradigm for visual robotic decision-making and interactive environment simulation.<n>This paper proposesiMac (Image as Action Control), a novel unified control paradigm that treats raw visual images as native action representations for embodied world models.
  arXiv  Detail & Related papers  (2026-06-08T17:55:41Z)
• SCAR: Self-Supervised Continuous Action Representation Learning [36.917304453471864]
  We propose SCAR, a joint inverse-forward dynamics framework for learning unified action representations across embodiments from visual transitions.<n>Built on a pretrained generative backbone, SCAR uses an inverse dynamics model (IDM) to infer latent actions from latent observation pairs and a forward dynamics model (FDM) to predict future dynamics conditioned on them.<n>Experiments on the Procgen and Robotwin dataset show that the learned unified latent action representation serves as a stronger conditioning interface for world modeling than embodiment-specific raw actions.
  arXiv  Detail & Related papers  (2026-05-13T16:23:11Z)
• OmniHumanoid: Streaming Cross-Embodiment Video Generation with Paired-Free Adaptation [63.65885191759872]
  Cross-embodiment video generation aims to transfer motions across different humanoid embodiments.<n>We present OmniHumanoid, a framework that factorizes transferable motion learning and embodiment-specific adaptation.
  arXiv  Detail & Related papers  (2026-05-12T12:21:11Z)
• AdaTracker: Learning Adaptive In-Context Policy for Cross-Embodiment Active Visual Tracking [42.310377711916104]
  Existing approaches typically train separate models for each embodiment, leading to poor scalability and limited generalization.<n>AdaTracker is an adaptive in-context policy learning framework that robustly tracks targets on diverse robot morphologies.<n> Experiments in both simulation and the real world demonstrate that AdaTracker significantly outperforms state-of-the-art methods in cross-embodiment generalization, sample efficiency, and zero-shot adaptation.
  arXiv  Detail & Related papers  (2026-04-22T08:06:32Z)
• Embedding Morphology into Transformers for Cross-Robot Policy Learning [24.85486808758998]
  Cross-robot policy learning remains a central challenge in robot learning.<n>We propose an embodiment-aware transformer policy that injects morphology via three mechanisms.<n>Across a range of embodiments, this structured integration consistently improves performance over a vanilla pi0.5 VLA baseline.
  arXiv  Detail & Related papers  (2026-02-26T21:42:34Z)
• MOTIF: Learning Action Motifs for Few-shot Cross-Embodiment Transfer [55.982504915794514]
  Cross-embodiment policies typically rely on shared-private architectures.<n>We introduce MOTIF for efficient few-shot cross-embodiment transfer.<n>We show that MOTIF significantly outperforms strong baselines in few-shot transfer scenarios.
  arXiv  Detail & Related papers  (2026-02-14T13:21:40Z)
• UniMotion: A Unified Motion Framework for Simulation, Prediction and Planning [60.55873455475112]
  We propose UniMotion, a unified motion framework that captures shared structures across motion tasks.<n>UniMotion employs dedicated interaction modes and tailored training strategies to simultaneously support these motion tasks.<n>With further fine-tuning, UniMotion achieves state-of-the-art performance across a range of motion tasks, establishing it as a versatile and scalable solution for autonomous driving.
  arXiv  Detail & Related papers  (2026-01-31T07:12:26Z)
• Meta-Controller: Few-Shot Imitation of Unseen Embodiments and Tasks in Continuous Control [19.259973997622346]
  Generalizing across robot embodiments and tasks is crucial for adaptive robotic systems.<n>We introduce a few-shot behavior cloning framework to simultaneously generalize to unseen embodiments and tasks.<n>A matching-based policy network then predicts actions from a few demonstrations, producing an adaptive policy that is robust to over-fitting.
  arXiv  Detail & Related papers  (2024-12-10T19:10:17Z)
• Composite Motion Learning with Task Control [0.6882042556551609]
  We present a deep learning method for composite and task-driven motion control for physically simulated characters. We learn decoupled motions for specific body parts from multiple reference motions simultaneously and directly by leveraging the use of multiple discriminators in a GAN-like setup. We show the applicability of our approach on a variety of challenging multi-objective tasks involving both composite motion imitation and multiple goal-directed control.
  arXiv  Detail & Related papers  (2023-05-05T05:02:41Z)
• Consolidating Kinematic Models to Promote Coordinated Mobile Manipulations [96.03270112422514]
  We construct a Virtual Kinematic Chain (VKC) that consolidates the kinematics of the mobile base, the arm, and the object to be manipulated in mobile manipulations. A mobile manipulation task is represented by altering the state of the constructed VKC, which can be converted to a motion planning problem.
  arXiv  Detail & Related papers  (2021-08-03T02:59:41Z)
• Goal-Conditioned End-to-End Visuomotor Control for Versatile Skill Primitives [89.34229413345541]
  We propose a conditioning scheme which avoids pitfalls by learning the controller and its conditioning in an end-to-end manner. Our model predicts complex action sequences based directly on a dynamic image representation of the robot motion. We report significant improvements in task success over representative MPC and IL baselines.
  arXiv  Detail & Related papers  (2020-03-19T15:04:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.