SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies

• URL: http://arxiv.org/abs/2606.24049v1
• Date: Tue, 23 Jun 2026 01:32:40 GMT
• Title: SPACE: Enabling Learning from Cross-Robot Data Toward Generalist Policies
• Abstract summary: We introduce State Prediction and Adaptive Command Execution (SPACE) framework.<n>SPACE handles robot dynamics variation at three levels: across different embodiments, across hardware units of the same embodiment, and within a single robot during operation.<n>Experiments show that SPACE substantially outperforms policies that directly predict control commands when learning from data collected across different embodiments and across hardware units of the same embodiment.
• Score: 20.583080585659513
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In robot learning, scaling training datasets across diverse embodiments and environments has become a dominant paradigm for learning generalizable robot policies. These policies are commonly trained via behavior cloning to imitate actions from pre-collected demonstrations. However, since robot actions are tied to the dynamics of the data collection robot, different robots may require different actions to achieve the same motion. This discrepancy hinders both policy training and deployment across diverse robots. To address this, we propose using Cartesian state delta as a universal action representation across robots, and introduce State Prediction and Adaptive Command Execution (SPACE) framework. SPACE handles robot dynamics variation at three levels: across different embodiments, across hardware units of the same embodiment, and within a single robot during operation. It consists of two components: (i) a Cartesian state delta policy that predicts geometric end-effector displacement, and (ii) Action Adapter, which converts the predicted Cartesian state delta into robot-specific control commands. Experiments show that SPACE substantially outperforms policies that directly predict control commands when learning from data collected across different embodiments and across hardware units of the same embodiment. SPACE also remains robust under dynamics shifts at deployment, including changes in control frequency, object weight, and controller gains. The project page is available at http://haeone.site/space-website/.

Related papers

• AnyWorld: Factorized Egocentric World Models for Cross-Embodiment Generalization [88.25615187835321]
  We propose AnyWorld, a cross-embodiment world modeling framework.<n>Our model factorizes an interaction into action, camera, and embodiment.<n>We train the model with large-scale human interaction pretraining.
  arXiv  Detail & Related papers  (2026-08-29T12:55:15Z)
• TAM: Torque Adaptation Module for Robust Motion Transfer in Manipulation [32.68351241308298]
  In contact-rich, dynamic manipulation, even small motion discrepancies can result in failure to track reference motion.<n>We introduce the Torque Adaptation Module (TAM), a learned module that adapts the torque commands sent to the robot to match the behavior of an ideal robot.
  arXiv  Detail & Related papers  (2026-06-04T14:31:54Z)
• Learning a Unified Latent Space for Cross-Embodiment Robot Control [8.76482934005711]
  We present a scalable framework for cross-embodiment humanoid robot control.<n>We learn a shared latent representation that unifies motion across humans and diverse humanoid platforms.<n>Our method supports the efficient addition of new robots to the latent space.
  arXiv  Detail & Related papers  (2026-01-21T19:31:17Z)
• The One RING: a Robotic Indoor Navigation Generalist [58.30694487843546]
  RING (Robotic Indoor Navigation Generalist) is an embodiment-agnostic policy that turns any mobile robot into an effective indoor semantic navigator.<n>Trained entirely in simulation, RING leverages large-scale randomization over robot embodiments to enable robust generalization to many real-world platforms.
  arXiv  Detail & Related papers  (2024-12-18T23:15:41Z)
• Autoregressive Action Sequence Learning for Robotic Manipulation [32.9580007141312]
  Existing autoregressive architectures generate end-effector waypoints sequentially as word tokens in language modeling.<n>We extend causal transformers' single-token prediction to support predicting a variable number of tokens in a single step.<n>We propose the Autoregressive Policy architecture, which solves manipulation tasks by generating hybrid action sequences.
  arXiv  Detail & Related papers  (2024-10-04T04:07:15Z)
• Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviation [49.03165169369552]
  By training a single policy across many different kinds of robots, a robot learning method can leverage much broader and more diverse datasets. We propose CrossFormer, a scalable and flexible transformer-based policy that can consume data from any embodiment. We demonstrate that the same network weights can control vastly different robots, including single and dual arm manipulation systems, wheeled robots, quadcopters, and quadrupeds.
  arXiv  Detail & Related papers  (2024-08-21T17:57:51Z)
• Cross-Embodiment Robot Manipulation Skill Transfer using Latent Space Alignment [24.93621734941354]
  This paper focuses on transferring control policies between robot manipulators with different morphology. Key insight is to project the state and action spaces of the source and target robots to a common latent space representation. We demonstrate sim-to-sim and sim-to-real manipulation policy transfer with source and target robots of different states, actions, and embodiments.
  arXiv  Detail & Related papers  (2024-06-04T05:00:24Z)
• Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulation [65.46610405509338]
  We seek to learn a generalizable goal-conditioned policy that enables zero-shot robot manipulation. Our framework,Track2Act predicts tracks of how points in an image should move in future time-steps based on a goal. We show that this approach of combining scalably learned track prediction with a residual policy enables diverse generalizable robot manipulation.
  arXiv  Detail & Related papers  (2024-05-02T17:56:55Z)
• RoboScript: Code Generation for Free-Form Manipulation Tasks across Real and Simulation [77.41969287400977]
  This paper presents textbfRobotScript, a platform for a deployable robot manipulation pipeline powered by code generation. We also present a benchmark for a code generation benchmark for robot manipulation tasks in free-form natural language. We demonstrate the adaptability of our code generation framework across multiple robot embodiments, including the Franka and UR5 robot arms.
  arXiv  Detail & Related papers  (2024-02-22T15:12:00Z)
• Polybot: Training One Policy Across Robots While Embracing Variability [70.74462430582163]
  We propose a set of key design decisions to train a single policy for deployment on multiple robotic platforms. Our framework first aligns the observation and action spaces of our policy across embodiments via utilizing wrist cameras. We evaluate our method on a dataset collected over 60 hours spanning 6 tasks and 3 robots with varying joint configurations and sizes.
  arXiv  Detail & Related papers  (2023-07-07T17:21:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.