Data Analogies Enable Efficient Cross-Embodiment Transfer

• URL: http://arxiv.org/abs/2603.06450v1
• Date: Fri, 06 Mar 2026 16:42:46 GMT
• Title: Data Analogies Enable Efficient Cross-Embodiment Transfer
• Abstract summary: Generalist robot policies are trained on demonstrations collected across a wide variety of robots, scenes, and viewpoints.<n>We ask: what form of demonstration data is most useful for enabling transfer across robot set-ups?<n>Our simulated experiments show that while perceptual shifts such as viewpoint benefit most from broad diversity, morphology shifts benefit far less from unstructured diversity.
• Score: 72.88252238231269
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generalist robot policies are trained on demonstrations collected across a wide variety of robots, scenes, and viewpoints. Yet it remains unclear how to best organize and scale such heterogeneous data so that it genuinely improves performance in a given target setting. In this work, we ask: what form of demonstration data is most useful for enabling transfer across robot set-ups? We conduct controlled experiments that vary end-effector morphology, robot platform appearance, and camera perspective, and compare the effects of simply scaling the number of demonstrations against systematically broadening the diversity in different ways. Our simulated experiments show that while perceptual shifts such as viewpoint benefit most from broad diversity, morphology shifts benefit far less from unstructured diversity and instead see the largest gains from data analogies, i.e. paired demonstrations that align scenes, tasks, and/or trajectories across different embodiments. Informed by the simulation results, we improve real-world cross-embodiment transfer success by an average of $22.5\%$ over large-scale, unpaired datasets by changing only the composition of the data.

Related papers

• Cross-Embodiment Transfer via Behavior-Aligned Representations [29.171887164748124]
  We study the role of using behavior-aligned representations in vision--action models to promote cross-embodiment transfer.<n>We develop a simulation-based benchmark designed to assess transfer with diverse cross-embodiment data to new embodiments.<n>We demonstrate that they can enhance sim-to-real cross-embodiment transfer, improving task completion progress of real robot policies pre-trained on simulation data by 28%.
  arXiv  Detail & Related papers  (2026-07-30T00:49:53Z)
• Multi-Camera View Scaling for Data-Efficient Robot Imitation Learning [57.88781687419521]
  Multiple synchronized camera perspectives are used to generate pseudo-demonstrations from each expert trajectory.<n>Experiments in simulation and real-world manipulation tasks demonstrate significant gains in data efficiency and generalization.<n>Our results suggest that scaling camera views provides a practical and scalable solution for imitation learning.
  arXiv  Detail & Related papers  (2026-04-01T07:00:44Z)
• Beyond Viewpoint Generalization: What Multi-View Demonstrations Offer and How to Synthesize Them for Robot Manipulation? [28.177241923955435]
  Multi-view demonstrations consistently improve single-view policy success and generalization.<n>Mechanistic analysis shows that multi-view learning promotes manipulation-relevant visual representations.<n>We propose RoboNVS, a geometry-aware self-supervised framework that synthesizes novel-view videos from monocular inputs.
  arXiv  Detail & Related papers  (2026-03-23T15:01:15Z)
• Diversity You Can Actually Measure: A Fast, Model-Free Diversity Metric for Robotics Datasets [12.45101201787042]
  We study how dataset diversity affects generalization performance in robot imitation learning.<n>We introduce FAKTUAL, a data curation algorithm that selects a subset of demonstrations maximizing entropy.<n>Our results suggest that FAKTUAL is a practical tool for understanding and improving dataset diversity in robot imitation learning.
  arXiv  Detail & Related papers  (2026-03-12T07:54:43Z)
• Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization [65.37179698521766]
  Vision-Language-Action (VLA) models show strong promise for generalist robot control.<n>It remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics.<n>We present a systematic, controlled study of VLA scaling that revisits core training choices for pretraining across diverse robots.
  arXiv  Detail & Related papers  (2026-02-10T12:25:43Z)
• Invariance Co-training for Robot Visual Generalization [72.88252238231269]
  Reasoning from diverse observations is a fundamental capability for generalist robot policies to operate in a wide range of environments.<n>We show that co-training on diverse data improves performance by 18 percent over existing generative augmentation methods.
  arXiv  Detail & Related papers  (2025-12-04T20:08:46Z)
• Is Diversity All You Need for Scalable Robotic Manipulation? [50.747150672933316]
  We investigate the nuanced role of data diversity in robot learning by examining three critical dimensions-task (what to do), embodiment (which robot to use), and expert (who demonstrates)-challenging the conventional intuition of "more diverse is better"<n>We show that task diversity proves more critical than per-task demonstration quantity, benefiting transfer from diverse pre-training tasks to novel downstream scenarios.<n>We propose a distribution debiasing method to mitigate velocity ambiguity, the yielding GO-1-Pro achieves substantial performance gains of 15%, equivalent to using 2.5 times pre-training data.
  arXiv  Detail & Related papers  (2025-07-08T17:52:44Z)
• How to Train Your Robots? The Impact of Demonstration Modality on Imitation Learning [25.798669976935283]
  Imitation learning is a promising approach for learning robot policies with user-provided data.<n>We compare low-cost demonstration modalities including kinesthetic teaching, teleoperation with a VR controller, and teleoperation with a spacemouse controller.<n>Our results show that kinesthetic teaching is rated the most intuitive for controlling the robot and provides cleanest data for best downstream learning performance.
  arXiv  Detail & Related papers  (2025-03-10T07:57:26Z)
• What Makes Pre-Trained Visual Representations Successful for Robust Manipulation? [57.92924256181857]
  We find that visual representations designed for manipulation and control tasks do not necessarily generalize under subtle changes in lighting and scene texture. We find that emergent segmentation ability is a strong predictor of out-of-distribution generalization among ViT models.
  arXiv  Detail & Related papers  (2023-11-03T18:09:08Z)
• MetaGraspNet: A Large-Scale Benchmark Dataset for Vision-driven Robotic Grasping via Physics-based Metaverse Synthesis [78.26022688167133]
  We present a large-scale benchmark dataset for vision-driven robotic grasping via physics-based metaverse synthesis. The proposed dataset contains 100,000 images and 25 different object types. We also propose a new layout-weighted performance metric alongside the dataset for evaluating object detection and segmentation performance.
  arXiv  Detail & Related papers  (2021-12-29T17:23:24Z)
• Visual Imitation Made Easy [102.36509665008732]
  We present an alternate interface for imitation that simplifies the data collection process while allowing for easy transfer to robots. We use commercially available reacher-grabber assistive tools both as a data collection device and as the robot's end-effector. We experimentally evaluate on two challenging tasks: non-prehensile pushing and prehensile stacking, with 1000 diverse demonstrations for each task.
  arXiv  Detail & Related papers  (2020-08-11T17:58:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.