Towards Generalizable Robotic Data Flywheel: High-Dimensional Factorization and Composition

• URL: http://arxiv.org/abs/2603.25583v1
• Date: Thu, 26 Mar 2026 16:00:39 GMT
• Title: Towards Generalizable Robotic Data Flywheel: High-Dimensional Factorization and Composition
• Abstract summary: The lack of sufficiently diverse data is a major bottleneck for generalist robotic models.<n>We propose F-ACIL, a factor-aware iterative learning framework that enables structured data factorization.<n>With extensive real-world experiments, we show that F-ACIL can achieve more than 45% performance gains.
• Score: 15.755384541529098
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The lack of sufficiently diverse data, coupled with limited data efficiency, remains a major bottleneck for generalist robotic models, yet systematic strategies for collecting and curating such data are not fully explored. Task diversity arises from implicit factors that are sparsely distributed across multiple dimensions and are difficult to define explicitly. To address this challenge, we propose F-ACIL, a heuristic factor-aware compositional iterative learning framework that enables structured data factorization and promotes compositional generalization. F-ACIL decomposes the data distribution into structured factor spaces such as object, action, and environment. Based on the factorized formulation, we develop a factor-wise data collection and an iterative training paradigm that promotes compositional generalization over the high-dimensional factor space, leading to more effective utilization of real-world robotic demonstrations. With extensive real-world experiments, we show that F-ACIL can achieve more than 45% performance gains with 5-10$\times$ fewer demonstrations comparing to that of which without the strategy. The results suggest that structured factorization offers a practical pathway toward efficient compositional generalization in real-world robotic learning. We believe F-ACIL can inspire more systematic research on building generalizable robotic data flywheel strategies. More demonstrations can be found at: https://f-acil.github.io/

Related papers

• World-Task Factorization for Robot Learning [14.616160772427847]
  We study what we argue is the most fundamental factorization in robotics: separating the world from the task.<n>World factors are properties of the embodied system and the environment.<n>Task factors are defined by the task's logic over what the world admits.
  arXiv  Detail & Related papers  (2026-06-01T10:16:07Z)
• Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization [65.37179698521766]
  Vision-Language-Action (VLA) models show strong promise for generalist robot control.<n>It remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics.<n>We present a systematic, controlled study of VLA scaling that revisits core training choices for pretraining across diverse robots.
  arXiv  Detail & Related papers  (2026-02-10T12:25:43Z)
• Data Value in the Age of Scaling: Understanding LLM Scaling Dynamics Under Real-Synthetic Data Mixtures [32.89034139737846]
  Large language models (LLMs) are built on datasets that blend real and synthetic data.<n> synthetic data offers scalability and cost-efficiency, but it often introduces systematic distributional discrepancies.<n>We propose an effective yet efficient data valuation method that scales to large-scale datasets.
  arXiv  Detail & Related papers  (2025-11-17T17:53:12Z)
• Fidelity-Aware Data Composition for Robust Robot Generalization [39.69070982795268]
  Generalist robot policies trained on large-scale, visually homogeneous datasets can be susceptible to shortcut learning.<n>This paper suggests that robust generalization depends on principled, fidelity-aware data composition.<n>We introduce Coherent Information Fidelity Tuning (CIFT), a framework that treats data composition as an optimization problem.
  arXiv  Detail & Related papers  (2025-09-29T13:48:36Z)
• From Parameters to Performance: A Data-Driven Study on LLM Structure and Development [73.67759647072519]
  Large language models (LLMs) have achieved remarkable success across various domains.<n>Despite the rapid growth in model scale and capability, systematic, data-driven research on how structural configurations affect performance remains scarce.<n>We present a large-scale dataset encompassing diverse open-source LLM structures and their performance across multiple benchmarks.
  arXiv  Detail & Related papers  (2025-09-14T12:20:39Z)
• Shortcut Learning in Generalist Robot Policies: The Role of Dataset Diversity and Fragmentation [117.54237701533805]
  Generalist robot policies trained on large-scale datasets such as Open X-Embodiment (OXE) demonstrate strong performance across a wide range of tasks.<n>They often struggle to generalize beyond the distribution of their training data.<n>We identify shortcut learning as a key impediment to generalization.
  arXiv  Detail & Related papers  (2025-08-08T16:14:01Z)
• Does Data Scaling Lead to Visual Compositional Generalization? [21.242714408660508]
  We find that compositional generalization is driven by data diversity, not mere data scale.<n>We prove this structure is key to efficiency, enabling perfect generalization from few observed combinations.
  arXiv  Detail & Related papers  (2025-07-09T17:59:03Z)
• Leveraging Large Language Models to Address Data Scarcity in Machine Learning: Applications in Graphene Synthesis [0.0]
  Machine learning in materials science faces challenges due to limited experimental data.<n>We propose strategies that utilize large language models (LLMs) to enhance machine learning performance.
  arXiv  Detail & Related papers  (2025-03-06T16:04:01Z)
• Efficient Data Collection for Robotic Manipulation via Compositional Generalization [70.76782930312746]
  We show that policies can compose environmental factors from their data to succeed when encountering unseen factor combinations. We propose better in-domain data collection strategies that exploit composition. We provide videos at http://iliad.stanford.edu/robot-data-comp/.
  arXiv  Detail & Related papers  (2024-03-08T07:15:38Z)
• How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data Composition [64.86360698067764]
  This study focuses on the interplay of data composition between mathematical reasoning, code generation, and general human-aligning abilities during supervised fine-tuning. Our experiments reveal that distinct capabilities scale differently and larger models generally show superior performance with same amount of data. Our findings suggest the amount of composition data influences performance more than the composition ratio.
  arXiv  Detail & Related papers  (2023-10-09T07:56:16Z)
• Dynamic Latent Separation for Deep Learning [67.62190501599176]
  A core problem in machine learning is to learn expressive latent variables for model prediction on complex data. Here, we develop an approach that improves expressiveness, provides partial interpretation, and is not restricted to specific applications.
  arXiv  Detail & Related papers  (2022-10-07T17:56:53Z)
• Efficient Data-specific Model Search for Collaborative Filtering [56.60519991956558]
  Collaborative filtering (CF) is a fundamental approach for recommender systems. In this paper, motivated by the recent advances in automated machine learning (AutoML), we propose to design a data-specific CF model. Key here is a new framework that unifies state-of-the-art (SOTA) CF methods and splits them into disjoint stages of input encoding, embedding function, interaction and prediction function.
  arXiv  Detail & Related papers  (2021-06-14T14:30:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.