Scalable Behavior Cloning with Open Data, Training, and Evaluation

• URL: http://arxiv.org/abs/2606.27375v1
• Date: Thu, 25 Jun 2026 17:59:57 GMT
• Title: Scalable Behavior Cloning with Open Data, Training, and Evaluation
• Abstract summary: We introduce ABC, a fully open-source stack for manipulation with behavior cloning.<n>ABC-130K is the largest open-source teleoperation dataset to date, featuring 3,500 hours of data spanning over 130K episodes across 195 diverse tasks.<n>We also open-source our accessible hardware setup, training infrastructure, and simulation pipeline.
• Score: 95.62769878386815
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce ABC, a fully open-source stack for manipulation with behavior cloning. At its core is ABC-130K: the largest open-source teleoperation dataset to date, featuring 3,500 hours of data spanning over 130K episodes across 195 diverse tasks. Furthermore, we open-source our accessible hardware setup, training infrastructure, and simulation pipeline. We also release 400 hours of sim-teleop data and provide a co-training recipe that produces correlated simulation and real-world evaluation, offering a reliable proxy for ablating model-design and training decisions before costly real-world evaluation. We explore various training recipes and compare common architectural choices for Diffusion Transformers (DiT) and Vision-Language-Action (VLA) models, grounding our findings in real-world evaluations. The resulting policies successfully execute dexterous tasks such as box folding and extracting credit cards from wallets. By providing a reproducible toolkit, we aim to place researchers on an equal footing, establishing the necessary foundation to learn the ABCs of Behavior Cloning together as a community.

Related papers

• FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence [21.911710953682256]
  $mathrmFluxVLA$ is an open, configuration-driven platform that turns heterogeneous embodied-policy components into a data-to-deployment workflow.<n>$mathrmFluxVLA$ standardizes interfaces for datasets, visual-language and world models, action heads, reward- or advantage-weighted learning, distributed training, simulation evaluation, optimized inference, and robot operators.
  arXiv  Detail & Related papers  (2026-09-15T13:59:09Z)
• OpenWAM: An Open, Modular Exploration Towards Systematic World-Action Model Pretraining [65.60703573854387]
  We introduce OpenWAM, an open research stack that turns world-action pretraining into a controlled experimental program.<n>OpenWAM-, an open WAM pretrained on roughly 6,400 hours of egocentric human and robot data, is evaluated across simulation and real-world benchmarks.
  arXiv  Detail & Related papers  (2026-09-07T12:12:32Z)
• DataComp-VLM: Improved Open Datasets for Vision-Language Models [161.68203673664217]
  We introduce DataComp for Vision-Language Models (DCVLM), a benchmark for data-centric experiments to improve VLM training.<n>We collect 160 datasets spanning four data types into a corpus of 6T multimodal tokens.<n>DCVLM allows participants to test curation strategies across 1B-8B models and 6.25B-200B token budgets.
  arXiv  Detail & Related papers  (2026-06-26T19:11:29Z)
• OpenThoughts-Agent: Data Recipes for Agentic Models [99.10629645072653]
  OT-Agent project is a fully open data curation pipeline for training agentic models.<n>We conduct more than 100 controlled ablation experiments to investigate each stage of the pipeline.<n>We assemble a training set of 100K examples from our pipeline and fine-tune Qwen3-32B on this dataset.
  arXiv  Detail & Related papers  (2026-06-23T17:34:29Z)
• OdysSim: Building Foundation Models for Human Behavior Simulation [70.35265860287608]
  Large language models are increasingly deployed as human simulators for interactive evaluation and social simulation.<n>Yet helpfulness-driven post-training pulls them toward a homogeneous, overly agreeable assistant register.<n>We present OdysSim, the largest open systematic investigation of behavioral foundation models.
  arXiv  Detail & Related papers  (2026-06-12T07:31:55Z)
• DataMaster: Data-Centric Autonomous AI Research [51.95819363392062]
  We study task-conditioned autonomous data engineering, where an agent improves a fixed learning algorithm by optimizing only the data side.<n>We propose DataMaster, a data-agent framework that integrates tree-structured search, shared candidate data, and cumulative memory.<n>We evaluate DataMaster on two types of benchmarks, MLE-Bench Lite and PostTrainBench.
  arXiv  Detail & Related papers  (2026-05-11T17:46:24Z)
• OpenDataArena: A Fair and Open Arena for Benchmarking Post-Training Dataset Value [74.80873109856563]
  OpenDataArena (ODA) is a holistic and open platform designed to benchmark the intrinsic value of post-training data.<n>ODA establishes a comprehensive ecosystem comprising four key pillars: (i) a unified training-evaluation pipeline that ensures fair, open comparisons across diverse models; (ii) a multi-dimensional scoring framework that profiles data quality along tens of distinct axes; and (iii) an interactive data lineage explorer to visualize dataset genealogy and dissect component sources.
  arXiv  Detail & Related papers  (2025-12-16T03:33:24Z)
• DeepDistill: Enhancing LLM Reasoning Capabilities via Large-Scale Difficulty-Graded Data Training [16.441081996257576]
  Large language models (LLMs) have recently achieved remarkable performance on various complex reasoning benchmarks.<n>We construct a large-scale, difficulty-graded reasoning dataset containing about 3.34 million unique queries of varying difficulty levels.<n>We significantly improve the reasoning capabilities of the base model, achieving a pass rate of 79.2% on the AIME2024 mathematical reasoning benchmark.
  arXiv  Detail & Related papers  (2025-04-24T13:57:53Z)
• PLANRL: A Motion Planning and Imitation Learning Framework to Bootstrap Reinforcement Learning [13.564676246832544]
  We introduce PLANRL, a framework that chooses when the robot should use classical motion planning and when it should learn a policy. PLANRL switches between two modes of operation: reaching a waypoint using classical techniques when away from the objects and fine-grained manipulation control when about to interact with objects. We evaluate our approach across multiple challenging simulation environments and real-world tasks, demonstrating superior performance in terms of adaptability, efficiency, and generalization compared to existing methods.
  arXiv  Detail & Related papers  (2024-08-07T19:30:08Z)
• Learning to be a Statistician: Learned Estimator for Number of Distinct Values [54.629042119819744]
  Estimating the number of distinct values (NDV) in a column is useful for many tasks in database systems. In this work, we focus on how to derive accurate NDV estimations from random (online/offline) samples. We propose to formulate the NDV estimation task in a supervised learning framework, and aim to learn a model as the estimator.
  arXiv  Detail & Related papers  (2022-02-06T15:42:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.