Modeling Robotics Dataset Construction as an Artifact-Based Build Process
- URL: http://arxiv.org/abs/2606.00162v1
- Date: Fri, 29 May 2026 10:11:45 GMT
- Title: Modeling Robotics Dataset Construction as an Artifact-Based Build Process
- Abstract summary: Robotic systems generate large volumes of multimodal sensor data.<n> converting ROS bag recordings into machine learning datasets is often handled by ad hoc sequential scripts.<n>We model dataset construction as an artifact-based build process over a dependency graph and implement this approach in Bagzel.
- Score: 0.6299766708197881
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Robotic systems generate large volumes of multimodal sensor data, but converting ROS bag recordings into machine learning datasets is often handled by ad hoc sequential scripts, creating engineering overhead and slow iteration cycles. We model dataset construction as an artifact-based build process over a dependency graph and implement this approach in Bagzel, an open-source Bazel extension for reproducible, incremental dataset generation (including nuScenes-format export). We compare Bagzel and Bagzel-xattr (server-side digest management) against a sequential rosbag2nuscenes baseline. Bagzel reduces runtime in all evaluated execution modes, with the largest gains in iterative workflows (up to 386.26x in warm builds and 7.21x in incremental builds on a 20.4 GB dataset). Across dataset sizes from 5.1 to 20.4 GB, Bagzel variants show markedly better scaling behavior than the baseline, especially in warm and incremental modes. Bagzel-xattr provides additional gains, with a mean runtime reduction of 5.9% compared to Bagzel in the input granularity study. Overall, modeling robotics dataset construction as an artifact-based build process substantially reduces dataset update latency while maintaining a deterministic build design that supports reproducibility. Bagzel is publicly available at https://github.com/UniBwTAS/bagzel.
Related papers
- BatchGen: An Architecture for Scalable and Efficient Batch Inference [7.794394498151309]
Batch inference has become a central mode of AI computation, yet existing inference engines still rely on execution models designed for interactive serving.<n>We introduce a new architectural foundation for batch inference: the sequence compute model, which represents each sequence as a fine-grained, event-driven sequence.<n>This model exposes expressive primitives that allow the runtime to reorganize work dynamically, enabling larger expert-level batches, mitigating stragglers, real work across devices, and maintaining utilization even on cost-effective or memory-constrained GPU.
arXiv Detail & Related papers (2026-06-19T19:56:21Z) - ISE: An Execution-Grounded Recipe for Multi-Turn OS-Agent Trajectories [18.739245125968175]
Training capable OS agents requires data that simultaneously captures structured user intents, multi-turn task delegation, and grounded tool execution--properties absent from existing datasets.<n>We propose ISE (Intent -> Simulate -> Execute), a three-stage synthesis paradigm that addresses these gaps jointly.
arXiv Detail & Related papers (2026-06-09T23:44:26Z) - Covering Human Action Space for Computer Use: Data Synthesis and Benchmark [59.01879944842542]
Computer-use agents (CUAs) automate on-screen work, as illustrated by GPT-5.4 and Claude.<n>Yet their reliability on complex, low-frequency interactions is still poor, limiting user trust.<n>We propose a new benchmark CUActSpot for evaluating models' capabilities on complex interactions.
arXiv Detail & Related papers (2026-05-12T17:59:58Z) - Sparkle: Realizing Lively Instruction-Guided Video Background Replacement via Decoupled Guidance [54.34473644733862]
Background Replacement is central to creative applications such as film production and advertising.<n>Background Replacement requires entirely new, temporally consistent scenes while maintaining accurate foreground-background interactions.<n>We introduce Sparkle, a dataset of 140K video pairs spanning five common background-change themes.
arXiv Detail & Related papers (2026-05-07T16:35:34Z) - BiDexGrasp: Coordinated Bimanual Dexterous Grasps across Object Geometries and Sizes [64.2030401965582]
BiDexGrasp consists of a large-scale bimanual dexterous grasp dataset and a novel generation model.<n>We construct a large-scale bimanual dexterous grasp dataset, comprising 6351 diverse objects with sizes ranging from 30 to 80 cm.<n>We introduce a bimanual-adaptive and geometry-size-adaptive dexterous grasping generation framework.
arXiv Detail & Related papers (2026-04-08T02:17:11Z) - PlotCraft: Pushing the Limits of LLMs for Complex and Interactive Data Visualization [82.96200364977737]
We introduce PlotCraft, a new benchmark featuring 1k challenging visualization tasks.<n>PlotCraft is structured around seven high-level visualization tasks and encompasses 48 distinct chart types.<n>It is the first to systematically evaluate both single-turn generation and multi-turn refinement across a diverse spectrum of task complexities.
arXiv Detail & Related papers (2025-10-15T10:14:39Z) - RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulation [52.2244588424002]
We present RoboTwin 2.0, a scalable framework for automated, large-scale generation of diverse and realistic data.<n>At its core is RoboTwin-OD, an object library of 731 instances across 147 categories with semantic and manipulation-relevant annotations.<n>To improve sim-to-real transfer, RoboTwin 2.0 applies structured domain randomization along five axes.
arXiv Detail & Related papers (2025-06-22T16:26:53Z) - Does Functional Package Management Enable Reproducible Builds at Scale? Yes [4.492444446637857]
Reproducible Builds (R-B) guarantee that rebuilding a software package from source leads to bitwise identical artifacts.<n>We perform the first large-scale study of bitwise in the context of the Nix functional package manager.<n>We obtain very high bitwise rates, between 69 and 91% with an upward trend, and even higher rebuildability rates, over 99%.
arXiv Detail & Related papers (2025-01-27T10:11:27Z) - Teddy: Efficient Large-Scale Dataset Distillation via Taylor-Approximated Matching [74.75248610868685]
Teddy is a Taylor-approximated dataset distillation framework designed to handle large-scale dataset.
Teddy attains state-of-the-art efficiency and performance on the Tiny-ImageNet and original-sized ImageNet-1K dataset.
arXiv Detail & Related papers (2024-10-10T03:28:46Z) - MASSTAR: A Multi-Modal and Large-Scale Scene Dataset with a Versatile Toolchain for Surface Prediction and Completion [25.44529512862336]
MASSTAR is a multi-modal lArge-scale scene dataset with a verSatile Toolchain for surfAce pRediction and completion.
We develop a versatile and efficient toolchain for processing the raw 3D data from the environments.
We generate an example dataset composed of over a thousand scene-level models with partial real-world data.
arXiv Detail & Related papers (2024-03-18T11:35:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.