LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory

• URL: http://arxiv.org/abs/2605.02288v1
• Date: Mon, 04 May 2026 07:24:56 GMT
• Title: LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory
• Abstract summary: We present LabBuilder, an end-to-end system that generates and verifies 3D laboratory layouts from concise textual specifications.<n>LabBuilder significantly outperforms existing state-of-the-art methods.
• Score: 93.63620478256063
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Automated laboratories hold the promise of accelerating scientific discovery, yet their deployment is bottlenecked by the difficulty of designing safe and executable environments. While simulator-based design offers scalability, existing 3D scene generation methods are primarily tailored for household settings, optimizing for visual plausibility while neglecting the rigorous functional semantics and safety constraints essential for scientific experimentation. We present LabBuilder, an end-to-end system that generates and verifies 3D laboratory layouts from concise textual specifications. It operates through three tightly coupled components: LabForge first curates a meta-dataset of annotated assets and chemical knowledge, translating natural language specifications into structured protocols; building on these protocols, LabGen synthesizes laboratory layouts via an iterative, constraint-aware optimization strategy; finally, LabTouchstone evaluates the resulting layouts as a unified benchmark. Extensive experiments demonstrate that LabBuilder significantly outperforms existing state-of-the-art methods, producing laboratory environments that are not only realistic but also functionally valid and safe for complex experimental workflows.

Related papers

• LabDex: A Hierarchical Benchmark for Dexterous Manipulation in Laboratories [40.311566677309536]
  LabDex is a large-scale real-world dataset and benchmark for dexterous manipulation in chemistry laboratories.<n>It is organized around a hierarchical task taxonomy spanning atomic skills, compositional tasks, and long-horizon experiments.<n>We conduct cross-level evaluations of representative robot learning methods in both real-world and simulation environments.
  arXiv  Detail & Related papers  (2026-08-19T07:11:06Z)
• LabGuard: Grounding Natural-Language Laboratory Rules into Runtime Guards for Embodied Laboratory Agents [48.775530122251844]
  LabGuard is a language-to-execution safety suite that grounds natural-language laboratory rules into executable specifications and deploys them as runtime guards.<n>LabGuard includes three core components: LabGuard-IR, which defines a typed executable representation; LabGuard-Bench, which provides 812 supervised annotations expanded from 203 seed laboratory rules; and LabGuard-Grounder, which maps natural-language laboratory rules into LabGuard-IR.<n>Experiments show that LabGuard generalizes to unseen laboratory-rule sources, achieves 79.4 task-scope F1, and reduces unsafe events from 39.5% to 23.8% after monitor
  arXiv  Detail & Related papers  (2026-06-30T02:30:51Z)
• Labimus: A Simulation and Benchmark for Humanoid Dexterous Manipulation in Chemical Laboratory [47.77200587195896]
  Labimus is the first benchmark for humanoid dexterous manipulation in organic chemistry laboratories.<n>It reconstructs over 30 functionally faithful assets from real organic chemistry workstations through real-to-sim modeling.<n>We introduce a precision-aware evaluation protocol designed to jointly measure task completion, experimental precision, and long-horizon execution.
  arXiv  Detail & Related papers  (2026-06-30T02:14:28Z)
• LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories [95.20367571157679]
  Vision-Language-Action (VLA) models provide one possible interface between written protocols and robot execution.<n>Existing policies are trained mostly on household and tabletop demonstrations and rarely encounter the instruments, transparent liquids, or fixed protocol found in scientific laboratories.<n>We present LabVLA, trained with a two-stage recipe: FAST action token pretraining first makes the Qwen3-VL-4B-Instruct backbone action aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation.
  arXiv  Detail & Related papers  (2026-06-11T17:03:53Z)
• Managing Uncertainty in LLM-Generated Procedural Knowledge for Virtual Laboratory Planning [0.0]
  This paper presents a prototype framework for managing uncertainty in LLM-generated procedural knowledge for virtu-al laboratory planning.<n>The framework aims to reduce procedural uncertainty by using structured domain representations and uncertain LLM-generated state-transition samples.<n>We illustrate the approach in a virtual laboratory domain involving laboratory instruments, containers, tools, and material-transfer actions.
  arXiv  Detail & Related papers  (2026-05-25T21:12:47Z)
• PhyScensis: Physics-Augmented LLM Agents for Complex Physical Scene Arrangement [89.35154754765502]
  PhyScensis is an agent-based framework powered by a physics engine to produce physically plausible scene configurations.<n>Our framework preserves strong controllability over fine-grained textual descriptions and numerical parameters.<n> Experimental results show that our method outperforms prior approaches in scene complexity, visual quality, and physical accuracy.
  arXiv  Detail & Related papers  (2026-02-16T17:55:25Z)
• Sci-VLA: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments [49.02509634515056]
  Recent vision-language-action models offer a promising foundation for robotic laboratories.<n>Experiments typically involve long-horizon tasks composed of multiple atomic tasks.<n>While VLA models fine-tuned for scientific tasks can reliably execute atomic experimental actions, they often fail to perform composite tasks formed by reordering and composing these known atomic actions.
  arXiv  Detail & Related papers  (2026-02-10T05:50:19Z)
• PRISM: Protocol Refinement through Intelligent Simulation Modeling [4.839327116611717]
  We introduce PRISM, a framework that automates the design, validation, and execution of experimental protocols.<n>PRISM uses a set of language-model-based agents that work together to generate and refine experimental steps.<n>We demonstrate PRISM as a practical end-to-end workflow that bridges language-based protocol generation, simulation-based validation, and automated robotic execution.
  arXiv  Detail & Related papers  (2026-01-08T20:15:28Z)
• ExpVid: A Benchmark for Experiment Video Understanding & Reasoning [65.17173232816818]
  We introduce ExpVid, the first benchmark designed to systematically evaluate MLLMs on scientific experiment videos.<n>We evaluate 19 leading MLLMs on ExpVid and find that while they excel at coarse-grained recognition, they struggle with disambiguating fine details, tracking state changes over time, and linking experimental procedures to scientific outcomes.<n>Our results reveal a notable performance gap between proprietary and open-source models, particularly in high-order reasoning.
  arXiv  Detail & Related papers  (2025-10-13T16:45:28Z)
• DisCo-Layout: Disentangling and Coordinating Semantic and Physical Refinement in a Multi-Agent Framework for 3D Indoor Layout Synthesis [76.7196710324494]
  3D indoor layout synthesis is crucial for creating virtual environments.<n>DisCo is a novel framework that disentangles and coordinates physical and semantic refinement.
  arXiv  Detail & Related papers  (2025-10-02T16:30:37Z)
• LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents [103.65422553044816]
  LabUtopia is a comprehensive simulation and benchmarking suite designed to facilitate the development of generalizable, reasoning-capable embodied agents.<n>It supports 30 distinct tasks and includes more than 200 scene and instrument assets.<n>We demonstrate that LabUtopia offers a powerful platform for advancing the integration of perception, planning, and control in scientific-purpose agents.
  arXiv  Detail & Related papers  (2025-05-28T17:50:53Z)
• Lessons from a Space Lab -- An Image Acquisition Perspective [7.2090712455329635]
  Interdisciplinary Center of Security, Reliability and Trust (SnT) at the University of Luxembourg has developed the 'SnT Zero-G Lab' This article presents a systematic approach combining market survey and experimental analyses for equipment selection.
  arXiv  Detail & Related papers  (2022-08-18T14:44:40Z)
• Bayesian optimization with known experimental and design constraints for chemistry applications [0.0]
  We extend our experiment planning algorithms Phoenics and Gryffin such that they can handle arbitrary known constraints. We illustrate their practical utility in two simulated chemical research scenarios.
  arXiv  Detail & Related papers  (2022-03-29T22:16:54Z)
• Empirica: a virtual lab for high-throughput macro-level experiments [4.077787659104315]
  Empirica is a modular virtual lab that offers a solution to the usability-functionality trade-off. Empirica's architecture is designed to allow for parameterizable experimental designs, reusable protocols, and rapid development.
  arXiv  Detail & Related papers  (2020-06-19T21:28:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.