LabDex: A Hierarchical Benchmark for Dexterous Manipulation in Laboratories

• URL: http://arxiv.org/abs/2608.18618v1
• Date: Wed, 19 Aug 2026 07:11:06 GMT
• Title: LabDex: A Hierarchical Benchmark for Dexterous Manipulation in Laboratories
• Abstract summary: LabDex is a large-scale real-world dataset and benchmark for dexterous manipulation in chemistry laboratories.<n>It is organized around a hierarchical task taxonomy spanning atomic skills, compositional tasks, and long-horizon experiments.<n>We conduct cross-level evaluations of representative robot learning methods in both real-world and simulation environments.
• Score: 40.311566677309536
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous laboratories hold great promise for accelerating scientific discovery. To achieve this vision, robots are supposed to dexterously manipulate diverse labware and instruments and execute long-horizon, state-dependent experimental procedures. Yet existing benchmarks do not jointly capture dexterous hand use, real-world laboratory interactions, and multi-stage experimental procedures, limiting systematic training and evaluation. To bridge this gap, we introduce LabDex, a large-scale real-world dataset and benchmark for dexterous manipulation in chemistry laboratories, organized around a hierarchical task taxonomy spanning atomic skills, compositional tasks, and long-horizon experiments. First, LabDex is cross-platform and, for the first time, unifies real-world and simulation platforms under a common framework, providing standardized task definitions, demonstrations, and evaluation protocols. Second, LabDex is large-scale and systematically organizes chemistry laboratory operations into three interconnected levels: Atomic Skills, which characterize fundamental dexterous manipulation capabilities; Compositional Skills; and Long-Horizon Laboratory Workflows. This hierarchical design not only supports the evaluation of end-task performance, but also enables the analysis of how fundamental dexterous skills compose and influence more complex laboratory operations. We conduct cross-level evaluations of representative robot learning methods in both real-world and simulation environments. The experimental results validate the effectiveness of the LabDex task design and demonstration data, and show that the benchmark supports the training and systematic evaluation of existing robotic policies across laboratory dexterous manipulation tasks at different levels, providing a foundation for further research and development of autonomous laboratory robots.

Related papers

• Labimus: A Simulation and Benchmark for Humanoid Dexterous Manipulation in Chemical Laboratory [47.77200587195896]
  Labimus is the first benchmark for humanoid dexterous manipulation in organic chemistry laboratories.<n>It reconstructs over 30 functionally faithful assets from real organic chemistry workstations through real-to-sim modeling.<n>We introduce a precision-aware evaluation protocol designed to jointly measure task completion, experimental precision, and long-horizon execution.
  arXiv  Detail & Related papers  (2026-06-30T02:14:28Z)
• LabVLA: Grounding Vision-Language-Action Models in Scientific Laboratories [95.20367571157679]
  Vision-Language-Action (VLA) models provide one possible interface between written protocols and robot execution.<n>Existing policies are trained mostly on household and tabletop demonstrations and rarely encounter the instruments, transparent liquids, or fixed protocol found in scientific laboratories.<n>We present LabVLA, trained with a two-stage recipe: FAST action token pretraining first makes the Qwen3-VL-4B-Instruct backbone action aware before any continuous control is learned, and flow matching posttraining then attaches a DiT action expert under knowledge insulation.
  arXiv  Detail & Related papers  (2026-06-11T17:03:53Z)
• LabBuilder: Protocol-Grounded 3D Layout Generation for Interactable and Safe Laboratory [93.63620478256063]
  We present LabBuilder, an end-to-end system that generates and verifies 3D laboratory layouts from concise textual specifications.<n>LabBuilder significantly outperforms existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-05-04T07:24:56Z)
• Sci-VLA: Agentic VLA Inference Plugin for Long-Horizon Tasks in Scientific Experiments [49.02509634515056]
  Recent vision-language-action models offer a promising foundation for robotic laboratories.<n>Experiments typically involve long-horizon tasks composed of multiple atomic tasks.<n>While VLA models fine-tuned for scientific tasks can reliably execute atomic experimental actions, they often fail to perform composite tasks formed by reordering and composing these known atomic actions.
  arXiv  Detail & Related papers  (2026-02-10T05:50:19Z)
• LabUtopia: High-Fidelity Simulation and Hierarchical Benchmark for Scientific Embodied Agents [103.65422553044816]
  LabUtopia is a comprehensive simulation and benchmarking suite designed to facilitate the development of generalizable, reasoning-capable embodied agents.<n>It supports 30 distinct tasks and includes more than 200 scene and instrument assets.<n>We demonstrate that LabUtopia offers a powerful platform for advancing the integration of perception, planning, and control in scientific-purpose agents.
  arXiv  Detail & Related papers  (2025-05-28T17:50:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.