CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design

• URL: http://arxiv.org/abs/2609.16251v1
• Date: Mon, 14 Sep 2026 19:19:05 GMT
• Title: CADWorld: Computer-Use Benchmark for Long-Horizon Computer-Aided Design
• Abstract summary: CADWorld is a benchmark for long-horizon computer use in FreeCAD.<n>It contains 200 tasks spanning 11 mechanical-CAD workflow categories, including sketching, part modeling, assembly, CAM, FEM, measurement, mesh processing, and technical drawing.<n>We find that weaker agents often fail before producing a valid artifact, whereas stronger agents increasingly fail on structural, geometric, and construction-process requirements.
• Score: 10.481042166600417
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Computer-use agents are increasingly evaluated in realistic desktop environments, but existing benchmarks provide limited coverage of professional engineering workflows whose outputs are persistent, structured artifacts. Mechanical computer-aided design (CAD) is a particularly demanding setting: an agent must manipulate geometry and constraints over long interaction horizons while producing a native project whose dimensions, construction structure, and downstream engineering state remain valid. We introduce \textbf{CADWorld}, a benchmark for long-horizon computer use in FreeCAD. CADWorld contains 200 tasks spanning 11 mechanical-CAD workflow categories, including sketching, part modeling, assembly, CAM, FEM, measurement, mesh processing, and technical drawing. Agents operate through screenshots and GUI actions, while success is determined by task-specific executable checks over saved FreeCAD artifacts and auxiliary outputs, covering geometric properties, parametric structure, constraints, manufacturing state, and simulation results. Across seven current agents on the full benchmark, the strongest agent achieves 17.5\% success, compared with an 87.0\% expert reference pass. We find that weaker agents often fail before producing a valid artifact, whereas stronger agents increasingly fail on structural, geometric, and construction-process requirements. CADWorld therefore exposes a gap between general GUI competence and reliable execution of persistent, verifiable engineering workflows. Project accessible at https://cad-world.github.io.

Related papers

• CIT-CAD: Constraint Intent Tree-based CAD Code Generation and Verification [14.39975999842683]
  We propose a framework that makes design intent explicit and lets a system check generated code against that intent.<n>The framework extracts actual constraints from the generated program, compares them with the expected constraints, and uses mismatches to localize and repair design violations.
  arXiv  Detail & Related papers  (2026-09-07T12:42:42Z)
• ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation [17.07760884362884]
  We present ArtisanCAD, a skill-guided industrial CAD agent with expert-grounded knowledge distillation.<n>The core of ArtisanCAD is CAD intermediate representation (CAD-IR), an executable procedural representation.<n>On the Text2CAD benchmark, CAD-IR improves generation from intermediate prompts by reducing mean Chamfer Distance from $14.83$ to $9.88$.
  arXiv  Detail & Related papers  (2026-07-07T02:11:50Z)
• BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD [14.284307846349774]
  We present BenchCAD, a unified benchmark for industrial CAD reasoning.<n> BenchCAD contains 17,900 execution-verified CadQuery programs across 106 industrial part families.<n>It evaluates models through visual question answering, code question answering, image-to-code generation, and instruction-guided code editing.
  arXiv  Detail & Related papers  (2026-05-11T17:13:36Z)
• CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models [80.47087401394882]
  We introduce CADFS, a data-centric framework that enables large vision-language models to generate complex CAD design histories.<n>We construct a dataset of 450k real-world CAD models spanning 15 modeling operations.<n>Fine-tuning a VLM on this representation yields state-of-the-art results in text-conditioned CAD generation and image-based reconstruction.
  arXiv  Detail & Related papers  (2026-05-03T15:12:36Z)
• Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data [8.896486786253766]
  We introduce Zero-to-CAD, a scalable framework for executable CAD construction sequences.<n>We frame synthesis as an agentic search problem: by embedding a large language model within a feedback-driven CAD environment, our system iteratively generates, executes, and validates code.<n>This agentic approach enables the synthesis of approximately one million executable, readable, editable CAD sequences.
  arXiv  Detail & Related papers  (2026-04-27T13:46:41Z)
• Using GUI Agent for Electronic Design Automation [123.86509061313912]
  Graphical User Interface (GUI) agents adopt an end-to-end paradigm that maps a screenshot to an action sequence.<n>Existing GUI agents are evaluated almost exclusively on commodity software such as Microsoft Word and Excel.<n>This work extends GUI agents from generic office automation to specialized, high-value engineering domains.
  arXiv  Detail & Related papers  (2025-12-12T14:49:32Z)
• From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation [47.67703214044401]
  We propose CAD-RL, a multimodal Chain-of-Thought guided reinforcement learning framework for CAD modeling code generation.<n>Our method combines Cold Start with goal-driven reinforcement learning post training using three task-specific rewards.<n>Experiments demonstrate that CAD-RL achieves significant improvements in reasoning quality, output precision, and code executability.
  arXiv  Detail & Related papers  (2025-08-13T18:30:49Z)
• UniCAD: Efficient and Extendable Architecture for Multi-Task Computer-Aided Diagnosis System [48.83716673786449]
  We propose UniCAD, a unified architecture that seamlessly handles both 2D and 3D medical images.<n>A low-rank adaptation strategy is employed to adapt a pre-trained visual model to the medical image domain, achieving performance on par with fully fine-tuned counterparts.<n>Building on this unified CAD architecture, we establish an open-source platform where researchers can share and access lightweight CAD experts.
  arXiv  Detail & Related papers  (2025-05-14T06:21:27Z)
• CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images [69.7768227804928]
  CADCrafter is an image-to-parametric CAD model generation framework that trains solely on synthetic textureless CAD data.<n>We introduce a geometry encoder to accurately capture diverse geometric features.<n>Our approach can robustly handle real unconstrained CAD images, and even generalize to unseen general objects.
  arXiv  Detail & Related papers  (2025-04-07T06:01:35Z)
• CAD-Assistant: Tool-Augmented VLLMs as Generic CAD Task Solvers [20.440350517523314]
  CAD-Assistant addresses user queries by generating actions that are iteratively executed on a Python interpreter equipped with the FreeCAD software.<n>We consider a wide range of CAD-specific tools including a sketch image parameterizer, rendering modules, a 2D cross-section generator, and other specialized routines.
  arXiv  Detail & Related papers  (2024-12-18T12:57:56Z)
• AutoCAD: Automatically Generating Counterfactuals for Mitigating Shortcut Learning [70.70393006697383]
  We present AutoCAD, a fully automatic and task-agnostic CAD generation framework. In this paper, we present AutoCAD, a fully automatic and task-agnostic CAD generation framework.
  arXiv  Detail & Related papers  (2022-11-29T13:39:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.