BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD

• URL: http://arxiv.org/abs/2605.10865v2
• Date: Tue, 12 May 2026 05:46:14 GMT
• Title: BenchCAD: A Comprehensive, Industry-Standard Benchmark for Programmatic CAD
• Abstract summary: We present BenchCAD, a unified benchmark for industrial CAD reasoning.<n> BenchCAD contains 17,900 execution-verified CadQuery programs across 106 industrial part families.<n>It evaluates models through visual question answering, code question answering, image-to-code generation, and instruction-guided code editing.
• Score: 14.284307846349774
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Industrial Computer-Aided Design (CAD) code generation requires models to produce executable parametric programs from visual or textual inputs. Beyond recognizing the outer shape of a part, this task involves understanding its 3D structure, inferring engineering parameters, and choosing CAD operations that reflect how the part would be designed and manufactured. Despite the promise of Multimodal large language models (MLLMs) for this task, they are rarely evaluated on whether these capabilities jointly hold in realistic industrial CAD settings. We present BenchCAD, a unified benchmark for industrial CAD reasoning. BenchCAD contains 17,900 execution-verified CadQuery programs across 106 industrial part families, including bevel gears, compression springs, twist drills, and other reusable engineering designs. It evaluates models through visual question answering, code question answering, image-to-code generation, and instruction-guided code editing, enabling fine-grained analysis across perception, parametric abstraction, and executable program synthesis. Across 10+ frontier models, BenchCAD shows that current systems often recover coarse outer geometry but fail to produce faithful parametric CAD programs. Common failures include missing fine 3D structure, misinterpreting industrial design parameters, and replacing essential operations such as sweeps, lofts, and twist-extrudes with simpler sketch-and-extrude patterns. Fine-tuning and reinforcement learning improve in-distribution performance, but generalization to unseen part families remains limited. These results position BenchCAD as a benchmark for measuring and improving the industrial readiness of multimodal CAD automation.

Related papers

• OmniMech: All-in-one Multimodal Mechanical Benchmark for 3D Reconstruction [15.427717696810456]
  We introduce OmniMech, the first million-scale benchmark for evaluating vision-language models on CAD generation from industrial data.<n> OmniMech contains more than 251,000 fully dimensioned and toleranced 2D orthographic drawings, paired with native CAD models.<n>We will release the benchmark data, evaluation code, and tool interfaces to support future research.
  arXiv  Detail & Related papers  (2026-08-06T02:36:22Z)
• ArtisanCAD: An Industrial-Level CAD Agent with Expert-Grounded Knowledge Distillation [17.07760884362884]
  We present ArtisanCAD, a skill-guided industrial CAD agent with expert-grounded knowledge distillation.<n>The core of ArtisanCAD is CAD intermediate representation (CAD-IR), an executable procedural representation.<n>On the Text2CAD benchmark, CAD-IR improves generation from intermediate prompts by reducing mean Chamfer Distance from $14.83$ to $9.88$.
  arXiv  Detail & Related papers  (2026-07-07T02:11:50Z)
• CADBench: A Multimodal Benchmark for AI-Assisted CAD Program Generation [3.6136995620089145]
  We introduce CADBench, a unified benchmark for multimodal CAD program generation.<n>CADBench contains 18,000 evaluation samples spanning six benchmark families.<n>We benchmark eleven CAD-specialized and general-purpose vision-language systems, generating more than 1.4 million CAD programs.
  arXiv  Detail & Related papers  (2026-05-11T17:25:47Z)
• Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data [8.896486786253766]
  We introduce Zero-to-CAD, a scalable framework for executable CAD construction sequences.<n>We frame synthesis as an agentic search problem: by embedding a large language model within a feedback-driven CAD environment, our system iteratively generates, executes, and validates code.<n>This agentic approach enables the synthesis of approximately one million executable, readable, editable CAD sequences.
  arXiv  Detail & Related papers  (2026-04-27T13:46:41Z)
• Learning From Design Procedure To Generate CAD Programs for Data Augmentation [7.894465542100662]
  A key challenge in large language models-based CAD program generation is the limited geometric complexity of generated shapes.<n>We propose a novel data augmentation paradigm that prompts an LLM to generate CAD programs conditioned on a reference surface program.<n>By varying the reference surface using a collection of organic shapes, our method enriches the geometric distribution of generated CAD models.
  arXiv  Detail & Related papers  (2026-03-06T21:32:15Z)
• DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces [67.45867367326105]
  We propose DreamCAD, a multi-modal generative framework that directly produces editable BReps from point-level supervision.<n>DreamCAD represents each BRep as a set of parametric patches and uses a differentiable tessellation method to generate meshes.<n>DreamCAD achieves state-of-the-art performance on ABC and averse benchmarks across text, image, and point modalities.
  arXiv  Detail & Related papers  (2026-03-05T19:04:07Z)
• From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation [47.67703214044401]
  We propose CAD-RL, a multimodal Chain-of-Thought guided reinforcement learning framework for CAD modeling code generation.<n>Our method combines Cold Start with goal-driven reinforcement learning post training using three task-specific rewards.<n>Experiments demonstrate that CAD-RL achieves significant improvements in reasoning quality, output precision, and code executability.
  arXiv  Detail & Related papers  (2025-08-13T18:30:49Z)
• CReFT-CAD: Boosting Orthographic Projection Reasoning for CAD via Reinforcement Fine-Tuning [31.342222156939403]
  We introduce CReFT-CAD, a two-stage fine-tuning paradigm that first employs a curriculum-driven reinforcement learning stage with difficulty-aware rewards to build reasoning ability steadily.<n>We release TriView2CAD, the first large-scale, open-source benchmark for orthographic projection reasoning.
  arXiv  Detail & Related papers  (2025-05-31T13:52:56Z)
• CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images [69.7768227804928]
  CADCrafter is an image-to-parametric CAD model generation framework that trains solely on synthetic textureless CAD data.<n>We introduce a geometry encoder to accurately capture diverse geometric features.<n>Our approach can robustly handle real unconstrained CAD images, and even generalize to unseen general objects.
  arXiv  Detail & Related papers  (2025-04-07T06:01:35Z)
• Text2CAD: Text to 3D CAD Generation via Technical Drawings [45.3611544056261]
  Text2CAD is a novel framework that employs stable diffusion models tailored to automate the generation process. We show that Text2CAD effectively generates technical drawings that are accurately translated into high-quality 3D CAD models.
  arXiv  Detail & Related papers  (2024-11-09T15:12:06Z)
• PS-CAD: Local Geometry Guidance via Prompting and Selection for CAD Reconstruction [86.726941702182]
  We introduce geometric guidance into the reconstruction network PS-CAD. We provide the geometry of surfaces where the current reconstruction differs from the complete model as a point cloud. Second, we use geometric analysis to extract a set of planar prompts, that correspond to candidate surfaces.
  arXiv  Detail & Related papers  (2024-05-24T03:43:55Z)
• AutoCAD: Automatically Generating Counterfactuals for Mitigating Shortcut Learning [70.70393006697383]
  We present AutoCAD, a fully automatic and task-agnostic CAD generation framework. In this paper, we present AutoCAD, a fully automatic and task-agnostic CAD generation framework.
  arXiv  Detail & Related papers  (2022-11-29T13:39:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.