Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generation
- URL: http://arxiv.org/abs/2605.18430v1
- Date: Mon, 18 May 2026 14:03:41 GMT
- Title: Text2CAD-Bench: A Benchmark for LLM-based Text-to-Parametric CAD Generation
- Abstract summary: We introduce Text2CAD-Bench, the first benchmark systematically evaluating text-to-CAD across geometric complexity and application diversity.<n>Our benchmark comprises 600 human-curated examples spanning four levels: L1-L2 cover fundamental geometry with standard features, L3 introduces complex topology and freeform surfaces, and L4 extends to real-world domains beyond mechanical parts.
- Score: 17.331508993372257
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Text-to-CAD generation aims to create parametric CAD models from natural language, enabling rapid prototyping and intuitive design workflows. However, existing benchmarks focus on basic primitives and simple sketch-extrude sequences, lacking advanced features essential for real-world applications and covering only traditional mechanical parts. We introduce Text2CAD-Bench, the first benchmark systematically evaluating text-to-CAD across geometric complexity and application diversity. Our benchmark comprises 600 human-curated examples spanning four levels: L1-L2 cover fundamental geometry with standard features, L3 introduces complex topology and freeform surfaces, and L4 extends to real-world domains beyond mechanical parts. Each example pairs dual-style prompts -- geometric descriptions mimicking non-expert users, and procedural sequences aligned with expert-level conventions. Evaluating mainstream general LLMs and domain-specific models, we find that current models perform reasonably on basic geometry but degrade substantially on complex topology and advanced features. We release our benchmark to drive progress in text-to-CAD research.
Related papers
- MUSE: Benchmarking Manufacturable, Functional, and Assemblable Text-to-CAD Generation [17.467056775887944]
MUSE is a Text-to-CAD benchmark focused on complex, editable boundary representation assemblies.<n>MUSE evaluates generated models through a three-stage protocol: code check, geometric check, and design-intent alignment.<n> Experiments on closed-source and open-source LLMs reveal a clear failure cascade from executable code to valid geometry.
arXiv Detail & Related papers (2026-05-27T15:01:59Z) - Dual-Pathway Geometry-Aware MLLM for Spatial Intelligence [63.11502936651325]
We propose GAMSI, a dual-pathway Geometry-Aware MLLM for Spatial Intelligence.<n>It takes only RGB images as input while internalizing both forms of geometric prior within a unified autoregressive backbone.<n>GAMSI achieves state-of-the-art performance on seven spatial intelligence benchmarks.
arXiv Detail & Related papers (2026-05-25T01:33:19Z) - CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models [80.47087401394882]
We introduce CADFS, a data-centric framework that enables large vision-language models to generate complex CAD design histories.<n>We construct a dataset of 450k real-world CAD models spanning 15 modeling operations.<n>Fine-tuning a VLM on this representation yields state-of-the-art results in text-conditioned CAD generation and image-based reconstruction.
arXiv Detail & Related papers (2026-05-03T15:12:36Z) - Towards High-Fidelity CAD Generation via LLM-Driven Program Generation and Text-Based B-Rep Primitive Grounding [18.983809090879348]
We present FutureCAD, a novel text-to-CAD framework for high-fidelity CAD generation.<n>Our method generates executable CadQuery scripts, and introduces a text-based query mechanism.<n>Experiments show that FutureCADGround achieves state-of-the-art CAD generation performance.
arXiv Detail & Related papers (2026-03-12T11:54:29Z) - CAD-Tokenizer: Towards Text-based CAD Prototyping via Modality-Specific Tokenization [16.26305802216836]
CAD-Tokenizer represents CAD data with modality-specific tokens using a sequence-based VQ-VAE with primitive-level pooling and constrained decoding.<n>This design produces compact, primitive-aware representations that align with CAD's structural nature.
arXiv Detail & Related papers (2025-09-25T13:38:36Z) - Human-in-the-Loop: Quantitative Evaluation of 3D Models Generation by Large Language Models [0.0]
This paper introduces a human in the loop framework for the quantitative evaluation of Large Language Models generated 3D models.<n>We propose a comprehensive suite of similarity and complexity metrics, including volumetric accuracy, surface alignment, dimensional fidelity, and topological intricacy.<n>Our findings demonstrate improved generation fidelity with increased semantic richness, with code level prompts achieving perfect reconstruction.
arXiv Detail & Related papers (2025-09-06T11:04:15Z) - SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting [85.87902260102652]
We introduce the novel task of Sequential 3D Gaussian Affordance Reasoning.<n>We then propose SeqSplatNet, an end-to-end framework that directly maps an instruction to a sequence of 3D affordance masks.<n>Our method sets a new state-of-the-art on our challenging benchmark, effectively advancing affordance reasoning from single-step interactions to complex, sequential tasks at the scene level.
arXiv Detail & Related papers (2025-07-31T17:56:55Z) - cadrille: Multi-modal CAD Reconstruction with Online Reinforcement Learning [55.16668009268005]
We propose a multi-modal CAD reconstruction model that simultaneously processes all three input modalities.<n>Inspired by large language model (LLM) training paradigms, we adopt a two-stage pipeline: supervised fine-tuning (SFT) on large-scale procedurally generated data, followed by reinforcement learning (RL) fine-tuning using online feedback, obtained programatically.<n>In the DeepCAD benchmark, our SFT model outperforms existing single-modal approaches in all three input modalities simultaneously.
arXiv Detail & Related papers (2025-05-28T22:32:31Z) - CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images [69.7768227804928]
CADCrafter is an image-to-parametric CAD model generation framework that trains solely on synthetic textureless CAD data.<n>We introduce a geometry encoder to accurately capture diverse geometric features.<n>Our approach can robustly handle real unconstrained CAD images, and even generalize to unseen general objects.
arXiv Detail & Related papers (2025-04-07T06:01:35Z) - PHT-CAD: Efficient CAD Parametric Primitive Analysis with Progressive Hierarchical Tuning [52.681829043446044]
ParaCAD comprises over 10 million annotated drawings for training and 3,000 real-world industrial drawings with complex topological structures and physical constraints for test.<n> PHT-CAD is a novel 2D PPA framework that harnesses the modality alignment and reasoning capabilities of Vision-Language Models.
arXiv Detail & Related papers (2025-03-23T17:24:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.