Text-to-CAD Retrieval: a Strong Baseline

• URL: http://arxiv.org/abs/2605.05572v1
• Date: Thu, 07 May 2026 01:35:42 GMT
• Title: Text-to-CAD Retrieval: a Strong Baseline
• Abstract summary: We introduce text-to-CAD retrieval as a new cross-modal retrieval task.<n>We retrieve semantically relevant CAD models from large-scale databases given natural language queries.<n>We propose a unified framework that learns multi-modal CAD embeddings from both procedural sequences and geometric point clouds.
• Score: 8.457991818222395
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Text-based retrieval of Computer-Aided Design (CAD) models is a critical yet underexplored task for the reuse of legacy industrial designs. Existing CAD repositories are typically searched using filenames or directories, which limits the efficiency, scalability, and accuracy of design retrieval. In this paper, we formally introduce text-to-CAD retrieval as a new cross-modal retrieval task, aiming to retrieve semantically relevant CAD models from large-scale databases given natural language queries. Leveraging paired text-CAD annotations from the Text2CAD dataset, we establish a practical benchmark for this task. To achieve text-based retrieval, we propose a unified framework that learns multi-modal CAD embeddings from both procedural sequences and geometric point clouds. Specifically, a sequence encoder captures the construction logic of CAD models, while a point encoder extracts explicit geometric features. A text encoder is used to learn semantic representations of textual queries. During training, we introduce a novel feature decoder that reconstructs masked sequence features via cross-attention with text and point features, encouraging implicit multi-modal alignment. At inference time, we remove this auxiliary decoder to enable efficient retrieval using concatenated sequence-point features. Our framework serves as a strong baseline for text-to-CAD retrieval and lays the foundation for downstream CAD generation paradigms, such as retrieval-augmented generation. The source code will be released.

Related papers

• Code as Representation: A Compilable Parsing Paradigm for Academic Documents [50.40789738182074]
  Compilable Academic Document Parsing (CADP) is a paradigm that reconstructs a full page as contextual La plus executable Python.<n>We introduce CADP-Bench, an expert-verified benchmark of full academic pages containing text and multiple SAE types.<n>Results show that even frontier models still struggle to produce high-fidelity executable reconstructions.
  arXiv  Detail & Related papers  (2026-08-18T09:10:43Z)
• CADFS: A Big CAD Program Dataset and Framework for Computer-Aided Design with Large Language Models [80.47087401394882]
  We introduce CADFS, a data-centric framework that enables large vision-language models to generate complex CAD design histories.<n>We construct a dataset of 450k real-world CAD models spanning 15 modeling operations.<n>Fine-tuning a VLM on this representation yields state-of-the-art results in text-conditioned CAD generation and image-based reconstruction.
  arXiv  Detail & Related papers  (2026-05-03T15:12:36Z)
• Zero-to-CAD: Agentic Synthesis of Interpretable CAD Programs at Million-Scale Without Real Data [8.896486786253766]
  We introduce Zero-to-CAD, a scalable framework for executable CAD construction sequences.<n>We frame synthesis as an agentic search problem: by embedding a large language model within a feedback-driven CAD environment, our system iteratively generates, executes, and validates code.<n>This agentic approach enables the synthesis of approximately one million executable, readable, editable CAD sequences.
  arXiv  Detail & Related papers  (2026-04-27T13:46:41Z)
• DreamCAD: Scaling Multi-modal CAD Generation using Differentiable Parametric Surfaces [67.45867367326105]
  We propose DreamCAD, a multi-modal generative framework that directly produces editable BReps from point-level supervision.<n>DreamCAD represents each BRep as a set of parametric patches and uses a differentiable tessellation method to generate meshes.<n>DreamCAD achieves state-of-the-art performance on ABC and averse benchmarks across text, image, and point modalities.
  arXiv  Detail & Related papers  (2026-03-05T19:04:07Z)
• When Text-as-Vision Meets Semantic IDs in Generative Recommendation: An Empirical Study [48.67151986743594]
  We revisit representation design for Semantic ID learning by treating text as a visual signal.<n>We conduct a systematic empirical study of OCR-based text representations, obtained by rendering item descriptions into images.<n>We find that OCR-text consistently matches or surpasses standard text embeddings for Semantic ID learning in both unimodal and multimodal settings.
  arXiv  Detail & Related papers  (2026-01-21T06:18:57Z)
• CADKnitter: Compositional CAD Generation from Text and Geometry Guidance [8.644079160190175]
  We propose CADKnitter, a compositional CAD generation framework with a geometry-guided diffusion sampling strategy.<n>CADKnitter is able to generate a complementary CAD part that follows both the geometric constraints of the given CAD model and the semantic constraints of the desired design text prompt.<n>We also curate a dataset, so-called KnitCAD, containing over 310,000 samples of CAD models, along with textual prompts and assembly metadata.
  arXiv  Detail & Related papers  (2025-12-12T01:06:38Z)
• CAD-Tokenizer: Towards Text-based CAD Prototyping via Modality-Specific Tokenization [16.26305802216836]
  CAD-Tokenizer represents CAD data with modality-specific tokens using a sequence-based VQ-VAE with primitive-level pooling and constrained decoding.<n>This design produces compact, primitive-aware representations that align with CAD's structural nature.
  arXiv  Detail & Related papers  (2025-09-25T13:38:36Z)
• CADmium: Fine-Tuning Code Language Models for Text-Driven Sequential CAD Design [14.874524630759332]
  We introduce a new large-scale pipeline of more than 170k CAD models annotated with human-like descriptions.<n>Our experiments and ablation studies on both synthetic and human-annotated data demonstrate that CADmium is able to automate CAD design.
  arXiv  Detail & Related papers  (2025-07-13T21:11:53Z)
• CADCrafter: Generating Computer-Aided Design Models from Unconstrained Images [69.7768227804928]
  CADCrafter is an image-to-parametric CAD model generation framework that trains solely on synthetic textureless CAD data.<n>We introduce a geometry encoder to accurately capture diverse geometric features.<n>Our approach can robustly handle real unconstrained CAD images, and even generalize to unseen general objects.
  arXiv  Detail & Related papers  (2025-04-07T06:01:35Z)
• Towards Text-Image Interleaved Retrieval [49.96332254241075]
  We introduce the text-image interleaved retrieval (TIIR) task, where the query and document are interleaved text-image sequences.<n>We construct a TIIR benchmark based on naturally interleaved wikiHow tutorials, where a specific pipeline is designed to generate interleaved queries.<n>We propose a novel Matryoshka Multimodal Embedder (MME), which compresses the number of visual tokens at different granularity.
  arXiv  Detail & Related papers  (2025-02-18T12:00:47Z)
• CAD-Editor: A Locate-then-Infill Framework with Automated Training Data Synthesis for Text-Based CAD Editing [12.277838798842689]
  We introduce emphCAD-Editor, the first framework for text-based CAD editing.<n>To tackle the composite nature of text-based CAD editing, we propose a locate-then-infill framework.<n> Experiments show that CAD-Editor achieves superior performance both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2025-02-06T11:57:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.