Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modelling

• URL: http://arxiv.org/abs/2508.00843v1
• Date: Sat, 05 Jul 2025 23:30:17 GMT
• Title: Generative AI for CAD Automation: Leveraging Large Language Models for 3D Modelling
• Authors: Sumit Kumar, Sarthak Kapoor, Harsh Vardhan, Yao Zhao,
• Abstract summary: Large Language Models (LLMs) are revolutionizing industries by enhancing efficiency, scalability, and innovation.<n>This paper investigates the potential of LLMs in automating Computer-Aided Design (CAD) by integrating FreeCAD with LLM as CAD design tool.<n>We propose a framework where LLMs generate initial CAD scripts from natural language descriptions, which are then executed and refined iteratively based on error feedback.
• Score: 31.94035963354055
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large Language Models (LLMs) are revolutionizing industries by enhancing efficiency, scalability, and innovation. This paper investigates the potential of LLMs in automating Computer-Aided Design (CAD) workflows, by integrating FreeCAD with LLM as CAD design tool. Traditional CAD processes are often complex and require specialized sketching skills, posing challenges for rapid prototyping and generative design. We propose a framework where LLMs generate initial CAD scripts from natural language descriptions, which are then executed and refined iteratively based on error feedback. Through a series of experiments with increasing complexity, we assess the effectiveness of this approach. Our findings reveal that LLMs perform well for simple to moderately complex designs but struggle with highly constrained models, necessitating multiple refinements. The study highlights the need for improved memory retrieval, adaptive prompt engineering, and hybrid AI techniques to enhance script robustness. Future directions include integrating cloud-based execution and exploring advanced LLM capabilities to further streamline CAD automation. This work underscores the transformative potential of LLMs in design workflows while identifying critical areas for future development.

Related papers

• From Intent to Execution: Multimodal Chain-of-Thought Reinforcement Learning for Precise CAD Code Generation [47.67703214044401]
  We propose CAD-RL, a multimodal Chain-of-Thought guided reinforcement learning framework for CAD modeling code generation.<n>Our method combines Cold Start with goal-driven reinforcement learning post training using three task-specific rewards.<n>Experiments demonstrate that CAD-RL achieves significant improvements in reasoning quality, output precision, and code executability.
  arXiv  Detail & Related papers  (2025-08-13T18:30:49Z)
• Speed Always Wins: A Survey on Efficient Architectures for Large Language Models [51.817121227562964]
  Large Language Models (LLMs) have delivered impressive results in language understanding, generation, reasoning, and pushes the ability boundary of multimodal models.<n> Transformer models, as the foundation of modern LLMs, offer a strong baseline with excellent scaling properties.<n>The traditional transformer architecture requires substantial computations and poses significant obstacles for large-scale training and practical deployment.
  arXiv  Detail & Related papers  (2025-08-13T14:13:46Z)
• CAD-Judge: Toward Efficient Morphological Grading and Verification for Text-to-CAD Generation [7.802597811923231]
  CAD-Judge is a novel, verifiable reward system for efficient and effective CAD preference grading and grammatical validation.<n>We introduce a simple yet effective agentic CAD generation approach and adopt the Compiler-as-a-Review Module.
  arXiv  Detail & Related papers  (2025-08-06T01:30:56Z)
• CReFT-CAD: Boosting Orthographic Projection Reasoning for CAD via Reinforcement Fine-Tuning [50.867869718716555]
  We introduce CReFT-CAD, a two-stage fine-tuning paradigm that first employs a curriculum-driven reinforcement learning stage with difficulty-aware rewards to build reasoning ability steadily.<n>We release TriView2CAD, the first large-scale, open-source benchmark for orthographic projection reasoning.
  arXiv  Detail & Related papers  (2025-05-31T13:52:56Z)
• cadrille: Multi-modal CAD Reconstruction with Online Reinforcement Learning [55.16668009268005]
  We propose a multi-modal CAD reconstruction model that simultaneously processes all three input modalities.<n>Inspired by large language model (LLM) training paradigms, we adopt a two-stage pipeline: supervised fine-tuning (SFT) on large-scale procedurally generated data, followed by reinforcement learning (RL) fine-tuning using online feedback, obtained programatically.<n>In the DeepCAD benchmark, our SFT model outperforms existing single-modal approaches in all three input modalities simultaneously.
  arXiv  Detail & Related papers  (2025-05-28T22:32:31Z)
• Automated CAD Modeling Sequence Generation from Text Descriptions via Transformer-Based Large Language Models [12.748800287967848]
  We propose a novel framework for industrial design automation, integrating large language models (LLMs) with computer-aided design (CAutoD)<n>Our approach introduces three key innovations: (1) a semi-automated data pipeline that leverages LLMs and vision-language large models (VLLMs) to generate high-quality parameters and appearance descriptions; (2) a Transformer-based CAD generator (TCADGen) that predicts modeling sequences via dual-channel feature aggregation; and (3) an enhanced CAD modeling generation model, called CADLLM, that is designed to refine the generated sequences.
  arXiv  Detail & Related papers  (2025-05-26T04:17:51Z)
• Large Language Models for Computer-Aided Design: A Survey [33.35688559256746]
  Large Language Models (LLMs) have seen rapid advancements in recent years.<n>As complexity of modern designs increases, the potential for LLMs to enhance and streamline Computer-Aided Design (CAD) presents an exciting frontier.<n>This article presents the first systematic survey exploring the intersection of LLMs and CAD.
  arXiv  Detail & Related papers  (2025-05-13T00:19:04Z)
• A Solver-Aided Hierarchical Language for LLM-Driven CAD Design [18.258735692299066]
  Large language models (LLMs) have been enormously successful in solving a wide variety of structured and unstructured generative tasks.<n>They struggle to generate procedural geometry in Computer Aided Design (CAD)<n>We introduce a solver-aided, hierarchical domain specific language called AIDL, which offloads the spatial reasoning requirements to a geometric constraint solver.
  arXiv  Detail & Related papers  (2025-02-13T23:31:30Z)
• BlenderLLM: Training Large Language Models for Computer-Aided Design with Self-improvement [45.19076032719869]
  We present BlenderLLM, a framework for training Large Language Models (LLMs) in Computer-Aided Design (CAD)<n>Our results reveal that existing models demonstrate significant limitations in generating accurate CAD scripts.<n>Through minimal instruction-based fine-tuning and iterative self-improvement, BlenderLLM significantly surpasses these models in both functionality and accuracy of CAD script generation.
  arXiv  Detail & Related papers  (2024-12-16T14:34:02Z)
• SynerGen-VL: Towards Synergistic Image Understanding and Generation with Vision Experts and Token Folding [66.74446220401296]
  We propose SynerGen-VL, a simple yet powerful encoder-free MLLM capable of both image understanding and generation.<n>We introduce the token folding mechanism and the vision-expert-based progressive alignment pretraining strategy, which effectively support high-resolution image understanding.<n>Our code and models shall be released.
  arXiv  Detail & Related papers  (2024-12-12T18:59:26Z)
• Geometric Deep Learning for Computer-Aided Design: A Survey [76.3325417461511]
  Geometric Deep Learning techniques have become a transformative force in the field of Computer-Aided Design.<n>The ability to process the CAD designs represented by geometric data and to analyze their encoded features enables the identification of similarities.<n>This survey offers a comprehensive overview of learning-based methods in computer-aided design across various categories.
  arXiv  Detail & Related papers  (2024-02-27T17:11:35Z)
• LLM4EDA: Emerging Progress in Large Language Models for Electronic Design Automation [74.7163199054881]
  Large Language Models (LLMs) have demonstrated their capability in context understanding, logic reasoning and answer generation. We present a systematic study on the application of LLMs in the EDA field. We highlight the future research direction, focusing on applying LLMs in logic synthesis, physical design, multi-modal feature extraction and alignment of circuits.
  arXiv  Detail & Related papers  (2023-12-28T15:09:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.