Hierarchical Neural Coding for Controllable CAD Model Generation

• URL: http://arxiv.org/abs/2307.00149v1
• Date: Fri, 30 Jun 2023 21:49:41 GMT
• Title: Hierarchical Neural Coding for Controllable CAD Model Generation
• Authors: Xiang Xu, Pradeep Kumar Jayaraman, Joseph G. Lambourne, Karl D.D. Willis, Yasutaka Furukawa
• Abstract summary: This paper presents a novel generative model for Computer Aided Design (CAD) It represents high-level design concepts of a CAD model as a three-level hierarchical tree of neural codes. It controls the generation or completion of CAD models by specifying the target design using a code tree.
• Score: 34.14256897199849
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper presents a novel generative model for Computer Aided Design (CAD) that 1) represents high-level design concepts of a CAD model as a three-level hierarchical tree of neural codes, from global part arrangement down to local curve geometry; and 2) controls the generation or completion of CAD models by specifying the target design using a code tree. Concretely, a novel variant of a vector quantized VAE with "masked skip connection" extracts design variations as neural codebooks at three levels. Two-stage cascaded auto-regressive transformers learn to generate code trees from incomplete CAD models and then complete CAD models following the intended design. Extensive experiments demonstrate superior performance on conventional tasks such as random generation while enabling novel interaction capabilities on conditional generation tasks. The code is available at https://github.com/samxuxiang/hnc-cad.

Related papers

• LaGeM: A Large Geometry Model for 3D Representation Learning and Diffusion [46.76882780184126]
  This paper introduces a novel hierarchical autoencoder that maps 3D models into a compressed latent space. We show that the model can be used to represent a wide range of 3D models while faithfully representing high-resolution geometry details.
  arXiv  Detail & Related papers  (2024-10-02T07:42:20Z)
• CAD-SIGNet: CAD Language Inference from Point Clouds using Layer-wise Sketch Instance Guided Attention [13.227571488321358]
  We propose an end-to-end trainable and auto-regressive architecture to recover the design history of a CAD model. Our model learns visual-language representations by layer-wise cross-attention between point cloud and CAD language embedding. Thanks to its auto-regressive nature, CAD-SIGNet not only reconstructs a unique full design history of the corresponding CAD model given an input point cloud but also provides multiple plausible design choices.
  arXiv  Detail & Related papers  (2024-02-27T16:53:16Z)
• Pushing Auto-regressive Models for 3D Shape Generation at Capacity and Scalability [118.26563926533517]
  Auto-regressive models have achieved impressive results in 2D image generation by modeling joint distributions in grid space. We extend auto-regressive models to 3D domains, and seek a stronger ability of 3D shape generation by improving auto-regressive models at capacity and scalability simultaneously.
  arXiv  Detail & Related papers  (2024-02-19T15:33:09Z)
• A Generative Neural Network Approach for 3D Multi-Criteria Design Generation and Optimization of an Engine Mount for an Unmanned Air Vehicle [2.0700747055024284]
  We train a neural network to learn dependencies between functionalities and a geometry in a very effective way. In this paper, we address a multi-criteria challenge for a 3D design use case related to an unmanned aerial vehicle (UAV) motor mount. We demonstrate the ability to generate optimized designs under self-defined functionality conditions using the trained neural network.
  arXiv  Detail & Related papers  (2023-11-06T09:33:56Z)
• Learning Versatile 3D Shape Generation with Improved AR Models [91.87115744375052]
  Auto-regressive (AR) models have achieved impressive results in 2D image generation by modeling joint distributions in the grid space. We propose the Improved Auto-regressive Model (ImAM) for 3D shape generation, which applies discrete representation learning based on a latent vector instead of volumetric grids.
  arXiv  Detail & Related papers  (2023-03-26T12:03:18Z)
• SECAD-Net: Self-Supervised CAD Reconstruction by Learning Sketch-Extrude Operations [21.000539206470897]
  SECAD-Net is an end-to-end neural network aimed at reconstructing compact and easy-to-edit CAD models. We show superiority over state-of-the-art alternatives including the closely related method for supervised CAD reconstruction.
  arXiv  Detail & Related papers  (2023-03-19T09:26:03Z)
• AutoCAD: Automatically Generating Counterfactuals for Mitigating Shortcut Learning [70.70393006697383]
  We present AutoCAD, a fully automatic and task-agnostic CAD generation framework. In this paper, we present AutoCAD, a fully automatic and task-agnostic CAD generation framework.
  arXiv  Detail & Related papers  (2022-11-29T13:39:53Z)
• SkexGen: Autoregressive Generation of CAD Construction Sequences with Disentangled Codebooks [37.33746656109331]
  We present SkexGen, a novel autoregressive generative model for computer-aided design (CAD) construction sequences. Autoregressive Transformer decoders generate CAD construction sequences sharing certain properties specified by the codebook vectors.
  arXiv  Detail & Related papers  (2022-07-11T05:10:51Z)
• DeepCAD: A Deep Generative Network for Computer-Aided Design Models [37.655225142981564]
  We present the first 3D generative model for a drastically different shape representation -- describing a shape as a sequence of computer-aided design (CAD) operations. Drawing an analogy between CAD operations and natural language, we propose a CAD generative network based on the Transformer.
  arXiv  Detail & Related papers  (2021-05-20T03:29:18Z)
• PT2PC: Learning to Generate 3D Point Cloud Shapes from Part Tree Conditions [66.87405921626004]
  This paper investigates the novel problem of generating 3D shape point cloud geometry from a symbolic part tree representation. We propose a conditional GAN "part tree"-to-"point cloud" model (PT2PC) that disentangles the structural and geometric factors.
  arXiv  Detail & Related papers  (2020-03-19T08:27:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.