Generative Structural Design Integrating BIM and Diffusion Model
- URL: http://arxiv.org/abs/2311.04052v1
- Date: Tue, 7 Nov 2023 15:05:19 GMT
- Title: Generative Structural Design Integrating BIM and Diffusion Model
- Authors: Zhili He, Yu-Hsing Wang, Jian Zhang
- Abstract summary: This study introduces building information modeling ( BIM) into intelligent structural design and establishes a structural design pipeline integrating BIM and generative AI.
In terms of generation framework, inspired by the process of human drawing, a novel 2-stage generation framework is proposed to reduce the generation difficulty for AI models.
In terms of generative AI tools adopted, diffusion models (DMs) are introduced to replace widely used generative adversarial network (GAN)-based models, and a novel physics-based conditional diffusion model (PCDM) is proposed to consider different design prerequisites.
- Score: 4.619347136761891
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Intelligent structural design using AI can effectively reduce time overhead
and increase efficiency. It has potential to become the new design paradigm in
the future to assist and even replace engineers, and so it has become a
research hotspot in the academic community. However, current methods have some
limitations to be addressed, whether in terms of application scope, visual
quality of generated results, or evaluation metrics of results. This study
proposes a comprehensive solution. Firstly, we introduce building information
modeling (BIM) into intelligent structural design and establishes a structural
design pipeline integrating BIM and generative AI, which is a powerful
supplement to the previous frameworks that only considered CAD drawings. In
order to improve the perceptual quality and details of generations, this study
makes 3 contributions. Firstly, in terms of generation framework, inspired by
the process of human drawing, a novel 2-stage generation framework is proposed
to replace the traditional end-to-end framework to reduce the generation
difficulty for AI models. Secondly, in terms of generative AI tools adopted,
diffusion models (DMs) are introduced to replace widely used generative
adversarial network (GAN)-based models, and a novel physics-based conditional
diffusion model (PCDM) is proposed to consider different design prerequisites.
Thirdly, in terms of neural networks, an attention block (AB) consisting of a
self-attention block (SAB) and a parallel cross-attention block (PCAB) is
designed to facilitate cross-domain data fusion. The quantitative and
qualitative results demonstrate the powerful generation and representation
capabilities of PCDM. Necessary ablation studies are conducted to examine the
validity of the methods. This study also shows that DMs have the potential to
replace GANs and become the new benchmark for generative problems in civil
engineering.
Related papers
- Generative AI Agent for Next-Generation MIMO Design: Fundamentals, Challenges, and Vision [76.4345564864002]
Next-generation multiple input multiple output (MIMO) is expected to be intelligent and scalable.
We propose the concept of the generative AI agent, which is capable of generating tailored and specialized contents.
We present two compelling case studies that demonstrate the effectiveness of leveraging the generative AI agent for performance analysis.
arXiv Detail & Related papers (2024-04-13T02:39:36Z) - Visual Prompting Upgrades Neural Network Sparsification: A Data-Model
Perspective [67.25782152459851]
We introduce a novel data-model co-design perspective: to promote superior weight sparsity.
Specifically, customized Visual Prompts are mounted to upgrade neural Network sparsification in our proposed VPNs framework.
arXiv Detail & Related papers (2023-12-03T13:50:24Z) - Human as Points: Explicit Point-based 3D Human Reconstruction from
Single-view RGB Images [78.56114271538061]
We introduce an explicit point-based human reconstruction framework called HaP.
Our approach is featured by fully-explicit point cloud estimation, manipulation, generation, and refinement in the 3D geometric space.
Our results may indicate a paradigm rollback to the fully-explicit and geometry-centric algorithm design.
arXiv Detail & Related papers (2023-11-06T05:52:29Z) - A Systematic Survey in Geometric Deep Learning for Structure-based Drug
Design [63.30166298698985]
Structure-based drug design (SBDD) utilizes the three-dimensional geometry of proteins to identify potential drug candidates.
Recent developments in geometric deep learning, focusing on the integration and processing of 3D geometric data, have greatly advanced the field of structure-based drug design.
arXiv Detail & Related papers (2023-06-20T14:21:58Z) - DA-VEGAN: Differentiably Augmenting VAE-GAN for microstructure
reconstruction from extremely small data sets [110.60233593474796]
DA-VEGAN is a model with two central innovations.
A $beta$-variational autoencoder is incorporated into a hybrid GAN architecture.
A custom differentiable data augmentation scheme is developed specifically for this architecture.
arXiv Detail & Related papers (2023-02-17T08:49:09Z) - Robust Graph Representation Learning via Predictive Coding [46.22695915912123]
Predictive coding is a message-passing framework initially developed to model information processing in the brain.
In this work, we build models that rely on the message-passing rule of predictive coding.
We show that the proposed models are comparable to standard ones in terms of performance in both inductive and transductive tasks.
arXiv Detail & Related papers (2022-12-09T03:58:22Z) - 3D pride without 2D prejudice: Bias-controlled multi-level generative
models for structure-based ligand design [1.978587235008588]
Data sparsity and bias are two main roadblocks to the development of 3D-aware models.
We propose a first-in-kind training protocol based on multi-level contrastive learning for improved bias control and data efficiency.
arXiv Detail & Related papers (2022-04-22T12:23:59Z) - Generative Pre-Trained Transformers for Biologically Inspired Design [13.852758740799452]
This paper proposes a generative design approach based on the pre-trained language model (PLM)
Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation.
The approach is then tested via a case study in which the fine-tuned models are applied to generate and evaluate light-weighted flying car concepts inspired by nature.
arXiv Detail & Related papers (2022-03-31T11:13:22Z) - An Intelligent End-to-End Neural Architecture Search Framework for Electricity Forecasting Model Development [4.940941112226529]
We propose an intelligent automated architecture search (IAAS) framework for the development of time-series electricity forecasting models.
The proposed framework contains three primary components, i.e., network function-preserving transformation operation, reinforcement learning (RL)-based network transformation control, and network screening.
We demonstrate that the proposed IAAS framework significantly outperforms the ten existing models or methods in terms of forecasting accuracy and stability.
arXiv Detail & Related papers (2022-03-25T10:36:27Z) - Dynamically Grown Generative Adversarial Networks [111.43128389995341]
We propose a method to dynamically grow a GAN during training, optimizing the network architecture and its parameters together with automation.
The method embeds architecture search techniques as an interleaving step with gradient-based training to periodically seek the optimal architecture-growing strategy for the generator and discriminator.
arXiv Detail & Related papers (2021-06-16T01:25:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.