Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers

• URL: http://arxiv.org/abs/2212.13196v1
• Date: Mon, 26 Dec 2022 16:06:04 GMT
• Title: Biologically Inspired Design Concept Generation Using Generative Pre-Trained Transformers
• Authors: Qihao Zhu, Xinyu Zhang, Jianxi Luo
• Abstract summary: This paper proposes a generative design approach based on the generative pre-trained language model (PLM) Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. The approach is evaluated and then employed in a real-world project of designing light-weighted flying cars.
• Score: 13.852758740799452
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Biological systems in nature have evolved for millions of years to adapt and survive the environment. Many features they developed can be inspirational and beneficial for solving technical problems in modern industries. This leads to a specific form of design-by-analogy called bio-inspired design (BID). Although BID as a design method has been proven beneficial, the gap between biology and engineering continuously hinders designers from effectively applying the method. Therefore, we explore the recent advance of artificial intelligence (AI) for a data-driven approach to bridge the gap. This paper proposes a generative design approach based on the generative pre-trained language model (PLM) to automatically retrieve and map biological analogy and generate BID in the form of natural language. The latest generative pre-trained transformer, namely GPT-3, is used as the base PLM. Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. Machine evaluators are also fine-tuned to assess the mapping relevancy between the domains within the generated BID concepts. The approach is evaluated and then employed in a real-world project of designing light-weighted flying cars during its conceptual design phase The results show our approach can generate BID concepts with good performance.

Related papers

• Cliqueformer: Model-Based Optimization with Structured Transformers [102.55764949282906]
  We develop a model that learns the structure of an MBO task and empirically leads to improved designs. We evaluate Cliqueformer on various tasks, ranging from high-dimensional black-box functions to real-world tasks of chemical and genetic design.
  arXiv  Detail & Related papers  (2024-10-17T00:35:47Z)
• Generative Structural Design Integrating BIM and Diffusion Model [4.619347136761891]
  This study introduces building information modeling ( BIM) into intelligent structural design and establishes a structural design pipeline integrating BIM and generative AI. In terms of generation framework, inspired by the process of human drawing, a novel 2-stage generation framework is proposed to reduce the generation difficulty for AI models. In terms of generative AI tools adopted, diffusion models (DMs) are introduced to replace widely used generative adversarial network (GAN)-based models, and a novel physics-based conditional diffusion model (PCDM) is proposed to consider different design prerequisites.
  arXiv  Detail & Related papers  (2023-11-07T15:05:19Z)
• Learning Transferable Conceptual Prototypes for Interpretable Unsupervised Domain Adaptation [79.22678026708134]
  In this paper, we propose an inherently interpretable method, named Transferable Prototype Learning ( TCPL) To achieve this goal, we design a hierarchically prototypical module that transfers categorical basic concepts from the source domain to the target domain and learns domain-shared prototypes for explaining the underlying reasoning process. Comprehensive experiments show that the proposed method can not only provide effective and intuitive explanations but also outperform previous state-of-the-arts.
  arXiv  Detail & Related papers  (2023-10-12T06:36:41Z)
• A Systematic Survey in Geometric Deep Learning for Structure-based Drug Design [63.30166298698985]
  Structure-based drug design (SBDD) utilizes the three-dimensional geometry of proteins to identify potential drug candidates. Recent developments in geometric deep learning, focusing on the integration and processing of 3D geometric data, have greatly advanced the field of structure-based drug design.
  arXiv  Detail & Related papers  (2023-06-20T14:21:58Z)
• Design Space Exploration and Explanation via Conditional Variational Autoencoders in Meta-model-based Conceptual Design of Pedestrian Bridges [52.77024349608834]
  This paper provides a performance-driven design exploration framework to augment the human designer through a Conditional Variational Autoencoder (CVAE) The CVAE is trained on 18'000 synthetically generated instances of a pedestrian bridge in Switzerland.
  arXiv  Detail & Related papers  (2022-11-29T17:28:31Z)
• Generative Transformers for Design Concept Generation [7.807713821263175]
  This study explores the recent advance of the natural language generation (NLG) technique in the artificial intelligence (AI) field. A novel approach utilizing the generative pre-trained transformer (GPT) is proposed to leverage the knowledge and reasoning from textual data. Three concept generation tasks are defined to leverage different knowledge and reasoning: domain knowledge synthesis, problem-driven synthesis, and analogy-driven synthesis.
  arXiv  Detail & Related papers  (2022-11-07T11:29:10Z)
• Generative Pre-Trained Transformers for Biologically Inspired Design [13.852758740799452]
  This paper proposes a generative design approach based on the pre-trained language model (PLM) Three types of design concept generators are identified and fine-tuned from the PLM according to the looseness of the problem space representation. The approach is then tested via a case study in which the fine-tuned models are applied to generate and evaluate light-weighted flying car concepts inspired by nature.
  arXiv  Detail & Related papers  (2022-03-31T11:13:22Z)
• Generative Design Ideation: A Natural Language Generation Approach [7.807713821263175]
  This paper aims to explore a generative approach for knowledge-based design ideation by applying the latest pre-trained language models in artificial intelligence (AI) The AI-generated ideas are not only in concise and understandable language but also able to synthesize the target design with external knowledge sources with controllable knowledge distance.
  arXiv  Detail & Related papers  (2022-03-28T08:11:29Z)
• Generative Pre-Trained Transformer for Design Concept Generation: An Exploration [6.233117407988574]
  This paper explores the uses of generative pre-trained transformers (GPT) for natural language design concept generation. Our experiments involve the use of GPT-2 and GPT-3 for different creative reasonings in design tasks.
  arXiv  Detail & Related papers  (2021-11-16T14:12:08Z)
• Dynamically Grown Generative Adversarial Networks [111.43128389995341]
  We propose a method to dynamically grow a GAN during training, optimizing the network architecture and its parameters together with automation. The method embeds architecture search techniques as an interleaving step with gradient-based training to periodically seek the optimal architecture-growing strategy for the generator and discriminator.
  arXiv  Detail & Related papers  (2021-06-16T01:25:51Z)
• Analogous to Evolutionary Algorithm: Designing a Unified Sequence Model [58.17021225930069]
  We explain the rationality of Vision Transformer by analogy with the proven practical Evolutionary Algorithm (EA) We propose a more efficient EAT model, and design task-related heads to deal with different tasks more flexibly. Our approach achieves state-of-the-art results on the ImageNet classification task compared with recent vision transformer works.
  arXiv  Detail & Related papers  (2021-05-31T16:20:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.