Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning

• URL: http://arxiv.org/abs/2305.00510v4
• Date: Thu, 18 Jul 2024 07:49:58 GMT
• Title: Towards AI-Architecture Liberty: A Comprehensive Survey on Design and Generation of Virtual Architecture by Deep Learning
• Authors: Anqi Wang, Jiahua Dong, Lik-Hang Lee, Jiachuan Shen, Pan Hui,
• Abstract summary: 3D shape generation techniques leveraging deep learning have garnered significant interest from both the computer vision and architectural design communities. We review 149 related articles covering architectural design, 3D shape techniques, and virtual environments. We highlight four important enablers of ubiquitous interaction with immersive systems in deep learning-assisted architectural generation.
• Score: 23.58793497403681
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: 3D shape generation techniques leveraging deep learning have garnered significant interest from both the computer vision and architectural design communities, promising to enrich the content in the virtual environment. However, research on virtual architectural design remains limited, particularly regarding designer-AI collaboration and deep learning-assisted design. In our survey, we reviewed 149 related articles (81.2% of articles published between 2019 and 2023) covering architectural design, 3D shape techniques, and virtual environments. Through scrutinizing the literature, we first identify the principles of virtual architecture and illuminate its current production challenges, including datasets, multimodality, design intuition, and generative frameworks. We then introduce the latest approaches to designing and generating virtual buildings leveraging 3D shape generation and summarize four characteristics of various approaches to virtual architecture. Based on our analysis, we expound on four research agendas, including agency, communication, user consideration, and integrating tools. Additionally, we highlight four important enablers of ubiquitous interaction with immersive systems in deep learning-assisted architectural generation. Our work contributes to fostering understanding between designers and deep learning techniques, broadening access to designer-AI collaboration. We advocate for interdisciplinary efforts to address this timely research topic, facilitating content designing and generation in the virtual environment.

Related papers

• Unlocking Comics: The AI4VA Dataset for Visual Understanding [62.345344799258804]
  This paper presents a novel dataset comprising Franco-Belgian comics from the 1950s annotated for tasks including depth estimation, semantic segmentation, saliency detection, and character identification. It consists of two distinct and consistent styles and incorporates object concepts and labels taken from natural images. By including such diverse information across styles, this dataset not only holds promise for computational creativity but also offers avenues for the digitization of art and storytelling innovation.
  arXiv  Detail & Related papers  (2024-10-27T14:27:05Z)
• Diffusion-Based Visual Art Creation: A Survey and New Perspectives [51.522935314070416]
  This survey explores the emerging realm of diffusion-based visual art creation, examining its development from both artistic and technical perspectives. Our findings reveal how artistic requirements are transformed into technical challenges and highlight the design and application of diffusion-based methods within visual art creation. We aim to shed light on the mechanisms through which AI systems emulate and possibly, enhance human capacities in artistic perception and creativity.
  arXiv  Detail & Related papers  (2024-08-22T04:49:50Z)
• LLM4DESIGN: An Automated Multi-Modal System for Architectural and Environmental Design [2.934816617441014]
  This study introduces LLM4DESIGN, a highly automated system for generating architectural and environmental design proposals. It employs Multi-Agent systems to foster creativity, Retrieval Augmented Generation (RAG) to ground designs in realism, and Visual Language Models (VLM) to synchronize all information.
  arXiv  Detail & Related papers  (2024-06-28T10:57:50Z)
• Sketch-to-Architecture: Generative AI-aided Architectural Design [20.42779592734634]
  We present a novel workflow that utilizes AI models to generate conceptual floorplans and 3D models from simple sketches. Our work demonstrates the potential of generative AI in the architectural design process, pointing towards a new direction of computer-aided architectural design.
  arXiv  Detail & Related papers  (2024-03-29T14:04:45Z)
• Recent Trends in 3D Reconstruction of General Non-Rigid Scenes [104.07781871008186]
  Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision. It enables the synthesizing of photorealistic novel views, useful for the movie industry and AR/VR applications. This state-of-the-art report (STAR) offers the reader a comprehensive summary of state-of-the-art techniques with monocular and multi-view inputs.
  arXiv  Detail & Related papers  (2024-03-22T09:46:11Z)
• Geometric Deep Learning for Computer-Aided Design: A Survey [85.79012726689511]
  This survey offers a comprehensive overview of learning-based methods in computer-aided design. It includes similarity analysis and retrieval, 2D and 3D CAD model synthesis, and CAD generation from point clouds. It provides a complete list of benchmark datasets and their characteristics, along with open-source codes that have propelled research in this domain.
  arXiv  Detail & Related papers  (2024-02-27T17:11:35Z)
• Experiments on Generative AI-Powered Parametric Modeling and BIM for Architectural Design [4.710049212041078]
  The study experiments with the potential of ChatGPT and generative AI in 3D architectural design. The framework provides architects with an intuitive and powerful method to convey design intent.
  arXiv  Detail & Related papers  (2023-08-01T01:51:59Z)
• Vision+X: A Survey on Multimodal Learning in the Light of Data [64.03266872103835]
  multimodal machine learning that incorporates data from various sources has become an increasingly popular research area. We analyze the commonness and uniqueness of each data format mainly ranging from vision, audio, text, and motions. We investigate the existing literature on multimodal learning from both the representation learning and downstream application levels.
  arXiv  Detail & Related papers  (2022-10-05T13:14:57Z)
• Detecting Visual Design Principles in Art and Architecture through Deep Convolutional Neural Networks [0.0]
  This research aims at a neural network model, which recognizes and classifies the design principles over different domains. The proposed model learns from the knowledge of myriads of original designs, by capturing the underlying shared patterns.
  arXiv  Detail & Related papers  (2021-08-09T14:00:17Z)
• Visionary: Vision architecture discovery for robot learning [58.67846907923373]
  We propose a vision-based architecture search algorithm for robot manipulation learning, which discovers interactions between low dimension action inputs and high dimensional visual inputs. Our approach automatically designs architectures while training on the task - discovering novel ways of combining and attending image feature representations with actions as well as features from previous layers.
  arXiv  Detail & Related papers  (2021-03-26T17:51:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.