Generative AI and the History of Architecture

• URL: http://arxiv.org/abs/2312.15106v1
• Date: Fri, 22 Dec 2023 23:02:09 GMT
• Title: Generative AI and the History of Architecture
• Authors: Joern Ploennigs and Markus Berger
• Abstract summary: We investigate generative AI platforms for text and image generation for different architectural styles. We analyze a data set of 101 million Midjourney queries to see if and how practitioners are already querying for specific architectural concepts.
• Score: 0.6993026261767287
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent generative AI platforms are able to create texts or impressive images from simple text prompts. This makes them powerful tools for summarizing knowledge about architectural history or deriving new creative work in early design tasks like ideation, sketching and modelling. But, how good is the understanding of the generative AI models of the history of architecture? Has it learned to properly distinguish styles, or is it hallucinating information? In this chapter, we investigate this question for generative AI platforms for text and image generation for different architectural styles, to understand the capabilities and boundaries of knowledge of those tools. We also analyze how they are already being used by analyzing a data set of 101 million Midjourney queries to see if and how practitioners are already querying for specific architectural concepts.

Related papers

• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• From Manifestations to Cognitive Architectures: a Scalable Framework [2.6563873893593826]
  We propose a novel way to interpret reality as an information source, that is later translated into a computational framework. This framework is able to build elements of classical cognitive architectures, like Long Term Memory and Working Memory.
  arXiv  Detail & Related papers  (2024-06-14T08:26:26Z)
• Visual Knowledge in the Big Model Era: Retrospect and Prospect [63.282425615863]
  Visual knowledge is a new form of knowledge representation that can encapsulate visual concepts and their relations in a succinct, comprehensive, and interpretable manner. As the knowledge about the visual world has been identified as an indispensable component of human cognition and intelligence, visual knowledge is poised to have a pivotal role in establishing machine intelligence.
  arXiv  Detail & Related papers  (2024-04-05T07:31:24Z)
• Sketch-to-Architecture: Generative AI-aided Architectural Design [20.42779592734634]
  We present a novel workflow that utilizes AI models to generate conceptual floorplans and 3D models from simple sketches. Our work demonstrates the potential of generative AI in the architectural design process, pointing towards a new direction of computer-aided architectural design.
  arXiv  Detail & Related papers  (2024-03-29T14:04:45Z)
• ArchiGuesser -- AI Art Architecture Educational Game [0.5919433278490629]
  generative AI can create educational content from text, speech, to images based on simple input prompts. In this paper we present the multisensory educational game ArchiGuesser that combines various AI technologies to serve a single purpose.
  arXiv  Detail & Related papers  (2023-12-14T20:48:26Z)
• AI-Generated Images as Data Source: The Dawn of Synthetic Era [61.879821573066216]
  generative AI has unlocked the potential to create synthetic images that closely resemble real-world photographs. This paper explores the innovative concept of harnessing these AI-generated images as new data sources. In contrast to real data, AI-generated data exhibit remarkable advantages, including unmatched abundance and scalability.
  arXiv  Detail & Related papers  (2023-10-03T06:55:19Z)
• Foundational Models Defining a New Era in Vision: A Survey and Outlook [151.49434496615427]
  Vision systems to see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The models learned to bridge the gap between such modalities coupled with large-scale training data facilitate contextual reasoning, generalization, and prompt capabilities at test time. The output of such models can be modified through human-provided prompts without retraining, e.g., segmenting a particular object by providing a bounding box, having interactive dialogues by asking questions about an image or video scene or manipulating the robot's behavior through language instructions.
  arXiv  Detail & Related papers  (2023-07-25T17:59:18Z)
• Unfinished Architectures: A Perspective from Artificial Intelligence [73.52315464582637]
  Development of Artificial Intelligence (AI) opens new avenues for the proposal of possibilities for the completion of unfinished architectures. Recent appearance of tools such as DALL-E, capable of completing images guided by a textual description. In this article we explore the use of these new AI tools for the completion of unfinished facades of historical temples and analyse the still germinal stadium in the field of architectural graphic composition.
  arXiv  Detail & Related papers  (2023-03-03T13:05:10Z)
• The Construction of Reality in an AI: A Review [0.0]
  This paper aims to increase awareness of constructivist AI implementations. It builds on Guerin's 2008 "Learning Like a Baby: A Survey of AI approaches" The focus is on knowledge representations and learning algorithms that have been used in practice viewed through lenses of Piaget's schemas.
  arXiv  Detail & Related papers  (2023-02-03T22:52:17Z)
• AI Art in Architecture [0.6853165736531939]
  Recent diffusion-based AI art platforms are able to create impressive images from simple text descriptions. This is also true for early stages of architectural design with multiple stages of ideation, sketching and modelling. We research the applicability of the platforms Midjourney, DALL-E 2 and StableDiffusion to a series of common use cases in architectural design.
  arXiv  Detail & Related papers  (2022-12-19T12:24:14Z)
• The Curious Layperson: Fine-Grained Image Recognition without Expert Labels [90.88501867321573]
  We consider a new problem: fine-grained image recognition without expert annotations. We learn a model to describe the visual appearance of objects using non-expert image descriptions. We then train a fine-grained textual similarity model that matches image descriptions with documents on a sentence-level basis.
  arXiv  Detail & Related papers  (2021-11-05T17:58:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.