ArchSeek: Retrieving Architectural Case Studies Using Vision-Language Models

• URL: http://arxiv.org/abs/2503.18680v1
• Date: Mon, 24 Mar 2025 13:50:23 GMT
• Title: ArchSeek: Retrieving Architectural Case Studies Using Vision-Language Models
• Authors: Danrui Li, Yichao Shi, Yaluo Wang, Ziying Shi, Mubbasir Kapadia,
• Abstract summary: ArchSeek is an innovative case study search system with recommendation capability.<n>Powered by vision-language models and cross-modal embeddings, it enables text and image queries with fine-grained control.
• Score: 6.936621948709572
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Efficiently searching for relevant case studies is critical in architectural design, as designers rely on precedent examples to guide or inspire their ongoing projects. However, traditional text-based search tools struggle to capture the inherently visual and complex nature of architectural knowledge, often leading to time-consuming and imprecise exploration. This paper introduces ArchSeek, an innovative case study search system with recommendation capability, tailored for architecture design professionals. Powered by the visual understanding capabilities from vision-language models and cross-modal embeddings, it enables text and image queries with fine-grained control, and interaction-based design case recommendations. It offers architects a more efficient, personalized way to discover design inspirations, with potential applications across other visually driven design fields. The source code is available at https://github.com/danruili/ArchSeek.

Related papers

• Computer-Aided Layout Generation for Building Design: A Review [18.703604111298695]
  In this paper, we conduct a review of three major research topics of architecture layout design and generation. For each topic, we present an overview of the leading paradigms, categorized either by research domains (architecture or machine learning) or by user input conditions or constraints.
  arXiv  Detail & Related papers  (2025-04-13T19:00:53Z)
• NADER: Neural Architecture Design via Multi-Agent Collaboration [37.48197934228379]
  We introduce NADER, a novel framework that formulates neural architecture design (NAD) as a multi-agent collaboration problem.<n>We propose the Reflector, which effectively learns from immediate feedback and long-term experiences.<n>Unlike previous LLM-based methods that use code to represent neural architectures, we utilize a graph-based representation.
  arXiv  Detail & Related papers  (2024-12-26T13:07:03Z)
• Automatic Layout Planning for Visually-Rich Documents with Instruction-Following Models [81.6240188672294]
  In graphic design, non-professional users often struggle to create visually appealing layouts due to limited skills and resources. We introduce a novel multimodal instruction-following framework for layout planning, allowing users to easily arrange visual elements into tailored layouts. Our method not only simplifies the design process for non-professionals but also surpasses the performance of few-shot GPT-4V models, with mIoU higher by 12% on Crello.
  arXiv  Detail & Related papers  (2024-04-23T17:58:33Z)
• Standardizing Knowledge Engineering Practices with a Reference Architecture [8.22187358555391]
  This paper proposes a vision of harmonizing the best practices in the field of knowledge engineering. We describe how a reference architecture can be iteratively designed and implemented to associate user needs with recurring systemic patterns.
  arXiv  Detail & Related papers  (2024-04-04T17:46:32Z)
• I-Design: Personalized LLM Interior Designer [57.00412237555167]
  I-Design is a personalized interior designer that allows users to generate and visualize their design goals through natural language communication. I-Design starts with a team of large language model agents that engage in dialogues and logical reasoning with one another. The final design is then constructed in 3D by retrieving and integrating assets from an existing object database.
  arXiv  Detail & Related papers  (2024-04-03T16:17:53Z)
• Sketch-to-Architecture: Generative AI-aided Architectural Design [20.42779592734634]
  We present a novel workflow that utilizes AI models to generate conceptual floorplans and 3D models from simple sketches. Our work demonstrates the potential of generative AI in the architectural design process, pointing towards a new direction of computer-aided architectural design.
  arXiv  Detail & Related papers  (2024-03-29T14:04:45Z)
• Unsupervised Graph Neural Architecture Search with Disentangled Self-supervision [51.88848982611515]
  Unsupervised graph neural architecture search remains unexplored in the literature. We propose a novel Disentangled Self-supervised Graph Neural Architecture Search model. Our model is able to achieve state-of-the-art performance against several baseline methods in an unsupervised manner.
  arXiv  Detail & Related papers  (2024-03-08T05:23:55Z)
• LayoutDETR: Detection Transformer Is a Good Multimodal Layout Designer [80.61492265221817]
  Graphic layout designs play an essential role in visual communication. Yet handcrafting layout designs is skill-demanding, time-consuming, and non-scalable to batch production. Generative models emerge to make design automation scalable but it remains non-trivial to produce designs that comply with designers' desires.
  arXiv  Detail & Related papers  (2022-12-19T21:57:35Z)
• AI Art in Architecture [0.6853165736531939]
  Recent diffusion-based AI art platforms are able to create impressive images from simple text descriptions. This is also true for early stages of architectural design with multiple stages of ideation, sketching and modelling. We research the applicability of the platforms Midjourney, DALL-E 2 and StableDiffusion to a series of common use cases in architectural design.
  arXiv  Detail & Related papers  (2022-12-19T12:24:14Z)
• Construction of Hierarchical Neural Architecture Search Spaces based on Context-free Grammars [66.05096551112932]
  We introduce a unifying search space design framework based on context-free grammars. By enhancing and using their properties, we effectively enable search over the complete architecture. We show that our search strategy can be superior to existing Neural Architecture Search approaches.
  arXiv  Detail & Related papers  (2022-11-03T14:23:00Z)
• Network Graph Based Neural Architecture Search [57.78724765340237]
  We search neural network by rewiring the corresponding graph and predict the architecture performance by graph properties. Because we do not perform machine learning over the entire graph space, the searching process is remarkably efficient.
  arXiv  Detail & Related papers  (2021-12-15T00:12:03Z)
• Detecting Visual Design Principles in Art and Architecture through Deep Convolutional Neural Networks [0.0]
  This research aims at a neural network model, which recognizes and classifies the design principles over different domains. The proposed model learns from the knowledge of myriads of original designs, by capturing the underlying shared patterns.
  arXiv  Detail & Related papers  (2021-08-09T14:00:17Z)
• A Design Space Study for LISTA and Beyond [79.76740811464597]
  In recent years, great success has been witnessed in building problem-specific deep networks from unrolling iterative algorithms. This paper revisits the role of unrolling as a design approach for deep networks, to what extent its resulting special architecture is superior, and can we find better? Using LISTA for sparse recovery as a representative example, we conduct the first thorough design space study for the unrolled models.
  arXiv  Detail & Related papers  (2021-04-08T23:01:52Z)
• A New Neural Search and Insights Platform for Navigating and Organizing AI Research [56.65232007953311]
  We introduce a new platform, AI Research Navigator, that combines classical keyword search with neural retrieval to discover and organize relevant literature. We give an overview of the overall architecture of the system and of the components for document analysis, question answering, search, analytics, expert search, and recommendations.
  arXiv  Detail & Related papers  (2020-10-30T19:12:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.