ArchiLense: A Framework for Quantitative Analysis of Architectural Styles Based on Vision Large Language Models
- URL: http://arxiv.org/abs/2506.07739v3
- Date: Sat, 02 Aug 2025 12:10:07 GMT
- Title: ArchiLense: A Framework for Quantitative Analysis of Architectural Styles Based on Vision Large Language Models
- Abstract summary: We construct a professional architectural style dataset named ArchDiffBench, which comprises 1,765 high-quality architectural images and their corresponding style annotations.<n>By integrating ad-vanced computer vision techniques, deep learning, and machine learning, ArchiLense enables automatic recognition, comparison, and precise classi-fication of architectural imagery.<n>ArchiLense achieves strong performance in architectural style recognition, with a 92.4% con-sistency rate with expert annotations and 84.5% classification accuracy.
- Score: 14.032055369239627
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Architectural cultures across regions are characterized by stylistic diversity, shaped by historical, social, and technological contexts in addition to geograph-ical conditions. Understanding architectural styles requires the ability to describe and analyze the stylistic features of different architects from various regions through visual observations of architectural imagery. However, traditional studies of architectural culture have largely relied on subjective expert interpretations and historical literature reviews, often suffering from regional biases and limited ex-planatory scope. To address these challenges, this study proposes three core contributions: (1) We construct a professional architectural style dataset named ArchDiffBench, which comprises 1,765 high-quality architectural images and their corresponding style annotations, collected from different regions and historical periods. (2) We propose ArchiLense, an analytical framework grounded in Vision-Language Models and constructed using the ArchDiffBench dataset. By integrating ad-vanced computer vision techniques, deep learning, and machine learning algo-rithms, ArchiLense enables automatic recognition, comparison, and precise classi-fication of architectural imagery, producing descriptive language outputs that ar-ticulate stylistic differences. (3) Extensive evaluations show that ArchiLense achieves strong performance in architectural style recognition, with a 92.4% con-sistency rate with expert annotations and 84.5% classification accuracy, effec-tively capturing stylistic distinctions across images. The proposed approach transcends the subjectivity inherent in traditional analyses and offers a more objective and accurate perspective for comparative studies of architectural culture.
Related papers
- Multimodal Cultural Heritage Architectural Style Classification for Residential Buildings in the UAE Based on CLIP Embeddings and SVM [0.27998963147546146]
This paper proposes a multimodal machine learning framework to analyze and classify Emirati residential architecture.<n>We integrate visual features from images and textual features from expert descriptions into a unified 512-dimensional embedding.<n>We achieve a classification accuracy of 98% across eight identified style clusters, higher than every other study in the literature.
arXiv Detail & Related papers (2026-09-15T13:41:36Z) - ArchSIBench: Benchmarking the Architectural Spatial Intelligence of Vision-Language Models [16.656416066183887]
ArchSIBench is a Benchmark for Architectural Spatial Intelligence based on the perspectives from architecture, cognitive science, and psychology.<n> ArchSIBench covers five core dimensions: perception, reasoning, navigation, transformation, and configuration, comprising 17 fine-grained subtasks.<n>We evaluate various Vision-Language Models (VLMs) and find that the architectural spatial intelligence of most models shows significant differences from human baselines.
arXiv Detail & Related papers (2026-05-20T07:27:08Z) - Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style [60.562013130566726]
We characterize the mechanisms underlying VLMs' ability to predict artistic style.<n>We employ a latent-space decomposition approach to identify concepts that drive art style prediction.<n>In cases where an irrelevant concept was used to successfully predict style, art historians identified possible reasons for its success.
arXiv Detail & Related papers (2026-03-11T17:49:45Z) - Bridging Cognitive Gap: Hierarchical Description Learning for Artistic Image Aesthetics Assessment [51.40989269202702]
aesthetic quality assessment task is crucial for developing a human-aligned quantitative evaluation system for AIGC.<n>We propose ArtQuant, an aesthetics assessment framework for artistic images which couples isolated aesthetic dimensions through description generation.<n>Our approach achieves epoch state-of-the-art performance on several datasets while requiring only 33% of conventional trainings.
arXiv Detail & Related papers (2025-12-29T12:18:26Z) - Disc-Cover Complexity Trends in Music Illustrations from Sinatra to Swift [51.70874799858211]
We examine the visual complexity of album covers spanning 75 years and 11 popular musical genres.<n>Our analysis reveals a broad shift toward minimalism across most genres, with notable exceptions.<n>At the same time, we observe growing variance over time, with many covers continuing to display high levels of abstraction and intricacy.
arXiv Detail & Related papers (2025-10-01T15:01:25Z) - ArchGPT: Understanding the World's Architectures with Large Multimodal Models [6.504675786709239]
We present ArchGPT, a multimodal architectural visual question answering (VQA) model.<n>This pipeline yields Arch-300K, a domain-specialized dataset of approximately 315,000 image-question-answer triplets.
arXiv Detail & Related papers (2025-09-25T07:49:43Z) - A vision-intelligent framework for mapping the genealogy of vernacular architecture [1.6520865430314056]
This study proposes a research framework by which intelligent technologies can be assembled to augment researchers' intuition.<n>We employ this framework to examine the stylistic classification of 1,277 historical shophouses in Singapore's Chinatown.<n>Findings extend beyond the chronological classification established by the Urban Redevelopment Authority of Singapore in the 1980s and 1990s.
arXiv Detail & Related papers (2025-05-24T06:39:28Z) - The Architecture Tradeoff and Risk Analysis Framework (ATRAF): A Unified Approach for Evaluating Software Architectures, Reference Architectures, and Architectural Frameworks [0.0]
We introduce the Architecture Tradeoff and Risk Analysis Framework (ATRAF)<n>ATRAF is a scenario-driven framework for evaluating tradeoffs and risks across architectural levels.<n>It enables the identification of sensitivities, tradeoffs, and risks while supporting continuous refinement of architectural artifacts.
arXiv Detail & Related papers (2025-05-01T17:48:52Z) - ArchSeek: Retrieving Architectural Case Studies Using Vision-Language Models [6.936621948709572]
ArchSeek is an innovative case study search system with recommendation capability.<n>Powered by vision-language models and cross-modal embeddings, it enables text and image queries with fine-grained control.
arXiv Detail & Related papers (2025-03-24T13:50:23Z) - Semi-Automated Design of Data-Intensive Architectures [49.1574468325115]
This paper introduces a development methodology for data-intensive architectures.<n>It guides architects in (i) designing a suitable architecture for their specific application scenario, and (ii) selecting an appropriate set of concrete systems to implement the application.<n>We show that the description languages we adopt can capture the key aspects of data-intensive architectures proposed by researchers and practitioners.
arXiv Detail & Related papers (2025-03-21T16:01:11Z) - Evaluation of Architectural Synthesis Using Generative AI [49.1574468325115]
This paper presents a comparative evaluation of two systems: GPT-4o and Claude 3.5, in the task of architectural 3D synthesis.<n>We conduct a case study on two buildings from Palladio's Four Books of Architecture (1965): Villa Rotonda and Palazzo Porto.<n>We assess the systems' abilities in (1) interpreting 2D and 3D representations of buildings from drawings, (2) encoding the buildings into a CAD software script, and (3) self-improving based on outputs.
arXiv Detail & Related papers (2025-03-04T18:39:28Z) - A Survey of Model Architectures in Information Retrieval [64.75808744228067]
We focus on two key aspects: backbone models for feature extraction and end-to-end system architectures for relevance estimation.<n>We trace the development from traditional term-based methods to modern neural approaches, particularly highlighting the impact of transformer-based models and subsequent large language models (LLMs)<n>We conclude by discussing emerging challenges and future directions, including architectural optimizations for performance and scalability, handling of multimodal, multilingual data, and adaptation to novel application domains beyond traditional search paradigms.
arXiv Detail & Related papers (2025-02-20T18:42:58Z) - Understanding Museum Exhibits using Vision-Language Reasoning [52.35301212718003]
Museums serve as repositories of cultural heritage and historical artifacts from diverse epochs, civilizations, and regions.<n> domain-specific models are essential for interactive query resolution and gaining historical insights.<n>We collect and curate a large-scale dataset of 65M images and 200M question-answer pairs for exhibits from all around the world.
arXiv Detail & Related papers (2024-12-02T10:54:31Z) - GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability.
Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI.
We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
arXiv Detail & Related papers (2024-08-01T11:52:56Z) - Impressions: Understanding Visual Semiotics and Aesthetic Impact [66.40617566253404]
We present Impressions, a novel dataset through which to investigate the semiotics of images.
We show that existing multimodal image captioning and conditional generation models struggle to simulate plausible human responses to images.
This dataset significantly improves their ability to model impressions and aesthetic evaluations of images through fine-tuning and few-shot adaptation.
arXiv Detail & Related papers (2023-10-27T04:30:18Z) - Thoughts on Architecture [0.0]
The term architecture has evolved from its original Greek roots and its application to buildings and computers to its more recent manifestation for minds.
This article considers lessons from this history, in terms of a set of relevant distinctions introduced at each of these stages and a definition of architecture that spans all three.
arXiv Detail & Related papers (2023-06-23T15:47:17Z) - Coarse-to-Fine Contrastive Learning in Image-Text-Graph Space for
Improved Vision-Language Compositionality [50.48859793121308]
Contrastively trained vision-language models have achieved remarkable progress in vision and language representation learning.
Recent research has highlighted severe limitations in their ability to perform compositional reasoning over objects, attributes, and relations.
arXiv Detail & Related papers (2023-05-23T08:28:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.