Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style

• URL: http://arxiv.org/abs/2603.11024v1
• Date: Wed, 11 Mar 2026 17:49:45 GMT
• Title: Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style
• Abstract summary: We characterize the mechanisms underlying VLMs' ability to predict artistic style.<n>We employ a latent-space decomposition approach to identify concepts that drive art style prediction.<n>In cases where an irrelevant concept was used to successfully predict style, art historians identified possible reasons for its success.
• Score: 60.562013130566726
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: VLMs have become increasingly proficient at a range of computer vision tasks, such as visual question answering and object detection. This includes increasingly strong capabilities in the domain of art, from analyzing artwork to generation of art. In an interdisciplinary collaboration between computer scientists and art historians, we characterize the mechanisms underlying VLMs' ability to predict artistic style and assess the extent to which they align with the criteria art historians use to reason about artistic style. We employ a latent-space decomposition approach to identify concepts that drive art style prediction and conduct quantitative evaluations, causal analysis and assessment by art historians. Our findings indicate that 73% of the extracted concepts are judged by art historians to exhibit a coherent and semantically meaningful visual feature and 90% of concepts used to predict style of a given artwork were judged relevant. In cases where an irrelevant concept was used to successfully predict style, art historians identified possible reasons for its success; for example, the model might "understand" a concept in more formal terms, such as dark/light contrasts.

Related papers

• Conducting Stylistic Analysis of Paintings through an Art-History Agent [0.0]
  We present an AI framework that automates stylistic analysis of paintings.<n>By training a vision transformer (ViT) on a large corpus of paintings with metadata, our system encodes this art history-specific data as embeddings.<n>A large language model (LLM) then interprets each feature by retrieving associated artworks and their accompanying curator-written texts, and synthesizes them into descriptions.
  arXiv  Detail & Related papers  (2026-08-30T08:10:58Z)
• The persistence of painting styles [0.0]
  We show how persistent homology (PH), a method from topological data analysis, provides objective and interpretable insights on artistic styles.<n>We show how PH can, with statistical certainty, differentiate between artists, both from different artistic currents and from the same one, and distinguish images of an artist from an AI-generated image in the artist's style.
  arXiv  Detail & Related papers  (2025-11-17T13:25:04Z)
• Disc-Cover Complexity Trends in Music Illustrations from Sinatra to Swift [51.70874799858211]
  We examine the visual complexity of album covers spanning 75 years and 11 popular musical genres.<n>Our analysis reveals a broad shift toward minimalism across most genres, with notable exceptions.<n>At the same time, we observe growing variance over time, with many covers continuing to display high levels of abstraction and intricacy.
  arXiv  Detail & Related papers  (2025-10-01T15:01:25Z)
• Context-aware Multimodal AI Reveals Hidden Pathways in Five Centuries of Art Evolution [1.8435193934665342]
  We use cutting-edge generative AI, specifically Stable Diffusion, to analyze 500 years of Western paintings.<n>Our findings reveal that contextual information differentiates between artistic periods, styles, and individual artists more successfully than formal elements.<n>Our generative experiment, infusing prospective contexts into historical artworks, successfully reproduces the evolutionary trajectory of artworks.
  arXiv  Detail & Related papers  (2025-03-15T10:45:04Z)
• Have Large Vision-Language Models Mastered Art History? [3.790400719319821]
  We test whether Vision-Language Models (VLMs) can classify the style, author and creation date of paintings.<n>Art historians have long studied the unique aspects of artworks, with style prediction being a crucial component of their discipline.
  arXiv  Detail & Related papers  (2024-09-05T13:33:57Z)
• Diffusion-Based Visual Art Creation: A Survey and New Perspectives [51.522935314070416]
  This survey explores the emerging realm of diffusion-based visual art creation, examining its development from both artistic and technical perspectives. Our findings reveal how artistic requirements are transformed into technical challenges and highlight the design and application of diffusion-based methods within visual art creation. We aim to shed light on the mechanisms through which AI systems emulate and possibly, enhance human capacities in artistic perception and creativity.
  arXiv  Detail & Related papers  (2024-08-22T04:49:50Z)
• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• AI Art Neural Constellation: Revealing the Collective and Contrastive State of AI-Generated and Human Art [36.21731898719347]
  We conduct a comprehensive analysis to position AI-generated art within the context of human art heritage. Our comparative analysis is based on an extensive dataset, dubbed ArtConstellation'' Key finding is that AI-generated artworks are visually related to the principle concepts for modern period art made in 1800-2000.
  arXiv  Detail & Related papers  (2024-02-04T11:49:51Z)
• Impressions: Understanding Visual Semiotics and Aesthetic Impact [66.40617566253404]
  We present Impressions, a novel dataset through which to investigate the semiotics of images. We show that existing multimodal image captioning and conditional generation models struggle to simulate plausible human responses to images. This dataset significantly improves their ability to model impressions and aesthetic evaluations of images through fine-tuning and few-shot adaptation.
  arXiv  Detail & Related papers  (2023-10-27T04:30:18Z)
• Learning to Evaluate the Artness of AI-generated Images [64.48229009396186]
  ArtScore is a metric designed to evaluate the degree to which an image resembles authentic artworks by artists. We employ pre-trained models for photo and artwork generation, resulting in a series of mixed models. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images.
  arXiv  Detail & Related papers  (2023-05-08T17:58:27Z)
• How Deep is Your Art: An Experimental Study on the Limits of Artistic Understanding in a Single-Task, Single-Modality Neural Network [0.0]
  This paper experimentally investigated the degree to which a state-of-the-art Deep Convolutional Neural Network (DCNN) can correctly distinguish modern conceptual art work into the galleries devised by art curators.
  arXiv  Detail & Related papers  (2022-03-30T03:32:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.