Artificial Intelligence and Misinformation in Art: Can Vision Language Models Judge the Hand or the Machine Behind the Canvas?

• URL: http://arxiv.org/abs/2508.01408v1
• Date: Sat, 02 Aug 2025 15:27:31 GMT
• Title: Artificial Intelligence and Misinformation in Art: Can Vision Language Models Judge the Hand or the Machine Behind the Canvas?
• Authors: Tarian Fu, Javier Conde, Gonzalo Martínez, Pedro Reviriego, Elena Merino-Gómez, Fernando Moral,
• Abstract summary: Powerful artificial intelligence models that can generate and analyze images creates new challenges for painting attribution.<n>On the one hand, AI models can create images that mimic the style of a painter, which can be incorrectly attributed, for example, by other AI models.<n>On the other hand, AI models may not be able to correctly identify the artist for real paintings, inducing users to incorrectly attribute paintings.
• Score: 40.65612212208553
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The attribution of artworks in general and of paintings in particular has always been an issue in art. The advent of powerful artificial intelligence models that can generate and analyze images creates new challenges for painting attribution. On the one hand, AI models can create images that mimic the style of a painter, which can be incorrectly attributed, for example, by other AI models. On the other hand, AI models may not be able to correctly identify the artist for real paintings, inducing users to incorrectly attribute paintings. In this paper, both problems are experimentally studied using state-of-the-art AI models for image generation and analysis on a large dataset with close to 40,000 paintings from 128 artists. The results show that vision language models have limited capabilities to: 1) perform canvas attribution and 2) to identify AI generated images. As users increasingly rely on queries to AI models to get information, these results show the need to improve the capabilities of VLMs to reliably perform artist attribution and detection of AI generated images to prevent the spread of incorrect information.

Related papers

• Could AI Trace and Explain the Origins of AI-Generated Images and Text? [53.11173194293537]
  AI-generated content is increasingly prevalent in the real world.<n> adversaries might exploit large multimodal models to create images that violate ethical or legal standards.<n>Paper reviewers may misuse large language models to generate reviews without genuine intellectual effort.
  arXiv  Detail & Related papers  (2025-04-05T20:51:54Z)
• Has an AI model been trained on your images? [13.106063755117399]
  We describe a method that allows us to determine if a model was trained on a specific image or set of images.<n>This method is computationally efficient and assumes no explicit knowledge of the model architecture or weights.<n>We anticipate that this method will be crucial for auditing existing models and, looking ahead, ensuring the fairer development and deployment of generative AI models.
  arXiv  Detail & Related papers  (2025-01-11T01:12:23Z)
• ArtBrain: An Explainable end-to-end Toolkit for Classification and Attribution of AI-Generated Art and Style [2.7321177315998915]
  This paper introduces AI-ArtBench, a dataset featuring 185,015 artistic images across 10 art styles.<n>It includes 125,015 AI-generated images and 60,000 pieces of human-created artwork.<n>The accuracy of attribution to the generative model reaches 0.999.
  arXiv  Detail & Related papers  (2024-12-02T14:03:50Z)
• Crafting Synthetic Realities: Examining Visual Realism and Misinformation Potential of Photorealistic AI-Generated Images [6.308018793111589]
  This study unpacks AI photorealism of AIGIs from four key dimensions, content, human, aesthetic, and production features.<n> photorealistic AIGIs often depict human figures, especially celebrities and politicians, with a high degree of surrealism and aesthetic professionalism.
  arXiv  Detail & Related papers  (2024-09-26T02:46:43Z)
• A Sanity Check for AI-generated Image Detection [49.08585395873425]
  We propose AIDE (AI-generated Image DEtector with Hybrid Features) to detect AI-generated images.<n>AIDE achieves +3.5% and +4.6% improvements to state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-06-27T17:59:49Z)
• The Adversarial AI-Art: Understanding, Generation, Detection, and Benchmarking [47.08666835021915]
  We present a systematic attempt at understanding and detecting AI-generated images (AI-art) in adversarial scenarios. The dataset, named ARIA, contains over 140K images in five categories: artworks (painting), social media images, news photos, disaster scenes, and anime pictures.
  arXiv  Detail & Related papers  (2024-04-22T21:00:13Z)
• Organic or Diffused: Can We Distinguish Human Art from AI-generated Images? [24.417027069545117]
  Distinguishing AI generated images from human art is a challenging problem. A failure to address this problem allows bad actors to defraud individuals paying a premium for human art and companies whose stated policies forbid AI imagery. We curate real human art across 7 styles, generate matching images from 5 generative models, and apply 8 detectors.
  arXiv  Detail & Related papers  (2024-02-05T17:25:04Z)
• Learning to Evaluate the Artness of AI-generated Images [64.48229009396186]
  ArtScore is a metric designed to evaluate the degree to which an image resembles authentic artworks by artists. We employ pre-trained models for photo and artwork generation, resulting in a series of mixed models. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images.
  arXiv  Detail & Related papers  (2023-05-08T17:58:27Z)
• Seeing is not always believing: Benchmarking Human and Model Perception of AI-Generated Images [66.20578637253831]
  There is a growing concern that the advancement of artificial intelligence (AI) technology may produce fake photos. This study aims to comprehensively evaluate agents for distinguishing state-of-the-art AI-generated visual content.
  arXiv  Detail & Related papers  (2023-04-25T17:51:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.