ArtMine: Discovering and Formalizing Artistic Processes

• URL: http://arxiv.org/abs/2607.08331v1
• Date: Thu, 09 Jul 2026 10:16:53 GMT
• Title: ArtMine: Discovering and Formalizing Artistic Processes
• Abstract summary: ArtMine is a framework for discovering and formalizing artistic processes from heterogeneous historical evidence.<n>By modeling creative processes rather than only final artifacts, our work moves toward process-centred human-AI co-creativity systems.
• Score: 0.8603232107584646
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Understanding how artworks are created requires reasoning about the iterative decisions, material operations, and contextual influences that shape artistic production. While recent generative AI systems can synthesize artworks with high fidelity, they primarily model distributions over finished artifacts rather than the creative processes underlying their creation. In practice, artistic workflows are only partially documented through fragmented sources such as archival records, preparatory studies, correspondence, etc., making process-level understanding difficult to formalize computationally. In this work, we introduce ArtMine, a framework for discovering and formalizing artistic processes from heterogeneous historical evidence. Our approach synthesizes heterogeneous artwork evidence into a structured repository, from which a Peircean abductive agent infers evidence-grounded production steps. These steps are converted into a compositional graph and rendering prompt, then optimized through self-reflection over deviations between the generated and reference artworks. We provide a preliminary proof-of-concept case study using open-domain historical sources across multiple artists and artistic movements, demonstrating that fragmented documentary evidence can support coherent, interpretable, and auditable representations of artistic workflows. By modeling creative processes rather than only final artifacts, our work moves toward process-centred human-AI co-creativity systems that can support artistic interpretation, creative education, reflective collaboration, and computational studies of cultural production.

Related papers

• Conducting Stylistic Analysis of Paintings through an Art-History Agent [0.0]
  We present an AI framework that automates stylistic analysis of paintings.<n>By training a vision transformer (ViT) on a large corpus of paintings with metadata, our system encodes this art history-specific data as embeddings.<n>A large language model (LLM) then interprets each feature by retrieving associated artworks and their accompanying curator-written texts, and synthesizes them into descriptions.
  arXiv  Detail & Related papers  (2026-08-30T08:10:58Z)
• Does AI See like Art Historians? Interpreting How Vision Language Models Recognize Artistic Style [60.562013130566726]
  We characterize the mechanisms underlying VLMs' ability to predict artistic style.<n>We employ a latent-space decomposition approach to identify concepts that drive art style prediction.<n>In cases where an irrelevant concept was used to successfully predict style, art historians identified possible reasons for its success.
  arXiv  Detail & Related papers  (2026-03-11T17:49:45Z)
• Enhancing Authorship Attribution with Synthetic Paintings [0.0]
  We propose a hybrid approach that combines real and synthetic data to enhance model accuracy and generalization across artistic styles.<n> Experimental results show that adding synthetic images leads to higher ROC-AUC and accuracy compared to using only real paintings.
  arXiv  Detail & Related papers  (2026-03-04T18:00:42Z)
• Loomis Painter: Reconstructing the Painting Process [56.713812157283805]
  Step-by-step painting tutorials are vital for learning artistic techniques, but existing video resources lack interactivity and personalization.<n>We propose a unified framework for multi-media painting process generation with a semantics-driven style control mechanism.<n>We also build a large-scale dataset of real painting processes and evaluate cross-media consistency, temporal coherence, and final-image fidelity.
  arXiv  Detail & Related papers  (2025-11-21T16:06:32Z)
• A Critical Assessment of Modern Generative Models' Ability to Replicate Artistic Styles [0.0]
  This paper presents a critical assessment of the style replication capabilities of contemporary generative models.<n>We examine how effectively these models reproduce traditional artistic styles while maintaining structural integrity and compositional balance.<n>The analysis is based on a new large dataset of AI-generated works imitating artistic styles of the past.
  arXiv  Detail & Related papers  (2025-02-21T07:00:06Z)
• PATCH: a deep learning method to assess heterogeneity of artistic practice in historical paintings [0.0]
  In the Renaissance and Early Modern period, paintings were largely produced by master painters directing workshops of apprentices.<n>Information on how different workshops were managed and the processes by which artworks were created remains elusive.
  arXiv  Detail & Related papers  (2025-02-04T01:05:12Z)
• Diffusion-Based Visual Art Creation: A Survey and New Perspectives [51.522935314070416]
  This survey explores the emerging realm of diffusion-based visual art creation, examining its development from both artistic and technical perspectives. Our findings reveal how artistic requirements are transformed into technical challenges and highlight the design and application of diffusion-based methods within visual art creation. We aim to shed light on the mechanisms through which AI systems emulate and possibly, enhance human capacities in artistic perception and creativity.
  arXiv  Detail & Related papers  (2024-08-22T04:49:50Z)
• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• CreativeSynth: Cross-Art-Attention for Artistic Image Synthesis with Multimodal Diffusion [73.08710648258985]
  Key painting attributes including layout, perspective, shape, and semantics often cannot be conveyed and expressed through style transfer.<n>Large-scale pretrained text-to-image generation models have demonstrated their capability to synthesize a vast amount of high-quality images.<n>Our main novel idea is to integrate multimodal semantic information as a synthesis guide into artworks, rather than transferring style to the real world.
  arXiv  Detail & Related papers  (2024-01-25T10:42:09Z)
• Understanding Compositional Structures in Art Historical Images using Pose and Gaze Priors [20.98603643788824]
  Image compositions are useful in analyzing the interactions in an image to study artists and their artworks. In this work, we attempt to automate this process using the existing state of the art machine learning techniques. Our approach focuses on two central themes of image composition: (a) detection of action regions and action lines of the artwork; and (b) pose-based segmentation of foreground and background.
  arXiv  Detail & Related papers  (2020-09-08T15:01:56Z)
• Modeling Artistic Workflows for Image Generation and Editing [83.43047077223947]
  We propose a generative model that follows a given artistic workflow. It enables both multi-stage image generation as well as multi-stage image editing of an existing piece of art.
  arXiv  Detail & Related papers  (2020-07-14T17:54:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.