Towards mapping the contemporary art world with ArtLM: an art-specific NLP model

• URL: http://arxiv.org/abs/2212.07127v3
• Date: Fri, 16 Dec 2022 12:52:19 GMT
• Title: Towards mapping the contemporary art world with ArtLM: an art-specific NLP model
• Authors: Qinkai Chen, Mohamed El-Mennaoui, Antoine Fosset, Amine Rebei, Haoyang Cao, Philine Bouscasse, Christy E\'oin O'Beirne, Sasha Shevchenko and Mathieu Rosenbaum
• Abstract summary: We present a generic Natural Language Processing framework (called ArtLM) to discover the connections among contemporary artists based on their biographies. With extensive experiments, we demonstrate that our ArtLM achieves 85.6% accuracy and 84.0% F1 score. We also provide a visualisation and a qualitative analysis of the artist network built from ArtLM's outputs.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: With an increasing amount of data in the art world, discovering artists and artworks suitable to collectors' tastes becomes a challenge. It is no longer enough to use visual information, as contextual information about the artist has become just as important in contemporary art. In this work, we present a generic Natural Language Processing framework (called ArtLM) to discover the connections among contemporary artists based on their biographies. In this approach, we first continue to pre-train the existing general English language models with a large amount of unlabelled art-related data. We then fine-tune this new pre-trained model with our biography pair dataset manually annotated by a team of professionals in the art industry. With extensive experiments, we demonstrate that our ArtLM achieves 85.6% accuracy and 84.0% F1 score and outperforms other baseline models. We also provide a visualisation and a qualitative analysis of the artist network built from ArtLM's outputs.

Related papers

• IntroStyle: Training-Free Introspective Style Attribution using Diffusion Features [89.95303251220734]
  We present a training-free framework to solve the style attribution problem, using the features produced by a diffusion model alone. This is denoted as introspective style attribution (IntroStyle) and demonstrates superior performance to state-of-the-art models for style retrieval. We also introduce a synthetic dataset of Style Hacks (SHacks) to isolate artistic style and evaluate fine-grained style attribution performance.
  arXiv  Detail & Related papers  (2024-12-19T01:21:23Z)
• Art-Free Generative Models: Art Creation Without Graphic Art Knowledge [50.60063523054282]
  We propose a text-to-image generation model trained without access to art-related content. We then introduce a simple yet effective method to learn an art adapter using only a few examples of selected artistic styles.
  arXiv  Detail & Related papers  (2024-11-29T18:59:01Z)
• Have Large Vision-Language Models Mastered Art History? [0.0]
  Art historians have long studied the unique aspects of artworks, with style prediction being a crucial component of their discipline. This paper investigates whether large Vision-Language Models, which integrate visual and textual data, can effectively predict the art historical attributes of paintings.
  arXiv  Detail & Related papers  (2024-09-05T13:33:57Z)
• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• Learning to Evaluate the Artness of AI-generated Images [64.48229009396186]
  ArtScore is a metric designed to evaluate the degree to which an image resembles authentic artworks by artists. We employ pre-trained models for photo and artwork generation, resulting in a series of mixed models. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images.
  arXiv  Detail & Related papers  (2023-05-08T17:58:27Z)
• Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method [64.40494830113286]
  We first introduce a large-scale AIAA dataset: Boldbrush Artistic Image dataset (BAID), which consists of 60,337 artistic images covering various art forms. We then propose a new method, SAAN, which can effectively extract and utilize style-specific and generic aesthetic information to evaluate artistic images. Experiments demonstrate that our proposed approach outperforms existing IAA methods on the proposed BAID dataset.
  arXiv  Detail & Related papers  (2023-03-27T12:59:15Z)
• Creative Painting with Latent Diffusion Models [1.4649095013539173]
  latent diffusion models (LDMs) have achieved stable and high fertility image generation. We focus on enhancing the creative painting ability of current LDMs in two directions, textual condition extension and model retraining with Wikiart dataset.
  arXiv  Detail & Related papers  (2022-09-29T11:49:07Z)
• Docent: A content-based recommendation system to discover contemporary art [0.8782885374383763]
  We present a content-based recommendation system on contemporary art relying on images of artworks and contextual metadata of artists. We gathered and annotated artworks with advanced and art-specific information to create a unique database that was used to train our models. After an assessment by a team of art specialists, we get an average final rating of 75% of meaningful artworks.
  arXiv  Detail & Related papers  (2022-07-12T16:26:27Z)
• Demographic Influences on Contemporary Art with Unsupervised Style Embeddings [25.107166631583212]
  contempArt is a collection of paintings and drawings, a detailed graph network based on social connections on Instagram and additional socio-demographic information. We evaluate three methods suited for generating unsupervised style embeddings of images and correlate them with the remaining data.
  arXiv  Detail & Related papers  (2020-09-30T10:13:18Z)
• Modeling Artistic Workflows for Image Generation and Editing [83.43047077223947]
  We propose a generative model that follows a given artistic workflow. It enables both multi-stage image generation as well as multi-stage image editing of an existing piece of art.
  arXiv  Detail & Related papers  (2020-07-14T17:54:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.