Docent: A content-based recommendation system to discover contemporary art

• URL: http://arxiv.org/abs/2207.05648v1
• Date: Tue, 12 Jul 2022 16:26:27 GMT
• Title: Docent: A content-based recommendation system to discover contemporary art
• Authors: Antoine Fosset, Mohamed El-Mennaoui, Amine Rebei, Paul Calligaro, Elise Farge Di Maria, H\'el\`ene Nguyen-Ban, Francesca Rea, Marie-Charlotte Vallade, Elisabetta Vitullo, Christophe Zhang, Guillaume Charpiat and Mathieu Rosenbaum
• Abstract summary: We present a content-based recommendation system on contemporary art relying on images of artworks and contextual metadata of artists. We gathered and annotated artworks with advanced and art-specific information to create a unique database that was used to train our models. After an assessment by a team of art specialists, we get an average final rating of 75% of meaningful artworks.
• Score: 0.8782885374383763
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Recommendation systems have been widely used in various domains such as music, films, e-shopping etc. After mostly avoiding digitization, the art world has recently reached a technological turning point due to the pandemic, making online sales grow significantly as well as providing quantitative online data about artists and artworks. In this work, we present a content-based recommendation system on contemporary art relying on images of artworks and contextual metadata of artists. We gathered and annotated artworks with advanced and art-specific information to create a completely unique database that was used to train our models. With this information, we built a proximity graph between artworks. Similarly, we used NLP techniques to characterize the practices of the artists and we extracted information from exhibitions and other event history to create a proximity graph between artists. The power of graph analysis enables us to provide an artwork recommendation system based on a combination of visual and contextual information from artworks and artists. After an assessment by a team of art specialists, we get an average final rating of 75% of meaningful artworks when compared to their professional evaluations.

Related papers

• Have Large Vision-Language Models Mastered Art History? [0.0]
  Art historians have long studied the unique aspects of artworks, with style prediction being a crucial component of their discipline. This paper investigates whether large Vision-Language Models, which integrate visual and textual data, can effectively predict the art historical attributes of paintings.
  arXiv  Detail & Related papers  (2024-09-05T13:33:57Z)
• GalleryGPT: Analyzing Paintings with Large Multimodal Models [64.98398357569765]
  Artwork analysis is important and fundamental skill for art appreciation, which could enrich personal aesthetic sensibility and facilitate the critical thinking ability. Previous works for automatically analyzing artworks mainly focus on classification, retrieval, and other simple tasks, which is far from the goal of AI. We introduce a superior large multimodal model for painting analysis composing, dubbed GalleryGPT, which is slightly modified and fine-tuned based on LLaVA architecture.
  arXiv  Detail & Related papers  (2024-08-01T11:52:56Z)
• Interactive Neural Painting [66.9376011879115]
  This paper proposes the first approach for Interactive Neural Painting (NP) We propose I-Paint, a novel method based on a conditional transformer Variational AutoEncoder (VAE) architecture with a two-stage decoder. Our experiments show that our approach provides good stroke suggestions and compares favorably to the state of the art.
  arXiv  Detail & Related papers  (2023-07-31T07:02:00Z)
• Learning to Evaluate the Artness of AI-generated Images [64.48229009396186]
  ArtScore is a metric designed to evaluate the degree to which an image resembles authentic artworks by artists. We employ pre-trained models for photo and artwork generation, resulting in a series of mixed models. This dataset is then employed to train a neural network that learns to estimate quantized artness levels of arbitrary images.
  arXiv  Detail & Related papers  (2023-05-08T17:58:27Z)
• Towards Artistic Image Aesthetics Assessment: a Large-scale Dataset and a New Method [64.40494830113286]
  We first introduce a large-scale AIAA dataset: Boldbrush Artistic Image dataset (BAID), which consists of 60,337 artistic images covering various art forms. We then propose a new method, SAAN, which can effectively extract and utilize style-specific and generic aesthetic information to evaluate artistic images. Experiments demonstrate that our proposed approach outperforms existing IAA methods on the proposed BAID dataset.
  arXiv  Detail & Related papers  (2023-03-27T12:59:15Z)
• Towards mapping the contemporary art world with ArtLM: an art-specific NLP model [0.0]
  We present a generic Natural Language Processing framework (called ArtLM) to discover the connections among contemporary artists based on their biographies. With extensive experiments, we demonstrate that our ArtLM achieves 85.6% accuracy and 84.0% F1 score. We also provide a visualisation and a qualitative analysis of the artist network built from ArtLM's outputs.
  arXiv  Detail & Related papers  (2022-12-14T09:26:07Z)
• Art Creation with Multi-Conditional StyleGANs [81.72047414190482]
  A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. We introduce a multi-conditional Generative Adversarial Network (GAN) approach trained on large amounts of human paintings to synthesize realistic-looking paintings that emulate human art.
  arXiv  Detail & Related papers  (2022-02-23T20:45:41Z)
• ArtGraph: Towards an Artistic Knowledge Graph [6.233095477694583]
  This paper presents our ongoing work towards ArtGraph: an artistic knowledge graph based on WikiArt and DBpedia. A knowledge graph that integrates a rich body of information about artworks, artists, painting schools, etc., in a unified structured framework can provide a valuable resource for more powerful information retrieval and knowledge discovery tools in the artistic domain.
  arXiv  Detail & Related papers  (2021-05-31T15:09:05Z)
• Demographic Influences on Contemporary Art with Unsupervised Style Embeddings [25.107166631583212]
  contempArt is a collection of paintings and drawings, a detailed graph network based on social connections on Instagram and additional socio-demographic information. We evaluate three methods suited for generating unsupervised style embeddings of images and correlate them with the remaining data.
  arXiv  Detail & Related papers  (2020-09-30T10:13:18Z)
• Understanding Compositional Structures in Art Historical Images using Pose and Gaze Priors [20.98603643788824]
  Image compositions are useful in analyzing the interactions in an image to study artists and their artworks. In this work, we attempt to automate this process using the existing state of the art machine learning techniques. Our approach focuses on two central themes of image composition: (a) detection of action regions and action lines of the artwork; and (b) pose-based segmentation of foreground and background.
  arXiv  Detail & Related papers  (2020-09-08T15:01:56Z)
• Art Speaks Maths, Maths Speaks Art [53.473846742702854]
  Our interdisciplinary team Mathematics for Applications in Cultural Heritage (MACH) aims to use mathematical research for the benefit of the arts and humanities. Our ultimate goal is to create user-friendly software toolkits for artists, art conservators and archaeologists.
  arXiv  Detail & Related papers  (2020-07-17T10:24:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.