Emergence of Painting Ability via Recognition-Driven Evolution

• URL: http://arxiv.org/abs/2501.04966v1
• Date: Thu, 09 Jan 2025 04:37:31 GMT
• Title: Emergence of Painting Ability via Recognition-Driven Evolution
• Authors: Yi Lin, Lin Gu, Ziteng Cui, Shenghan Su, Yumo Hao, Yingtao Tian, Tatsuya Harada, Jianfei Yang,
• Abstract summary: We present a model with a stroke branch and a palette branch that together simulate human-like painting. We quantify the efficiency of visual communication by measuring the recognition accuracy achieved with machine vision. Experimental results show that our model achieves superior performance in high-level recognition tasks.
• Score: 49.666177849272856
• License:
• Abstract: From Paleolithic cave paintings to Impressionism, human painting has evolved to depict increasingly complex and detailed scenes, conveying more nuanced messages. This paper attempts to emerge this artistic capability by simulating the evolutionary pressures that enhance visual communication efficiency. Specifically, we present a model with a stroke branch and a palette branch that together simulate human-like painting. The palette branch learns a limited colour palette, while the stroke branch parameterises each stroke using B\'ezier curves to render an image, subsequently evaluated by a high-level recognition module. We quantify the efficiency of visual communication by measuring the recognition accuracy achieved with machine vision. The model then optimises the control points and colour choices for each stroke to maximise recognition accuracy with minimal strokes and colours. Experimental results show that our model achieves superior performance in high-level recognition tasks, delivering artistic expression and aesthetic appeal, especially in abstract sketches. Additionally, our approach shows promise as an efficient bit-level image compression technique, outperforming traditional methods.

Related papers

• PrefPaint: Aligning Image Inpainting Diffusion Model with Human Preference [62.72779589895124]
  We make the first attempt to align diffusion models for image inpainting with human aesthetic standards via a reinforcement learning framework. We train a reward model with a dataset we construct, consisting of nearly 51,000 images annotated with human preferences. Experiments on inpainting comparison and downstream tasks, such as image extension and 3D reconstruction, demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2024-10-29T11:49:39Z)
• AttentionPainter: An Efficient and Adaptive Stroke Predictor for Scene Painting [82.54770866332456]
  Stroke-based Rendering (SBR) aims to decompose an input image into a sequence of parameterized strokes, which can be rendered into a painting that resembles the input image. We propose AttentionPainter, an efficient and adaptive model for single-step neural painting.
  arXiv  Detail & Related papers  (2024-10-21T18:36:45Z)
• Hyperstroke: A Novel High-quality Stroke Representation for Assistive Artistic Drawing [12.71408421022756]
  We introduce hyperstroke, a novel stroke representation designed to capture precise fine stroke details. We propose to model assistive drawing via a transformer-based architecture, to enable intuitive and user-friendly drawing applications.
  arXiv  Detail & Related papers  (2024-08-18T04:05:53Z)
• Segmentation-Based Parametric Painting [22.967620358813214]
  We introduce a novel image-to-painting method that facilitates the creation of large-scale, high-fidelity paintings with human-like quality and stylistic variation. We introduce a segmentation-based painting process and a dynamic attention map approach inspired by human painting strategies. Our optimized batch processing and patch-based loss framework enable efficient handling of large canvases.
  arXiv  Detail & Related papers  (2023-11-24T04:15:10Z)
• A domain adaptive deep learning solution for scanpath prediction of paintings [66.46953851227454]
  This paper focuses on the eye-movement analysis of viewers during the visual experience of a certain number of paintings. We introduce a new approach to predicting human visual attention, which impacts several cognitive functions for humans. The proposed new architecture ingests images and returns scanpaths, a sequence of points featuring a high likelihood of catching viewers' attention.
  arXiv  Detail & Related papers  (2022-09-22T22:27:08Z)
• Perceptual Artifacts Localization for Inpainting [60.5659086595901]
  We propose a new learning task of automatic segmentation of inpainting perceptual artifacts. We train advanced segmentation networks on a dataset to reliably localize inpainting artifacts within inpainted images. We also propose a new evaluation metric called Perceptual Artifact Ratio (PAR), which is the ratio of objectionable inpainted regions to the entire inpainted area.
  arXiv  Detail & Related papers  (2022-08-05T18:50:51Z)
• PTGCF: Printing Texture Guided Color Fusion for Impressionism Oil Painting Style Rendering [0.3249853429482705]
  The extraction of style information such as stroke texture and color of the target style image is the key to image stylization. A new stroke rendering method is proposed, which fully considers the tonal characteristics and the representative color of the original oil painting image. The experiments have validated the efficacy of the proposed model.
  arXiv  Detail & Related papers  (2022-07-26T00:31:23Z)
• ViCE: Self-Supervised Visual Concept Embeddings as Contextual and Pixel Appearance Invariant Semantic Representations [77.3590853897664]
  This work presents a self-supervised method to learn dense semantically rich visual embeddings for images inspired by methods for learning word embeddings in NLP.
  arXiv  Detail & Related papers  (2021-11-24T12:27:30Z)
• Automatic analysis of artistic paintings using information-based measures [1.25456674968456]
  We identify hidden patterns and relationships present in artistic paintings by analysing their complexity. We apply Normalized Compression (NC) and the Block Decomposition Method (BDM) to a dataset of 4,266 paintings from 91 authors. We define a fingerprint that describes critical information regarding the artists' style, their artistic influences, and shared techniques.
  arXiv  Detail & Related papers  (2021-02-02T21:40:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.