Toward Modeling Creative Processes for Algorithmic Painting

• URL: http://arxiv.org/abs/2205.01605v1
• Date: Tue, 3 May 2022 16:33:45 GMT
• Title: Toward Modeling Creative Processes for Algorithmic Painting
• Authors: Aaron Hertzmann
• Abstract summary: The paper argues that creative processes often involve two important components: vague, high-level goals and exploratory processes for discovering new ideas. This paper sketches out possible computational mechanisms for imitating those elements of the painting process, including underspecified loss functions and iterative painting procedures with explicit task decompositions.
• Score: 12.602935529346063
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper proposes a framework for computational modeling of artistic painting algorithms, inspired by human creative practices. Based on examples from expert artists and from the author's own experience, the paper argues that creative processes often involve two important components: vague, high-level goals (e.g., "make a good painting"), and exploratory processes for discovering new ideas. This paper then sketches out possible computational mechanisms for imitating those elements of the painting process, including underspecified loss functions and iterative painting procedures with explicit task decompositions.

Related papers

• ProcessPainter: Learn Painting Process from Sequence Data [27.9875429986135]
  The painting process of artists is inherently stepwise and varies significantly among different painters and styles. Traditional stroke-based rendering methods break down images into sequences of brushstrokes, yet they fall short of replicating the authentic processes of artists. We introduce ProcessPainter, a text-to-video model that is initially pre-trained on synthetic data and subsequently fine-tuned with a select set of artists' painting sequences.
  arXiv  Detail & Related papers  (2024-06-10T07:18:41Z)
• Collaborative Neural Painting [27.880814775833578]
  We introduce a novel task, Collaborative Neural Painting (CNP), to facilitate collaborative art painting generation between humans and machines. CNP should produce a sequence of strokes supporting the completion of a coherent painting. We propose a painting representation based on a sequence of parametrized strokes, which makes it easy both editing and composition operations.
  arXiv  Detail & Related papers  (2023-12-04T10:45:12Z)
• SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation [111.2195741547517]
  We present a method to generate controlled sketches using a text-conditioned diffusion model trained on pixel representations of images. Our objective is to empower non-professional users to create sketches and, through a series of optimisation processes, transform a narrative into a storyboard.
  arXiv  Detail & Related papers  (2023-08-27T19:44:44Z)
• Interactive Neural Painting [66.9376011879115]
  This paper proposes the first approach for Interactive Neural Painting (NP) We propose I-Paint, a novel method based on a conditional transformer Variational AutoEncoder (VAE) architecture with a two-stage decoder. Our experiments show that our approach provides good stroke suggestions and compares favorably to the state of the art.
  arXiv  Detail & Related papers  (2023-07-31T07:02:00Z)
• Perceptual Artifacts Localization for Inpainting [60.5659086595901]
  We propose a new learning task of automatic segmentation of inpainting perceptual artifacts. We train advanced segmentation networks on a dataset to reliably localize inpainting artifacts within inpainted images. We also propose a new evaluation metric called Perceptual Artifact Ratio (PAR), which is the ratio of objectionable inpainted regions to the entire inpainted area.
  arXiv  Detail & Related papers  (2022-08-05T18:50:51Z)
• Generative Art Using Neural Visual Grammars and Dual Encoders [25.100664361601112]
  A novel algorithm for producing generative art is described. It allows a user to input a text string, and which in a creative response to this string, outputs an image.
  arXiv  Detail & Related papers  (2021-05-01T04:21:52Z)
• Identifying centres of interest in paintings using alignment and edge detection: Case studies on works by Luc Tuymans [1.8855270809505869]
  We set the first preliminary steps to algorithmically deconstruct some of the transformations that an artist applies to an original image in order to establish centres of interest. We introduce a comparative methodology that first cuts out the minimal segment from the original image on which the painting is based, then aligns the painting with this source, investigates micro-differences to identify centres of interest and attempts to understand their role.
  arXiv  Detail & Related papers  (2021-01-04T10:04:19Z)
• Explaining Creative Artifacts [69.86890599471202]
  We develop an inverse problem formulation to deconstruct the products of and compositional creativity into associative chains. In particular, our formulation is structured as solving a traveling salesman problem through a knowledge graph of associative elements.
  arXiv  Detail & Related papers  (2020-10-14T14:32:38Z)
• SketchEmbedNet: Learning Novel Concepts by Imitating Drawings [125.45799722437478]
  We explore properties of image representations learned by training a model to produce sketches of images. We show that this generative, class-agnostic model produces informative embeddings of images from novel examples, classes, and even novel datasets in a few-shot setting.
  arXiv  Detail & Related papers  (2020-08-27T16:43:28Z)
• Modeling Artistic Workflows for Image Generation and Editing [83.43047077223947]
  We propose a generative model that follows a given artistic workflow. It enables both multi-stage image generation as well as multi-stage image editing of an existing piece of art.
  arXiv  Detail & Related papers  (2020-07-14T17:54:26Z)
• Interactive Neural Style Transfer with Artists [6.130486652666935]
  We present interactive painting processes in which a painter and various neural style transfer algorithms interact on a real canvas. We gather a set of paired painting-pictures images and present a new evaluation methodology based on the predictivity of neural style transfer algorithms.
  arXiv  Detail & Related papers  (2020-03-14T15:27:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.