A Method for Animating Children's Drawings of the Human Figure

• URL: http://arxiv.org/abs/2303.12741v2
• Date: Tue, 4 Apr 2023 17:03:59 GMT
• Title: A Method for Animating Children's Drawings of the Human Figure
• Authors: Harrison Jesse Smith, Qingyuan Zheng, Yifei Li, Somya Jain, Jessica K. Hodgins
• Abstract summary: We present a system that automatically animates children's drawings of the human figure. We demonstrate the value and broad appeal of our approach by building and releasing the Animated Drawings Demo.
• Score: 9.076663874652725
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Children's drawings have a wonderful inventiveness, creativity, and variety to them. We present a system that automatically animates children's drawings of the human figure, is robust to the variance inherent in these depictions, and is simple and straightforward enough for anyone to use. We demonstrate the value and broad appeal of our approach by building and releasing the Animated Drawings Demo, a freely available public website that has been used by millions of people around the world. We present a set of experiments exploring the amount of training data needed for fine-tuning, as well as a perceptual study demonstrating the appeal of a novel twisted perspective retargeting technique. Finally, we introduce the Amateur Drawings Dataset, a first-of-its-kind annotated dataset, collected via the public demo, containing over 178,000 amateur drawings and corresponding user-accepted character bounding boxes, segmentation masks, and joint location annotations.

Related papers

• Pencils to Pixels: A Systematic Study of Creative Drawings across Children, Adults and AI [0.0]
  We analyze 1338 drawings by children, adults and AI on a creative drawing task. For style, we define measures of ink density, ink distribution and number of elements. For content, we use expert-annotated categories to study conceptual diversity. We build simple models to predict expert and automated creativity scores.
  arXiv  Detail & Related papers  (2025-02-09T19:02:32Z)
• Breathing Life Into Sketches Using Text-to-Video Priors [101.8236605955899]
  A sketch is one of the most intuitive and versatile tools humans use to convey their ideas visually. In this work, we present a method that automatically adds motion to a single-subject sketch. The output is a short animation provided in vector representation, which can be easily edited.
  arXiv  Detail & Related papers  (2023-11-21T18:09:30Z)
• SketchDreamer: Interactive Text-Augmented Creative Sketch Ideation [111.2195741547517]
  We present a method to generate controlled sketches using a text-conditioned diffusion model trained on pixel representations of images. Our objective is to empower non-professional users to create sketches and, through a series of optimisation processes, transform a narrative into a storyboard.
  arXiv  Detail & Related papers  (2023-08-27T19:44:44Z)
• I Know What You Draw: Learning Grasp Detection Conditioned on a Few Freehand Sketches [74.63313641583602]
  We propose a method to generate a potential grasp configuration relevant to the sketch-depicted objects. Our model is trained and tested in an end-to-end manner which is easy to be implemented in real-world applications.
  arXiv  Detail & Related papers  (2022-05-09T04:23:36Z)
• Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data [88.78171717494688]
  We propose a novel method to automatically transform face photos to portrait drawings using unpaired training data. Our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.
  arXiv  Detail & Related papers  (2022-02-08T06:49:57Z)
• DoodleFormer: Creative Sketch Drawing with Transformers [68.18953603715514]
  Creative sketching or doodling is an expressive activity, where imaginative and previously unseen depictions of everyday visual objects are drawn. Here, we propose a novel coarse-to-fine two-stage framework, DoodleFormer, that decomposes the creative sketch generation problem into the creation of coarse sketch composition. To ensure diversity of the generated creative sketches, we introduce a probabilistic coarse sketch decoder.
  arXiv  Detail & Related papers  (2021-12-06T18:59:59Z)
• Learning-based pose edition for efficient and interactive design [55.41644538483948]
  In computer-aided animation artists define the key poses of a character by manipulating its skeletons. Character pose must respect many ill-defined constraints, and so the resulting realism greatly depends on the animator's skill and knowledge. We describe an efficient tool for pose design, allowing users to intuitively manipulate a pose to create character animations.
  arXiv  Detail & Related papers  (2021-07-01T12:15:02Z)
• Creative Sketch Generation [48.16835161875747]
  We introduce two datasets of creative sketches -- Creative Birds and Creative Creatures -- containing 10k sketches each along with part annotations. We propose DoodlerGAN -- a part-based Generative Adrial Network (GAN) -- to generate unseen compositions of novel part appearances. Quantitative evaluations as well as human studies demonstrate that sketches generated by our approach are more creative and of higher quality than existing approaches.
  arXiv  Detail & Related papers  (2020-11-19T18:57:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.