AutoToon: Automatic Geometric Warping for Face Cartoon Generation

• URL: http://arxiv.org/abs/2004.02377v1
• Date: Mon, 6 Apr 2020 02:27:51 GMT
• Title: AutoToon: Automatic Geometric Warping for Face Cartoon Generation
• Authors: Julia Gong (1), Yannick Hold-Geoffroy (2), Jingwan Lu (2) ((1) Stanford University, (2) Adobe Research)
• Abstract summary: We propose AutoToon, the first supervised deep learning method that yields high-quality warps for the warping component of caricatures. In contrast to prior art, we leverage an SENet and spatial transformer module and train directly on artist warping fields. We achieve appealing exaggerations that amplify distinguishing features of the face while preserving facial detail.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Caricature, a type of exaggerated artistic portrait, amplifies the distinctive, yet nuanced traits of human faces. This task is typically left to artists, as it has proven difficult to capture subjects' unique characteristics well using automated methods. Recent development of deep end-to-end methods has achieved promising results in capturing style and higher-level exaggerations. However, a key part of caricatures, face warping, has remained challenging for these systems. In this work, we propose AutoToon, the first supervised deep learning method that yields high-quality warps for the warping component of caricatures. Completely disentangled from style, it can be paired with any stylization method to create diverse caricatures. In contrast to prior art, we leverage an SENet and spatial transformer module and train directly on artist warping fields, applying losses both prior to and after warping. As shown by our user studies, we achieve appealing exaggerations that amplify distinguishing features of the face while preserving facial detail.

Related papers

• Portrait Diffusion: Training-free Face Stylization with Chain-of-Painting [64.43760427752532]
  Face stylization refers to the transformation of a face into a specific portrait style. Current methods require the use of example-based adaptation approaches to fine-tune pre-trained generative models. This paper proposes a training-free face stylization framework, named Portrait Diffusion.
  arXiv  Detail & Related papers  (2023-12-03T06:48:35Z)
• High-Quality Face Caricature via Style Translation [1.3457834965263997]
  We propose a high-quality, unpaired face caricature method that is appropriate for use in the real world. We attain the exaggeration of facial features and the stylization of appearance through a two-step process. The Face caricature projection employs an encoder trained with real and caricature faces with the pretrained generator to project real and caricature faces.
  arXiv  Detail & Related papers  (2023-11-22T12:03:33Z)
• Portrait Stylization: Artistic Style Transfer with Auxiliary Networks for Human Face Stylization [0.0]
  This paper proposes the use of embeddings from an auxiliary pre-trained face recognition model to encourage the algorithm to propagate human face features from the content image to the final stylized result.
  arXiv  Detail & Related papers  (2023-09-23T23:02:32Z)
• Quality Metric Guided Portrait Line Drawing Generation from Unpaired Training Data [88.78171717494688]
  We propose a novel method to automatically transform face photos to portrait drawings using unpaired training data. Our method can (1) learn to generate high quality portrait drawings in multiple styles using a single network and (2) generate portrait drawings in a "new style" unseen in the training data.
  arXiv  Detail & Related papers  (2022-02-08T06:49:57Z)
• Unsupervised Contrastive Photo-to-Caricature Translation based on Auto-distortion [49.93278173824292]
  Photo-to-caricature aims to synthesize the caricature as a rendered image exaggerating the features through sketching, pencil strokes, or other artistic drawings. Style rendering and geometry deformation are the most important aspects in photo-to-caricature translation task. We propose an unsupervised contrastive photo-to-caricature translation architecture.
  arXiv  Detail & Related papers  (2020-11-10T08:14:36Z)
• CariMe: Unpaired Caricature Generation with Multiple Exaggerations [22.342630945133312]
  Caricature generation aims to translate real photos into caricatures with artistic styles and shape exaggerations. Previous caricature generation methods are obsessed with predicting definite image warping from a given photo. We propose a Multi-exaggeration Warper network to learn the distribution-level mapping from photo to facial exaggerations.
  arXiv  Detail & Related papers  (2020-10-01T08:14:32Z)
• DeepFacePencil: Creating Face Images from Freehand Sketches [77.00929179469559]
  Existing image-to-image translation methods require a large-scale dataset of paired sketches and images for supervision. We propose DeepFacePencil, an effective tool that is able to generate photo-realistic face images from hand-drawn sketches.
  arXiv  Detail & Related papers  (2020-08-31T03:35:21Z)
• Neutral Face Game Character Auto-Creation via PokerFace-GAN [0.0]
  This paper studies the problem of automatically creating in-game characters with a single photo. We first build a differentiable character which is more flexible than the previous methods in multi-view rendering cases. We then take advantage of the adversarial training to effectively disentangle the expression parameters from the identity parameters.
  arXiv  Detail & Related papers  (2020-08-17T08:43:48Z)
• Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture [58.78290175562601]
  This paper presents a solution to the problem of deforming an artist-drawn caricature according to a given normal face expression. The key of our solution is a novel method to model caricature expression, which extends traditional 3DMM representation to caricature domain. The experiments demonstrate the effectiveness of the proposed method.
  arXiv  Detail & Related papers  (2020-08-13T06:31:01Z)
• Learning to Caricature via Semantic Shape Transform [95.25116681761142]
  We propose an algorithm based on a semantic shape transform to produce shape exaggerations. We show that the proposed framework is able to render visually pleasing shape exaggerations while maintaining their facial structures.
  arXiv  Detail & Related papers  (2020-08-12T03:41:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.