VOGUE: Try-On by StyleGAN Interpolation Optimization
- URL: http://arxiv.org/abs/2101.02285v1
- Date: Wed, 6 Jan 2021 22:01:46 GMT
- Title: VOGUE: Try-On by StyleGAN Interpolation Optimization
- Authors: Kathleen M Lewis, Srivatsan Varadharajan, Ira Kemelmacher-Shlizerman
- Abstract summary: Given an image of a target person and an image of another person wearing a garment, we automatically generate the target garment.
At the core of our method is a pose-conditioned StyleGAN2 latent space, which seamlessly combines the areas of interest from each image.
Our algorithm allows for garments to deform according to the given body shape, while preserving pattern and material details.
- Score: 14.327659393182204
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Given an image of a target person and an image of another person wearing a
garment, we automatically generate the target person in the given garment. At
the core of our method is a pose-conditioned StyleGAN2 latent space
interpolation, which seamlessly combines the areas of interest from each image,
i.e., body shape, hair, and skin color are derived from the target person,
while the garment with its folds, material properties, and shape comes from the
garment image. By automatically optimizing for interpolation coefficients per
layer in the latent space, we can perform a seamless, yet true to source,
merging of the garment and target person. Our algorithm allows for garments to
deform according to the given body shape, while preserving pattern and material
details. Experiments demonstrate state-of-the-art photo-realistic results at
high resolution ($512\times 512$).
Related papers
- AniDress: Animatable Loose-Dressed Avatar from Sparse Views Using
Garment Rigging Model [58.035758145894846]
We introduce AniDress, a novel method for generating animatable human avatars in loose clothes using very sparse multi-view videos.
A pose-driven deformable neural radiance field conditioned on both body and garment motions is introduced, providing explicit control of both parts.
Our method is able to render natural garment dynamics that deviate highly from the body and well to generalize to both unseen views and poses.
arXiv Detail & Related papers (2024-01-27T08:48:18Z) - SPnet: Estimating Garment Sewing Patterns from a Single Image [10.604555099281173]
This paper presents a novel method for reconstructing 3D garment models from a single image of a posed user.
By inferring the fundamental shape of the garment through sewing patterns from a single image, we can generate 3D garments that can adaptively deform to arbitrary poses.
arXiv Detail & Related papers (2023-12-26T09:51:25Z) - TryOnDiffusion: A Tale of Two UNets [46.54704157349114]
Given two images depicting a person and a garment worn by another person, our goal is to generate a visualization of how the garment might look on the input person.
A key challenge is to synthesize a detail-preserving visualization of the garment, while warping the garment to accommodate a significant body pose and shape change.
We propose a diffusion-based architecture that unifies two UNets (referred to as Parallel-UNet)
arXiv Detail & Related papers (2023-06-14T06:25:58Z) - Layered-Garment Net: Generating Multiple Implicit Garment Layers from a
Single Image [8.221518970067288]
Layered-Garment Net (LGN) is capable of generating intersection-free multiple layers of garments on the human body from a single image.
To the best of our knowledge, LGN is the first research work to generate intersection-free multiple layers of garments on the human body from a single image.
arXiv Detail & Related papers (2022-11-22T00:55:42Z) - DIG: Draping Implicit Garment over the Human Body [56.68349332089129]
We propose an end-to-end differentiable pipeline that represents garments using implicit surfaces and learns a skinning field conditioned on shape and pose parameters of an articulated body model.
We show that our method, thanks to its end-to-end differentiability, allows to recover body and garments parameters jointly from image observations.
arXiv Detail & Related papers (2022-09-22T08:13:59Z) - Per Garment Capture and Synthesis for Real-time Virtual Try-on [15.128477359632262]
Existing image-based works try to synthesize a try-on image from a single image of a target garment.
It is difficult to reproduce the change of wrinkles caused by pose and body size change, as well as pulling and stretching of the garment by hand.
We propose an alternative per garment capture and synthesis workflow to handle such rich interactions by training the model with many systematically captured images.
arXiv Detail & Related papers (2021-09-10T03:49:37Z) - HumanGAN: A Generative Model of Humans Images [78.6284090004218]
We present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style.
Our model encodes part-based latent appearance vectors in a normalized pose-independent space and warps them to different poses, it preserves body and clothing appearance under varying posture.
arXiv Detail & Related papers (2021-03-11T19:00:38Z) - PISE: Person Image Synthesis and Editing with Decoupled GAN [64.70360318367943]
We propose PISE, a novel two-stage generative model for Person Image Synthesis and Editing.
For human pose transfer, we first synthesize a human parsing map aligned with the target pose to represent the shape of clothing.
To decouple the shape and style of clothing, we propose joint global and local per-region encoding and normalization.
arXiv Detail & Related papers (2021-03-06T04:32:06Z) - BCNet: Learning Body and Cloth Shape from A Single Image [56.486796244320125]
We propose a layered garment representation on top of SMPL and novelly make the skinning weight of garment independent of the body mesh.
Compared with existing methods, our method can support more garment categories and recover more accurate geometry.
arXiv Detail & Related papers (2020-04-01T03:41:36Z) - GarmentGAN: Photo-realistic Adversarial Fashion Transfer [0.0]
GarmentGAN performs image-based garment transfer through generative adversarial methods.
The framework allows users to virtually try-on items before purchase and generalizes to various apparel types.
arXiv Detail & Related papers (2020-03-04T05:01:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.