Shape Controllable Virtual Try-on for Underwear Models
- URL: http://arxiv.org/abs/2107.13156v1
- Date: Wed, 28 Jul 2021 04:01:01 GMT
- Title: Shape Controllable Virtual Try-on for Underwear Models
- Authors: Xin Gao (1), Zhenjiang Liu (1), Zunlei Feng (2), Chengji Shen (2),
Kairi Ou (1), Haihong Tang (1) and Mingli Song (2) ((1) Alibaba Group, (2)
Zhejiang University)
- Abstract summary: We propose a Shape Controllable Virtual Try-On Network (SC-VTON) to dress clothing for underwear models.
SC-VTON integrates information of model and clothing to generate warped clothing image.
Our method can generate high-resolution results with detailed textures.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Image virtual try-on task has abundant applications and has become a hot
research topic recently. Existing 2D image-based virtual try-on methods aim to
transfer a target clothing image onto a reference person, which has two main
disadvantages: cannot control the size and length precisely; unable to
accurately estimate the user's figure in the case of users wearing thick
clothes, resulting in inaccurate dressing effect. In this paper, we put forward
an akin task that aims to dress clothing for underwear models. %, which is also
an urgent need in e-commerce scenarios. To solve the above drawbacks, we
propose a Shape Controllable Virtual Try-On Network (SC-VTON), where a graph
attention network integrates the information of model and clothing to generate
the warped clothing image. In addition, the control points are incorporated
into SC-VTON for the desired clothing shape. Furthermore, by adding a Splitting
Network and a Synthesis Network, we can use clothing/model pair data to help
optimize the deformation module and generalize the task to the typical virtual
try-on task. Extensive experiments show that the proposed method can achieve
accurate shape control. Meanwhile, compared with other methods, our method can
generate high-resolution results with detailed textures.
Related papers
- MV-VTON: Multi-View Virtual Try-On with Diffusion Models [91.71150387151042]
Multi-View Virtual Try-ON (MV-VTON) aims to reconstruct the dressing results of a person from multiple views using the given clothes.
In particular, we propose a view-adaptive selection method where hard-selection and soft-selection are applied.
Experiments show that the proposed method achieves state-of-the-art results on MV-VTON task using our MVG dataset.
arXiv Detail & Related papers (2024-04-26T12:27:57Z) - Better Fit: Accommodate Variations in Clothing Types for Virtual Try-on [25.550019373321653]
Image-based virtual try-on aims to transfer target in-shop clothing to a dressed model image.
We propose an adaptive mask training paradigm that dynamically adjusts training masks.
For unpaired try-on validation, we construct a comprehensive cross-try-on benchmark.
arXiv Detail & Related papers (2024-03-13T12:07:14Z) - A Two-stage Personalized Virtual Try-on Framework with Shape Control and
Texture Guidance [7.302929117437442]
This paper proposes a brand new personalized virtual try-on model (PE-VITON), which uses the two stages (shape control and texture guidance) to decouple the clothing attributes.
The proposed model can effectively solve the problems of weak reduction of clothing folds, poor generation effect under complex human posture, blurred edges of clothing, and unclear texture styles in traditional try-on methods.
arXiv Detail & Related papers (2023-12-24T13:32:55Z) - StableVITON: Learning Semantic Correspondence with Latent Diffusion
Model for Virtual Try-On [35.227896906556026]
Given a clothing image and a person image, an image-based virtual try-on aims to generate a customized image that appears natural and accurately reflects the characteristics of the clothing image.
In this work, we aim to expand the applicability of the pre-trained diffusion model so that it can be utilized independently for the virtual try-on task.
Our proposed zero cross-attention blocks not only preserve the clothing details by learning the semantic correspondence but also generate high-fidelity images by utilizing the inherent knowledge of the pre-trained model in the warping process.
arXiv Detail & Related papers (2023-12-04T08:27:59Z) - ClothFit: Cloth-Human-Attribute Guided Virtual Try-On Network Using 3D
Simulated Dataset [5.260305201345232]
We propose a novel virtual try-on method called ClothFit.
It can predict the draping shape of a garment on a target body based on the actual size of the garment and human attributes.
Our experimental results demonstrate that ClothFit can significantly improve the existing state-of-the-art methods in terms of photo-realistic virtual try-on results.
arXiv Detail & Related papers (2023-06-24T08:57:36Z) - Arbitrary Virtual Try-On Network: Characteristics Preservation and
Trade-off between Body and Clothing [85.74977256940855]
We propose an Arbitrary Virtual Try-On Network (AVTON) for all-type clothes.
AVTON can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person.
Our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.
arXiv Detail & Related papers (2021-11-24T08:59:56Z) - Towards Scalable Unpaired Virtual Try-On via Patch-Routed
Spatially-Adaptive GAN [66.3650689395967]
We propose a texture-preserving end-to-end network, the PAtch-routed SpaTially-Adaptive GAN (PASTA-GAN), that facilitates real-world unpaired virtual try-on.
To disentangle the style and spatial information of each garment, PASTA-GAN consists of an innovative patch-routed disentanglement module.
arXiv Detail & Related papers (2021-11-20T08:36:12Z) - SPG-VTON: Semantic Prediction Guidance for Multi-pose Virtual Try-on [27.870740623131816]
Image-based virtual try-on is challenging in fitting a target in-shop clothes into a reference person under diverse human poses.
We propose an end-to-end Semantic Prediction Guidance multi-pose Virtual Try-On Network (SPG-VTON)
We evaluate the proposed method on the most massive multi-pose dataset (MPV) and the DeepFashion dataset.
arXiv Detail & Related papers (2021-08-03T15:40:50Z) - SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks [54.94737477860082]
We present an end-to-end trainable framework that takes raw 3D scans of a clothed human and turns them into an animatable avatar.
SCANimate does not rely on a customized mesh template or surface mesh registration.
Our method can be applied to pose-aware appearance modeling to generate a fully textured avatar.
arXiv Detail & Related papers (2021-04-07T17:59:58Z) - Neural 3D Clothes Retargeting from a Single Image [91.5030622330039]
We present a method of clothes; generating the potential poses and deformations of a given 3D clothing template model to fit onto a person in a single RGB image.
The problem is fundamentally ill-posed as attaining the ground truth data is impossible, i.e. images of people wearing the different 3D clothing template model model at exact same pose.
We propose a semi-supervised learning framework that validates the physical plausibility of 3D deformation by matching with the prescribed body-to-cloth contact points and clothing to fit onto the unlabeled silhouette.
arXiv Detail & Related papers (2021-01-29T20:50:34Z) - SIZER: A Dataset and Model for Parsing 3D Clothing and Learning Size
Sensitive 3D Clothing [50.63492603374867]
We introduce SizerNet to predict 3D clothing conditioned on human body shape and garment size parameters.
We also introduce Net to infer garment meshes and shape under clothing with personal details in a single pass from an input mesh.
arXiv Detail & Related papers (2020-07-22T18:13:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.