Controllable Garment Transfer

• URL: http://arxiv.org/abs/2204.01965v1
• Date: Tue, 5 Apr 2022 03:43:21 GMT
• Title: Controllable Garment Transfer
• Authors: Jooeun Son, Tomas Cabezon Pedroso, Carolene Siga, Jinsung Lee
• Abstract summary: Image-based garment transfer replaces the garment on the target human with the desired garment. We aim to add this customizable option of "garment tweaking" to our model to control garment attributes, such as sleeve length, waist width, and garment texture.
• Score: 0.726437825413781
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Image-based garment transfer replaces the garment on the target human with the desired garment; this enables users to virtually view themselves in the desired garment. To this end, many approaches have been proposed using the generative model and have shown promising results. However, most fail to provide the user with on the fly garment modification functionality. We aim to add this customizable option of "garment tweaking" to our model to control garment attributes, such as sleeve length, waist width, and garment texture.

Related papers

• IMAGDressing-v1: Customizable Virtual Dressing [58.44155202253754]
  IMAGDressing-v1 is a virtual dressing task that generates freely editable human images with fixed garments and optional conditions. IMAGDressing-v1 incorporates a garment UNet that captures semantic features from CLIP and texture features from VAE. We present a hybrid attention module, including a frozen self-attention and a trainable cross-attention, to integrate garment features from the garment UNet into a frozen denoising UNet.
  arXiv  Detail & Related papers  (2024-07-17T16:26:30Z)
• Magic Clothing: Controllable Garment-Driven Image Synthesis [7.46772222515689]
  We propose Magic Clothing, a latent diffusion model (LDM)-based network architecture for an unexplored garment-driven image synthesis task. Aiming at generating customized characters wearing the target garments with diverse text prompts, the image controllability is the most critical issue. We introduce a garment extractor to capture the detailed garment features, and employ self-attention fusion to incorporate them into the pretrained LDMs.
  arXiv  Detail & Related papers  (2024-04-15T07:15:39Z)
• AniDress: Animatable Loose-Dressed Avatar from Sparse Views Using Garment Rigging Model [58.035758145894846]
  We introduce AniDress, a novel method for generating animatable human avatars in loose clothes using very sparse multi-view videos. A pose-driven deformable neural radiance field conditioned on both body and garment motions is introduced, providing explicit control of both parts. Our method is able to render natural garment dynamics that deviate highly from the body and well to generalize to both unseen views and poses.
  arXiv  Detail & Related papers  (2024-01-27T08:48:18Z)
• SPnet: Estimating Garment Sewing Patterns from a Single Image [10.604555099281173]
  This paper presents a novel method for reconstructing 3D garment models from a single image of a posed user. By inferring the fundamental shape of the garment through sewing patterns from a single image, we can generate 3D garments that can adaptively deform to arbitrary poses.
  arXiv  Detail & Related papers  (2023-12-26T09:51:25Z)
• Garment Recovery with Shape and Deformation Priors [51.41962835642731]
  We propose a method that delivers realistic garment models from real-world images, regardless of garment shape or deformation. Not only does our approach recover the garment geometry accurately, it also yields models that can be directly used by downstream applications such as animation and simulation.
  arXiv  Detail & Related papers  (2023-11-17T07:06:21Z)
• Wearing the Same Outfit in Different Ways -- A Controllable Virtual Try-on Method [9.176056742068813]
  An outfit visualization method generates an image of a person wearing real garments from images of those garments. Current methods can produce images that look realistic and preserve garment identity, captured in details such as collar, cuffs, texture, hem, and sleeve length. We describe an outfit visualization method that controls drape while preserving garment identity.
  arXiv  Detail & Related papers  (2022-11-29T01:01:01Z)
• DIG: Draping Implicit Garment over the Human Body [56.68349332089129]
  We propose an end-to-end differentiable pipeline that represents garments using implicit surfaces and learns a skinning field conditioned on shape and pose parameters of an articulated body model. We show that our method, thanks to its end-to-end differentiability, allows to recover body and garments parameters jointly from image observations.
  arXiv  Detail & Related papers  (2022-09-22T08:13:59Z)
• Per Garment Capture and Synthesis for Real-time Virtual Try-on [15.128477359632262]
  Existing image-based works try to synthesize a try-on image from a single image of a target garment. It is difficult to reproduce the change of wrinkles caused by pose and body size change, as well as pulling and stretching of the garment by hand. We propose an alternative per garment capture and synthesis workflow to handle such rich interactions by training the model with many systematically captured images.
  arXiv  Detail & Related papers  (2021-09-10T03:49:37Z)
• Addressing the Cold-Start Problem in Outfit Recommendation Using Visual Preference Modelling [51.147871738838305]
  This paper attempts to address the cold-start problem for new users by leveraging a novel visual preference modelling approach. We demonstrate the use of our approach with feature-weighted clustering to personalise occasion-oriented outfit recommendation.
  arXiv  Detail & Related papers  (2020-08-04T10:07:09Z)
• BCNet: Learning Body and Cloth Shape from A Single Image [56.486796244320125]
  We propose a layered garment representation on top of SMPL and novelly make the skinning weight of garment independent of the body mesh. Compared with existing methods, our method can support more garment categories and recover more accurate geometry.
  arXiv  Detail & Related papers  (2020-04-01T03:41:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.