Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Image

• URL: http://arxiv.org/abs/2211.11931v1
• Date: Tue, 22 Nov 2022 00:55:42 GMT
• Title: Layered-Garment Net: Generating Multiple Implicit Garment Layers from a Single Image
• Authors: Alakh Aggarwal and Jikai Wang and Steven Hogue and Saifeng Ni and Madhukar Budagavi and Xiaohu Guo
• Abstract summary: Layered-Garment Net (LGN) is capable of generating intersection-free multiple layers of garments on the human body from a single image. To the best of our knowledge, LGN is the first research work to generate intersection-free multiple layers of garments on the human body from a single image.
• Score: 8.221518970067288
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent research works have focused on generating human models and garments from their 2D images. However, state-of-the-art researches focus either on only a single layer of the garment on a human model or on generating multiple garment layers without any guarantee of the intersection-free geometric relationship between them. In reality, people wear multiple layers of garments in their daily life, where an inner layer of garment could be partially covered by an outer one. In this paper, we try to address this multi-layer modeling problem and propose the Layered-Garment Net (LGN) that is capable of generating intersection-free multiple layers of garments defined by implicit function fields over the body surface, given the person's near front-view image. With a special design of garment indication fields (GIF), we can enforce an implicit covering relationship between the signed distance fields (SDF) of different layers to avoid self-intersections among different garment surfaces and the human body. Experiments demonstrate the strength of our proposed LGN framework in generating multi-layer garments as compared to state-of-the-art methods. To the best of our knowledge, LGN is the first research work to generate intersection-free multiple layers of garments on the human body from a single image.

Related papers

• Multi-Garment Customized Model Generation [3.1679243514285194]
  Multi-Garment Customized Model Generation is a unified framework based on Latent Diffusion Models (LDMs) Our framework supports the conditional generation of multiple garments through decoupled multi-garment feature fusion. The proposed garment encoder is a plug-and-play module that can be combined with other extension modules.
  arXiv  Detail & Related papers  (2024-08-09T17:57:33Z)
• ISP: Multi-Layered Garment Draping with Implicit Sewing Patterns [57.176642106425895]
  We introduce a garment representation model that addresses limitations of current approaches. It is faster and yields higher quality reconstructions than purely implicit surface representations. It supports rapid editing of garment shapes and texture by modifying individual 2D panels.
  arXiv  Detail & Related papers  (2023-05-23T14:23:48Z)
• ClothCombo: Modeling Inter-Cloth Interaction for Draping Multi-Layered Clothes [3.8079353598215757]
  We present ClothCombo, a pipeline to drape arbitrary combinations of clothes on 3D human models. Our method utilizes a GNN-based network to efficiently model the interaction between clothes in different layers.
  arXiv  Detail & Related papers  (2023-04-07T06:23:54Z)
• DIG: Draping Implicit Garment over the Human Body [56.68349332089129]
  We propose an end-to-end differentiable pipeline that represents garments using implicit surfaces and learns a skinning field conditioned on shape and pose parameters of an articulated body model. We show that our method, thanks to its end-to-end differentiability, allows to recover body and garments parameters jointly from image observations.
  arXiv  Detail & Related papers  (2022-09-22T08:13:59Z)
• InsetGAN for Full-Body Image Generation [90.71033704904629]
  We propose a novel method to combine multiple pretrained GANs. One GAN generates a global canvas (e.g., human body) and a set of specialized GANs, or insets, focus on different parts. We demonstrate the setup by combining a full body GAN with a dedicated high-quality face GAN to produce plausible-looking humans.
  arXiv  Detail & Related papers  (2022-03-14T17:01:46Z)
• HumanGAN: A Generative Model of Humans Images [78.6284090004218]
  We present a generative model for images of dressed humans offering control over pose, local body part appearance and garment style. Our model encodes part-based latent appearance vectors in a normalized pose-independent space and warps them to different poses, it preserves body and clothing appearance under varying posture.
  arXiv  Detail & Related papers  (2021-03-11T19:00:38Z)
• SMPLicit: Topology-aware Generative Model for Clothed People [65.84665248796615]
  We introduce SMPLicit, a novel generative model to jointly represent body pose, shape and clothing geometry. In the experimental section, we demonstrate SMPLicit can be readily used for fitting 3D scans and for 3D reconstruction in images of dressed people.
  arXiv  Detail & Related papers  (2021-03-11T18:57:03Z)
• VOGUE: Try-On by StyleGAN Interpolation Optimization [14.327659393182204]
  Given an image of a target person and an image of another person wearing a garment, we automatically generate the target garment. At the core of our method is a pose-conditioned StyleGAN2 latent space, which seamlessly combines the areas of interest from each image. Our algorithm allows for garments to deform according to the given body shape, while preserving pattern and material details.
  arXiv  Detail & Related papers  (2021-01-06T22:01:46Z)
• BCNet: Learning Body and Cloth Shape from A Single Image [56.486796244320125]
  We propose a layered garment representation on top of SMPL and novelly make the skinning weight of garment independent of the body mesh. Compared with existing methods, our method can support more garment categories and recover more accurate geometry.
  arXiv  Detail & Related papers  (2020-04-01T03:41:36Z)
• GarmentGAN: Photo-realistic Adversarial Fashion Transfer [0.0]
  GarmentGAN performs image-based garment transfer through generative adversarial methods. The framework allows users to virtually try-on items before purchase and generalizes to various apparel types.
  arXiv  Detail & Related papers  (2020-03-04T05:01:15Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.