Pattern Guided UV Recovery for Realistic Video Garment Texturing

• URL: http://arxiv.org/abs/2407.10137v1
• Date: Sun, 14 Jul 2024 09:47:37 GMT
• Title: Pattern Guided UV Recovery for Realistic Video Garment Texturing
• Abstract summary: We present a pattern-based approach for UV and shading recovery from a captured real video so that the garment's texture can be replaced automatically. We propose a novel loss on the Jacobian of the UV mapping to create pleasant seams around the folding areas and the boundary of occluded regions. We show plausible texture replacement results in our experiment, in which the folding and overlapping of the garment can be greatly preserved.
• Score: 32.759330693659514
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The fast growth of E-Commerce creates a global market worth USD 821 billion for online fashion shopping. What unique about fashion presentation is that, the same design can usually be offered with different cloths textures. However, only real video capturing or manual per-frame editing can be used for virtual showcase on the same design with different textures, both of which are heavily labor intensive. In this paper, we present a pattern-based approach for UV and shading recovery from a captured real video so that the garment's texture can be replaced automatically. The core of our approach is a per-pixel UV regression module via blended-weight multilayer perceptrons (MLPs) driven by the detected discrete correspondences from the cloth pattern. We propose a novel loss on the Jacobian of the UV mapping to create pleasant seams around the folding areas and the boundary of occluded regions while avoiding UV distortion. We also adopts the temporal constraint to ensure consistency and accuracy in UV prediction across adjacent frames. We show that our approach is robust to a variety type of clothes, in the wild illuminations and with challenging motions. We show plausible texture replacement results in our experiment, in which the folding and overlapping of the garment can be greatly preserved. We also show clear qualitative and quantitative improvement compared to the baselines as well. With the one-click setup, we look forward to our approach contributing to the growth of fashion E-commerce.

Related papers

• Generative Relightable Avatars [54.38436795769187]
  Generative Relightable Avatars (GRA) is a person-specific method for free-view rendering and environment-map relighting of full-body humans.<n>GRA follows a hybrid approach that combines controllable, physics-grounded relighting with probabilistic refinement.
  arXiv  Detail & Related papers  (2026-06-21T23:36:00Z)
• UIKA: Fast Universal Head Avatar from Pose-Free Images [65.03770342532134]
  We present Uika, a feed-forward animatable Gaussian head model from an arbitrary number of unposed inputs.<n>Unlike the traditional avatar method, we rethink the task through the lenses of model representation, network design, and data preparation.<n>Our method significantly outperforms existing approaches in both monocular and multi-view settings.
  arXiv  Detail & Related papers  (2026-01-12T14:53:56Z)
• GTAvatar: Bridging Gaussian Splatting and Texture Mapping for Relightable and Editable Gaussian Avatars [15.497767924681254]
  We propose a method that combines the accuracy and fidelity of 2D Gaussian Splatting with the intuitiveness of UV texture mapping.<n>We demonstrate the accuracy of our reconstructions, the quality of our relighting results, and the ability to provide intuitive controls for modifying an avatar's appearance and geometry.
  arXiv  Detail & Related papers  (2025-12-09T22:19:28Z)
• SeamCrafter: Enhancing Mesh Seam Generation for Artist UV Unwrapping via Reinforcement Learning [17.67515163123214]
  We introduce SeamCrafter, an autoregressive GPT-style seam generator conditioned on point encoder inputs.<n>SeamCrafter produces seams with substantially lower distortion and fragmentation than prior approaches.
  arXiv  Detail & Related papers  (2025-09-25T03:58:59Z)
• ArtUV: Artist-style UV Unwrapping [15.072561481603037]
  We introduce ArtUV, a fully automated, end-to-end method for generating artist-style UV unwrapping.<n>We simulate the professional UV mapping process by dividing it into two stages: surface seam prediction and artist-style UV parameterization.<n>Our method ensures semantic consistency and preserves topological structure, making the UV map ready for 2D editing.
  arXiv  Detail & Related papers  (2025-09-25T03:21:21Z)
• SeqTex: Generate Mesh Textures in Video Sequence [62.766839821764144]
  We introduce SeqTex, a novel end-to-end framework for training 3D texture generative models.<n>We show that SeqTex achieves state-of-the-art performance on both image-conditioned and text-conditioned 3D texture generation tasks.
  arXiv  Detail & Related papers  (2025-07-06T07:58:36Z)
• MagicTryOn: Harnessing Diffusion Transformer for Garment-Preserving Video Virtual Try-on [16.0505428363005]
  We propose MagicTryOn, a video virtual try-on framework built upon the large-scale video diffusion Transformer.<n>We replace the U-Net architecture with a diffusion Transformer and combine full self-attention to model the garment consistency of videos.<n>Our method outperforms existing SOTA methods in comprehensive evaluations and generalizes to in-the-wild scenarios.
  arXiv  Detail & Related papers  (2025-05-27T15:22:02Z)
• TEXGen: a Generative Diffusion Model for Mesh Textures [63.43159148394021]
  We focus on the fundamental problem of learning in the UV texture space itself. We propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. We train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images.
  arXiv  Detail & Related papers  (2024-11-22T05:22:11Z)
• GraVITON: Graph based garment warping with attention guided inversion for Virtual-tryon [5.790630195329777]
  We introduce a novel graph based warping technique which emphasizes the value of context in garment flow. Our method, validated on VITON-HD and Dresscode datasets, showcases substantial improvement in garment warping, texture preservation, and overall realism.
  arXiv  Detail & Related papers  (2024-06-04T10:29:18Z)
• Texture-GS: Disentangling the Geometry and Texture for 3D Gaussian Splatting Editing [79.10630153776759]
  3D Gaussian splatting, emerging as a groundbreaking approach, has drawn increasing attention for its capabilities of high-fidelity reconstruction and real-time rendering. We propose a novel approach, namely Texture-GS, to disentangle the appearance from the geometry by representing it as a 2D texture mapped onto the 3D surface. Our method not only facilitates high-fidelity appearance editing but also achieves real-time rendering on consumer-level devices.
  arXiv  Detail & Related papers  (2024-03-15T06:42:55Z)
• Texture Generation on 3D Meshes with Point-UV Diffusion [86.69672057856243]
  We present Point-UV diffusion, a coarse-to-fine pipeline that marries the denoising diffusion model with UV mapping to generate high-quality texture images in UV space. Our method can process meshes of any genus, generating diversified, geometry-compatible, and high-fidelity textures.
  arXiv  Detail & Related papers  (2023-08-21T06:20:54Z)
• xCloth: Extracting Template-free Textured 3D Clothes from a Monocular Image [4.056667956036515]
  We present a novel framework for template-free textured 3D garment digitization. More specifically, we propose to extend PeeledHuman representation to predict the pixel-aligned, layered depth and semantic maps. We achieve high-fidelity 3D garment reconstruction results on three publicly available datasets and generalization on internet images.
  arXiv  Detail & Related papers  (2022-08-27T05:57:00Z)
• TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates [37.58323494348772]
  We propose a novel approach to generate temporally coherent UV coordinates for loose clothing. Our method is not constrained by human body outlines and can capture loose garments and hair.
  arXiv  Detail & Related papers  (2022-04-07T18:00:32Z)
• Arbitrary Virtual Try-On Network: Characteristics Preservation and Trade-off between Body and Clothing [85.74977256940855]
  We propose an Arbitrary Virtual Try-On Network (AVTON) for all-type clothes. AVTON can synthesize realistic try-on images by preserving and trading off characteristics of the target clothes and the reference person. Our approach can achieve better performance compared with the state-of-the-art virtual try-on methods.
  arXiv  Detail & Related papers  (2021-11-24T08:59:56Z)
• DeepCloth: Neural Garment Representation for Shape and Style Editing [37.595804908189855]
  We introduce a novel method, termed as DeepCloth, to establish a unified garment representation framework. Our key idea is to represent garment geometry by a "UV-position map with mask" We learn a continuous feature space mapped from the above UV space, enabling garment shape editing and transition.
  arXiv  Detail & Related papers  (2020-11-30T08:42:38Z)
• MonoClothCap: Towards Temporally Coherent Clothing Capture from Monocular RGB Video [10.679773937444445]
  We present a method to capture temporally coherent dynamic clothing deformation from a monocular RGB video input. We build statistical deformation models for three types of clothing: T-shirt, short pants and long pants. Our method produces temporally coherent reconstruction of body and clothing from monocular video.
  arXiv  Detail & Related papers  (2020-09-22T17:54:38Z)
• BCNet: Learning Body and Cloth Shape from A Single Image [56.486796244320125]
  We propose a layered garment representation on top of SMPL and novelly make the skinning weight of garment independent of the body mesh. Compared with existing methods, our method can support more garment categories and recover more accurate geometry.
  arXiv  Detail & Related papers  (2020-04-01T03:41:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.