TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates

• URL: http://arxiv.org/abs/2204.03671v1
• Date: Thu, 7 Apr 2022 18:00:32 GMT
• Title: TemporalUV: Capturing Loose Clothing with Temporally Coherent UV Coordinates
• Abstract summary: We propose a novel approach to generate temporally coherent UV coordinates for loose clothing. Our method is not constrained by human body outlines and can capture loose garments and hair.
• Score: 37.58323494348772
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose a novel approach to generate temporally coherent UV coordinates for loose clothing. Our method is not constrained by human body outlines and can capture loose garments and hair. We implemented a differentiable pipeline to learn UV mapping between a sequence of RGB inputs and textures via UV coordinates. Instead of treating the UV coordinates of each frame separately, our data generation approach connects all UV coordinates via feature matching for temporal stability. Subsequently, a generative model is trained to balance the spatial quality and temporal stability. It is driven by supervised and unsupervised losses in both UV and image spaces. Our experiments show that the trained models output high-quality UV coordinates and generalize to new poses. Once a sequence of UV coordinates has been inferred by our model, it can be used to flexibly synthesize new looks and modified visual styles. Compared to existing methods, our approach reduces the computational workload to animate new outfits by several orders of magnitude.

Related papers

• UVFaceFusion: Fast Multi-view Topologically Consistent Face Reconstruction in the Wild via UV-space Neural Fusion [19.95550287456286]
  We present UVFaceFusion, a feed-forward framework for multi-view, fixed-topology face reconstruction from daily images.<n>Our key idea is to replace topological optimization with learnable neural fusion in a canonical UV space.<n>Experiments show that UVFaceFusion achieves state-of-the-art reconstruction accuracy while reconstructing a mesh from 16 input views in less than 3 seconds.
  arXiv  Detail & Related papers  (2026-07-21T07:24:42Z)
• DreamUV: Unwrap Artist-like UV by End-to-End Flow Matching [16.305062860577557]
  We present DreamUV, an end-to-end learning framework that formulates UV unwrapping as a generative Flow Matching problem.<n>We evaluate DreamUV on a large-scale dataset of professionally authored UV layouts.
  arXiv  Detail & Related papers  (2026-06-21T11:41:32Z)
• UIKA: Fast Universal Head Avatar from Pose-Free Images [65.03770342532134]
  We present Uika, a feed-forward animatable Gaussian head model from an arbitrary number of unposed inputs.<n>Unlike the traditional avatar method, we rethink the task through the lenses of model representation, network design, and data preparation.<n>Our method significantly outperforms existing approaches in both monocular and multi-view settings.
  arXiv  Detail & Related papers  (2026-01-12T14:53:56Z)
• PartUV: Part-Based UV Unwrapping of 3D Meshes [33.100992979838814]
  PartUV is a part-based UV unwrapping pipeline that generates fewer, part-aligned charts while maintaining low distortion.<n>PartUV is evaluated across four diverse datasets, including man-made, CAD, AI-generated, and Common Shapes.
  arXiv  Detail & Related papers  (2025-11-20T18:58:39Z)
• ArtUV: Artist-style UV Unwrapping [15.072561481603037]
  We introduce ArtUV, a fully automated, end-to-end method for generating artist-style UV unwrapping.<n>We simulate the professional UV mapping process by dividing it into two stages: surface seam prediction and artist-style UV parameterization.<n>Our method ensures semantic consistency and preserves topological structure, making the UV map ready for 2D editing.
  arXiv  Detail & Related papers  (2025-09-25T03:21:21Z)
• Human Pose-Constrained UV Map Estimation [21.917582794820095]
  UV map estimation is used in computer vision for detailed analysis of human posture or activity. We propose Pose-Constrained Continuous Surface Embeddings (PC-CSE), which integrates estimated 2D human pose into the pixel-to-vertex assignment process.
  arXiv  Detail & Related papers  (2025-01-15T14:12:55Z)
• UV-Attack: Physical-World Adversarial Attacks for Person Detection via Dynamic-NeRF-based UV Mapping [27.142039594420293]
  adversarial attacks on person detectors have struggled with low success rates due to the flexible nature of human movement. We introduce UV-Attack, a groundbreaking approach that achieves high success rates even with extensive and unseen human actions.
  arXiv  Detail & Related papers  (2025-01-10T08:33:31Z)
• UV-free Texture Generation with Denoising and Geodesic Heat Diffusions [50.55154348768031]
  Seams, wasted UV space, and varying resolution over the surface are the most prominent issues of the standard UV-based processing mechanism of meshes. We propose to represent textures as coloured point-cloud colours generated by a denoising diffusion model constrained to operate on the surface of 3D meshes.
  arXiv  Detail & Related papers  (2024-08-29T17:57:05Z)
• Pattern Guided UV Recovery for Realistic Video Garment Texturing [32.759330693659514]
  We present a pattern-based approach for UV and shading recovery from a captured real video so that the garment's texture can be replaced automatically. We propose a novel loss on the Jacobian of the UV mapping to create pleasant seams around the folding areas and the boundary of occluded regions. We show plausible texture replacement results in our experiment, in which the folding and overlapping of the garment can be greatly preserved.
  arXiv  Detail & Related papers  (2024-07-14T09:47:37Z)
• UVMap-ID: A Controllable and Personalized UV Map Generative Model [67.71022515856653]
  We introduce UVMap-ID, a controllable and personalized UV Map generative model. Unlike traditional large-scale training methods in 2D, we propose to fine-tune a pre-trained text-to-image diffusion model. Both quantitative and qualitative analyses demonstrate the effectiveness of our method in controllable and personalized UV Map generation.
  arXiv  Detail & Related papers  (2024-04-22T20:30:45Z)
• UV Gaussians: Joint Learning of Mesh Deformation and Gaussian Textures for Human Avatar Modeling [71.87807614875497]
  We propose UV Gaussians, which models the 3D human body by jointly learning mesh deformations and 2D UV-space Gaussian textures. We collect and process a new dataset of human motion, which includes multi-view images, scanned models, parametric model registration, and corresponding texture maps. Experimental results demonstrate that our method achieves state-of-the-art synthesis of novel view and novel pose.
  arXiv  Detail & Related papers  (2024-03-18T09:03:56Z)
• Nuvo: Neural UV Mapping for Unruly 3D Representations [61.87715912587394]
  Existing UV mapping algorithms operate on geometry produced by state-of-the-art 3D reconstruction and generation techniques. We present a UV mapping method designed to operate on geometry produced by 3D reconstruction and generation techniques.
  arXiv  Detail & Related papers  (2023-12-11T18:58:38Z)
• Texture Generation on 3D Meshes with Point-UV Diffusion [86.69672057856243]
  We present Point-UV diffusion, a coarse-to-fine pipeline that marries the denoising diffusion model with UV mapping to generate high-quality texture images in UV space. Our method can process meshes of any genus, generating diversified, geometry-compatible, and high-fidelity textures.
  arXiv  Detail & Related papers  (2023-08-21T06:20:54Z)
• Self-Aligning Depth-regularized Radiance Fields for Asynchronous RGB-D Sequences [12.799443250845224]
  We propose a novel time-pose function, which is an implicit network that maps timestamps to $rm SE(3)$ elements. Our algorithm consists of three steps: (1) time-pose function fitting, (2) radiance field bootstrapping, (3) joint pose error compensation and radiance field refinement. We also show qualitatively improved results on a real-world asynchronous RGB-D sequence captured by drone.
  arXiv  Detail & Related papers  (2022-11-14T15:37:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.