High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approach

• URL: http://arxiv.org/abs/2506.13233v1
• Date: Mon, 16 Jun 2025 08:32:57 GMT
• Title: High-Quality Facial Albedo Generation for 3D Face Reconstruction from a Single Image using a Coarse-to-Fine Approach
• Authors: Jiashu Dai, Along Wang, Binfan Ni, Tao Cao,
• Abstract summary: We propose a novel end-to-end coarse-to-fine approach for UV albedo map generation.<n>Our method first utilizes a UV Albedo Parametric Model (UVAPM), driven by low-dimensional coefficients, to generate coarse albedo maps.<n>To capture high-frequency details, we train a detail generator using a decoupled albedo map, producing high-resolution albedo maps.
• Score: 0.19999259391104385
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Facial texture generation is crucial for high-fidelity 3D face reconstruction from a single image. However, existing methods struggle to generate UV albedo maps with high-frequency details. To address this challenge, we propose a novel end-to-end coarse-to-fine approach for UV albedo map generation. Our method first utilizes a UV Albedo Parametric Model (UVAPM), driven by low-dimensional coefficients, to generate coarse albedo maps with skin tones and low-frequency texture details. To capture high-frequency details, we train a detail generator using a decoupled albedo map dataset, producing high-resolution albedo maps. Extensive experiments demonstrate that our method can generate high-fidelity textures from a single image, outperforming existing methods in terms of texture quality and realism. The code and pre-trained model are publicly available at https://github.com/MVIC-DAI/UVAPM, facilitating reproducibility and further research.

Related papers

• TEXGen: a Generative Diffusion Model for Mesh Textures [63.43159148394021]
  We focus on the fundamental problem of learning in the UV texture space itself. We propose a scalable network architecture that interleaves convolutions on UV maps with attention layers on point clouds. We train a 700 million parameter diffusion model that can generate UV texture maps guided by text prompts and single-view images.
  arXiv  Detail & Related papers  (2024-11-22T05:22:11Z)
• High-Fidelity Facial Albedo Estimation via Texture Quantization [59.100759403614695]
  We present HiFiAlbedo, which recovers the albedo map directly from a single image without the need for captured albedo data. Our method exhibits excellent generalizability and is capable of achieving high-fidelity results for in-the-wild facial albedo recovery.
  arXiv  Detail & Related papers  (2024-06-19T01:53:30Z)
• UVMap-ID: A Controllable and Personalized UV Map Generative Model [67.71022515856653]
  We introduce UVMap-ID, a controllable and personalized UV Map generative model. Unlike traditional large-scale training methods in 2D, we propose to fine-tune a pre-trained text-to-image diffusion model. Both quantitative and qualitative analyses demonstrate the effectiveness of our method in controllable and personalized UV Map generation.
  arXiv  Detail & Related papers  (2024-04-22T20:30:45Z)
• FFHQ-UV: Normalized Facial UV-Texture Dataset for 3D Face Reconstruction [46.3392612457273]
  This dataset contains over 50,000 high-quality texture UV-maps with even illuminations, neutral expressions, and cleaned facial regions. Our pipeline utilizes the recent advances in StyleGAN-based facial image editing approaches. Experiments show that our method improves the reconstruction accuracy over state-of-the-art approaches.
  arXiv  Detail & Related papers  (2022-11-25T03:21:05Z)
• Weakly-Supervised Photo-realistic Texture Generation for 3D Face Reconstruction [48.952656891182826]
  High-fidelity 3D face texture generation has yet to be studied. Model consists of a UV sampler and a UV generator. Training is based on pseudo ground truth blended by the 3DMM texture and the input face texture.
  arXiv  Detail & Related papers  (2021-06-14T12:34:35Z)
• OSTeC: One-Shot Texture Completion [86.23018402732748]
  We propose an unsupervised approach for one-shot 3D facial texture completion. The proposed approach rotates an input image in 3D and fill-in the unseen regions by reconstructing the rotated image in a 2D face generator. We frontalize the target image by projecting the completed texture into the generator.
  arXiv  Detail & Related papers  (2020-12-30T23:53:26Z)
• StyleUV: Diverse and High-fidelity UV Map Generative Model [24.982824840625216]
  We present a novel UV map generative model that learns to generate diverse and realistic synthetic UV maps without requiring high-quality UV maps for training. Both quantitative and qualitative evaluations demonstrate that our proposed texture model produces more diverse and higher fidelity textures compared to existing methods.
  arXiv  Detail & Related papers  (2020-11-25T17:19:44Z)
• Towards High-Fidelity 3D Face Reconstruction from In-the-Wild Images Using Graph Convolutional Networks [32.859340851346786]
  We introduce a method to reconstruct 3D facial shapes with high-fidelity textures from single-view images in-the-wild. Our method can generate high-quality results and outperforms state-of-the-art methods in both qualitative and quantitative comparisons.
  arXiv  Detail & Related papers  (2020-03-12T08:06:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.