FitMe: Deep Photorealistic 3D Morphable Model Avatars
- URL: http://arxiv.org/abs/2305.09641v1
- Date: Tue, 16 May 2023 17:42:45 GMT
- Title: FitMe: Deep Photorealistic 3D Morphable Model Avatars
- Authors: Alexandros Lattas, Stylianos Moschoglou, Stylianos Ploumpis, Baris
Gecer, Jiankang Deng, Stefanos Zafeiriou
- Abstract summary: We introduce FitMe, a facial reflectance model and a differentiable rendering pipeline.
FitMe achieves state-of-the-art reflectance acquisition and identity preservation on single "in-the-wild" facial images.
In contrast with recent implicit avatar reconstructions, FitMe requires only one minute and produces relightable mesh and texture-based avatars.
- Score: 119.03325450951074
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this paper, we introduce FitMe, a facial reflectance model and a
differentiable rendering optimization pipeline, that can be used to acquire
high-fidelity renderable human avatars from single or multiple images. The
model consists of a multi-modal style-based generator, that captures facial
appearance in terms of diffuse and specular reflectance, and a PCA-based shape
model. We employ a fast differentiable rendering process that can be used in an
optimization pipeline, while also achieving photorealistic facial shading. Our
optimization process accurately captures both the facial reflectance and shape
in high-detail, by exploiting the expressivity of the style-based latent
representation and of our shape model. FitMe achieves state-of-the-art
reflectance acquisition and identity preservation on single "in-the-wild"
facial images, while it produces impressive scan-like results, when given
multiple unconstrained facial images pertaining to the same identity. In
contrast with recent implicit avatar reconstructions, FitMe requires only one
minute and produces relightable mesh and texture-based avatars, that can be
used by end-user applications.
Related papers
Err
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.