Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps
- URL: http://arxiv.org/abs/2512.17143v1
- Date: Fri, 19 Dec 2025 00:40:53 GMT
- Title: Pro-Pose: Unpaired Full-Body Portrait Synthesis via Canonical UV Maps
- Authors: Sandeep Mishra, Yasamin Jafarian, Andreas Lugmayr, Yingwei Li, Varsha Ramakrishnan, Srivatsan Varadharajan, Alan C. Bovik, Ira Kemelmacher-Shlizerman,
- Abstract summary: We explore how to create a professional'' version of a person's photograph.<n>A key challenge is to preserve the person's unique identity, face and body features while transforming the photo.<n>Our approach yields high-quality, reposed portraits and achieves strong qualitative and quantitative performance on real-world imagery.
- Score: 30.970209890835793
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Photographs of people taken by professional photographers typically present the person in beautiful lighting, with an interesting pose, and flattering quality. This is unlike common photos people can take of themselves. In this paper, we explore how to create a ``professional'' version of a person's photograph, i.e., in a chosen pose, in a simple environment, with good lighting, and standard black top/bottom clothing. A key challenge is to preserve the person's unique identity, face and body features while transforming the photo. If there would exist a large paired dataset of the same person photographed both ``in the wild'' and by a professional photographer, the problem would potentially be easier to solve. However, such data does not exist, especially for a large variety of identities. To that end, we propose two key insights: 1) Our method transforms the input photo and person's face to a canonical UV space, which is further coupled with reposing methodology to model occlusions and novel view synthesis. Operating in UV space allows us to leverage existing unpaired datasets. 2) We personalize the output photo via multi image finetuning. Our approach yields high-quality, reposed portraits and achieves strong qualitative and quantitative performance on real-world imagery.
Related papers
- Exposure Bracketing Is All You Need For A High-Quality Image [50.822601495422916]
Multi-exposure images are complementary in denoising, deblurring, high dynamic range imaging, and super-resolution.<n>We propose to utilize exposure bracketing photography to get a high-quality image by combining these tasks in this work.<n>In particular, a temporally modulated recurrent network (TMRNet) and self-supervised adaptation method are proposed.
arXiv Detail & Related papers (2024-01-01T14:14:35Z) - MagiCapture: High-Resolution Multi-Concept Portrait Customization [34.131515004434846]
MagiCapture is a personalization method for integrating subject and style concepts to generate high-resolution portrait images.
We present a novel Attention Refocusing loss coupled with auxiliary priors, both of which facilitate robust learning within this weakly supervised learning setting.
Our pipeline also includes additional post-processing steps to ensure the creation of highly realistic outputs.
arXiv Detail & Related papers (2023-09-13T11:37:04Z) - Photo2Relief: Let Human in the Photograph Stand Out [26.102307166656157]
We introduce a sigmoid variant function to manipulate gradients tactfully and train our neural networks by equipping with a loss function defined in gradient domain.
To make a clear division of labor in network modules, a two-scale architecture is proposed to create high-quality relief from a single photograph.
arXiv Detail & Related papers (2023-07-21T05:33:57Z) - POCE: Pose-Controllable Expression Editing [75.7701103792032]
This paper presents POCE, an innovative pose-controllable expression editing network.
It can generate realistic facial expressions and head poses simultaneously with just unpaired training images.
The learned model can generate realistic and high-fidelity facial expressions under various new poses.
arXiv Detail & Related papers (2023-04-18T12:26:19Z) - SunStage: Portrait Reconstruction and Relighting using the Sun as a
Light Stage [75.0473791925894]
A light stage uses a series of calibrated cameras and lights to capture a subject's facial appearance under varying illumination and viewpoint.
Unfortunately, light stages are often inaccessible: they are expensive and require significant technical expertise for construction and operation.
We present SunStage: a lightweight alternative to a light stage that captures comparable data using only a smartphone camera and the sun.
arXiv Detail & Related papers (2022-04-07T17:59:51Z) - Hallucinating Pose-Compatible Scenes [55.064949607528405]
We present a large-scale generative adversarial network for pose-conditioned scene generation.
We curating a massive meta-dataset containing over 19 million frames of humans in everyday environments.
We leverage our trained model for various applications: hallucinating pose-compatible scene(s) with or without humans, visualizing incompatible scenes and poses, placing a person from one generated image into another scene, and animating pose.
arXiv Detail & Related papers (2021-12-13T18:59:26Z) - PhotoApp: Photorealistic Appearance Editing of Head Portraits [97.23638022484153]
We present an approach for high-quality intuitive editing of the camera viewpoint and scene illumination in a portrait image.
Most editing approaches rely on supervised learning using training data captured with setups such as light and camera stages.
We design a supervised problem which learns in the latent space of StyleGAN.
This combines the best of supervised learning and generative adversarial modeling.
arXiv Detail & Related papers (2021-03-13T08:59:49Z) - Unselfie: Translating Selfies to Neutral-pose Portraits in the Wild [57.944605468653414]
In selfies, constraints such as human arm length often make the body pose look unnatural.
We introduce $textitunselfie$, a novel photographic transformation that automatically translates a selfie into a neutral-pose portrait.
We propose a novel nearest pose search module that makes the reposing task easier and enables the generation of multiple neutral-pose results.
arXiv Detail & Related papers (2020-07-29T19:21:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.