Only a Matter of Style: Age Transformation Using a Style-Based
Regression Model
- URL: http://arxiv.org/abs/2102.02754v1
- Date: Thu, 4 Feb 2021 17:33:28 GMT
- Title: Only a Matter of Style: Age Transformation Using a Style-Based
Regression Model
- Authors: Yuval Alaluf, Or Patashnik, Daniel Cohen-Or
- Abstract summary: We present an image-to-image translation method that learns to encode real facial images into the latent space of a pre-trained unconditional GAN.
We employ a pre-trained age regression network used to explicitly guide the encoder in generating the latent codes corresponding to the desired age.
- Score: 46.48263482909809
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The task of age transformation illustrates the change of an individual's
appearance over time. Accurately modeling this complex transformation over an
input facial image is extremely challenging as it requires making convincing
and possibly large changes to facial features and head shape, while still
preserving the input identity. In this work, we present an image-to-image
translation method that learns to directly encode real facial images into the
latent space of a pre-trained unconditional GAN (e.g., StyleGAN) subject to a
given aging shift. We employ a pre-trained age regression network used to
explicitly guide the encoder in generating the latent codes corresponding to
the desired age. In this formulation, our method approaches the continuous
aging process as a regression task between the input age and desired target
age, providing fine-grained control over the generated image. Moreover, unlike
other approaches that operate solely in the latent space using a prior on the
path controlling age, our method learns a more disentangled, non-linear path.
Finally, we demonstrate that the end-to-end nature of our approach, coupled
with the rich semantic latent space of StyleGAN, allows for further editing of
the generated images. Qualitative and quantitative evaluations show the
advantages of our method compared to state-of-the-art approaches.
Related papers
- IdenBAT: Disentangled Representation Learning for Identity-Preserved Brain Age Transformation [9.23090816270662]
Brain age transformation aims to convert reference brain images into synthesized images that accurately reflect the age-specific features of a target age group.
We propose a novel architecture that employs disentangled representation learning for identity-preserved brain age transformation called IdenBAT.
Our method adeptly converts input images to target age while retaining individual characteristics accurately.
arXiv Detail & Related papers (2024-10-22T12:20:15Z) - ToonAging: Face Re-Aging upon Artistic Portrait Style Transfer [6.305926064192544]
We introduce a novel one-stage method for face re-aging combined with portrait style transfer.
We leverage existing face re-aging and style transfer networks, both trained within the same PR domain.
Our method offers greater flexibility compared to domain-level fine-tuning approaches.
arXiv Detail & Related papers (2024-02-05T05:25:33Z) - Face Aging via Diffusion-based Editing [5.318584973533008]
We propose FADING, a novel approach to address Face Aging via DIffusion-based editiNG.
We go beyond existing methods by leveraging the rich prior of large-scale language-image diffusion models.
Our method outperforms existing approaches with respect to aging accuracy, attribute preservation, and aging quality.
arXiv Detail & Related papers (2023-09-20T13:47:10Z) - FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in
the Wild [50.8865921538953]
We propose a method to explicitly incorporate facial semantics into age estimation.
We design a face parsing-based network to learn semantic information at different scales.
We show that our method consistently outperforms all existing age estimation methods.
arXiv Detail & Related papers (2021-06-21T14:31:32Z) - Pose Guided Person Image Generation with Hidden p-Norm Regression [113.41144529452663]
We propose a novel approach to solve the pose guided person image generation task.
Our method estimates a pose-invariant feature matrix for each identity, and uses it to predict the target appearance conditioned on the target pose.
Our method yields competitive performance in all the aforementioned variant scenarios.
arXiv Detail & Related papers (2021-02-19T17:03:54Z) - Age Gap Reducer-GAN for Recognizing Age-Separated Faces [72.26969872180841]
We propose a novel algorithm for matching faces with temporal variations caused due to age progression.
The proposed generative adversarial network algorithm is a unified framework that combines facial age estimation and age-separated face verification.
arXiv Detail & Related papers (2020-11-11T16:43:32Z) - Transforming Facial Weight of Real Images by Editing Latent Space of
StyleGAN [9.097538101642192]
We present an invert-and-edit framework to transform facial weight of an input face image to look thinner or heavier by leveraging semantic facial attributes encoded in the latent space of Generative Adversarial Networks (GANs)
Our framework is empirically shown to produce high-quality and realistic facial-weight transformations without requiring training GANs with a large amount of labeled face images from scratch.
Our framework can be utilized as part of an intervention to motivate individuals to make healthier food choices by visualizing the future impacts of their behavior on appearance.
arXiv Detail & Related papers (2020-11-05T01:45:18Z) - Semantic Photo Manipulation with a Generative Image Prior [86.01714863596347]
GANs are able to synthesize images conditioned on inputs such as user sketch, text, or semantic labels.
It is hard for GANs to precisely reproduce an input image.
In this paper, we address these issues by adapting the image prior learned by GANs to image statistics of an individual image.
Our method can accurately reconstruct the input image and synthesize new content, consistent with the appearance of the input image.
arXiv Detail & Related papers (2020-05-15T18:22:05Z) - Lifespan Age Transformation Synthesis [40.963816368819415]
We propose a novel image-to-image generative adversarial network architecture.
Our framework can predict a full head portrait for ages 0-70 from a single photo.
arXiv Detail & Related papers (2020-03-21T22:48:06Z) - Fine-grained Image-to-Image Transformation towards Visual Recognition [102.51124181873101]
We aim at transforming an image with a fine-grained category to synthesize new images that preserve the identity of the input image.
We adopt a model based on generative adversarial networks to disentangle the identity related and unrelated factors of an image.
Experiments on the CompCars and Multi-PIE datasets demonstrate that our model preserves the identity of the generated images much better than the state-of-the-art image-to-image transformation models.
arXiv Detail & Related papers (2020-01-12T05:26:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.