Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging

• URL: http://arxiv.org/abs/2311.11642v3
• Date: Thu, 14 Mar 2024 09:13:55 GMT
• Title: Video Face Re-Aging: Toward Temporally Consistent Face Re-Aging
• Authors: Abdul Muqeet, Kyuchul Lee, Bumsoo Kim, Yohan Hong, Hyungrae Lee, Woonggon Kim, KwangHee Lee,
• Abstract summary: Video face re-aging deals with altering the apparent age of a person to the target age in videos. Most re-aging methods process each image individually without considering the temporal consistency of videos. We propose a novel synthetic video dataset that features subjects across a diverse range of age groups.
• Score: 5.252268654349522
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video face re-aging deals with altering the apparent age of a person to the target age in videos. This problem is challenging due to the lack of paired video datasets maintaining temporal consistency in identity and age. Most re-aging methods process each image individually without considering the temporal consistency of videos. While some existing works address the issue of temporal coherence through video facial attribute manipulation in latent space, they often fail to deliver satisfactory performance in age transformation. To tackle the issues, we propose (1) a novel synthetic video dataset that features subjects across a diverse range of age groups; (2) a baseline architecture designed to validate the effectiveness of our proposed dataset, and (3) the development of novel metrics tailored explicitly for evaluating the temporal consistency of video re-aging techniques. Our comprehensive experiments on public datasets, including VFHQ and CelebA-HQ, show that our method outperforms existing approaches in age transformation accuracy and temporal consistency. Notably, in user studies, our method was preferred for temporal consistency by 48.1\% of participants for the older direction and by 39.3\% for the younger direction.

Related papers

• P-Age: Pexels Dataset for Robust Spatio-Temporal Apparent Age Classification [0.7234862895932991]
  AgeFormer utilizes information on the dynamics of the entire body face-based methods for age classification. To fill the gap in predicting age in real-world situations from videos, we construct a video dataset called Pexels Age. The proposed method achieves superior results compared to existing face-based age estimation methods.
  arXiv  Detail & Related papers  (2023-11-04T15:23:21Z)
• Age Prediction From Face Images Via Contrastive Learning [1.7705784090599048]
  We leverage readily available face datasets of different people at different ages and aim to extract age-related features using contrastive learning. Our method emphasizes relevant features while suppressing identity-related features using a combination of cosine similarity and triplet margin losses.
  arXiv  Detail & Related papers  (2023-08-23T03:43:34Z)
• Transform-Equivariant Consistency Learning for Temporal Sentence Grounding [66.10949751429781]
  We introduce a novel Equivariant Consistency Regulation Learning framework to learn more discriminative representations for each video. Our motivation comes from that the temporal boundary of the query-guided activity should be consistently predicted. In particular, we devise a self-supervised consistency loss module to enhance the completeness and smoothness of the augmented video.
  arXiv  Detail & Related papers  (2023-05-06T19:29:28Z)
• Generating Long Videos of Dynamic Scenes [66.56925105992472]
  We present a video generation model that reproduces object motion, changes in camera viewpoint, and new content that arises over time. A common failure case is for content to never change due to over-reliance on inductive biases to provide temporal consistency.
  arXiv  Detail & Related papers  (2022-06-07T16:29:51Z)
• FP-Age: Leveraging Face Parsing Attention for Facial Age Estimation in the Wild [50.8865921538953]
  We propose a method to explicitly incorporate facial semantics into age estimation. We design a face parsing-based network to learn semantic information at different scales. We show that our method consistently outperforms all existing age estimation methods.
  arXiv  Detail & Related papers  (2021-06-21T14:31:32Z)
• Continuous Face Aging Generative Adversarial Networks [11.75204350455584]
  Face aging is the task aiming to translate the faces in input images to designated ages. Previous methods have limited themselves only able to produce discrete age groups, each of which consists of ten years. We propose the continuous face aging generative adversarial networks (CFA-GAN)
  arXiv  Detail & Related papers  (2021-02-26T06:22:25Z)
• PFA-GAN: Progressive Face Aging with Generative Adversarial Network [19.45760984401544]
  This paper proposes a novel progressive face aging framework based on generative adversarial network (PFA-GAN) The framework can be trained in an end-to-end manner to eliminate accumulative artifacts and blurriness. Extensively experimental results demonstrate superior performance over existing (c)GANs-based methods.
  arXiv  Detail & Related papers  (2020-12-07T05:45:13Z)
• Age Gap Reducer-GAN for Recognizing Age-Separated Faces [72.26969872180841]
  We propose a novel algorithm for matching faces with temporal variations caused due to age progression. The proposed generative adversarial network algorithm is a unified framework that combines facial age estimation and age-separated face verification.
  arXiv  Detail & Related papers  (2020-11-11T16:43:32Z)
• Blind Video Temporal Consistency via Deep Video Prior [61.062900556483164]
  We present a novel and general approach for blind video temporal consistency. Our method is only trained on a pair of original and processed videos directly. We show that temporal consistency can be achieved by training a convolutional network on a video with the Deep Video Prior.
  arXiv  Detail & Related papers  (2020-10-22T16:19:20Z)
• Enhancing Facial Data Diversity with Style-based Face Aging [59.984134070735934]
  In particular, face datasets are typically biased in terms of attributes such as gender, age, and race. We propose a novel, generative style-based architecture for data augmentation that captures fine-grained aging patterns. We show that the proposed method outperforms state-of-the-art algorithms for age transfer.
  arXiv  Detail & Related papers  (2020-06-06T21:53:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.