RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detection

• URL: http://arxiv.org/abs/2307.10642v1
• Date: Thu, 20 Jul 2023 07:12:56 GMT
• Title: RetouchingFFHQ: A Large-scale Dataset for Fine-grained Face Retouching Detection
• Authors: Qichao Ying, Jiaxin Liu, Sheng Li, Haisheng Xu, Zhenxing Qian, Xinpeng Zhang
• Abstract summary: We introduce RetouchingFFHQ, a large-scale and fine-grained face retouching dataset. By including four typical types of face retouching operations and different retouching levels, we extend the binary face retouching detection into a fine-grained, multi-retouching type, and multi-retouching level estimation problem.
• Score: 25.08843970102635
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The widespread use of face retouching filters on short-video platforms has raised concerns about the authenticity of digital appearances and the impact of deceptive advertising. To address these issues, there is a pressing need to develop advanced face retouching techniques. However, the lack of large-scale and fine-grained face retouching datasets has been a major obstacle to progress in this field. In this paper, we introduce RetouchingFFHQ, a large-scale and fine-grained face retouching dataset that contains over half a million conditionally-retouched images. RetouchingFFHQ stands out from previous datasets due to its large scale, high quality, fine-grainedness, and customization. By including four typical types of face retouching operations and different retouching levels, we extend the binary face retouching detection into a fine-grained, multi-retouching type, and multi-retouching level estimation problem. Additionally, we propose a Multi-granularity Attention Module (MAM) as a plugin for CNN backbones for enhanced cross-scale representation learning. Extensive experiments using different baselines as well as our proposed method on RetouchingFFHQ show decent performance on face retouching detection. With the proposed new dataset, we believe there is great potential for future work to tackle the challenging problem of real-world fine-grained face retouching detection.

Related papers

• Geometric Prior-Guided Neural Implicit Surface Reconstruction in the Wild [13.109693095684921]
  We introduce a novel approach that applies multiple geometric constraints to the implicit surface optimization process.<n>First, we utilize sparse 3D points from structure-from-motion (SfM) to refine the signed distance function estimation for the reconstructed surface.<n>We also employ robust normal priors derived from a normal predictor, enhanced by edge prior filtering and multi-view consistency constraints.
  arXiv  Detail & Related papers  (2025-05-12T09:17:30Z)
• SUPER: Selfie Undistortion and Head Pose Editing with Identity Preservation [37.89326064230339]
  Super is a novel method of eliminating distortions and adjusting head pose in a close-up face crop. We perform 3D GAN inversion for a facial image by optimizing camera parameters and face latent code. We estimate depth from the obtained latent code, create a depth-induced 3D mesh, and render it with updated camera parameters to obtain a warped portrait.
  arXiv  Detail & Related papers  (2024-06-18T15:14:14Z)
• Face2Face: Label-driven Facial Retouching Restoration [8.01225897515609]
  By altering facial images, users can easily create deceptive images, leading to the dissemination of false information. This may pose challenges to the reliability of identity verification systems and social media, and even lead to online fraud. We propose a framework, dubbed Face2Face, which consists of three components: a facial retouching detector, an image restoration model named FaceR, and a color correction module called H-AdaIN.
  arXiv  Detail & Related papers  (2024-04-22T13:49:42Z)
• GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning [50.7702397913573]
  The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable. Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology. We propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection.
  arXiv  Detail & Related papers  (2024-02-03T03:13:50Z)
• Towards Multi-domain Face Landmark Detection with Synthetic Data from Diffusion model [27.307563102526192]
  deep learning-based facial landmark detection for in-the-wild faces has achieved significant improvement. There are still challenges in face landmark detection in other domains (e.g. cartoon, caricature, etc) We design a two-stage training approach that effectively leverages limited datasets and the pre-trained diffusion model. Our results demonstrate that our method outperforms existing methods on multi-domain face landmark detection.
  arXiv  Detail & Related papers  (2024-01-24T02:35:32Z)
• Do Not DeepFake Me: Privacy-Preserving Neural 3D Head Reconstruction Without Sensitive Images [5.462031439048112]
  We propose a novel two-stage 3D facial reconstruction method aimed at avoiding exposure to sensitive facial information while preserving detailed geometric accuracy. Our approach first uses non-sensitive rear-head images for initial geometry and then refines this geometry using processed privacy-removed gradient images.
  arXiv  Detail & Related papers  (2023-12-07T07:41:10Z)
• Effective Adapter for Face Recognition in the Wild [72.75516495170199]
  We tackle the challenge of face recognition in the wild, where images often suffer from low quality and real-world distortions. Traditional approaches-either training models directly on degraded images or their enhanced counterparts using face restoration techniques-have proven ineffective. We propose an effective adapter for augmenting existing face recognition models trained on high-quality facial datasets.
  arXiv  Detail & Related papers  (2023-12-04T08:55:46Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• A Survey of Deep Face Restoration: Denoise, Super-Resolution, Deblur, Artifact Removal [177.21001709272144]
  Face Restoration (FR) aims to restore High-Quality (HQ) faces from Low-Quality (LQ) input images. This paper comprehensively surveys recent advances in deep learning techniques for face restoration.
  arXiv  Detail & Related papers  (2022-11-05T07:08:15Z)
• A new face swap method for image and video domains: a technical report [60.47144478048589]
  We introduce a new face swap pipeline that is based on FaceShifter architecture. New eye loss function, super-resolution block, and Gaussian-based face mask generation leads to improvements in quality.
  arXiv  Detail & Related papers  (2022-02-07T10:15:50Z)
• OSTeC: One-Shot Texture Completion [86.23018402732748]
  We propose an unsupervised approach for one-shot 3D facial texture completion. The proposed approach rotates an input image in 3D and fill-in the unseen regions by reconstructing the rotated image in a 2D face generator. We frontalize the target image by projecting the completed texture into the generator.
  arXiv  Detail & Related papers  (2020-12-30T23:53:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.