Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Faces

• URL: http://arxiv.org/abs/2109.00162v1
• Date: Wed, 1 Sep 2021 03:25:50 GMT
• Title: Eyes Tell All: Irregular Pupil Shapes Reveal GAN-generated Faces
• Authors: Hui Guo, Shu Hu, Xin Wang, Ming-Ching Chang, Siwei Lyu
• Abstract summary: We show that GAN-generated faces can be exposed via irregular pupil shapes. This phenomenon is caused by the lack of physiological constraints in the GAN models.
• Score: 40.15016121723183
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Generative adversary network (GAN) generated high-realistic human faces have been used as profile images for fake social media accounts and are visually challenging to discern from real ones. In this work, we show that GAN-generated faces can be exposed via irregular pupil shapes. This phenomenon is caused by the lack of physiological constraints in the GAN models. We demonstrate that such artifacts exist widely in high-quality GAN-generated faces and further describe an automatic method to extract the pupils from two eyes and analysis their shapes for exposing the GAN-generated faces. Qualitative and quantitative evaluations of our method suggest its simplicity and effectiveness in distinguishing GAN-generated faces.

Related papers

• CemiFace: Center-based Semi-hard Synthetic Face Generation for Face Recognition [33.17771044475894]
  We show that face images with certain degree of similarities to their identity centers show great effectiveness in the performance of trained face recognition models. Inspired by this, we propose a novel diffusion-based approach (namely Center-based Semi-hard Synthetic Face Generation) which produces facial samples with various levels of similarity to the subject center.
  arXiv  Detail & Related papers  (2024-09-27T16:11:30Z)
• Detecting High-Quality GAN-Generated Face Images using Neural Networks [23.388645531702597]
  We propose a new strategy to differentiate GAN-generated images from authentic images by leveraging spectral band discrepancies. In particular, we enable the digital preservation of face images using the Cross-band co-occurrence matrix and spatial co-occurrence matrix. We show that the performance boost is particularly significant and achieves more than 92% in different post-processing environments.
  arXiv  Detail & Related papers  (2022-03-03T13:53:27Z)
• GAN-generated Faces Detection: A Survey and New Perspectives [48.596997330548]
  Generative Adversarial Networks (GAN) have led to the generation of very realistic face images. The corresponding GAN-face detection techniques are under active development that can examine and expose such fake faces. We focus on methods that can detect face images that are generated or synthesized from GAN models.
  arXiv  Detail & Related papers  (2022-02-15T02:36:56Z)
• MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation [69.35523133292389]
  We propose a framework that a priori models physical attributes of the face explicitly, thus providing disentanglement by design. Our method, MOST-GAN, integrates the expressive power and photorealism of style-based GANs with the physical disentanglement and flexibility of nonlinear 3D morphable models. It achieves photorealistic manipulation of portrait images with fully disentangled 3D control over their physical attributes, enabling extreme manipulation of lighting, facial expression, and pose variations up to full profile view.
  arXiv  Detail & Related papers  (2021-11-01T15:53:36Z)
• Face Hallucination via Split-Attention in Split-Attention Network [58.30436379218425]
  convolutional neural networks (CNNs) have been widely employed to promote the face hallucination. We propose a novel external-internal split attention group (ESAG) to take into account the overall facial profile and fine texture details simultaneously. By fusing the features from these two paths, the consistency of facial structure and the fidelity of facial details are strengthened.
  arXiv  Detail & Related papers  (2020-10-22T10:09:31Z)
• Exposing GAN-generated Faces Using Inconsistent Corneal Specular Highlights [42.83346543247565]
  We show that GAN synthesized faces can be exposed with the inconsistent corneal specular highlights between two eyes. The inconsistency is caused by the lack of physical/physiological constraints in the GAN models.
  arXiv  Detail & Related papers  (2020-09-24T19:43:16Z)
• InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANs [73.27299786083424]
  We propose a framework called InterFaceGAN to interpret the disentangled face representation learned by state-of-the-art GAN models. We first find that GANs learn various semantics in some linear subspaces of the latent space. We then conduct a detailed study on the correlation between different semantics and manage to better disentangle them via subspace projection.
  arXiv  Detail & Related papers  (2020-05-18T18:01:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.