A Study of the Human Perception of Synthetic Faces
- URL: http://arxiv.org/abs/2111.04230v1
- Date: Mon, 8 Nov 2021 02:03:18 GMT
- Title: A Study of the Human Perception of Synthetic Faces
- Authors: Bingyu Shen, Brandon RichardWebster, Alice O'Toole, Kevin Bowyer,
Walter J. Scheirer
- Abstract summary: We introduce a study of the human perception of synthetic faces generated using different strategies including a state-of-the-art deep learning-based GAN model.
We answer important questions such as how often do GAN-based and more traditional image processing-based techniques confuse human observers, and are there subtle cues within a synthetic face image that cause humans to perceive it as a fake without having to search for obvious clues?
- Score: 10.058235580923583
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Advances in face synthesis have raised alarms about the deceptive use of
synthetic faces. Can synthetic identities be effectively used to fool human
observers? In this paper, we introduce a study of the human perception of
synthetic faces generated using different strategies including a
state-of-the-art deep learning-based GAN model. This is the first rigorous
study of the effectiveness of synthetic face generation techniques grounded in
experimental techniques from psychology. We answer important questions such as
how often do GAN-based and more traditional image processing-based techniques
confuse human observers, and are there subtle cues within a synthetic face
image that cause humans to perceive it as a fake without having to search for
obvious clues? To answer these questions, we conducted a series of large-scale
crowdsourced behavioral experiments with different sources of face imagery.
Results show that humans are unable to distinguish synthetic faces from real
faces under several different circumstances. This finding has serious
implications for many different applications where face images are presented to
human users.
Related papers
- Single Image, Any Face: Generalisable 3D Face Generation [59.9369171926757]
We propose a novel model, Gen3D-Face, which generates 3D human faces with unconstrained single image input.
To the best of our knowledge, this is the first attempt and benchmark for creating photorealistic 3D human face avatars from single images.
arXiv Detail & Related papers (2024-09-25T14:56:37Z) - ComFace: Facial Representation Learning with Synthetic Data for Comparing Faces [5.07975834105566]
We propose a facial representation learning method using synthetic images for comparing faces, called ComFace.
For effective representation learning, ComFace aims to acquire two feature representations, i.e., inter-personal facial differences and intra-personal facial changes.
Our ComFace, trained using only synthetic data, achieves comparable to or better transfer performance than general pre-training and state-of-the-art representation learning methods trained using real images.
arXiv Detail & Related papers (2024-05-25T02:44:07Z) - The Value of AI Guidance in Human Examination of Synthetically-Generated
Faces [4.144518961834414]
We investigate whether human-guided synthetic face detectors can assist non-expert human operators in the task of synthetic image detection.
We conducted a large-scale experiment with more than 1,560 subjects classifying whether an image shows an authentic or synthetically-generated face.
Models trained with human-guidance offer better support to human examination of face images when compared to models trained traditionally using cross-entropy loss.
arXiv Detail & Related papers (2022-08-22T18:45:53Z) - GAN-generated Faces Detection: A Survey and New Perspectives [48.596997330548]
Generative Adversarial Networks (GAN) have led to the generation of very realistic face images.
The corresponding GAN-face detection techniques are under active development that can examine and expose such fake faces.
We focus on methods that can detect face images that are generated or synthesized from GAN models.
arXiv Detail & Related papers (2022-02-15T02:36:56Z) - SynFace: Face Recognition with Synthetic Data [83.15838126703719]
We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap.
We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
arXiv Detail & Related papers (2021-08-18T03:41:54Z) - More Real than Real: A Study on Human Visual Perception of Synthetic
Faces [7.25613186882905]
We describe a perceptual experiment where volunteers have been exposed to synthetic face images produced by state-of-the-art Generative Adversarial Networks.
Experiment outcomes reveal how strongly we should call into question our human ability to discriminate real faces from synthetic ones generated through modern AI.
arXiv Detail & Related papers (2021-06-14T08:27:25Z) - Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
This work explores facial expression bias as a security vulnerability of face recognition systems.
We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
arXiv Detail & Related papers (2020-11-17T18:12:41Z) - LandmarkGAN: Synthesizing Faces from Landmarks [43.53204737135101]
We describe a new method, namely LandmarkGAN, to synthesize faces based on facial landmarks as input.
Our method is able to transform a set of facial landmarks into new faces of different subjects, while retains the same facial expression and orientation.
arXiv Detail & Related papers (2020-10-31T13:27:21Z) - InterFaceGAN: Interpreting the Disentangled Face Representation Learned
by GANs [73.27299786083424]
We propose a framework called InterFaceGAN to interpret the disentangled face representation learned by state-of-the-art GAN models.
We first find that GANs learn various semantics in some linear subspaces of the latent space.
We then conduct a detailed study on the correlation between different semantics and manage to better disentangle them via subspace projection.
arXiv Detail & Related papers (2020-05-18T18:01:22Z) - Learning Inverse Rendering of Faces from Real-world Videos [52.313931830408386]
Existing methods decompose a face image into three components (albedo, normal, and illumination) by supervised training on synthetic data.
We propose a weakly supervised training approach to train our model on real face videos, based on the assumption of consistency of albedo and normal.
Our network is trained on both real and synthetic data, benefiting from both.
arXiv Detail & Related papers (2020-03-26T17:26:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.