DeepFakes Evolution: Analysis of Facial Regions and Fake Detection Performance

• URL: http://arxiv.org/abs/2004.07532v2
• Date: Thu, 2 Jul 2020 16:24:22 GMT
• Title: DeepFakes Evolution: Analysis of Facial Regions and Fake Detection Performance
• Authors: Ruben Tolosana, Sergio Romero-Tapiador, Julian Fierrez and Ruben Vera-Rodriguez
• Abstract summary: This study provides an exhaustive analysis of both 1st and 2nd DeepFake generations in terms of facial regions and fake detection performance. We highlight the poor fake detection results achieved even by the strongest state-of-the-art fake detectors in the latest DeepFake databases of the 2nd generation.
• Score: 3.441021278275805
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Media forensics has attracted a lot of attention in the last years in part due to the increasing concerns around DeepFakes. Since the initial DeepFake databases from the 1st generation such as UADFV and FaceForensics++ up to the latest databases of the 2nd generation such as Celeb-DF and DFDC, many visual improvements have been carried out, making fake videos almost indistinguishable to the human eye. This study provides an exhaustive analysis of both 1st and 2nd DeepFake generations in terms of facial regions and fake detection performance. Two different methods are considered in our experimental framework: i) the traditional one followed in the literature and based on selecting the entire face as input to the fake detection system, and ii) a novel approach based on the selection of specific facial regions as input to the fake detection system. Among all the findings resulting from our experiments, we highlight the poor fake detection results achieved even by the strongest state-of-the-art fake detectors in the latest DeepFake databases of the 2nd generation, with Equal Error Rate results ranging from 15% to 30%. These results remark the necessity of further research to develop more sophisticated fake detectors.

Related papers

• DF40: Toward Next-Generation Deepfake Detection [62.073997142001424]
  Existing works identify top-notch detection algorithms and models by adhering to the common practice: training detectors on one specific dataset (e.g., FF++) and testing them on other prevalent deepfake datasets. But can these stand-out "winners" be truly applied to tackle the myriad of realistic and diverse deepfakes lurking in the real world? We construct a highly diverse and large-scale deepfake dataset called DF40, which comprises 40 distinct deepfake techniques. We then conduct comprehensive evaluations using 4 standard evaluation protocols and 7 representative detectors, resulting in over 2,000 evaluations.
  arXiv  Detail & Related papers  (2024-06-19T12:35:02Z)
• Diffusion Facial Forgery Detection [56.69763252655695]
  This paper introduces DiFF, a comprehensive dataset dedicated to face-focused diffusion-generated images. We conduct extensive experiments on the DiFF dataset via a human test and several representative forgery detection methods. The results demonstrate that the binary detection accuracy of both human observers and automated detectors often falls below 30%.
  arXiv  Detail & Related papers  (2024-01-29T03:20:19Z)
• DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake Detection [67.3143177137102]
  Deepfake detection refers to detecting artificially generated or edited faces in images or videos. We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
  arXiv  Detail & Related papers  (2023-12-07T07:19:45Z)
• GazeForensics: DeepFake Detection via Gaze-guided Spatial Inconsistency Learning [63.547321642941974]
  We introduce GazeForensics, an innovative DeepFake detection method that utilizes gaze representation obtained from a 3D gaze estimation model. Experiment results reveal that our proposed GazeForensics outperforms the current state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-11-13T04:48:33Z)
• Are Face Detection Models Biased? [69.68854430664399]
  We investigate possible bias in the domain of face detection through facial region localization. Most existing face detection datasets lack suitable annotation for such analysis. We observe a high disparity in detection accuracies across gender and skin-tone, and interplay of confounding factors beyond demography.
  arXiv  Detail & Related papers  (2022-11-07T14:27:55Z)
• Voice-Face Homogeneity Tells Deepfake [56.334968246631725]
  Existing detection approaches contribute to exploring the specific artifacts in deepfake videos. We propose to perform the deepfake detection from an unexplored voice-face matching view. Our model obtains significantly improved performance as compared to other state-of-the-art competitors.
  arXiv  Detail & Related papers  (2022-03-04T09:08:50Z)
• An Experimental Evaluation on Deepfake Detection using Deep Face Recognition [0.0]
  Deep learning has led to the generation of very realistic fake content, also known as deepfakes. Most of the current deepfake detection methods are deemed as a binary classification problem in distinguishing authentic images or videos from fake ones using two-class convolutional neural networks (CNNs) This paper thoroughly evaluate the efficacy of deep face recognition in identifying deepfakes, using different loss functions and deepfake generation techniques.
  arXiv  Detail & Related papers  (2021-10-04T18:02:56Z)
• DeepFake Detection with Inconsistent Head Poses: Reproducibility and Analysis [0.0]
  We analyze an existing DeepFake detection technique based on head pose estimation. Our results correct the current literature's perception of state of the art performance for DeepFake detection.
  arXiv  Detail & Related papers  (2021-08-28T22:56:09Z)
• Where Do Deep Fakes Look? Synthetic Face Detection via Gaze Tracking [8.473714899301601]
  We propose several prominent eye and gaze features that deep fakes exhibit differently. Second, we compile those features into signatures and analyze and compare those of real and fake videos. Third, we generalize this formulation to deep fake detection problem by a deep neural network.
  arXiv  Detail & Related papers  (2021-01-04T18:54:46Z)
• DeepFakesON-Phys: DeepFakes Detection based on Heart Rate Estimation [25.413558889761127]
  This work introduces a novel DeepFake detection framework based on physiological measurement. In particular, we consider methods looking for subtle color changes in the human skin, revealing the presence of human tissues under blood. The proposed fake detector named DeepFakesONPhys uses a Convolutional Attention Network (CAN), which extracts spatial and temporal information from video frames.
  arXiv  Detail & Related papers  (2020-10-01T13:37:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.