DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection

• URL: http://arxiv.org/abs/2001.00179v3
• Date: Thu, 18 Jun 2020 18:17:43 GMT
• Title: DeepFakes and Beyond: A Survey of Face Manipulation and Fake Detection
• Authors: Ruben Tolosana, Ruben Vera-Rodriguez, Julian Fierrez, Aythami Morales, Javier Ortega-Garcia
• Abstract summary: This survey provides a review of techniques for manipulating face images including DeepFake methods. In particular, four types of facial manipulation are reviewed: entire face synthesis, identity swap (DeepFakes), attribute manipulation, and expression swap. We pay special attention to the latest generation of DeepFakes, highlighting its improvements and challenges for fake detection.
• Score: 17.602598143822917
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The free access to large-scale public databases, together with the fast progress of deep learning techniques, in particular Generative Adversarial Networks, have led to the generation of very realistic fake content with its corresponding implications towards society in this era of fake news. This survey provides a thorough review of techniques for manipulating face images including DeepFake methods, and methods to detect such manipulations. In particular, four types of facial manipulation are reviewed: i) entire face synthesis, ii) identity swap (DeepFakes), iii) attribute manipulation, and iv) expression swap. For each manipulation group, we provide details regarding manipulation techniques, existing public databases, and key benchmarks for technology evaluation of fake detection methods, including a summary of results from those evaluations. Among all the aspects discussed in the survey, we pay special attention to the latest generation of DeepFakes, highlighting its improvements and challenges for fake detection. In addition to the survey information, we also discuss open issues and future trends that should be considered to advance in the field.

Related papers

• Understanding Audiovisual Deepfake Detection: Techniques, Challenges, Human Factors and Perceptual Insights [49.81915942821647]
  Deep Learning has been successfully applied in diverse fields, and its impact on deepfake detection is no exception. Deepfakes are fake yet realistic synthetic content that can be used deceitfully for political impersonation, phishing, slandering, or spreading misinformation. This paper aims to improve the effectiveness of deepfake detection strategies and guide future research in cybersecurity and media integrity.
  arXiv  Detail & Related papers  (2024-11-12T09:02:11Z)
• Deep Learning Technology for Face Forgery Detection: A Survey [17.519617618071003]
  Deep learning has enabled the creation or manipulation of high-fidelity facial images and videos. This technology, also known as deepfake, has achieved dramatic progress and become increasingly popular in social media. To diminish the risks of deepfake, it is desirable to develop powerful forgery detection methods.
  arXiv  Detail & Related papers  (2024-09-22T01:42:01Z)
• Media Forensics and Deepfake Systematic Survey [0.0]
  Deepfake is a generative deep learning algorithm that creates or changes facial features in a very realistic way. It can be used to make movies look better as well as to spread false information by imitating famous people.
  arXiv  Detail & Related papers  (2024-06-19T07:33:33Z)
• Deepfake Generation and Detection: A Benchmark and Survey [134.19054491600832]
  Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions. This survey comprehensively reviews the latest developments in deepfake generation and detection. We focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing.
  arXiv  Detail & Related papers  (2024-03-26T17:12:34Z)
• Real Face Foundation Representation Learning for Generalized Deepfake Detection [74.4691295738097]
  The emergence of deepfake technologies has become a matter of social concern as they pose threats to individual privacy and public security. It is almost impossible to collect sufficient representative fake faces, and it is hard for existing detectors to generalize to all types of manipulation. We propose Real Face Foundation Representation Learning (RFFR), which aims to learn a general representation from large-scale real face datasets.
  arXiv  Detail & Related papers  (2023-03-15T08:27:56Z)
• Detecting and Recovering Sequential DeepFake Manipulation [32.34908534582532]
  We propose a novel research problem called Detecting Sequential DeepFake Manipulation (Seq-DeepFake) Unlike the existing deepfake detection task only demanding a binary label prediction, Seq-DeepFake requires correctly predicting a sequential vector of facial manipulation operations. We build a comprehensive benchmark and set up rigorous evaluation protocols and metrics for this new research problem.
  arXiv  Detail & Related papers  (2022-07-05T17:59:33Z)
• OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild [48.67582300190131]
  This paper presents a study on two new countermeasure tasks: multi-face forgery detection and segmentation in-the-wild. Localizing forged faces among multiple human faces in unrestricted natural scenes is far more challenging than the traditional deepfake recognition task. With its rich annotations, our OpenForensics dataset has great potentials for research in both deepfake prevention and general human face detection.
  arXiv  Detail & Related papers  (2021-07-30T08:15:41Z)
• Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
  Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
  arXiv  Detail & Related papers  (2021-04-28T09:35:48Z)
• Towards Generalizable and Robust Face Manipulation Detection via Bag-of-local-feature [55.47546606878931]
  We propose a novel method for face manipulation detection, which can improve the generalization ability and robustness by bag-of-local-feature. Specifically, we extend Transformers using bag-of-feature approach to encode inter-patch relationships, allowing it to learn local forgery features without any explicit supervision.
  arXiv  Detail & Related papers  (2021-03-14T12:50:48Z)
• Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward [2.15242029196761]
  It is possible to generate deepfakes to disseminate disinformation, revenge porn, financial frauds, hoaxes, and to disrupt government functioning. No attempt has been made to review approaches for detection and generation of both audio and video deepfakes. This paper provides a comprehensive review and detailed analysis of existing tools and machine learning (ML) based approaches for deepfake generation.
  arXiv  Detail & Related papers  (2021-02-25T18:26:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.