Countering Malicious DeepFakes: Survey, Battleground, and Horizon
- URL: http://arxiv.org/abs/2103.00218v1
- Date: Sat, 27 Feb 2021 13:48:54 GMT
- Title: Countering Malicious DeepFakes: Survey, Battleground, and Horizon
- Authors: Felix Juefei-Xu and Run Wang and Yihao Huang and Qing Guo and Lei Ma
and Yang Liu
- Abstract summary: The creation and the manipulation of facial appearance via deep generative approaches, known as DeepFake, have achieved significant progress.
The evil side of this new technique poses another popular study, i.e., DeepFake detection aiming to identify the fake faces from the real ones.
With the rapid development of the DeepFake-related studies in the community, both sides (i.e., DeepFake generation and detection) have formed the relationship of the battleground.
- Score: 17.153920019319603
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The creation and the manipulation of facial appearance via deep generative
approaches, known as DeepFake, have achieved significant progress and promoted
a wide range of benign and malicious applications. The evil side of this new
technique poses another popular study, i.e., DeepFake detection aiming to
identify the fake faces from the real ones. With the rapid development of the
DeepFake-related studies in the community, both sides (i.e., DeepFake
generation and detection) have formed the relationship of the battleground,
pushing the improvements of each other and inspiring new directions, e.g., the
evasion of DeepFake detection. Nevertheless, the overview of such battleground
and the new direction is unclear and neglected by recent surveys due to the
rapid increase of related publications, limiting the in-depth understanding of
the tendency and future works.
To fill this gap, in this paper, we provide a comprehensive overview and
detailed analysis of the research work on the topic of DeepFake generation,
DeepFake detection as well as evasion of DeepFake detection, with more than 191
research papers carefully surveyed. We present the taxonomy of various DeepFake
generation methods and the categorization of various DeepFake detection
methods, and more importantly, we showcase the battleground between the two
parties with detailed interactions between the adversaries (DeepFake
generation) and the defenders (DeepFake detection). The battleground allows
fresh perspective into the latest landscape of the DeepFake research and can
provide valuable analysis towards the research challenges and opportunities as
well as research trends and directions in the field of DeepFake generation and
detection. We also elaborately design interactive diagrams
(http://www.xujuefei.com/dfsurvey) to allow researchers to explore their own
interests on popular DeepFake generators or detectors.
Related papers
- Deep Learning Technology for Face Forgery Detection: A Survey [17.519617618071003]
Deep learning has enabled the creation or manipulation of high-fidelity facial images and videos.
This technology, also known as deepfake, has achieved dramatic progress and become increasingly popular in social media.
To diminish the risks of deepfake, it is desirable to develop powerful forgery detection methods.
arXiv Detail & Related papers (2024-09-22T01:42:01Z) - Deepfake Generation and Detection: A Benchmark and Survey [134.19054491600832]
Deepfake is a technology dedicated to creating highly realistic facial images and videos under specific conditions.
This survey comprehensively reviews the latest developments in deepfake generation and detection.
We focus on researching four representative deepfake fields: face swapping, face reenactment, talking face generation, and facial attribute editing.
arXiv Detail & Related papers (2024-03-26T17:12:34Z) - GazeForensics: DeepFake Detection via Gaze-guided Spatial Inconsistency
Learning [63.547321642941974]
We introduce GazeForensics, an innovative DeepFake detection method that utilizes gaze representation obtained from a 3D gaze estimation model.
Experiment results reveal that our proposed GazeForensics outperforms the current state-of-the-art methods.
arXiv Detail & Related papers (2023-11-13T04:48:33Z) - DeePhy: On Deepfake Phylogeny [58.01631614114075]
DeePhy is a novel Deepfake Phylogeny dataset which consists of 5040 deepfake videos generated using three different generation techniques.
We present the benchmark on DeePhy dataset using six deepfake detection algorithms.
arXiv Detail & Related papers (2022-09-19T15:30:33Z) - DFGC 2022: The Second DeepFake Game Competition [93.05016504907401]
The DeepFake is rapidly evolving, and realistic face-swaps are becoming more deceptive and difficult to detect.
There is a two-party game between DeepFake creators and defenders.
This competition provides a common platform for benchmarking the game between the current state-of-the-arts in DeepFake creation and detection methods.
arXiv Detail & Related papers (2022-06-30T09:13:06Z) - Restricted Black-box Adversarial Attack Against DeepFake Face Swapping [70.82017781235535]
We introduce a practical adversarial attack that does not require any queries to the facial image forgery model.
Our method is built on a substitute model persuing for face reconstruction and then transfers adversarial examples from the substitute model directly to inaccessible black-box DeepFake models.
arXiv Detail & Related papers (2022-04-26T14:36:06Z) - DeepFakes: Detecting Forged and Synthetic Media Content Using Machine
Learning [18.623444153774948]
The study presents challenges, research trends, and directions related to DeepFake creation and detection techniques.
The study reviews the notable research in the DeepFake domain to facilitate the development of more robust approaches that could deal with the more advance DeepFake in the future.
arXiv Detail & Related papers (2021-09-07T05:19:36Z) - DeepFake Detection with Inconsistent Head Poses: Reproducibility and
Analysis [0.0]
We analyze an existing DeepFake detection technique based on head pose estimation.
Our results correct the current literature's perception of state of the art performance for DeepFake detection.
arXiv Detail & Related papers (2021-08-28T22:56:09Z) - DFGC 2021: A DeepFake Game Competition [58.77039013470618]
This paper presents a summary of the DFGC 2021 competition.
DeepFake technology is developing fast, and realistic face-swaps are increasingly deceiving and hard to detect.
This competition provides a common platform for benchmarking the adversarial game between current state-of-the-art DeepFake creation and detection methods.
arXiv Detail & Related papers (2021-06-02T15:10:13Z) - DeepFake-o-meter: An Open Platform for DeepFake Detection [36.62547135445819]
We develop an open-source online platform, known as DeepFake-o-meter, that integrates state-of-the-art DeepFake detection methods.
We describe the design and function of DeepFake-o-meter in this work.
arXiv Detail & Related papers (2021-03-02T20:45:33Z) - Landmark Breaker: Obstructing DeepFake By Disturbing Landmark Extraction [40.71503677067645]
We describe Landmark Breaker, the first dedicated method to disrupt facial landmark extraction.
Our motivation is that disrupting the facial landmark extraction can affect the alignment of input face so as to degrade the DeepFake quality.
Compared to the detection methods that only work after DeepFake generation, Landmark Breaker goes one step ahead to prevent DeepFake generation.
arXiv Detail & Related papers (2021-02-01T12:27:08Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.