Identity-Driven DeepFake Detection
- URL: http://arxiv.org/abs/2012.03930v1
- Date: Mon, 7 Dec 2020 18:59:08 GMT
- Title: Identity-Driven DeepFake Detection
- Authors: Xiaoyi Dong and Jianmin Bao and Dongdong Chen and Weiming Zhang and
Nenghai Yu and Dong Chen and Fang Wen and Baining Guo
- Abstract summary: Identity-Driven DeepFake Detection takes as input the suspect image/video as well as the target identity information.
We output a decision on whether the identity in the suspect image/video is the same as the target identity.
We present a simple identity-based detection algorithm called the OuterFace, which may serve as a baseline for further research.
- Score: 91.0504621868628
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: DeepFake detection has so far been dominated by ``artifact-driven'' methods
and the detection performance significantly degrades when either the type of
image artifacts is unknown or the artifacts are simply too hard to find. In
this work, we present an alternative approach: Identity-Driven DeepFake
Detection. Our approach takes as input the suspect image/video as well as the
target identity information (a reference image or video). We output a decision
on whether the identity in the suspect image/video is the same as the target
identity. Our motivation is to prevent the most common and harmful DeepFakes
that spread false information of a targeted person. The identity-based approach
is fundamentally different in that it does not attempt to detect image
artifacts. Instead, it focuses on whether the identity in the suspect
image/video is true. To facilitate research on identity-based detection, we
present a new large scale dataset ``Vox-DeepFake", in which each suspect
content is associated with multiple reference images collected from videos of a
target identity. We also present a simple identity-based detection algorithm
called the OuterFace, which may serve as a baseline for further research. Even
trained without fake videos, the OuterFace algorithm achieves superior
detection accuracy and generalizes well to different DeepFake methods, and is
robust with respect to video degradation techniques -- a performance not
achievable with existing detection algorithms.
Related papers
- Deepfake detection in videos with multiple faces using geometric-fakeness features [79.16635054977068]
Deepfakes of victims or public figures can be used by fraudsters for blackmailing, extorsion and financial fraud.
In our research we propose to use geometric-fakeness features (GFF) that characterize a dynamic degree of a face presence in a video.
We employ our approach to analyze videos with multiple faces that are simultaneously present in a video.
arXiv Detail & Related papers (2024-10-10T13:10:34Z) - Shaking the Fake: Detecting Deepfake Videos in Real Time via Active Probes [3.6308756891251392]
Real-time deepfake, a type of generative AI, is capable of "creating" non-existing contents (e.g., swapping one's face with another) in a video.
It has been misused to produce deepfake videos for malicious purposes, including financial scams and political misinformation.
We propose SFake, a new real-time deepfake detection method that exploits deepfake models' inability to adapt to physical interference.
arXiv Detail & Related papers (2024-09-17T04:58:30Z) - In Anticipation of Perfect Deepfake: Identity-anchored Artifact-agnostic Detection under Rebalanced Deepfake Detection Protocol [20.667392938528987]
We introduce the Rebalanced Deepfake Detection Protocol (RDDP) to stress-test detectors under balanced scenarios.
We present ID-Miner, a detector that identifies the puppeteer behind the disguise by focusing on motion over artifacts or appearances.
arXiv Detail & Related papers (2024-05-01T12:48:13Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - CrossDF: Improving Cross-Domain Deepfake Detection with Deep Information Decomposition [53.860796916196634]
We propose a Deep Information Decomposition (DID) framework to enhance the performance of Cross-dataset Deepfake Detection (CrossDF)
Unlike most existing deepfake detection methods, our framework prioritizes high-level semantic features over specific visual artifacts.
It adaptively decomposes facial features into deepfake-related and irrelevant information, only using the intrinsic deepfake-related information for real/fake discrimination.
arXiv Detail & Related papers (2023-09-30T12:30:25Z) - Diff-ID: An Explainable Identity Difference Quantification Framework for
DeepFake Detection [41.03606237571299]
We propose Diff-ID, a concise and effective approach that explains and measures the identity loss induced by facial manipulations.
When testing on an image of a specific person, Diff-ID utilizes an authentic image of that person as a reference and aligns them to the same identity-insensitive attribute feature space.
We then visualize the identity loss between the test and the reference image from the image differences of the aligned pairs, and design a custom metric to quantify the identity loss.
arXiv Detail & Related papers (2023-03-30T10:10:20Z) - Audio-Visual Person-of-Interest DeepFake Detection [77.04789677645682]
The aim of this work is to propose a deepfake detector that can cope with the wide variety of manipulation methods and scenarios encountered in the real world.
We leverage a contrastive learning paradigm to learn the moving-face and audio segment embeddings that are most discriminative for each identity.
Our method can detect both single-modality (audio-only, video-only) and multi-modality (audio-video) attacks, and is robust to low-quality or corrupted videos.
arXiv Detail & Related papers (2022-04-06T20:51:40Z) - Voice-Face Homogeneity Tells Deepfake [56.334968246631725]
Existing detection approaches contribute to exploring the specific artifacts in deepfake videos.
We propose to perform the deepfake detection from an unexplored voice-face matching view.
Our model obtains significantly improved performance as compared to other state-of-the-art competitors.
arXiv Detail & Related papers (2022-03-04T09:08:50Z) - DeepFake Detection with Inconsistent Head Poses: Reproducibility and
Analysis [0.0]
We analyze an existing DeepFake detection technique based on head pose estimation.
Our results correct the current literature's perception of state of the art performance for DeepFake detection.
arXiv Detail & Related papers (2021-08-28T22:56:09Z) - Understanding the Security of Deepfake Detection [23.118012417901078]
We study the security of state-of-the-art deepfake detection methods in adversarial settings.
We use two large-scale public deepfakes data sources including FaceForensics++ and Facebook Deepfake Detection Challenge.
Our results uncover multiple security limitations of the deepfake detection methods in adversarial settings.
arXiv Detail & Related papers (2021-07-05T14:18:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.