FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge
- URL: http://arxiv.org/abs/2404.13872v2
- Date: Mon, 6 May 2024 09:14:42 GMT
- Title: FreqBlender: Enhancing DeepFake Detection by Blending Frequency Knowledge
- Authors: Hanzhe Li, Yuezun Li, Jiaran Zhou, Bin Li, Junyu Dong,
- Abstract summary: Existing methods typically generate synthetic fake faces by blending real or fake faces in color space.
This paper introduces em FreqBlender, a new method that can generate pseudo-fake faces by blending frequency knowledge.
Experimental results demonstrate the effectiveness of our method in enhancing DeepFake detection, making it a potential plug-and-play strategy for other methods.
- Score: 32.81674814838492
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Generating synthetic fake faces, known as pseudo-fake faces, is an effective way to improve the generalization of DeepFake detection. Existing methods typically generate these faces by blending real or fake faces in color space. While these methods have shown promise, they overlook the simulation of frequency distribution in pseudo-fake faces, limiting the learning of generic forgery traces in-depth. To address this, this paper introduces {\em FreqBlender}, a new method that can generate pseudo-fake faces by blending frequency knowledge. Specifically, we investigate the major frequency components and propose a Frequency Parsing Network to adaptively partition frequency components related to forgery traces. Then we blend this frequency knowledge from fake faces into real faces to generate pseudo-fake faces. Since there is no ground truth for frequency components, we describe a dedicated training strategy by leveraging the inner correlations among different frequency knowledge to instruct the learning process. Experimental results demonstrate the effectiveness of our method in enhancing DeepFake detection, making it a potential plug-and-play strategy for other methods.
Related papers
- Deepfake Detection without Deepfakes: Generalization via Synthetic Frequency Patterns Injection [12.33030785907372]
Deepfake detectors are typically trained on large sets of pristine and generated images.
Deepfake detectors excel at identifying deepfakes created through methods encountered during training but struggle with those generated by unknown techniques.
This paper introduces a learning approach aimed at significantly enhancing the generalization capabilities of deepfake detectors.
arXiv Detail & Related papers (2024-03-20T10:33:10Z) - Frequency-Aware Deepfake Detection: Improving Generalizability through
Frequency Space Learning [81.98675881423131]
This research addresses the challenge of developing a universal deepfake detector that can effectively identify unseen deepfake images.
Existing frequency-based paradigms have relied on frequency-level artifacts introduced during the up-sampling in GAN pipelines to detect forgeries.
We introduce a novel frequency-aware approach called FreqNet, centered around frequency domain learning, specifically designed to enhance the generalizability of deepfake detectors.
arXiv Detail & Related papers (2024-03-12T01:28:00Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - Real Face Foundation Representation Learning for Generalized Deepfake
Detection [74.4691295738097]
The emergence of deepfake technologies has become a matter of social concern as they pose threats to individual privacy and public security.
It is almost impossible to collect sufficient representative fake faces, and it is hard for existing detectors to generalize to all types of manipulation.
We propose Real Face Foundation Representation Learning (RFFR), which aims to learn a general representation from large-scale real face datasets.
arXiv Detail & Related papers (2023-03-15T08:27:56Z) - Self-supervised Transformer for Deepfake Detection [112.81127845409002]
Deepfake techniques in real-world scenarios require stronger generalization abilities of face forgery detectors.
Inspired by transfer learning, neural networks pre-trained on other large-scale face-related tasks may provide useful features for deepfake detection.
In this paper, we propose a self-supervised transformer based audio-visual contrastive learning method.
arXiv Detail & Related papers (2022-03-02T17:44:40Z) - EMface: Detecting Hard Faces by Exploring Receptive Field Pyraminds [10.926608043159918]
We propose a simple yet effective method to enhance the representation ability of feature pyramids.
It can learn different receptive fields in each feature map adaptively based on the varying scales of detected faces.
Our proposed method can accelerate the inference rate significantly while achieving state-of-the-art performance.
arXiv Detail & Related papers (2021-05-21T03:01:37Z) - Lips Don't Lie: A Generalisable and Robust Approach to Face Forgery
Detection [118.37239586697139]
LipForensics is a detection approach capable of both generalising manipulations and withstanding various distortions.
It consists in first pretraining a-temporal network to perform visual speech recognition (lipreading)
A temporal network is subsequently finetuned on fixed mouth embeddings of real and forged data in order to detect fake videos based on mouth movements without over-fitting to low-level, manipulation-specific artefacts.
arXiv Detail & Related papers (2020-12-14T15:53:56Z) - Deep Detection for Face Manipulation [10.551455590390418]
We introduce a deep learning method to detect face manipulation.
It consists of two stages: feature extraction and binary classification.
We show that it generates better performance than state-of-the-art techniques in most cases.
arXiv Detail & Related papers (2020-09-13T06:48:34Z) - DeepFake Detection Based on the Discrepancy Between the Face and its
Context [94.47879216590813]
We propose a method for detecting face swapping and other identity manipulations in single images.
Our approach involves two networks: (i) a face identification network that considers the face region bounded by a tight semantic segmentation, and (ii) a context recognition network that considers the face context.
We describe a method which uses the recognition signals from our two networks to detect such discrepancies.
Our method achieves state of the art results on the FaceForensics++, Celeb-DF-v2, and DFDC benchmarks for face manipulation detection, and even generalizes to detect fakes produced by unseen methods.
arXiv Detail & Related papers (2020-08-27T17:04:46Z) - One-Shot GAN Generated Fake Face Detection [3.3707422585608953]
We propose a universal One-Shot GAN generated fake face detection method.
The proposed method is based on extracting out-of-context objects from faces via scene understanding models.
Our experiments show that, we can discriminate fake faces from real ones in terms of out-of-context features.
arXiv Detail & Related papers (2020-03-27T05:51:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.