Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues
- URL: http://arxiv.org/abs/2212.14629v2
- Date: Tue, 19 Sep 2023 09:41:02 GMT
- Title: Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues
- Authors: Decheng Liu, Zeyang Zheng, Chunlei Peng, Yukai Wang, Nannan Wang,
Xinbo Gao
- Abstract summary: We propose a novel Hierarchical Forgery for Multi-modality Face Forgery Detection (HFC-MFFD)
The HFC-MFFD learns robust patches-based hybrid representation to enhance forgery authentication in multiple-modality scenarios.
The specific hierarchical face forgery is proposed to alleviate the class imbalance problem and further boost detection performance.
- Score: 61.37306431455152
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Face forgery detection plays an important role in personal privacy and social
security. With the development of adversarial generative models, high-quality
forgery images become more and more indistinguishable from real to humans.
Existing methods always regard as forgery detection task as the common binary
or multi-label classification, and ignore exploring diverse multi-modality
forgery image types, e.g. visible light spectrum and near-infrared scenarios.
In this paper, we propose a novel Hierarchical Forgery Classifier for
Multi-modality Face Forgery Detection (HFC-MFFD), which could effectively learn
robust patches-based hybrid domain representation to enhance forgery
authentication in multiple-modality scenarios. The local spatial hybrid domain
feature module is designed to explore strong discriminative forgery clues both
in the image and frequency domain in local distinct face regions. Furthermore,
the specific hierarchical face forgery classifier is proposed to alleviate the
class imbalance problem and further boost detection performance. Experimental
results on representative multi-modality face forgery datasets demonstrate the
superior performance of the proposed HFC-MFFD compared with state-of-the-art
algorithms. The source code and models are publicly available at
https://github.com/EdWhites/HFC-MFFD.
Related papers
- Diversity over Uniformity: Rethinking Representation in Generated Image Detection [22.020742109848317]
We argue that reliably generated image detection should not depend on a single decision path but should preserve multiple judgment perspectives.<n>We propose an anti-feature-collapse learning framework that filters task-irrelevant components and suppresses excessive overlap among different forgery cues in the representation space.<n>This design maintains diverse and complementary evidence within the model, reduces reliance on a small set of salient cues, and enhances robustness under unseen generative settings.
arXiv Detail & Related papers (2026-02-28T15:42:12Z) - FOCA: Frequency-Oriented Cross-Domain Forgery Detection, Localization and Explanation via Multi-Modal Large Language Model [11.08248067961235]
FOCA is a large language model-based framework that integrates discriminative features from both the RGB spatial and frequency domains.<n>FSE-Set is a large-scale dataset with diverse authentic and tampered images, pixel-level masks, and dual-domain annotations.
arXiv Detail & Related papers (2026-02-21T15:53:44Z) - DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attention [12.36906630199689]
We construct a DA-HFNet forged image dataset guided by text or image-assisted GAN and Diffusion model.
Our goal is to utilize a hierarchical progressive network to capture forged artifacts at different scales for detection and localization.
arXiv Detail & Related papers (2024-06-03T16:13:33Z) - GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross Appearance-Edge Learning [50.7702397913573]
The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable.
Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology.
We propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection.
arXiv Detail & Related papers (2024-02-03T03:13:50Z) - COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
Face forgery recognition methods can only process one face at a time.
Most face forgery recognition methods can only process one face at a time.
We propose COMICS, an end-to-end framework for multi-face forgery detection.
arXiv Detail & Related papers (2023-08-03T03:37:13Z) - Towards General Visual-Linguistic Face Forgery Detection [95.73987327101143]
Deepfakes are realistic face manipulations that can pose serious threats to security, privacy, and trust.
Existing methods mostly treat this task as binary classification, which uses digital labels or mask signals to train the detection model.
We propose a novel paradigm named Visual-Linguistic Face Forgery Detection(VLFFD), which uses fine-grained sentence-level prompts as the annotation.
arXiv Detail & Related papers (2023-07-31T10:22:33Z) - Attention Consistency Refined Masked Frequency Forgery Representation
for Generalizing Face Forgery Detection [96.539862328788]
Existing forgery detection methods suffer from unsatisfactory generalization ability to determine the authenticity in the unseen domain.
We propose a novel Attention Consistency Refined masked frequency forgery representation model toward generalizing face forgery detection algorithm (ACMF)
Experiment results on several public face forgery datasets demonstrate the superior performance of the proposed method compared with the state-of-the-art methods.
arXiv Detail & Related papers (2023-07-21T08:58:49Z) - Prepended Domain Transformer: Heterogeneous Face Recognition without
Bells and Whistles [9.419177623349947]
We propose a surprisingly simple, yet, very effective method for matching face images across different sensing modalities.
The proposed approach is architecture agnostic, meaning they can be added to any pre-trained models.
The source code and protocols will be made available publicly.
arXiv Detail & Related papers (2022-10-12T18:54:57Z) - Dynamic Prototype Mask for Occluded Person Re-Identification [88.7782299372656]
Existing methods mainly address this issue by employing body clues provided by an extra network to distinguish the visible part.
We propose a novel Dynamic Prototype Mask (DPM) based on two self-evident prior knowledge.
Under this condition, the occluded representation could be well aligned in a selected subspace spontaneously.
arXiv Detail & Related papers (2022-07-19T03:31:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.