Unmasking Facial DeepFakes: A Robust Multiview Detection Framework for Natural Images
- URL: http://arxiv.org/abs/2510.15576v1
- Date: Fri, 17 Oct 2025 12:16:04 GMT
- Title: Unmasking Facial DeepFakes: A Robust Multiview Detection Framework for Natural Images
- Authors: Sami Belguesmia, Mohand Saïd Allili, Assia Hamadene,
- Abstract summary: We propose a multi-view architecture that enhances DeepFake detection by analyzing facial features at multiple levels.<n>Our approach integrates three specialized encoders, a global view encoder for detecting boundary inconsistencies, a middle view encoder for analyzing texture and color alignment, and a local view encoder for capturing distortions in expressive facial regions.<n>By fusing features from these encoders, our model achieves superior performance in detecting manipulated images, even under challenging pose and lighting conditions.
- Score: 1.5049442691806052
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: DeepFake technology has advanced significantly in recent years, enabling the creation of highly realistic synthetic face images. Existing DeepFake detection methods often struggle with pose variations, occlusions, and artifacts that are difficult to detect in real-world conditions. To address these challenges, we propose a multi-view architecture that enhances DeepFake detection by analyzing facial features at multiple levels. Our approach integrates three specialized encoders, a global view encoder for detecting boundary inconsistencies, a middle view encoder for analyzing texture and color alignment, and a local view encoder for capturing distortions in expressive facial regions such as the eyes, nose, and mouth, where DeepFake artifacts frequently occur. Additionally, we incorporate a face orientation encoder, trained to classify face poses, ensuring robust detection across various viewing angles. By fusing features from these encoders, our model achieves superior performance in detecting manipulated images, even under challenging pose and lighting conditions.Experimental results on challenging datasets demonstrate the effectiveness of our method, outperforming conventional single-view approaches
Related papers
- Seeing Through the Blur: Unlocking Defocus Maps for Deepfake Detection [27.079338164502634]
generative AI has enabled the mass production of photorealistic synthetic images, blurring the boundary between authentic and fabricated visual content.<n>We propose a physically interpretable deepfake detection framework and demonstrate that defocus blur can serve as an effective forensic signal.<n>We aim for our defocus-based detection pipeline and interpretability tools to contribute meaningfully to ongoing research in media forensics.
arXiv Detail & Related papers (2025-09-27T13:02:53Z) - Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach [77.65459419417533]
We propose an automated dataset expansion technique to support semantics-oriented DeepFake detection tasks.<n>We also resort to the joint embedding of face images and labels (depicted by text descriptions) for prediction.<n>Our method improves the generalizability of DeepFake detection and renders some degree of model interpretation by providing human-understandable explanations.
arXiv Detail & Related papers (2024-08-29T07:11:50Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - Multi-Channel Cross Modal Detection of Synthetic Face Images [0.0]
Synthetically generated face images have shown to be indistinguishable from real images by humans.<n>New and improved generative models are proposed with rapid speed and arbitrary image post-processing can be applied.<n>We propose a multi-channel architecture for detecting entirely synthetic face images.
arXiv Detail & Related papers (2023-11-28T13:30:10Z) - COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
Face forgery recognition methods can only process one face at a time.
Most face forgery recognition methods can only process one face at a time.
We propose COMICS, an end-to-end framework for multi-face forgery detection.
arXiv Detail & Related papers (2023-08-03T03:37:13Z) - Deep Convolutional Pooling Transformer for Deepfake Detection [54.10864860009834]
We propose a deep convolutional Transformer to incorporate decisive image features both locally and globally.
Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy.
The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.
arXiv Detail & Related papers (2022-09-12T15:05:41Z) - A new face swap method for image and video domains: a technical report [60.47144478048589]
We introduce a new face swap pipeline that is based on FaceShifter architecture.
New eye loss function, super-resolution block, and Gaussian-based face mask generation leads to improvements in quality.
arXiv Detail & Related papers (2022-02-07T10:15:50Z) - Contrastive Attention Network with Dense Field Estimation for Face
Completion [11.631559190975034]
We propose a self-supervised Siamese inference network to improve the generalization and robustness of encoders.
To deal with geometric variations of face images, a dense correspondence field is integrated into the network.
This multi-scale architecture is beneficial for the decoder to utilize discriminative representations learned from encoders into images.
arXiv Detail & Related papers (2021-12-20T02:54:38Z) - Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures.
Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues.
We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
arXiv Detail & Related papers (2021-04-28T09:35:48Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.