Face Forensics in the Wild
- URL: http://arxiv.org/abs/2103.16076v1
- Date: Tue, 30 Mar 2021 05:06:19 GMT
- Title: Face Forensics in the Wild
- Authors: Tianfei Zhou, Wenguan Wang, Zhiyuan Liang, Jianbing Shen
- Abstract summary: We construct a novel large-scale dataset, called FFIW-10K, which comprises 10,000 high-quality forgery videos.
The manipulation procedure is fully automatic, controlled by a domain-adversarial quality assessment network.
In addition, we propose a novel algorithm to tackle the task of multi-person face forgery detection.
- Score: 121.23154918448618
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: On existing public benchmarks, face forgery detection techniques have
achieved great success. However, when used in multi-person videos, which often
contain many people active in the scene with only a small subset having been
manipulated, their performance remains far from being satisfactory. To take
face forgery detection to a new level, we construct a novel large-scale
dataset, called FFIW-10K, which comprises 10,000 high-quality forgery videos,
with an average of three human faces in each frame. The manipulation procedure
is fully automatic, controlled by a domain-adversarial quality assessment
network, making our dataset highly scalable with low human cost. In addition,
we propose a novel algorithm to tackle the task of multi-person face forgery
detection. Supervised by only video-level label, the algorithm explores
multiple instance learning and learns to automatically attend to tampered
faces. Our algorithm outperforms representative approaches for both forgery
classification and localization on FFIW-10K, and also shows high generalization
ability on existing benchmarks. We hope that our dataset and study will help
the community to explore this new field in more depth.
Related papers
- GenFace: A Large-Scale Fine-Grained Face Forgery Benchmark and Cross
Appearance-Edge Learning [49.93362169016503]
The rapid advancement of photorealistic generators has reached a critical juncture where the discrepancy between authentic and manipulated images is increasingly indistinguishable.
Although there have been a number of publicly available face forgery datasets, the forgery faces are mostly generated using GAN-based synthesis technology.
We propose a large-scale, diverse, and fine-grained high-fidelity dataset, namely GenFace, to facilitate the advancement of deepfake detection.
arXiv Detail & Related papers (2024-02-03T03:13:50Z) - Unmasking Deepfakes: Masked Autoencoding Spatiotemporal Transformers for
Enhanced Video Forgery Detection [19.432851794777754]
We present a novel approach for the detection of deepfake videos using a pair of vision transformers pre-trained by a self-supervised masked autoencoding setup.
Our method consists of two distinct components, one of which focuses on learning spatial information from individual RGB frames of the video, while the other learns temporal consistency information from optical flow fields generated from consecutive frames.
arXiv Detail & Related papers (2023-06-12T05:49:23Z) - Benchmarking person re-identification datasets and approaches for
practical real-world implementations [1.0079626733116613]
Person Re-Identification (Re-ID) has received a lot of attention.
However, when such Re-ID models are deployed in new cities or environments, the task of searching for people within a network of security cameras is likely to face an important domain shift.
This paper introduces a complete methodology to evaluate Re-ID approaches and training datasets with respect to their suitability for unsupervised deployment for live operations.
arXiv Detail & Related papers (2022-12-20T03:45:38Z) - OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery
Detection And Segmentation In-The-Wild [48.67582300190131]
This paper presents a study on two new countermeasure tasks: multi-face forgery detection and segmentation in-the-wild.
Localizing forged faces among multiple human faces in unrestricted natural scenes is far more challenging than the traditional deepfake recognition task.
With its rich annotations, our OpenForensics dataset has great potentials for research in both deepfake prevention and general human face detection.
arXiv Detail & Related papers (2021-07-30T08:15:41Z) - Multi-attentional Deepfake Detection [79.80308897734491]
Face forgery by deepfake is widely spread over the internet and has raised severe societal concerns.
We propose a new multi-attentional deepfake detection network. Specifically, it consists of three key components: 1) multiple spatial attention heads to make the network attend to different local parts; 2) textural feature enhancement block to zoom in the subtle artifacts in shallow features; 3) aggregate the low-level textural feature and high-level semantic features guided by the attention maps.
arXiv Detail & Related papers (2021-03-03T13:56:14Z) - Fast Facial Landmark Detection and Applications: A Survey [0.0]
We focus on approaches that have led to a significant increase in quality over the past few years on datasets with large pose and emotion variability.
We summarize the improvements into categories, provide quality comparison on difficult and modern in-the-wild datasets: 300-W, AFLW, WFLW, COFW.
arXiv Detail & Related papers (2021-01-12T09:40:40Z) - Self-supervised Human Detection and Segmentation via Multi-view
Consensus [116.92405645348185]
We propose a multi-camera framework in which geometric constraints are embedded in the form of multi-view consistency during training.
We show that our approach outperforms state-of-the-art self-supervised person detection and segmentation techniques on images that visually depart from those of standard benchmarks.
arXiv Detail & Related papers (2020-12-09T15:47:21Z) - DeeperForensics-1.0: A Large-Scale Dataset for Real-World Face Forgery
Detection [93.24684159708114]
DeeperForensics-1.0 is the largest face forgery detection dataset by far, with 60,000 videos constituted by a total of 17.6 million frames.
The quality of generated videos outperforms those in existing datasets, validated by user studies.
The benchmark features a hidden test set, which contains manipulated videos achieving high deceptive scores in human evaluations.
arXiv Detail & Related papers (2020-01-09T14:37:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.