ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis

• URL: http://arxiv.org/abs/2103.05630v1
• Date: Tue, 9 Mar 2021 18:58:32 GMT
• Title: ForgeryNet: A Versatile Benchmark for Comprehensive Forgery Analysis
• Authors: Yinan He, Bei Gan, Siyu Chen, Yichun Zhou, Guojun Yin, Luchuan Song, Lu Sheng, Jing Shao and Ziwei Liu
• Abstract summary: ForgeryNet is an extremely large face forgery dataset with unified annotations in image- and video-level data. ForgeryNet is by far the largest publicly available deep face forgery dataset in terms of data-scale.
• Score: 36.49022293347066
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: The rapid progress of photorealistic synthesis techniques has reached at a critical point where the boundary between real and manipulated images starts to blur. Thus, benchmarking and advancing digital forgery analysis have become a pressing issue. However, existing face forgery datasets either have limited diversity or only support coarse-grained analysis. To counter this emerging threat, we construct the ForgeryNet dataset, an extremely large face forgery dataset with unified annotations in image- and video-level data across four tasks: 1) Image Forgery Classification, including two-way (real / fake), three-way (real / fake with identity-replaced forgery approaches / fake with identity-remained forgery approaches), and n-way (real and 15 respective forgery approaches) classification. 2) Spatial Forgery Localization, which segments the manipulated area of fake images compared to their corresponding source real images. 3) Video Forgery Classification, which re-defines the video-level forgery classification with manipulated frames in random positions. This task is important because attackers in real world are free to manipulate any target frame. and 4) Temporal Forgery Localization, to localize the temporal segments which are manipulated. ForgeryNet is by far the largest publicly available deep face forgery dataset in terms of data-scale (2.9 million images, 221,247 videos), manipulations (7 image-level approaches, 8 video-level approaches), perturbations (36 independent and more mixed perturbations) and annotations (6.3 million classification labels, 2.9 million manipulated area annotations and 221,247 temporal forgery segment labels). We perform extensive benchmarking and studies of existing face forensics methods and obtain several valuable observations.

Related papers

• Fine-grained Recognition with Learnable Semantic Data Augmentation [68.48892326854494]
  Fine-grained image recognition is a longstanding computer vision challenge. We propose diversifying the training data at the feature-level to alleviate the discriminative region loss problem. Our method significantly improves the generalization performance on several popular classification networks.
  arXiv  Detail & Related papers  (2023-09-01T11:15:50Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation [56.73855202368894]
  Previous work related to forgery detection mostly focuses on the entire faces. Recent forgery methods have developed to edit important facial components while maintaining others unchanged. We propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components.
  arXiv  Detail & Related papers  (2023-04-17T08:49:11Z)
• Hierarchical Forgery Classifier On Multi-modality Face Forgery Clues [61.37306431455152]
  We propose a novel Hierarchical Forgery for Multi-modality Face Forgery Detection (HFC-MFFD) The HFC-MFFD learns robust patches-based hybrid representation to enhance forgery authentication in multiple-modality scenarios. The specific hierarchical face forgery is proposed to alleviate the class imbalance problem and further boost detection performance.
  arXiv  Detail & Related papers  (2022-12-30T10:54:29Z)
• CFL-Net: Image Forgery Localization Using Contrastive Learning [16.668334854459143]
  We use contrastive loss to learn mapping into a feature space where the features between untampered and manipulated regions are well-separated for each image. Our method has the advantage of localizing manipulated region without requiring any prior knowledge or assumption about the forgery type.
  arXiv  Detail & Related papers  (2022-10-04T15:31:30Z)
• Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection [7.460203098159187]
  Copy-move forgery is a manipulation of copying and pasting specific patches from and to an image, with potentially illegal or unethical uses. Recent advances in the forensic methods for copy-move forgery have shown increasing success in detection accuracy and robustness. For images with high self-similarity or strong signal corruption, the existing algorithms often exhibit inefficient processes and unreliable results.
  arXiv  Detail & Related papers  (2022-07-19T09:11:43Z)
• ForgeryNet -- Face Forgery Analysis Challenge 2021: Methods and Results [34.73701165667725]
  This paper reports methods and results in the ForgeryNet - Face Forgery Analysis Challenge 2021, which employs the ForgeryNet benchmark. A total of 186 participants registered for the competition, and 11 teams made valid submissions.
  arXiv  Detail & Related papers  (2021-12-15T18:17:55Z)
• Detection of Deepfake Videos Using Long Distance Attention [73.6659488380372]
  Most existing detection methods treat the problem as a vanilla binary classification problem. In this paper, the problem is treated as a special fine-grained classification problem since the differences between fake and real faces are very subtle. A spatial-temporal model is proposed which has two components for capturing spatial and temporal forgery traces in global perspective.
  arXiv  Detail & Related papers  (2021-06-24T08:33:32Z)
• Syn2Real: Forgery Classification via Unsupervised Domain Adaptation [1.8229783460536682]
  We propose to create a synthetic forged dataset using deep semantic image inpainting and copy-move forgery algorithm. We use unsupervised domain adaptation networks to detect copy-move forgery in new domains by mapping the feature space from our synthetically generated dataset.
  arXiv  Detail & Related papers  (2020-02-03T15:02:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.