OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild

• URL: http://arxiv.org/abs/2107.14480v1
• Date: Fri, 30 Jul 2021 08:15:41 GMT
• Title: OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wild
• Authors: Trung-Nghia Le and Huy H. Nguyen and Junichi Yamagishi and Isao Echizen
• Abstract summary: This paper presents a study on two new countermeasure tasks: multi-face forgery detection and segmentation in-the-wild. Localizing forged faces among multiple human faces in unrestricted natural scenes is far more challenging than the traditional deepfake recognition task. With its rich annotations, our OpenForensics dataset has great potentials for research in both deepfake prevention and general human face detection.
• Score: 48.67582300190131
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The proliferation of deepfake media is raising concerns among the public and relevant authorities. It has become essential to develop countermeasures against forged faces in social media. This paper presents a comprehensive study on two new countermeasure tasks: multi-face forgery detection and segmentation in-the-wild. Localizing forged faces among multiple human faces in unrestricted natural scenes is far more challenging than the traditional deepfake recognition task. To promote these new tasks, we have created the first large-scale dataset posing a high level of challenges that is designed with face-wise rich annotations explicitly for face forgery detection and segmentation, namely OpenForensics. With its rich annotations, our OpenForensics dataset has great potentials for research in both deepfake prevention and general human face detection. We have also developed a suite of benchmarks for these tasks by conducting an extensive evaluation of state-of-the-art instance detection and segmentation methods on our newly constructed dataset in various scenarios. The dataset, benchmark results, codes, and supplementary materials will be publicly available on our project page: https://sites.google.com/view/ltnghia/research/openforensics

Related papers

• Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach [77.65459419417533]
  We propose an automatic dataset expansion technique to support semantics-oriented DeepFake detection tasks. We also resort to joint embedding of face images and their corresponding labels for prediction. Our method improves the generalizability of DeepFake detection and renders some degree of model interpretation by providing human-understandable explanations.
  arXiv  Detail & Related papers  (2024-08-29T07:11:50Z)
• UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
  High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization. We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
  arXiv  Detail & Related papers  (2024-07-26T20:51:54Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• FedForgery: Generalized Face Forgery Detection with Residual Federated Learning [87.746829550726]
  Existing face forgery detection methods directly utilize the obtained public shared or centralized data for training. The paper proposes a novel generalized residual Federated learning for face Forgery detection (FedForgery) Experiments conducted on publicly available face forgery detection datasets prove the superior performance of the proposed FedForgery.
  arXiv  Detail & Related papers  (2022-10-18T03:32:18Z)
• Face Forensics in the Wild [121.23154918448618]
  We construct a novel large-scale dataset, called FFIW-10K, which comprises 10,000 high-quality forgery videos. The manipulation procedure is fully automatic, controlled by a domain-adversarial quality assessment network. In addition, we propose a novel algorithm to tackle the task of multi-person face forgery detection.
  arXiv  Detail & Related papers  (2021-03-30T05:06:19Z)
• Going Deeper Into Face Detection: A Survey [30.711114908611563]
  Face detection is a crucial first step in many facial recognition and face analysis systems. With the breakthrough work in image classification using deep neural networks in 2012, there has been a huge paradigm shift in face detection. In this work, we provide a detailed overview of some of the most representative deep learning based face detection methods.
  arXiv  Detail & Related papers  (2021-03-27T20:18:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.