Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning

• URL: http://arxiv.org/abs/2207.03776v1
• Date: Fri, 8 Jul 2022 09:23:59 GMT
• Title: Towards Intrinsic Common Discriminative Features Learning for Face Forgery Detection using Adversarial Learning
• Authors: Wanyi Zhuang, Qi Chu, Haojie Yuan, Changtao Miao, Bin Liu, Nenghai Yu
• Abstract summary: We propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities. Our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities.
• Score: 59.548960057358435
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Existing face forgery detection methods usually treat face forgery detection as a binary classification problem and adopt deep convolution neural networks to learn discriminative features. The ideal discriminative features should be only related to the real/fake labels of facial images. However, we observe that the features learned by vanilla classification networks are correlated to unnecessary properties, such as forgery methods and facial identities. Such phenomenon would limit forgery detection performance especially for the generalization ability. Motivated by this, we propose a novel method which utilizes adversarial learning to eliminate the negative effect of different forgery methods and facial identities, which helps classification network to learn intrinsic common discriminative features for face forgery detection. To leverage data lacking ground truth label of facial identities, we design a special identity discriminator based on similarity information derived from off-the-shelf face recognition model. With the help of adversarial learning, our face forgery detection model learns to extract common discriminative features through eliminating the effect of forgery methods and facial identities. Extensive experiments demonstrate the effectiveness of the proposed method under both intra-dataset and cross-dataset evaluation settings.

Related papers

• UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
  High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization. We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
  arXiv  Detail & Related papers  (2024-07-26T20:51:54Z)
• Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
  Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy. Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
  arXiv  Detail & Related papers  (2023-10-18T14:49:54Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• CoReFace: Sample-Guided Contrastive Regularization for Deep Face Recognition [3.1677775852317085]
  We propose Contrastive Regularization for Face recognition (CoReFace) to apply image-level regularization in feature representation learning. Specifically, we employ sample-guided contrastive learning to regularize the training with the image-image relationship directly. To integrate contrastive learning into face recognition, we augment embeddings instead of images to avoid the image quality degradation.
  arXiv  Detail & Related papers  (2023-04-23T14:33:24Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• Dual Contrastive Learning for General Face Forgery Detection [64.41970626226221]
  We propose a novel face forgery detection framework, named Dual Contrastive Learning (DCL), which constructs positive and negative paired data. To explore the essential discrepancies, Intra-Instance Contrastive Learning (Intra-ICL) is introduced to focus on the local content inconsistencies prevalent in the forged faces.
  arXiv  Detail & Related papers  (2021-12-27T05:44:40Z)
• Heterogeneous Visible-Thermal and Visible-Infrared Face Recognition using Unit-Class Loss and Cross-Modality Discriminator [0.43748379918040853]
  We propose an end-to-end framework for cross-modal face recognition. A novel Unit-Class Loss is proposed for preserving identity information while discarding modality information. The proposed network can be used to extract modality-independent vector representations or a matching-pair classification for test images.
  arXiv  Detail & Related papers  (2021-11-29T06:14:00Z)
• Modeling Discriminative Representations for Out-of-Domain Detection with Supervised Contrastive Learning [16.77134235390429]
  Key challenge of OOD detection is to learn discriminative semantic features. We propose a supervised contrastive learning objective to minimize intra-class variance. We employ an adversarial augmentation mechanism to obtain pseudo diverse views of a sample.
  arXiv  Detail & Related papers  (2021-05-29T12:54:22Z)
• SensitiveLoss: Improving Accuracy and Fairness of Face Representations with Discrimination-Aware Deep Learning [17.088716485755917]
  We propose a discrimination-aware learning method to improve accuracy and fairness of biased face recognition algorithms. We experimentally show that learning processes based on the most used face databases have led to popular pre-trained deep face models that present a strong algorithmic discrimination. Our approach works as an add-on to pre-trained networks and is used to improve their performance in terms of average accuracy and fairness.
  arXiv  Detail & Related papers  (2020-04-22T10:32:16Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.