Learning Expressive And Generalizable Motion Features For Face Forgery Detection

• URL: http://arxiv.org/abs/2403.05172v1
• Date: Fri, 8 Mar 2024 09:25:48 GMT
• Title: Learning Expressive And Generalizable Motion Features For Face Forgery Detection
• Authors: Jingyi Zhang, Peng Zhang, Jingjing Wang, Di Xie, Shiliang Pu
• Abstract summary: We propose an effective sequence-based forgery detection framework based on an existing video classification method. To make the motion features more expressive for manipulation detection, we propose an alternative motion consistency block. We make a general video classification network achieve promising results on three popular face forgery datasets.
• Score: 52.54404879581527
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Previous face forgery detection methods mainly focus on appearance features, which may be easily attacked by sophisticated manipulation. Considering the majority of current face manipulation methods generate fake faces based on a single frame, which do not take frame consistency and coordination into consideration, artifacts on frame sequences are more effective for face forgery detection. However, current sequence-based face forgery detection methods use general video classification networks directly, which discard the special and discriminative motion information for face manipulation detection. To this end, we propose an effective sequence-based forgery detection framework based on an existing video classification method. To make the motion features more expressive for manipulation detection, we propose an alternative motion consistency block instead of the original motion features module. To make the learned features more generalizable, we propose an auxiliary anomaly detection block. With these two specially designed improvements, we make a general video classification network achieve promising results on three popular face forgery datasets.

Related papers

• UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
  High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization. We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
  arXiv  Detail & Related papers  (2024-07-26T20:51:54Z)
• Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
  Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy. Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
  arXiv  Detail & Related papers  (2023-10-18T14:49:54Z)
• COMICS: End-to-end Bi-grained Contrastive Learning for Multi-face Forgery Detection [56.7599217711363]
  Face forgery recognition methods can only process one face at a time. Most face forgery recognition methods can only process one face at a time. We propose COMICS, an end-to-end framework for multi-face forgery detection.
  arXiv  Detail & Related papers  (2023-08-03T03:37:13Z)
• Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation [56.73855202368894]
  Previous work related to forgery detection mostly focuses on the entire faces. Recent forgery methods have developed to edit important facial components while maintaining others unchanged. We propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components.
  arXiv  Detail & Related papers  (2023-04-17T08:49:11Z)
• Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
  Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
  arXiv  Detail & Related papers  (2021-04-28T09:35:48Z)
• Deep Face Forgery Detection [6.230751621285322]
  This paper describes an approach for various tampering scenarios. We propose to use transfer learning from face recognition task to improve tampering detection. We evaluate both approaches on the public FaceForensics benchmark, achieving state of the art accuracy.
  arXiv  Detail & Related papers  (2020-04-06T11:13:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.