On Disentangling Spoof Trace for Generic Face Anti-Spoofing

• URL: http://arxiv.org/abs/2007.09273v1
• Date: Fri, 17 Jul 2020 23:14:16 GMT
• Title: On Disentangling Spoof Trace for Generic Face Anti-Spoofing
• Authors: Yaojie Liu, Joel Stehouwer, Xiaoming Liu
• Abstract summary: Key to face anti-spoofing lies in subtle image pattern, termed "spoof trace" This work designs a novel adversarial learning framework to disentangle the spoof traces from input faces.
• Score: 24.75975874643976
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Prior studies show that the key to face anti-spoofing lies in the subtle image pattern, termed "spoof trace", e.g., color distortion, 3D mask edge, Moire pattern, and many others. Designing a generic anti-spoofing model to estimate those spoof traces can improve not only the generalization of the spoof detection, but also the interpretability of the model's decision. Yet, this is a challenging task due to the diversity of spoof types and the lack of ground truth in spoof traces. This work designs a novel adversarial learning framework to disentangle the spoof traces from input faces as a hierarchical combination of patterns at multiple scales. With the disentangled spoof traces, we unveil the live counterpart of the original spoof face, and further synthesize realistic new spoof faces after a proper geometric correction. Our method demonstrates superior spoof detection performance on both seen and unseen spoof scenarios while providing visually convincing estimation of spoof traces. Code is available at https://github.com/yaojieliu/ECCV20-STDN.

Related papers

• Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio [35.485350559012645]
  This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes locating spoof regions and clustering them according to different spoofing methods.
  arXiv  Detail & Related papers  (2024-06-12T02:23:57Z)
• SHIELD : An Evaluation Benchmark for Face Spoofing and Forgery Detection with Multimodal Large Language Models [63.946809247201905]
  We introduce a new benchmark, namely SHIELD, to evaluate the ability of MLLMs on face spoofing and forgery detection. We design true/false and multiple-choice questions to evaluate multimodal face data in these two face security tasks. The results indicate that MLLMs hold substantial potential in the face security domain.
  arXiv  Detail & Related papers  (2024-02-06T17:31:36Z)
• Modeling Spoof Noise by De-spoofing Diffusion and its Application in Face Anti-spoofing [40.82039387208269]
  We present a pioneering attempt to employ diffusion models to denoise a spoof image and restore the genuine image. The difference between these two images is considered as the spoof noise, which can serve as a discriminative cue for face anti-spoofing.
  arXiv  Detail & Related papers  (2024-01-16T10:54:37Z)
• Learning Polysemantic Spoof Trace: A Multi-Modal Disentanglement Network for Face Anti-spoofing [34.44061534596512]
  This paper presents a multi-modal disentanglement model which targetedly learns polysemantic spoof traces for more accurate and robust generic attack detection. In particular, based on the adversarial learning mechanism, a two-stream disentangling network is designed to estimate spoof patterns from the RGB and depth inputs, respectively.
  arXiv  Detail & Related papers  (2022-12-07T20:23:51Z)
• Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning [54.15303628138665]
  Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks. Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance. We propose Dual Spoof Disentanglement Generation framework to tackle this challenge by "anti-spoofing via generation"
  arXiv  Detail & Related papers  (2021-12-01T15:36:59Z)
• Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
  Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
  arXiv  Detail & Related papers  (2021-04-28T09:35:48Z)
• Physics-Guided Spoof Trace Disentanglement for Generic Face Anti-Spoofing [26.389969978817042]
  Key to face anti-spoofing lies in subtle image pattern, termed "spoof trace" In this work, we design a novel adversarial learning framework to disentangle spoof faces into the spoof traces and the live counterparts.
  arXiv  Detail & Related papers  (2020-12-09T17:22:44Z)
• Anomaly Detection-Based Unknown Face Presentation Attack Detection [74.4918294453537]
  Anomaly detection-based spoof attack detection is a recent development in face Presentation Attack Detection. In this paper, we present a deep-learning solution for anomaly detection-based spoof attack detection. The proposed approach benefits from the representation learning power of the CNNs and learns better features for fPAD task.
  arXiv  Detail & Related papers  (2020-07-11T21:20:55Z)
• Look Locally Infer Globally: A Generalizable Face Anti-Spoofing Approach [53.86588268914105]
  State-of-the-art spoof detection methods tend to overfit to the spoof types seen during training and fail to generalize to unknown spoof types. We propose Self-Supervised Regional Fully Convolutional Network (SSR-FCN) that is trained to learn local discriminative cues from a face image in a self-supervised manner.
  arXiv  Detail & Related papers  (2020-06-04T13:11:17Z)
• Learning Generalized Spoof Cues for Face Anti-spoofing [43.32561471100592]
  We propose a residual-learning framework to learn the discriminative live-spoof differences which are defined as the spoof cues. The generator minimizes the spoof cues of live samples while imposes no explicit constraint on those of spoof samples to generalize well to unseen attacks. We conduct extensive experiments and the experimental results show the proposed method consistently outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-05-08T09:22:13Z)
• Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing [61.82466976737915]
  Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. We propose a new approach to detect presentation attacks from multiple frames based on two insights. The proposed approach achieves state-of-the-art results on five benchmark datasets.
  arXiv  Detail & Related papers  (2020-03-18T06:11:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.