Physics-Guided Spoof Trace Disentanglement for Generic Face Anti-Spoofing

• URL: http://arxiv.org/abs/2012.05185v1
• Date: Wed, 9 Dec 2020 17:22:44 GMT
• Title: Physics-Guided Spoof Trace Disentanglement for Generic Face Anti-Spoofing
• Authors: Yaojie Liu and Xiaoming Liu
• Abstract summary: Key to face anti-spoofing lies in subtle image pattern, termed "spoof trace" In this work, we design a novel adversarial learning framework to disentangle spoof faces into the spoof traces and the live counterparts.
• Score: 26.389969978817042
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Prior studies show that the key to face anti-spoofing lies in the subtle image pattern, termed "spoof trace", e.g., color distortion, 3D mask edge, Moire pattern, and many others. Designing a generic face anti-spoofing model to estimate those spoof traces can improve not only the generalization of the spoof detection, but also the interpretability of the model's decision. Yet, this is a challenging task due to the diversity of spoof types and the lack of ground truth in spoof traces. In this work, we design a novel adversarial learning framework to disentangle spoof faces into the spoof traces and the live counterparts. Guided by physical properties, the spoof generation is represented as a combination of additive process and inpainting process. Additive process describes spoofing as spoof material introducing extra patterns (e.g., moire pattern), where the live counterpart can be recovered by removing those patterns. Inpainting process describes spoofing as spoof material fully covering certain regions, where the live counterpart of those regions has to be "guessed". We use 3 additive components and 1 inpainting component to represent traces at different frequency bands. The disentangled spoof traces can be utilized to synthesize realistic new spoof faces after proper geometric correction, and the synthesized spoof can be used for training and improve the generalization of spoof detection. Our approach demonstrates superior spoof detection performance on 3 testing scenarios: known attacks, unknown attacks, and open-set attacks. Meanwhile, it provides a visually-convincing estimation of the spoof traces. Source code and pre-trained models will be publicly available upon publication.

Related papers

• Spoof Diarization: "What Spoofed When" in Partially Spoofed Audio [35.485350559012645]
  This paper defines Spoof Diarization as a novel task in the Partial Spoof (PS) scenario. It aims to determine what spoofed when, which includes locating spoof regions and clustering them according to different spoofing methods.
  arXiv  Detail & Related papers  (2024-06-12T02:23:57Z)
• Modeling Spoof Noise by De-spoofing Diffusion and its Application in Face Anti-spoofing [40.82039387208269]
  We present a pioneering attempt to employ diffusion models to denoise a spoof image and restore the genuine image. The difference between these two images is considered as the spoof noise, which can serve as a discriminative cue for face anti-spoofing.
  arXiv  Detail & Related papers  (2024-01-16T10:54:37Z)
• Learning Polysemantic Spoof Trace: A Multi-Modal Disentanglement Network for Face Anti-spoofing [34.44061534596512]
  This paper presents a multi-modal disentanglement model which targetedly learns polysemantic spoof traces for more accurate and robust generic attack detection. In particular, based on the adversarial learning mechanism, a two-stream disentangling network is designed to estimate spoof patterns from the RGB and depth inputs, respectively.
  arXiv  Detail & Related papers  (2022-12-07T20:23:51Z)
• Semantic-aware One-shot Face Re-enactment with Dense Correspondence Estimation [100.60938767993088]
  One-shot face re-enactment is a challenging task due to the identity mismatch between source and driving faces. This paper proposes to use 3D Morphable Model (3DMM) for explicit facial semantic decomposition and identity disentanglement.
  arXiv  Detail & Related papers  (2022-11-23T03:02:34Z)
• Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning [54.15303628138665]
  Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks. Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance. We propose Dual Spoof Disentanglement Generation framework to tackle this challenge by "anti-spoofing via generation"
  arXiv  Detail & Related papers  (2021-12-01T15:36:59Z)
• Robust Face-Swap Detection Based on 3D Facial Shape Information [59.32489266682952]
  Face-swap images and videos have attracted more and more malicious attackers to discredit some key figures. Previous pixel-level artifacts based detection techniques always focus on some unclear patterns but ignore some available semantic clues. We propose a biometric information based method to fully exploit the appearance and shape feature for face-swap detection of key figures.
  arXiv  Detail & Related papers  (2021-04-28T09:35:48Z)
• On Disentangling Spoof Trace for Generic Face Anti-Spoofing [24.75975874643976]
  Key to face anti-spoofing lies in subtle image pattern, termed "spoof trace" This work designs a novel adversarial learning framework to disentangle the spoof traces from input faces.
  arXiv  Detail & Related papers  (2020-07-17T23:14:16Z)
• Anomaly Detection-Based Unknown Face Presentation Attack Detection [74.4918294453537]
  Anomaly detection-based spoof attack detection is a recent development in face Presentation Attack Detection. In this paper, we present a deep-learning solution for anomaly detection-based spoof attack detection. The proposed approach benefits from the representation learning power of the CNNs and learns better features for fPAD task.
  arXiv  Detail & Related papers  (2020-07-11T21:20:55Z)
• Look Locally Infer Globally: A Generalizable Face Anti-Spoofing Approach [53.86588268914105]
  State-of-the-art spoof detection methods tend to overfit to the spoof types seen during training and fail to generalize to unknown spoof types. We propose Self-Supervised Regional Fully Convolutional Network (SSR-FCN) that is trained to learn local discriminative cues from a face image in a self-supervised manner.
  arXiv  Detail & Related papers  (2020-06-04T13:11:17Z)
• Learning Generalized Spoof Cues for Face Anti-spoofing [43.32561471100592]
  We propose a residual-learning framework to learn the discriminative live-spoof differences which are defined as the spoof cues. The generator minimizes the spoof cues of live samples while imposes no explicit constraint on those of spoof samples to generalize well to unseen attacks. We conduct extensive experiments and the experimental results show the proposed method consistently outperforms the state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-05-08T09:22:13Z)
• Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing [61.82466976737915]
  Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing. We propose a new approach to detect presentation attacks from multiple frames based on two insights. The proposed approach achieves state-of-the-art results on five benchmark datasets.
  arXiv  Detail & Related papers  (2020-03-18T06:11:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.