PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognition

• URL: http://arxiv.org/abs/2203.14325v1
• Date: Sun, 27 Mar 2022 15:16:17 GMT
• Title: PatchNet: A Simple Face Anti-Spoofing Framework via Fine-Grained Patch Recognition
• Authors: Chien-Yi Wang, Yu-Ding Lu, Shang-Ta Yang, Shang-Hong Lai
• Abstract summary: Face anti-spoofing (FAS) plays a critical role in securing face recognition systems from presentation attacks. We propose PatchNet which reformulates face anti-spoofing as a fine-grained patch-type recognition problem.
• Score: 13.840830140721462
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Face anti-spoofing (FAS) plays a critical role in securing face recognition systems from different presentation attacks. Previous works leverage auxiliary pixel-level supervision and domain generalization approaches to address unseen spoof types. However, the local characteristics of image captures, i.e., capturing devices and presenting materials, are ignored in existing works and we argue that such information is required for networks to discriminate between live and spoof images. In this work, we propose PatchNet which reformulates face anti-spoofing as a fine-grained patch-type recognition problem. To be specific, our framework recognizes the combination of capturing devices and presenting materials based on the patches cropped from non-distorted face images. This reformulation can largely improve the data variation and enforce the network to learn discriminative feature from local capture patterns. In addition, to further improve the generalization ability of the spoof feature, we propose the novel Asymmetric Margin-based Classification Loss and Self-supervised Similarity Loss to regularize the patch embedding space. Our experimental results verify our assumption and show that the model is capable of recognizing unseen spoof types robustly by only looking at local regions. Moreover, the fine-grained and patch-level reformulation of FAS outperforms the existing approaches on intra-dataset, cross-dataset, and domain generalization benchmarks. Furthermore, our PatchNet framework can enable practical applications like Few-Shot Reference-based FAS and facilitate future exploration of spoof-related intrinsic cues.

Related papers

• DiffFAS: Face Anti-Spoofing via Generative Diffusion Models [27.533334690705733]
  Face anti-spoofing (FAS) plays a vital role in preventing face recognition (FR) systems from presentation attacks. We propose DiffFAS framework, which quantifies quality as prior information input into the network to counter image quality shift. We demonstrate the effectiveness of our framework on challenging cross-domain and cross-attack FAS datasets.
  arXiv  Detail & Related papers  (2024-09-13T06:45:23Z)
• A Closer Look at Geometric Temporal Dynamics for Face Anti-Spoofing [13.725319422213623]
  Face anti-spoofing (FAS) is indispensable for a face recognition system. We propose Geometry-Aware Interaction Network (GAIN) to distinguish between normal and abnormal movements of live and spoof presentations. Our approach achieves state-of-the-art performance in the standard intra- and cross-dataset evaluations.
  arXiv  Detail & Related papers  (2023-06-25T18:59:52Z)
• Learning Facial Liveness Representation for Domain Generalized Face Anti-spoofing [25.07432145233952]
  Face anti-spoofing (FAS) aims at distinguishing face spoof attacks from the authentic ones. It is not practical to assume that the type of spoof attacks would be known in advance. We propose a deep learning model for addressing the aforementioned domain-generalized face anti-spoofing task.
  arXiv  Detail & Related papers  (2022-08-16T16:13:24Z)
• Exposing Fine-Grained Adversarial Vulnerability of Face Anti-Spoofing Models [13.057451851710924]
  Face anti-spoofing aims to discriminate the spoofing face images (e.g., printed photos) from live ones. Previous works conducted adversarial attack methods to evaluate the face anti-spoofing performance. We propose a novel framework to expose the fine-grained adversarial vulnerability of the face anti-spoofing models.
  arXiv  Detail & Related papers  (2022-05-30T04:56:33Z)
• Unsupervised Compound Domain Adaptation for Face Anti-Spoofing [74.6122128643823]
  We address the problem of face anti-spoofing which aims to make the face verification systems robust in the real world settings. We propose a memory augmentation method for adapting the source model to the target domain in a domain aware manner. The proposed method successfully adapts to the compound target domain consisting multiple new spoof types.
  arXiv  Detail & Related papers  (2021-05-18T12:08:07Z)
• Aurora Guard: Reliable Face Anti-Spoofing via Mobile Lighting System [103.5604680001633]
  Anti-spoofing against high-resolution rendering replay of paper photos or digital videos remains an open problem. We propose a simple yet effective face anti-spoofing system, termed Aurora Guard (AG)
  arXiv  Detail & Related papers  (2021-02-01T09:17:18Z)
• Camera Invariant Feature Learning for Generalized Face Anti-spoofing [95.30490139294136]
  We describe a framework that eliminates the influence of inherent variance from acquisition cameras at the feature level. Experiments show that the proposed method can achieve better performance in both intra-dataset and cross-dataset settings.
  arXiv  Detail & Related papers  (2021-01-25T13:40:43Z)
• Uncertainty-Aware Physically-Guided Proxy Tasks for Unseen Domain Face Anti-spoofing [128.32381246318954]
  Face anti-spoofing (FAS) seeks to discriminate genuine faces from fake ones arising from any type of spoofing attack. We propose to leverage physical cues to attain better generalization on unseen domains.
  arXiv  Detail & Related papers  (2020-11-28T03:22:26Z)
• Revisiting Pixel-Wise Supervision for Face Anti-Spoofing [75.89648108213773]
  Face anti-spoofing (FAS) plays a vital role in securing face recognition systems from presentation attacks (PAs) Traditionally, deep models supervised by binary loss are weak in describing intrinsic and discriminative spoofing patterns. Recent, pixel-wise supervision has been proposed for the FAS task, intending to provide more fine-grained pixel/patch-level cues.
  arXiv  Detail & Related papers  (2020-11-24T11:25:58Z)
• Face Anti-Spoofing Via Disentangled Representation Learning [90.90512800361742]
  Face anti-spoofing is crucial to security of face recognition systems. We propose a novel perspective of face anti-spoofing that disentangles the liveness features and content features from images.
  arXiv  Detail & Related papers  (2020-08-19T03:54:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.