Learning Multiple Explainable and Generalizable Cues for Face
Anti-spoofing
- URL: http://arxiv.org/abs/2202.10187v1
- Date: Mon, 21 Feb 2022 12:55:59 GMT
- Title: Learning Multiple Explainable and Generalizable Cues for Face
Anti-spoofing
- Authors: Ying Bian, Peng Zhang, Jingjing Wang, Chunmao Wang, Shiliang Pu
- Abstract summary: We propose a novel framework to learn multiple explainable and generalizable cues (MEGC) for face anti-spoofing.
Inspired by the process of human decision, four mainly used cues by humans are introduced as auxiliary supervision.
- Score: 35.60198131792312
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Although previous CNN based face anti-spoofing methods have achieved
promising performance under intra-dataset testing, they suffer from poor
generalization under cross-dataset testing. The main reason is that they learn
the network with only binary supervision, which may learn arbitrary cues
overfitting on the training dataset. To make the learned feature explainable
and more generalizable, some researchers introduce facial depth and reflection
map as the auxiliary supervision. However, many other generalizable cues are
unexplored for face anti-spoofing, which limits their performance under
cross-dataset testing. To this end, we propose a novel framework to learn
multiple explainable and generalizable cues (MEGC) for face anti-spoofing.
Specifically, inspired by the process of human decision, four mainly used cues
by humans are introduced as auxiliary supervision including the boundary of
spoof medium, moir\'e pattern, reflection artifacts and facial depth in
addition to the binary supervision. To avoid extra labelling cost,
corresponding synthetic methods are proposed to generate these auxiliary
supervision maps. Extensive experiments on public datasets validate the
effectiveness of these cues, and state-of-the-art performances are achieved by
our proposed method.
Related papers
- Learning to Discover Forgery Cues for Face Forgery Detection [12.938400190194946]
We introduce a weakly supervised model, named Forgery Cue Discovery (FoCus), to locate forgery cues in unpaired faces.
FoCus is designed to sidestep their shortcomings of capturing partial and inaccurate forgery cues.
The produced manipulation maps can serve as better supervision to enhance face forgery detectors.
arXiv Detail & Related papers (2024-09-02T08:07:58Z) - Semantics-Oriented Multitask Learning for DeepFake Detection: A Joint Embedding Approach [77.65459419417533]
We propose an automatic dataset expansion technique to support semantics-oriented DeepFake detection tasks.
We also resort to joint embedding of face images and their corresponding labels for prediction.
Our method improves the generalizability of DeepFake detection and renders some degree of model interpretation by providing human-understandable explanations.
arXiv Detail & Related papers (2024-08-29T07:11:50Z) - UniForensics: Face Forgery Detection via General Facial Representation [60.5421627990707]
High-level semantic features are less susceptible to perturbations and not limited to forgery-specific artifacts, thus having stronger generalization.
We introduce UniForensics, a novel deepfake detection framework that leverages a transformer-based video network, with a meta-functional face classification for enriched facial representation.
arXiv Detail & Related papers (2024-07-26T20:51:54Z) - Generalized Face Anti-Spoofing via Multi-Task Learning and One-Side Meta
Triplet Loss [12.829618913069567]
This paper presents a generalized face anti-spoofing framework that consists of three tasks: depth estimation, face parsing, and live/spoof classification.
Experiments on four public datasets demonstrate that the proposed framework and training strategies are more effective than previous works for model generalization to unseen domains.
arXiv Detail & Related papers (2022-11-29T06:28:00Z) - Generalizable Method for Face Anti-Spoofing with Semi-Supervised
Learning [0.0]
Face anti-spoofing has drawn a lot of attention due to the high security requirements in biometric authentication systems.
Bringing face biometric to commercial hardware became mostly dependent on developing reliable methods for detecting fake login sessions.
Current CNN-based method perform well on the domains they were trained for, but often show poor generalization on previously unseen datasets.
arXiv Detail & Related papers (2022-06-13T22:44:14Z) - More than just an auxiliary loss: Anti-spoofing Backbone Training via
Adversarial Pseudo-depth Generation [4.542003078412816]
A new method of training pipeline is discussed to achieve significant performance on the task of anti-spoofing with RGB image.
Our method approaches the baseline performance of the current state of the art anti-spoofing models with 15.8x less parameters used.
arXiv Detail & Related papers (2021-01-01T09:00:17Z) - Uncertainty-Aware Physically-Guided Proxy Tasks for Unseen Domain Face
Anti-spoofing [128.32381246318954]
Face anti-spoofing (FAS) seeks to discriminate genuine faces from fake ones arising from any type of spoofing attack.
We propose to leverage physical cues to attain better generalization on unseen domains.
arXiv Detail & Related papers (2020-11-28T03:22:26Z) - Face Anti-Spoofing with Human Material Perception [76.4844593082362]
Face anti-spoofing (FAS) plays a vital role in securing the face recognition systems from presentation attacks.
We rephrase face anti-spoofing as a material recognition problem and combine it with classical human material perception.
We propose the Bilateral Convolutional Networks (BCN), which is able to capture intrinsic material-based patterns.
arXiv Detail & Related papers (2020-07-04T18:25:53Z) - Spoof Face Detection Via Semi-Supervised Adversarial Training [34.99908561729825]
Face spoofing causes severe security threats in face recognition systems.
We propose a semi-supervised adversarial learning framework for spoof face detection.
Our approach is free of the spoof faces, thus being robust and general to different types of spoof, even unknown spoof.
arXiv Detail & Related papers (2020-05-22T04:32:33Z) - Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing [61.82466976737915]
Depth supervised learning has been proven as one of the most effective methods for face anti-spoofing.
We propose a new approach to detect presentation attacks from multiple frames based on two insights.
The proposed approach achieves state-of-the-art results on five benchmark datasets.
arXiv Detail & Related papers (2020-03-18T06:11:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.