Multi-domain Learning for Updating Face Anti-spoofing Models

• URL: http://arxiv.org/abs/2208.11148v2
• Date: Mon, 17 Apr 2023 03:47:27 GMT
• Title: Multi-domain Learning for Updating Face Anti-spoofing Models
• Authors: Xiao Guo, Yaojie Liu, Anil Jain, and Xiaoming Liu
• Abstract summary: We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data. First, we devise a simple yet effective module, called spoof region estimator(SRE), to identify spoof traces in the spoof image. Unlike prior works that estimate spoof traces which generate multiple outputs or a low-resolution binary mask, SRE produces one single, detailed pixel-wise estimate in an unsupervised manner.
• Score: 17.506385040102213
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this work, we study multi-domain learning for face anti-spoofing(MD-FAS), where a pre-trained FAS model needs to be updated to perform equally well on both source and target domains while only using target domain data for updating. We present a new model for MD-FAS, which addresses the forgetting issue when learning new domain data, while possessing a high level of adaptability. First, we devise a simple yet effective module, called spoof region estimator(SRE), to identify spoof traces in the spoof image. Such spoof traces reflect the source pre-trained model's responses that help upgraded models combat catastrophic forgetting during updating. Unlike prior works that estimate spoof traces which generate multiple outputs or a low-resolution binary mask, SRE produces one single, detailed pixel-wise estimate in an unsupervised manner. Secondly, we propose a novel framework, named FAS-wrapper, which transfers knowledge from the pre-trained models and seamlessly integrates with different FAS models. Lastly, to help the community further advance MD-FAS, we construct a new benchmark based on SIW, SIW-Mv2 and Oulu-NPU, and introduce four distinct protocols for evaluation, where source and target domains are different in terms of spoof type, age, ethnicity, and illumination. Our proposed method achieves superior performance on the MD-FAS benchmark than previous methods. Our code and newly curated SIW-Mv2 are publicly available.

Related papers

• GM-DF: Generalized Multi-Scenario Deepfake Detection [49.072106087564144]
  Existing face forgery detection usually follows the paradigm of training models in a single domain. In this paper, we elaborately investigate the generalization capacity of deepfake detection models when jointly trained on multiple face forgery detection datasets.
  arXiv  Detail & Related papers  (2024-06-28T17:42:08Z)
• Source-Guided Similarity Preservation for Online Person Re-Identification [3.655597435084387]
  Online Unsupervised Domain Adaptation (OUDA) is the task of continuously adapting a model trained on a well-annotated source domain dataset to a target domain observed as a data stream. In OUDA, person Re-ID models face two main challenges: catastrophic forgetting and domain shift. We propose a new Source-guided Similarity Preservation (S2P) framework to alleviate these two problems.
  arXiv  Detail & Related papers  (2024-02-23T09:07:20Z)
• AdAM: Few-Shot Image Generation via Adaptation-Aware Kernel Modulation [71.58154388819887]
  Few-shot image generation (F SIG) aims to generate new and diverse images given few (e.g., 10) training samples. Recent work has addressed F SIG by leveraging a GAN pre-trained on a large-scale source domain and adapting it to the target domain with few target samples. We propose Adaptation-Aware kernel Modulation (AdAM) for general F SIG of different source-target domain proximity.
  arXiv  Detail & Related papers  (2023-07-04T03:56:43Z)
• Rehearsal-Free Domain Continual Face Anti-Spoofing: Generalize More and Forget Less [30.737133780202985]
  Face Anti-Spoofing (FAS) is recently studied under the continual learning setting. Existing methods need extra replay buffers to store previous data for rehearsal. We propose the first rehearsal-free method for Domain Continual Learning.
  arXiv  Detail & Related papers  (2023-03-16T12:22:53Z)
• MiDAS: Multi-integrated Domain Adaptive Supervision for Fake News Detection [3.210653757360955]
  We propose MiDAS, a multi-domain adaptative approach for fake news detection. MiDAS ranks relevancy of existing models to new samples. We evaluate MiDAS on generalization to drifted data with 9 fake news datasets.
  arXiv  Detail & Related papers  (2022-05-19T19:36:08Z)
• Distill and Fine-tune: Effective Adaptation from a Black-box Source Model [138.12678159620248]
  Unsupervised domain adaptation (UDA) aims to transfer knowledge in previous related labeled datasets (source) to a new unlabeled dataset (target) We propose a novel two-step adaptation framework called Distill and Fine-tune (Dis-tune)
  arXiv  Detail & Related papers  (2021-04-04T05:29:05Z)
• Bilevel Online Adaptation for Out-of-Domain Human Mesh Reconstruction [94.25865526414717]
  This paper considers a new problem of adapting a pre-trained model of human mesh reconstruction to out-of-domain streaming videos. We propose Bilevel Online Adaptation, which divides the optimization process of overall multi-objective into two steps of weight probe and weight update in a training. We demonstrate that BOA leads to state-of-the-art results on two human mesh reconstruction benchmarks.
  arXiv  Detail & Related papers  (2021-03-30T15:47:58Z)
• Learning to Generalize Unseen Domains via Memory-based Multi-Source Meta-Learning for Person Re-Identification [59.326456778057384]
  We propose the Memory-based Multi-Source Meta-Learning framework to train a generalizable model for unseen domains. We also present a meta batch normalization layer (MetaBN) to diversify meta-test features. Experiments demonstrate that our M$3$L can effectively enhance the generalization ability of the model for unseen domains.
  arXiv  Detail & Related papers  (2020-12-01T11:38:16Z)
• Learning Meta Face Recognition in Unseen Domains [74.69681594452125]
  We propose a novel face recognition method via meta-learning named Meta Face Recognition (MFR) MFR synthesizes the source/target domain shift with a meta-optimization objective. We propose two benchmarks for generalized face recognition evaluation.
  arXiv  Detail & Related papers  (2020-03-17T14:10:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.