My Eyes Are Up Here: Promoting Focus on Uncovered Regions in Masked Face Recognition

• URL: http://arxiv.org/abs/2108.00996v1
• Date: Mon, 2 Aug 2021 15:51:15 GMT
• Title: My Eyes Are Up Here: Promoting Focus on Uncovered Regions in Masked Face Recognition
• Authors: Pedro C. Neto, Fadi Boutros, Mohsen Saffari, Jo\~ao Ribeiro Pinto, Naser Damer, Ana F. Sequeira, Jaime S. Cardoso
• Abstract summary: We address the challenge of masked face recognition (MFR) and focus on evaluating the verification performance in FRS. We propose a methodology that combines the traditional triplet loss and the mean squared error (MSE) intending to improve the robustness of an MFR system in the masked-unmasked comparison mode.
• Score: 4.171626860914305
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The recent Covid-19 pandemic and the fact that wearing masks in public is now mandatory in several countries, created challenges in the use of face recognition systems (FRS). In this work, we address the challenge of masked face recognition (MFR) and focus on evaluating the verification performance in FRS when verifying masked vs unmasked faces compared to verifying only unmasked faces. We propose a methodology that combines the traditional triplet loss and the mean squared error (MSE) intending to improve the robustness of an MFR system in the masked-unmasked comparison mode. The results obtained by our proposed method show improvements in a detailed step-wise ablation study. The conducted study showed significant performance gains induced by our proposed training paradigm and modified triplet loss on two evaluation databases.

Related papers

• Attribute-Guided Encryption with Facial Texture Masking [64.77548539959501]
  We propose Attribute Guided Encryption with Facial Texture Masking to protect users from unauthorized facial recognition systems. Our proposed method produces more natural-looking encrypted images than state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-22T23:50:43Z)
• Localization using Multi-Focal Spatial Attention for Masked Face Recognition [22.833899749506394]
  It is necessary to develop masked Face Recognition for contactless biometric recognition systems. We propose Complementary Attention Learning and Multi-Focal Spatial Attention that precisely removes masked region. We evaluate the MFR performance on the ICCV 2021-MFR/Insightface track, and demonstrate the improved performance on the both MFR and FR datasets.
  arXiv  Detail & Related papers  (2023-05-03T05:39:12Z)
• Mask-invariant Face Recognition through Template-level Knowledge Distillation [3.727773051465455]
  Masks affect the performance of previous face recognition systems. We propose a mask-invariant face recognition solution (MaskInv) In addition to the distilled knowledge, the student network benefits from additional guidance by margin-based identity classification loss.
  arXiv  Detail & Related papers  (2021-12-10T16:19:28Z)
• Adversarial Mask: Real-World Adversarial Attack Against Face Recognition Models [66.07662074148142]
  We propose a physical adversarial universal perturbation (UAP) against state-of-the-art deep learning-based facial recognition models. In our experiments, we examined the transferability of our adversarial mask to a wide range of deep learning models and datasets. We validated our adversarial mask effectiveness in real-world experiments by printing the adversarial pattern on a fabric medical face mask.
  arXiv  Detail & Related papers  (2021-11-21T08:13:21Z)
• Partial Attack Supervision and Regional Weighted Inference for Masked Face Presentation Attack Detection [5.71864964818217]
  Wearing a mask has proven to be one of the most effective ways to prevent the transmission of SARS-CoV-2 coronavirus. The main issues facing the mask face PAD are the wrongly classified bona fide masked faces and the wrongly classified partial attacks. This work proposes a method that considers partial attack labels to supervise the PAD model training, as well as regional weighted inference to further improve the PAD performance.
  arXiv  Detail & Related papers  (2021-11-08T08:53:46Z)
• FocusFace: Multi-task Contrastive Learning for Masked Face Recognition [4.420321822469077]
  SARS-CoV-2 has presented direct and indirect challenges to the scientific community. Face recognition methods struggle to perform identity verification with similar accuracy on masked and unmasked individuals. We propose FocusFace, a multi-task architecture that uses contrastive learning to be able to accurately perform masked face recognition.
  arXiv  Detail & Related papers  (2021-10-28T08:17:12Z)
• MLFW: A Database for Face Recognition on Masked Faces [56.441078419992046]
  Masked LFW (MLFW) is a tool to generate masked faces from unmasked faces automatically. The recognition accuracy of SOTA models declines 5%-16% on MLFW database compared with the accuracy on the original images.
  arXiv  Detail & Related papers  (2021-09-13T09:30:10Z)
• Masked Face Recognition Challenge: The InsightFace Track Report [79.77020394722788]
  During the COVID-19 coronavirus epidemic, almost everyone wears a facial mask, which poses a huge challenge to deep face recognition. In this workshop, we focus on bench-marking deep face recognition methods under the existence of facial masks.
  arXiv  Detail & Related papers  (2021-08-18T15:14:44Z)
• Towards NIR-VIS Masked Face Recognition [47.00916333095693]
  Near-infrared to visible (NIR-VIS) face recognition is the most common case in heterogeneous face recognition. We propose a novel training method to maximize the mutual information shared by the face representation of two domains. In addition, a 3D face reconstruction based approach is employed to synthesize masked face from the existing NIR image.
  arXiv  Detail & Related papers  (2021-04-14T10:40:09Z)
• Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection [103.7264459186552]
  Face presentation attack detection (PAD) is essential to secure face recognition systems. Most existing 3D mask PAD benchmarks suffer from several drawbacks. We introduce a largescale High-Fidelity Mask dataset to bridge the gap to real-world applications.
  arXiv  Detail & Related papers  (2021-04-13T12:48:38Z)
• Unmasking Face Embeddings by Self-restrained Triplet Loss for Accurate Masked Face Recognition [6.865656740940772]
  We present a solution to improve the masked face recognition performance. Specifically, we propose the Embedding Unmasking Model (EUM) operated on top of existing face recognition models. We also propose a novel loss function, the Self-restrained Triplet (SRT), which enabled the EUM to produce embeddings similar to these of unmasked faces of the same identities.
  arXiv  Detail & Related papers  (2021-03-02T13:43:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.