Boosting Masked Face Recognition with Multi-Task ArcFace
- URL: http://arxiv.org/abs/2104.09874v2
- Date: Wed, 21 Apr 2021 06:54:29 GMT
- Title: Boosting Masked Face Recognition with Multi-Task ArcFace
- Authors: David Montero, Marcos Nieto, Peter Leskovsky and Naiara Aginako
- Abstract summary: Given the global health crisis caused by COVID-19, mouth and nose-covering masks have become an essential everyday-clothing-accessory.
This measure has put the state-of-the-art face recognition models on the ropes since they have not been designed to work with masked faces.
A full training pipeline is presented based on the ArcFace work, with several modifications for the backbone and the loss function.
- Score: 0.973681576519524
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: In this paper, we address the problem of face recognition with masks. Given
the global health crisis caused by COVID-19, mouth and nose-covering masks have
become an essential everyday-clothing-accessory. This sanitary measure has put
the state-of-the-art face recognition models on the ropes since they have not
been designed to work with masked faces. In addition, the need has arisen for
applications capable of detecting whether the subjects are wearing masks to
control the spread of the virus. To overcome these problems a full training
pipeline is presented based on the ArcFace work, with several modifications for
the backbone and the loss function. From the original face-recognition dataset,
a masked version is generated using data augmentation, and both datasets are
combined during the training process. The selected network, based on ResNet-50,
is modified to also output the probability of mask usage without adding any
computational cost. Furthermore, the ArcFace loss is combined with the
mask-usage classification loss, resulting in a new function named Multi-Task
ArcFace (MTArcFace). Experimental results show that the proposed approach
highly boosts the original model accuracy when dealing with masked faces, while
preserving almost the same accuracy on the original non-masked datasets.
Furthermore, it achieves an average accuracy of 99.78% in mask-usage
classification.
Related papers
- Seeing through the Mask: Multi-task Generative Mask Decoupling Face
Recognition [47.248075664420874]
Current general face recognition system suffers from serious performance degradation when encountering occluded scenes.
This paper proposes a Multi-task gEnerative mask dEcoupling face Recognition (MEER) network to jointly handle these two tasks.
We first present a novel mask decoupling module to disentangle mask and identity information, which makes the network obtain purer identity features from visible facial components.
arXiv Detail & Related papers (2023-11-20T03:23:03Z) - MaskMTL: Attribute prediction in masked facial images with deep
multitask learning [9.91045425400833]
This paper presents a deep Multi-Task Learning (MTL) approach to jointly estimate various heterogeneous attributes from a single masked facial image.
The proposed approach supersedes in performance to other competing techniques.
arXiv Detail & Related papers (2022-01-09T13:03:29Z) - Development of a face mask detection pipeline for mask-wearing
monitoring in the era of the COVID-19 pandemic: A modular approach [0.0]
During the SARS-Cov-2 pandemic, mask-wearing became an effective tool to prevent spreading and contracting the virus.
The ability to monitor the mask-wearing rate in the population would be useful for determining public health strategies against the virus.
We present a two-step face mask detection approach consisting of two separate modules: 1) face detection and alignment and 2) face mask classification.
arXiv Detail & Related papers (2021-12-30T12:32:33Z) - Mask-invariant Face Recognition through Template-level Knowledge
Distillation [3.727773051465455]
Masks affect the performance of previous face recognition systems.
We propose a mask-invariant face recognition solution (MaskInv)
In addition to the distilled knowledge, the student network benefits from additional guidance by margin-based identity classification loss.
arXiv Detail & Related papers (2021-12-10T16:19:28Z) - MLFW: A Database for Face Recognition on Masked Faces [56.441078419992046]
Masked LFW (MLFW) is a tool to generate masked faces from unmasked faces automatically.
The recognition accuracy of SOTA models declines 5%-16% on MLFW database compared with the accuracy on the original images.
arXiv Detail & Related papers (2021-09-13T09:30:10Z) - A realistic approach to generate masked faces applied on two novel
masked face recognition data sets [14.130698536174767]
We propose a method for enhancing data sets containing faces without masks by creating synthetic masks and overlaying them on faces in the original images.
We employ our method to generate a number of 445,446 (90%) samples of masks for the CASIA-WebFace data set and 196,254 (96.8%) masks for the CelebA data set.
We show that our method produces significantly more realistic training examples of masks overlaid on faces by asking volunteers to qualitatively compare it to other methods or data sets.
arXiv Detail & Related papers (2021-09-03T22:33:55Z) - End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
State-of-the-art general face recognition models do not generalize well to occluded face images.
This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network.
Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
arXiv Detail & Related papers (2021-08-21T09:08:41Z) - Indian Masked Faces in the Wild Dataset [86.79402670904338]
We present a novel textbfIndian Masked Faces in the Wild (IMFW) dataset which contains images with variations in pose, illumination, resolution, and the variety of masks worn by the subjects.
We have also benchmarked the performance of existing face recognition models on the proposed IMFW dataset.
arXiv Detail & Related papers (2021-06-17T17:23:54Z) - Multi-Dataset Benchmarks for Masked Identification using Contrastive
Representation Learning [0.0]
COVID-19 pandemic has drastically changed accepted norms globally.
Official documents such as passports, driving license and national identity cards are enrolled with fully uncovered face images.
In an airport or security checkpoint it is safer to match the unmasked image of the identifying document to the masked person rather than asking them to remove the mask.
We propose a contrastive visual representation learning based pre-training workflow which is specialized to masked vs unmasked face matching.
arXiv Detail & Related papers (2021-06-10T08:58:10Z) - Image Inpainting by End-to-End Cascaded Refinement with Mask Awareness [66.55719330810547]
Inpainting arbitrary missing regions is challenging because learning valid features for various masked regions is nontrivial.
We propose a novel mask-aware inpainting solution that learns multi-scale features for missing regions in the encoding phase.
Our framework is validated both quantitatively and qualitatively via extensive experiments on three public datasets.
arXiv Detail & Related papers (2021-04-28T13:17:47Z) - Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face
Presentation Attack Detection [103.7264459186552]
Face presentation attack detection (PAD) is essential to secure face recognition systems.
Most existing 3D mask PAD benchmarks suffer from several drawbacks.
We introduce a largescale High-Fidelity Mask dataset to bridge the gap to real-world applications.
arXiv Detail & Related papers (2021-04-13T12:48:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.