Masked Face Dataset Generation and Masked Face Recognition

• URL: http://arxiv.org/abs/2311.07475v2
• Date: Mon, 25 Dec 2023 17:09:02 GMT
• Title: Masked Face Dataset Generation and Masked Face Recognition
• Authors: Rui Cai, Xuying Ning, Peter N. Belhumeur
• Abstract summary: In post-pandemic era, wearing face masks has posed great challenge to the ordinary face recognition. To make the model more adaptable to the real world situation, we created a more challenging masked face dataset. The best test accuracy on 50 identity MFR has achieved 95%.
• Score: 2.4377103193902703
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In the post-pandemic era, wearing face masks has posed great challenge to the ordinary face recognition. In the previous study, researchers has applied pretrained VGG16, and ResNet50 to extract features on the elaborate curated existing masked face recognition (MFR) datasets, RMFRD and SMFRD. To make the model more adaptable to the real world situation where the sample size is smaller and the camera environment has greater changes, we created a more challenging masked face dataset ourselves, by selecting 50 identities with 1702 images from Labelled Faces in the Wild (LFW) Dataset, and simulated face masks through key point detection. The another part of our study is to solve the masked face recognition problem, and we chose models by referring to the former state of the art results, instead of directly using pretrained models, we fine tuned the model on our new dataset and use the last linear layer to do the classification directly. Furthermore, we proposed using data augmentation strategy to further increase the test accuracy, and fine tuned a new networks beyond the former study, one of the most SOTA networks, Inception ResNet v1. The best test accuracy on 50 identity MFR has achieved 95%.

Related papers

• Toward High Quality Facial Representation Learning [58.873356953627614]
  We propose a self-supervised pre-training framework, called Mask Contrastive Face (MCF) We use feature map of a pre-trained visual backbone as a supervision item and use a partially pre-trained decoder for mask image modeling. Our model achieves 0.932 NME_diag$ for AFLW-19 face alignment and 93.96 F1 score for LaPa face parsing.
  arXiv  Detail & Related papers  (2023-09-07T09:11:49Z)
• Ensemble Learning using Transformers and Convolutional Networks for Masked Face Recognition [1.0742675209112622]
  Wearing a face mask is one of the adjustments we had to follow to reduce the spread of the coronavirus. Current face recognition systems have extremely high accuracy when dealing with unconstrained general face recognition cases. In this work, we propose a system for masked face recognition. The proposed system comprises two Convolutional Neural Network (CNN) models and two Transformer models.
  arXiv  Detail & Related papers  (2022-10-10T16:25:13Z)
• FaceMAE: Privacy-Preserving Face Recognition via Masked Autoencoders [81.21440457805932]
  We propose a novel framework FaceMAE, where the face privacy and recognition performance are considered simultaneously. randomly masked face images are used to train the reconstruction module in FaceMAE. We also perform sufficient privacy-preserving face recognition on several public face datasets.
  arXiv  Detail & Related papers  (2022-05-23T07:19:42Z)
• Mask-invariant Face Recognition through Template-level Knowledge Distillation [3.727773051465455]
  Masks affect the performance of previous face recognition systems. We propose a mask-invariant face recognition solution (MaskInv) In addition to the distilled knowledge, the student network benefits from additional guidance by margin-based identity classification loss.
  arXiv  Detail & Related papers  (2021-12-10T16:19:28Z)
• Balanced Masked and Standard Face Recognition [1.2149550080095914]
  We present the improved network architecture, data augmentation, and training strategies for the Webface track and Insightface/Glint360K track of the masked face recognition challenge of ICCV 2021.
  arXiv  Detail & Related papers  (2021-10-04T15:41:05Z)
• End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
  State-of-the-art general face recognition models do not generalize well to occluded face images. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
  arXiv  Detail & Related papers  (2021-08-21T09:08:41Z)
• Masked Face Recognition Challenge: The WebFace260M Track Report [81.57455766506197]
  Face Bio-metrics under COVID Workshop and Masked Face Recognition Challenge in ICCV 2021. WebFace260M Track aims to push the frontiers of practical MFR. In the first phase of WebFace260M Track, 69 teams (total 833 solutions) participate in the challenge. There are second phase of the challenge till October 1, 2021 and on-going leaderboard.
  arXiv  Detail & Related papers  (2021-08-16T15:51:51Z)
• Boosting Masked Face Recognition with Multi-Task ArcFace [0.973681576519524]
  Given the global health crisis caused by COVID-19, mouth and nose-covering masks have become an essential everyday-clothing-accessory. This measure has put the state-of-the-art face recognition models on the ropes since they have not been designed to work with masked faces. A full training pipeline is presented based on the ArcFace work, with several modifications for the backbone and the loss function.
  arXiv  Detail & Related papers  (2021-04-20T10:12:04Z)
• Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection [103.7264459186552]
  Face presentation attack detection (PAD) is essential to secure face recognition systems. Most existing 3D mask PAD benchmarks suffer from several drawbacks. We introduce a largescale High-Fidelity Mask dataset to bridge the gap to real-world applications.
  arXiv  Detail & Related papers  (2021-04-13T12:48:38Z)
• Masked Face Recognition Dataset and Application [28.2082082956263]
  This work proposes three types of masked face datasets, including Masked Face Detection dataset (MFDD), Real-world Masked Face Recognition dataset (RMFRD) and Simulated Masked Face Recognition dataset (SMFRD) The multi-granularity masked face recognition model we developed achieves 95% accuracy, exceeding the results reported by the industry.
  arXiv  Detail & Related papers  (2020-03-20T04:15:19Z)
• DotFAN: A Domain-transferred Face Augmentation Network for Pose and Illumination Invariant Face Recognition [94.96686189033869]
  We propose a 3D model-assisted domain-transferred face augmentation network (DotFAN) DotFAN can generate a series of variants of an input face based on the knowledge distilled from existing rich face datasets collected from other domains. Experiments show that DotFAN is beneficial for augmenting small face datasets to improve their within-class diversity.
  arXiv  Detail & Related papers  (2020-02-23T08:16:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.