Ensemble Learning using Transformers and Convolutional Networks for Masked Face Recognition

• URL: http://arxiv.org/abs/2210.04816v1
• Date: Mon, 10 Oct 2022 16:25:13 GMT
• Title: Ensemble Learning using Transformers and Convolutional Networks for Masked Face Recognition
• Authors: Mohammed R. Al-Sinan, Aseel F. Haneef, Hamzah Luqman
• Abstract summary: Wearing a face mask is one of the adjustments we had to follow to reduce the spread of the coronavirus. Current face recognition systems have extremely high accuracy when dealing with unconstrained general face recognition cases. In this work, we propose a system for masked face recognition. The proposed system comprises two Convolutional Neural Network (CNN) models and two Transformer models.
• Score: 1.0742675209112622
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Wearing a face mask is one of the adjustments we had to follow to reduce the spread of the coronavirus. Having our faces covered by masks constantly has driven the need to understand and investigate how this behavior affects the recognition capability of face recognition systems. Current face recognition systems have extremely high accuracy when dealing with unconstrained general face recognition cases but do not generalize well with occluded masked faces. In this work, we propose a system for masked face recognition. The proposed system comprises two Convolutional Neural Network (CNN) models and two Transformer models. The CNN models have been fine-tuned on FaceNet pre-trained model. We ensemble the predictions of the four models using the majority voting technique to identify the person with the mask. The proposed system has been evaluated on a synthetically masked LFW dataset created in this work. The best accuracy is obtained using the ensembled models with an accuracy of 92%. This recognition rate outperformed the accuracy of other models and it shows the correctness and robustness of the proposed model for recognizing masked faces. The code and data are available at https://github.com/Hamzah-Luqman/MFR

Related papers

• OSDFace: One-Step Diffusion Model for Face Restoration [72.5045389847792]
  Diffusion models have demonstrated impressive performance in face restoration. We propose OSDFace, a novel one-step diffusion model for face restoration. Results demonstrate that OSDFace surpasses current state-of-the-art (SOTA) methods in both visual quality and quantitative metrics.
  arXiv  Detail & Related papers  (2024-11-26T07:07:48Z)
• Seeing through the Mask: Multi-task Generative Mask Decoupling Face Recognition [47.248075664420874]
  Current general face recognition system suffers from serious performance degradation when encountering occluded scenes. This paper proposes a Multi-task gEnerative mask dEcoupling face Recognition (MEER) network to jointly handle these two tasks. We first present a novel mask decoupling module to disentangle mask and identity information, which makes the network obtain purer identity features from visible facial components.
  arXiv  Detail & Related papers  (2023-11-20T03:23:03Z)
• Improving Masked Autoencoders by Learning Where to Mask [65.89510231743692]
  Masked image modeling is a promising self-supervised learning method for visual data. We present AutoMAE, a framework that uses Gumbel-Softmax to interlink an adversarially-trained mask generator and a mask-guided image modeling process. In our experiments, AutoMAE is shown to provide effective pretraining models on standard self-supervised benchmarks and downstream tasks.
  arXiv  Detail & Related papers  (2023-03-12T05:28:55Z)
• Towards Improved Input Masking for Convolutional Neural Networks [66.99060157800403]
  We propose a new masking method for CNNs we call layer masking. We show that our method is able to eliminate or minimize the influence of the mask shape or color on the output of the model. We also demonstrate how the shape of the mask may leak information about the class, thus affecting estimates of model reliance on class-relevant features.
  arXiv  Detail & Related papers  (2022-11-26T19:31:49Z)
• Rapid Face Mask Detection and Person Identification Model based on Deep Neural Networks [0.0]
  Covid-19 has been constantly getting mutated and in three or four months a new variant gets introduced to us. The things that prevent us from getting Covid is getting vaccinated and wearing a face mask. In this paper, we have implemented a new Face Mask Detection and Person Recognition model named Insight face.
  arXiv  Detail & Related papers  (2021-12-18T15:29:14Z)
• Mask-invariant Face Recognition through Template-level Knowledge Distillation [3.727773051465455]
  Masks affect the performance of previous face recognition systems. We propose a mask-invariant face recognition solution (MaskInv) In addition to the distilled knowledge, the student network benefits from additional guidance by margin-based identity classification loss.
  arXiv  Detail & Related papers  (2021-12-10T16:19:28Z)
• MLFW: A Database for Face Recognition on Masked Faces [56.441078419992046]
  Masked LFW (MLFW) is a tool to generate masked faces from unmasked faces automatically. The recognition accuracy of SOTA models declines 5%-16% on MLFW database compared with the accuracy on the original images.
  arXiv  Detail & Related papers  (2021-09-13T09:30:10Z)
• End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
  State-of-the-art general face recognition models do not generalize well to occluded face images. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
  arXiv  Detail & Related papers  (2021-08-21T09:08:41Z)
• Multi-Dataset Benchmarks for Masked Identification using Contrastive Representation Learning [0.0]
  COVID-19 pandemic has drastically changed accepted norms globally. Official documents such as passports, driving license and national identity cards are enrolled with fully uncovered face images. In an airport or security checkpoint it is safer to match the unmasked image of the identifying document to the masked person rather than asking them to remove the mask. We propose a contrastive visual representation learning based pre-training workflow which is specialized to masked vs unmasked face matching.
  arXiv  Detail & Related papers  (2021-06-10T08:58:10Z)
• Boosting Masked Face Recognition with Multi-Task ArcFace [0.973681576519524]
  Given the global health crisis caused by COVID-19, mouth and nose-covering masks have become an essential everyday-clothing-accessory. This measure has put the state-of-the-art face recognition models on the ropes since they have not been designed to work with masked faces. A full training pipeline is presented based on the ArcFace work, with several modifications for the backbone and the loss function.
  arXiv  Detail & Related papers  (2021-04-20T10:12:04Z)
• Masked Face Recognition for Secure Authentication [2.429066522170765]
  Masked faces make it difficult to be detected and recognized, thereby threatening to make the in-house datasets invalid. We present an open-source tool, MaskTheFace to mask faces effectively creating a large dataset of masked faces. We report an increase of 38% in the true positive rate for the Facenet system.
  arXiv  Detail & Related papers  (2020-08-25T15:33:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.