Masked Face Recognition: Human vs. Machine
- URL: http://arxiv.org/abs/2103.01924v1
- Date: Tue, 2 Mar 2021 18:36:01 GMT
- Title: Masked Face Recognition: Human vs. Machine
- Authors: Naser Damer, Fadi Boutros, Marius S\"u{\ss}milch, Meiling Fang,
Florian Kirchbuchner, Arjan Kuijper
- Abstract summary: The recent COVID-19 pandemic has increased the focus on hygienic and contactless identity verification methods.
The effect of wearing a mask on face recognition in a collaborative environment is currently sensitive yet understudied issue.
This work provides a joint evaluation and in-depth analyses of the face verification performance of human experts in comparison to state-of-the-art automatic face recognition solutions.
- Score: 6.24950085812444
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The recent COVID-19 pandemic has increased the focus on hygienic and
contactless identity verification methods. However, the pandemic led to the
wide use of face masks, essential to keep the pandemic under control. The
effect of wearing a mask on face recognition in a collaborative environment is
currently sensitive yet understudied issue. Recent reports have tackled this by
evaluating the masked probe effect on the performance of automatic face
recognition solutions. However, such solutions can fail in certain processes,
leading to performing the verification task by a human expert. This work
provides a joint evaluation and in-depth analyses of the face verification
performance of human experts in comparison to state-of-the-art automatic face
recognition solutions. This involves an extensive evaluation with 12 human
experts and 4 automatic recognition solutions. The study concludes with a set
of take-home-messages on different aspects of the correlation between the
verification behavior of human and machine.
Related papers
- Seeing through the Mask: Multi-task Generative Mask Decoupling Face
Recognition [47.248075664420874]
Current general face recognition system suffers from serious performance degradation when encountering occluded scenes.
This paper proposes a Multi-task gEnerative mask dEcoupling face Recognition (MEER) network to jointly handle these two tasks.
We first present a novel mask decoupling module to disentangle mask and identity information, which makes the network obtain purer identity features from visible facial components.
arXiv Detail & Related papers (2023-11-20T03:23:03Z) - Exploring Decision-based Black-box Attacks on Face Forgery Detection [53.181920529225906]
Face forgery generation technologies generate vivid faces, which have raised public concerns about security and privacy.
Although face forgery detection has successfully distinguished fake faces, recent studies have demonstrated that face forgery detectors are very vulnerable to adversarial examples.
arXiv Detail & Related papers (2023-10-18T14:49:54Z) - Medical Face Masks and Emotion Recognition from the Body: Insights from
a Deep Learning Perspective [31.55798962786664]
The COVID-19 pandemic has forced people to extensively wear medical face masks, in order to prevent transmission.
This paper conducts insightful studies about the effect of face occlusion on emotion recognition performance.
We utilize a deep learning model based on the Temporal Segment Network framework, and aspire to fully overcome the face mask consequences.
arXiv Detail & Related papers (2023-02-20T15:07:24Z) - A Survey on Computer Vision based Human Analysis in the COVID-19 Era [58.79053747159797]
The emergence of COVID-19 has had a global and profound impact, not only on society as a whole, but also on the lives of individuals.
Various prevention measures were introduced around the world to limit the transmission of the disease, including face masks, mandates for social distancing and regular disinfection in public spaces, and the use of screening applications.
These developments triggered the need for novel and improved computer vision techniques capable of (i) providing support to the prevention measures through an automated analysis of visual data, on the one hand, and (ii) facilitating normal operation of existing vision-based services, such as biometric authentication
arXiv Detail & Related papers (2022-11-07T17:20:39Z) - I Only Have Eyes for You: The Impact of Masks On Convolutional-Based
Facial Expression Recognition [78.07239208222599]
We evaluate how the recently proposed FaceChannel adapts towards recognizing facial expressions from persons with masks.
We also perform specific feature-level visualization to demonstrate how the inherent capabilities of the FaceChannel to learn and combine facial features change when in a constrained social interaction scenario.
arXiv Detail & Related papers (2021-04-16T20:03:30Z) - Unmasking Face Embeddings by Self-restrained Triplet Loss for Accurate
Masked Face Recognition [6.865656740940772]
We present a solution to improve the masked face recognition performance.
Specifically, we propose the Embedding Unmasking Model (EUM) operated on top of existing face recognition models.
We also propose a novel loss function, the Self-restrained Triplet (SRT), which enabled the EUM to produce embeddings similar to these of unmasked faces of the same identities.
arXiv Detail & Related papers (2021-03-02T13:43:11Z) - Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
This work explores facial expression bias as a security vulnerability of face recognition systems.
We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
arXiv Detail & Related papers (2020-11-17T18:12:41Z) - Learning Emotional-Blinded Face Representations [77.7653702071127]
We propose two face representations that are blind to facial expressions associated to emotional responses.
This work is motivated by new international regulations for personal data protection.
arXiv Detail & Related papers (2020-09-18T09:24:10Z) - The Effect of Wearing a Mask on Face Recognition Performance: an
Exploratory Study [17.577672647262116]
Face recognition has become essential in our daily lives as a convenient and contactless method of accurate identity verification.
The recent COVID-19 pandemic have increased the value of hygienic and contactless identity verification.
The effect of wearing a mask on face recognition in a collaborative environment is currently sensitive yet understudied.
arXiv Detail & Related papers (2020-07-27T13:03:32Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.