On Recognizing Occluded Faces in the Wild

• URL: http://arxiv.org/abs/2109.03672v1
• Date: Wed, 8 Sep 2021 14:20:10 GMT
• Title: On Recognizing Occluded Faces in the Wild
• Authors: Mustafa Ekrem Erak{\i}n, U\u{g}ur Demir, Haz{\i}m Kemal Ekenel
• Abstract summary: We present the Real World Occluded Faces dataset. This dataset contains faces with both upper face. occluded, due to sunglasses, and lower face. occluded, due to masks. It is observed that the performance drop is far less when the models are tested on synthetically generated occluded faces.
• Score: 10.420394952839242
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Facial appearance variations due to occlusion has been one of the main challenges for face recognition systems. To facilitate further research in this area, it is necessary and important to have occluded face datasets collected from real-world, as synthetically generated occluded faces cannot represent the nature of the problem. In this paper, we present the Real World Occluded Faces (ROF) dataset, that contains faces with both upper face occlusion, due to sunglasses, and lower face occlusion, due to masks. We propose two evaluation protocols for this dataset. Benchmark experiments on the dataset have shown that no matter how powerful the deep face representation models are, their performance degrades significantly when they are tested on real-world occluded faces. It is observed that the performance drop is far less when the models are tested on synthetically generated occluded faces. The ROF dataset and the associated evaluation protocols are publicly available at the following link https://github.com/ekremerakin/RealWorldOccludedFaces.

Related papers

• DiffusionFace: Towards a Comprehensive Dataset for Diffusion-Based Face Forgery Analysis [71.40724659748787]
  DiffusionFace is the first diffusion-based face forgery dataset. It covers various forgery categories, including unconditional and Text Guide facial image generation, Img2Img, Inpaint, and Diffusion-based facial exchange algorithms. It provides essential metadata and a real-world internet-sourced forgery facial image dataset for evaluation.
  arXiv  Detail & Related papers  (2024-03-27T11:32:44Z)
• Generalized Face Liveness Detection via De-spoofing Face Generator [58.7043386978171]
  Previous Face Anti-spoofing (FAS) works face the challenge of generalizing in unseen domains. We conduct an Anomalous cue Guided FAS (AG-FAS) method, which leverages real faces for improving model generalization via a De-spoofing Face Generator (DFG) We then propose an Anomalous cue Guided FAS feature extraction Network (AG-Net) to further improve the FAS feature generalization via a cross-attention transformer.
  arXiv  Detail & Related papers  (2024-01-17T06:59:32Z)
• Delving into High-Quality Synthetic Face Occlusion Segmentation Datasets [83.749895930242]
  We propose two techniques for producing high-quality naturalistic synthetic occluded faces. We empirically show the effectiveness and robustness of both methods, even for unseen occlusions. We present two high-resolution real-world occluded face datasets with fine-grained annotations, RealOcc and RealOcc-Wild.
  arXiv  Detail & Related papers  (2022-05-12T17:03:57Z)
• FaceOcc: A Diverse, High-quality Face Occlusion Dataset for Human Face Extraction [3.8502825594372703]
  Occlusions often occur in face images in the wild, troubling face-related tasks such as landmark detection, 3D reconstruction, and face recognition. This paper proposes a novel face segmentation dataset with manually labeled face occlusions from the CelebA-HQ and the internet. We trained a straightforward face segmentation model but obtained SOTA performance, convincingly demonstrating the effectiveness of the proposed dataset.
  arXiv  Detail & Related papers  (2022-01-20T19:44:18Z)
• EDFace-Celeb-1M: Benchmarking Face Hallucination with a Million-scale Dataset [92.537021496096]
  Recent deep face hallucination methods show stunning performance in super-resolving severely degraded facial images. It is thus unclear how these algorithms perform on public face hallucination datasets. This paper builds a public Ethnically Diverse Face dataset, EDFace-Celeb-1M, and design a benchmark task for face hallucination.
  arXiv  Detail & Related papers  (2021-10-11T06:53:24Z)
• Robust Attentive Deep Neural Network for Exposing GAN-generated Faces [40.15016121723183]
  We propose a robust, attentive, end-to-end network that can spot GAN-generated faces by analyzing their eye inconsistencies. Our deep network addresses the imbalance learning issues by considering the AUC loss and the traditional cross-entropy loss jointly.
  arXiv  Detail & Related papers  (2021-09-05T21:22:39Z)
• End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
  State-of-the-art general face recognition models do not generalize well to occluded face images. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
  arXiv  Detail & Related papers  (2021-08-21T09:08:41Z)
• SynFace: Face Recognition with Synthetic Data [83.15838126703719]
  We devise the SynFace with identity mixup (IM) and domain mixup (DM) to mitigate the performance gap. We also perform a systematically empirical analysis on synthetic face images to provide some insights on how to effectively utilize synthetic data for face recognition.
  arXiv  Detail & Related papers  (2021-08-18T03:41:54Z)
• When Face Recognition Meets Occlusion: A New Benchmark [37.616211206620854]
  We create a simulated occlusion face recognition dataset. It covers 804,704 face images of 10,575 subjects. Our dataset significantly outperforms the state-of-the-arts.
  arXiv  Detail & Related papers  (2021-03-04T03:07:42Z)
• Improving Makeup Face Verification by Exploring Part-Based Representations [0.0]
  We propose and evaluate the adoption of facial parts to fuse with current holistic representations. Experimental results show that the fusion of deep features extracted of facial parts with holistic representation increases the accuracy of face verification systems.
  arXiv  Detail & Related papers  (2021-01-18T21:51:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.