Beyond the Visible: A Survey on Cross-spectral Face Recognition

• URL: http://arxiv.org/abs/2201.04435v4
• Date: Wed, 09 Oct 2024 01:02:59 GMT
• Title: Beyond the Visible: A Survey on Cross-spectral Face Recognition
• Authors: David Anghelone, Cunjian Chen, Arun Ross, Antitza Dantcheva,
• Abstract summary: Cross-spectral face recognition (CFR) refers to recognizing individuals using face images stemming from different spectral bands. Recent advances in deep neural networks (DNNs) have resulted in significant improvement in the performance of CFR systems.
• Score: 15.469814029453893
• License:
• Abstract: Cross-spectral face recognition (CFR) refers to recognizing individuals using face images stemming from different spectral bands, such as infrared versus visible. While CFR is inherently more challenging than classical face recognition due to significant variation in facial appearance caused by the modality gap, it is useful in many scenarios including night-vision biometrics and detecting presentation attacks. Recent advances in deep neural networks (DNNs) have resulted in significant improvement in the performance of CFR systems. Given these developments, the contributions of this survey are three-fold. First, we provide an overview of CFR, by formalizing the CFR problem and presenting related applications. Secondly, we discuss the appropriate spectral bands for face recognition and discuss recent CFR methods, placing emphasis on deep neural networks. In particular we describe techniques that have been proposed to extract and compare heterogeneous features emerging from different spectral bands. We also discuss the datasets that have been used for evaluating CFR methods. Finally, we discuss the challenges and future lines of research on this topic.

Related papers

• Beyond Spatial Explanations: Explainable Face Recognition in the Frequency Domain [6.69421628320396]
  We take a step forward and investigate explainable face recognition in the unexplored frequency domain. This makes this work the first to propose explainability of verification-based decisions in the frequency domain.
  arXiv  Detail & Related papers  (2024-07-16T17:29:24Z)
• A Comprehensive Survey of Masked Faces: Recognition, Detection, and Unmasking [0.5898893619901381]
  Masked face recognition (MFR) has emerged as a critical domain in biometric identification, especially by the global COVID-19 pandemic. This survey paper presents a comprehensive analysis of the challenges and advancements in recognising and detecting individuals with masked faces.
  arXiv  Detail & Related papers  (2024-05-09T16:52:43Z)
• Rethinking the Domain Gap in Near-infrared Face Recognition [65.7871950460781]
  Heterogeneous face recognition (HFR) involves the intricate task of matching face images across the visual domains of visible (VIS) and near-infrared (NIR) Much of the existing literature on HFR identifies the domain gap as a primary challenge and directs efforts towards bridging it at either the input or feature level. We observe that large neural networks, unlike their smaller counterparts, when pre-trained on large scale homogeneous VIS data, demonstrate exceptional zero-shot performance in HFR.
  arXiv  Detail & Related papers  (2023-12-01T14:43:28Z)
• Survey on Deep Face Restoration: From Non-blind to Blind and Beyond [79.1398990834247]
  Face restoration (FR) is a specialized field within image restoration that aims to recover low-quality (LQ) face images into high-quality (HQ) face images. Recent advances in deep learning technology have led to significant progress in FR methods.
  arXiv  Detail & Related papers  (2023-09-27T08:39:03Z)
• Localization using Multi-Focal Spatial Attention for Masked Face Recognition [22.833899749506394]
  It is necessary to develop masked Face Recognition for contactless biometric recognition systems. We propose Complementary Attention Learning and Multi-Focal Spatial Attention that precisely removes masked region. We evaluate the MFR performance on the ICCV 2021-MFR/Insightface track, and demonstrate the improved performance on the both MFR and FR datasets.
  arXiv  Detail & Related papers  (2023-05-03T05:39:12Z)
• Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucination [68.78903256687697]
  In Heterogeneous Face Recognition (HFR), the objective is to match faces across two different domains such as visible and thermal. Recent methods attempting to fill the gap via synthesis have achieved promising results, but their performance is still limited by the scarcity of paired training data. In this paper, we propose a new face hallucination paradigm for HFR, which not only enables data-efficient synthesis but also allows to scale up model training without breaking any privacy policy.
  arXiv  Detail & Related papers  (2022-03-30T20:44:33Z)
• A Synthesis-Based Approach for Thermal-to-Visible Face Verification [105.63410428506536]
  This paper presents an algorithm that achieves state-of-the-art performance on the ARL-VTF and TUFTS multi-spectral face datasets. We also present MILAB-VTF(B), a challenging multi-spectral face dataset composed of paired thermal and visible videos.
  arXiv  Detail & Related papers  (2021-08-21T17:59:56Z)
• End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
  State-of-the-art general face recognition models do not generalize well to occluded face images. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
  arXiv  Detail & Related papers  (2021-08-21T09:08:41Z)
• Learning Fair Face Representation With Progressive Cross Transformer [79.73754444296213]
  We propose a progressive cross transformer (PCT) method for fair face recognition. We show that PCT is capable of mitigating bias in face recognition while achieving state-of-the-art FR performance.
  arXiv  Detail & Related papers  (2021-08-11T01:31:14Z)
• Multi-Metric Evaluation of Thermal-to-Visual Face Recognition [3.0255457622022486]
  We aim to address the problem of heterogeneous or cross-spectral face recognition using machine learning to synthesize visual spectrum face from infrared images. We explore the ability to use Geneversarative Adrial Networks (GANs) for face image synthesis, and examine the performance of these images using pre-trained Convolutional Neural Networks (CNNs) The features extracted using CNNs are applied in face identification and verification.
  arXiv  Detail & Related papers  (2020-07-22T10:18:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.