The Invisible Threat: Evaluating the Vulnerability of Cross-Spectral Face Recognition to Presentation Attacks

• URL: http://arxiv.org/abs/2505.00380v1
• Date: Thu, 01 May 2025 08:15:48 GMT
• Title: The Invisible Threat: Evaluating the Vulnerability of Cross-Spectral Face Recognition to Presentation Attacks
• Authors: Anjith George, Sebastien Marcel,
• Abstract summary: Cross-spectral face recognition systems are designed to enhance the performance of facial recognition systems.<n>The use of NIR imaging offers several advantages, including greater robustness to illumination variations.<n>Despite these claimed benefits, the robustness of NIR-based systems against presentation attacks has not been systematically studied.
• Score: 4.910937238451485
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Cross-spectral face recognition systems are designed to enhance the performance of facial recognition systems by enabling cross-modal matching under challenging operational conditions. A particularly relevant application is the matching of near-infrared (NIR) images to visible-spectrum (VIS) images, enabling the verification of individuals by comparing NIR facial captures acquired with VIS reference images. The use of NIR imaging offers several advantages, including greater robustness to illumination variations, better visibility through glasses and glare, and greater resistance to presentation attacks. Despite these claimed benefits, the robustness of NIR-based systems against presentation attacks has not been systematically studied in the literature. In this work, we conduct a comprehensive evaluation into the vulnerability of NIR-VIS cross-spectral face recognition systems to presentation attacks. Our empirical findings indicate that, although these systems exhibit a certain degree of reliability, they remain vulnerable to specific attacks, emphasizing the need for further research in this area.

Related papers

• OpticalDR: A Deep Optical Imaging Model for Privacy-Protective Depression Recognition [66.91236298878383]
  Depression Recognition (DR) poses a considerable challenge, especially in the context of privacy concerns. We design a new imaging system to erase the identity information of captured facial images while retain disease-relevant features. It is irreversible for identity information recovery while preserving essential disease-related characteristics necessary for accurate DR.
  arXiv  Detail & Related papers  (2024-02-29T01:20:29Z)
• Cross-Modality Perturbation Synergy Attack for Person Re-identification [66.48494594909123]
  Cross-modality person re-identification (ReID) systems are based on RGB images.<n>Main challenge in cross-modality ReID lies in effectively dealing with visual differences between different modalities.<n>Existing attack methods have primarily focused on the characteristics of the visible image modality.<n>This study proposes a universal perturbation attack specifically designed for cross-modality ReID.
  arXiv  Detail & Related papers  (2024-01-18T15:56:23Z)
• Hypergraph-Guided Disentangled Spectrum Transformer Networks for Near-Infrared Facial Expression Recognition [31.783671943393344]
  We give the first attempt to deep NIR facial expression recognition and proposed a novel method called near-infrared facial expression transformer (NFER-Former) NFER-Former disentangles the expression information and spectrum information from the input image, so that the expression features can be extracted without the interference of spectrum variation. We have constructed a large NIR-VIS Facial Expression dataset that includes 360 subjects to better validate the efficiency of NFER-Former.
  arXiv  Detail & Related papers  (2023-12-10T15:15:50Z)
• Attribute-Guided Encryption with Facial Texture Masking [64.77548539959501]
  We propose Attribute Guided Encryption with Facial Texture Masking to protect users from unauthorized facial recognition systems. Our proposed method produces more natural-looking encrypted images than state-of-the-art methods.
  arXiv  Detail & Related papers  (2023-05-22T23:50:43Z)
• Physically-Based Face Rendering for NIR-VIS Face Recognition [165.54414962403555]
  Near infrared (NIR) to Visible (VIS) face matching is challenging due to the significant domain gaps. We propose a novel method for paired NIR-VIS facial image generation. To facilitate the identity feature learning, we propose an IDentity-based Maximum Mean Discrepancy (ID-MMD) loss.
  arXiv  Detail & Related papers  (2022-11-11T18:48:16Z)
• Compact multi-scale periocular recognition using SAFE features [63.48764893706088]
  We present a new approach for periocular recognition based on the Symmetry Assessment by Feature Expansion (SAFE) descriptor. We use the sclera center as single key point for feature extraction, highlighting the object-like identity properties that concentrates to this point unique of the eye.
  arXiv  Detail & Related papers  (2022-10-18T11:46:38Z)
• A Bidirectional Conversion Network for Cross-Spectral Face Recognition [1.9766522384767227]
  Cross-spectral face recognition is challenging due to the dramatic difference between the visible light and IR imageries. This paper proposes a framework of bidirectional cross-spectral conversion (BCSC-GAN) between the heterogeneous face images. The network reduces the cross-spectral recognition problem into an intra-spectral problem, and improves performance by fusing bidirectional information.
  arXiv  Detail & Related papers  (2022-05-03T16:20:10Z)
• Beyond the Visible: A Survey on Cross-spectral Face Recognition [15.469814029453893]
  Cross-spectral face recognition (CFR) refers to recognizing individuals using face images stemming from different spectral bands. Recent advances in deep neural networks (DNNs) have resulted in significant improvement in the performance of CFR systems.
  arXiv  Detail & Related papers  (2022-01-12T12:09:24Z)
• A Synthesis-Based Approach for Thermal-to-Visible Face Verification [105.63410428506536]
  This paper presents an algorithm that achieves state-of-the-art performance on the ARL-VTF and TUFTS multi-spectral face datasets. We also present MILAB-VTF(B), a challenging multi-spectral face dataset composed of paired thermal and visible videos.
  arXiv  Detail & Related papers  (2021-08-21T17:59:56Z)
• Cross-Spectral Iris Matching Using Conditional Coupled GAN [22.615156512223766]
  Cross-spectral iris recognition is emerging as a promising biometric approach to authenticating the identity of individuals. matching iris images acquired at different spectral bands shows significant performance degradation when compared to single-band near-infrared (NIR) matching. We propose a conditional coupled generative adversarial network (CpGAN) architecture for cross-spectral iris recognition.
  arXiv  Detail & Related papers  (2020-10-09T19:13:24Z)
• Face Anti-Spoofing Via Disentangled Representation Learning [90.90512800361742]
  Face anti-spoofing is crucial to security of face recognition systems. We propose a novel perspective of face anti-spoofing that disentangles the liveness features and content features from images.
  arXiv  Detail & Related papers  (2020-08-19T03:54:23Z)
• Multi-Metric Evaluation of Thermal-to-Visual Face Recognition [3.0255457622022486]
  We aim to address the problem of heterogeneous or cross-spectral face recognition using machine learning to synthesize visual spectrum face from infrared images. We explore the ability to use Geneversarative Adrial Networks (GANs) for face image synthesis, and examine the performance of these images using pre-trained Convolutional Neural Networks (CNNs) The features extracted using CNNs are applied in face identification and verification.
  arXiv  Detail & Related papers  (2020-07-22T10:18:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.