A Test Suite for Efficient Robustness Evaluation of Face Recognition Systems

• URL: http://arxiv.org/abs/2504.21420v1
• Date: Wed, 30 Apr 2025 08:27:08 GMT
• Title: A Test Suite for Efficient Robustness Evaluation of Face Recognition Systems
• Authors: Ruihan Zhang, Jun Sun,
• Abstract summary: RobFace is an efficient and easy-to-use method for evaluating the robustness of face recognition systems.<n>It contains transferable adversarial face images that are designed to comprehensively evaluate a face recognition system's robustness.<n>To our knowledge, RobFace is the first system-agnostic robustness estimation test suite.
• Score: 3.350980549219263
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Face recognition is a widely used authentication technology in practice, where robustness is required. It is thus essential to have an efficient and easy-to-use method for evaluating the robustness of (possibly third-party) trained face recognition systems. Existing approaches to evaluating the robustness of face recognition systems are either based on empirical evaluation (e.g., measuring attacking success rate using state-of-the-art attacking methods) or formal analysis (e.g., measuring the Lipschitz constant). While the former demands significant user efforts and expertise, the latter is extremely time-consuming. In pursuit of a comprehensive, efficient, easy-to-use and scalable estimation of the robustness of face recognition systems, we take an old-school alternative approach and introduce RobFace, i.e., evaluation using an optimised test suite. It contains transferable adversarial face images that are designed to comprehensively evaluate a face recognition system's robustness along a variety of dimensions. RobFace is system-agnostic and still consistent with system-specific empirical evaluation or formal analysis. We support this claim through extensive experimental results with various perturbations on multiple face recognition systems. To our knowledge, RobFace is the first system-agnostic robustness estimation test suite.

Related papers

• Local Features Meet Stochastic Anonymization: Revolutionizing Privacy-Preserving Face Recognition for Black-Box Models [54.88064975480573]
  The task of privacy-preserving face recognition (PPFR) currently faces two major unsolved challenges.<n>By disrupting global features while enhancing local features, we achieve effective recognition even in black-box environments.<n>Our method achieves an average recognition accuracy of 94.21% on black-box models, outperforming existing methods in both privacy protection and anti-reconstruction capabilities.
  arXiv  Detail & Related papers  (2024-12-11T10:49:15Z)
• TetraLoss: Improving the Robustness of Face Recognition against Morphing Attacks [6.492755549391469]
  Face recognition systems are widely deployed in high-security applications.<n>Digital manipulations, such as face morphing, pose a security threat to face recognition systems.<n>We present a novel method for adapting deep learning-based face recognition systems to be more robust against face morphing attacks.
  arXiv  Detail & Related papers  (2024-01-21T21:04:05Z)
• Analysis of Recent Trends in Face Recognition Systems [0.0]
  Due to inter-class similarities and intra-class variations, face recognition systems generate false match and false non-match errors respectively. Recent research focuses on improving the robustness of extracted features and the pre-processing algorithms to enhance recognition accuracy.
  arXiv  Detail & Related papers  (2023-04-23T18:55:45Z)
• Robustness Disparities in Face Detection [64.71318433419636]
  We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models. Across all the datasets and systems, we generally find that photos of individuals who are $textitmasculine presenting$, of $textitolder$, of $textitdarker skin type$, or have $textitdim lighting$ are more susceptible to errors than their counterparts in other identities.
  arXiv  Detail & Related papers  (2022-11-29T05:22:47Z)
• ScaleFace: Uncertainty-aware Deep Metric Learning [2.7383076864024636]
  We propose an approach for deep metric learning that allows direct estimation of the uncertainty with almost no additional computational cost. The developed textitScaleFace algorithm uses trainable scale values that modify similarities in the space of embeddings. We provide comprehensive experiments on face recognition tasks that show the superior performance of ScaleFace compared to other uncertainty-aware face recognition approaches.
  arXiv  Detail & Related papers  (2022-09-05T10:27:16Z)
• Harnessing Unrecognizable Faces for Face Recognition [87.80037162457427]
  We propose a measure of recognizability of a face image, implemented by a deep neural network trained using mostly recognizable identities. We show that accounting for recognizability reduces error rate of single-image face recognition by 58% at FAR=1e-5.
  arXiv  Detail & Related papers  (2021-06-08T05:25:03Z)
• FACESEC: A Fine-grained Robustness Evaluation Framework for Face Recognition Systems [49.577302852655144]
  FACESEC is a framework for fine-grained robustness evaluation of face recognition systems. We study five face recognition systems in both closed-set and open-set settings. We find that accurate knowledge of neural architecture is significantly more important than knowledge of the training data in black-box attacks.
  arXiv  Detail & Related papers  (2021-04-08T23:00:25Z)
• Face recognition using PCA integrated with Delaunay triangulation [0.0]
  The research examines the integration of Principal Component Analysis with Delaunay Triangulation. The method triangulates a set of face landmark points and obtains eigenfaces of the provided images. It compares the algorithm with traditional PCA and discusses the inclusion of different face landmark points to deliver an effective recognition rate.
  arXiv  Detail & Related papers  (2020-11-25T14:46:08Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• The Elements of End-to-end Deep Face Recognition: A Survey of Recent Advances [56.432660252331495]
  Face recognition is one of the most popular and long-standing topics in computer vision. Deep face recognition has made remarkable progress and been widely used in many real-world applications. In this survey article, we present a comprehensive review about the recent advance of each element.
  arXiv  Detail & Related papers  (2020-09-28T13:02:17Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.