Explanation of Face Recognition via Saliency Maps

• URL: http://arxiv.org/abs/2304.06118v1
• Date: Wed, 12 Apr 2023 19:04:21 GMT
• Title: Explanation of Face Recognition via Saliency Maps
• Authors: Yuhang Lu and Touradj Ebrahimi
• Abstract summary: This paper proposes a rigorous definition of explainable face recognition (XFR) It then introduces a similarity-based RISE algorithm (S-RISE) to produce high-quality visual saliency maps. An evaluation approach is proposed to systematically validate the reliability and accuracy of general visual saliency-based XFR methods.
• Score: 13.334500258498798
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the significant progress in face recognition in the past years, they are often treated as "black boxes" and have been criticized for lacking explainability. It becomes increasingly important to understand the characteristics and decisions of deep face recognition systems to make them more acceptable to the public. Explainable face recognition (XFR) refers to the problem of interpreting why the recognition model matches a probe face with one identity over others. Recent studies have explored use of visual saliency maps as an explanation, but they often lack a deeper analysis in the context of face recognition. This paper starts by proposing a rigorous definition of explainable face recognition (XFR) which focuses on the decision-making process of the deep recognition model. Following the new definition, a similarity-based RISE algorithm (S-RISE) is then introduced to produce high-quality visual saliency maps. Furthermore, an evaluation approach is proposed to systematically validate the reliability and accuracy of general visual saliency-based XFR methods.

Related papers

• Beyond Spatial Explanations: Explainable Face Recognition in the Frequency Domain [6.69421628320396]
  We take a step forward and investigate explainable face recognition in the unexplored frequency domain. This makes this work the first to propose explainability of verification-based decisions in the frequency domain.
  arXiv  Detail & Related papers  (2024-07-16T17:29:24Z)
• Towards A Comprehensive Visual Saliency Explanation Framework for AI-based Face Recognition Systems [9.105950041800225]
  This manuscript conceives a comprehensive explanation framework for face recognition tasks. An exhaustive definition of visual saliency map-based explanations for AI-based face recognition systems is provided. A new model-agnostic explanation method named CorrRISE is proposed to produce saliency maps.
  arXiv  Detail & Related papers  (2024-07-08T14:25:46Z)
• Discriminative Deep Feature Visualization for Explainable Face Recognition [9.105950041800225]
  This paper contributes to the problem of explainable face recognition by first conceiving a face reconstruction-based explanation module. To further interpret the decision of an FR model, a novel visual saliency explanation algorithm has been proposed.
  arXiv  Detail & Related papers  (2023-06-01T07:06:43Z)
• Towards Visual Saliency Explanations of Face Verification [10.234175295380107]
  This paper focuses on explainable face verification tasks using deep convolutional neural networks. A new model-agnostic explanation method named CorrRISE is proposed to produce saliency maps. Results show that the proposed CorrRISE method demonstrates promising results in comparison with other state-of-the-art explainable face verification approaches.
  arXiv  Detail & Related papers  (2023-05-15T11:17:17Z)
• Analysis of Recent Trends in Face Recognition Systems [0.0]
  Due to inter-class similarities and intra-class variations, face recognition systems generate false match and false non-match errors respectively. Recent research focuses on improving the robustness of extracted features and the pre-processing algorithms to enhance recognition accuracy.
  arXiv  Detail & Related papers  (2023-04-23T18:55:45Z)
• End2End Occluded Face Recognition by Masking Corrupted Features [82.27588990277192]
  State-of-the-art general face recognition models do not generalize well to occluded face images. This paper presents a novel face recognition method that is robust to occlusions based on a single end-to-end deep neural network. Our approach, named FROM (Face Recognition with Occlusion Masks), learns to discover the corrupted features from the deep convolutional neural networks, and clean them by the dynamically learned masks.
  arXiv  Detail & Related papers  (2021-08-21T09:08:41Z)
• Learning Fair Face Representation With Progressive Cross Transformer [79.73754444296213]
  We propose a progressive cross transformer (PCT) method for fair face recognition. We show that PCT is capable of mitigating bias in face recognition while achieving state-of-the-art FR performance.
  arXiv  Detail & Related papers  (2021-08-11T01:31:14Z)
• Harnessing Unrecognizable Faces for Face Recognition [87.80037162457427]
  We propose a measure of recognizability of a face image, implemented by a deep neural network trained using mostly recognizable identities. We show that accounting for recognizability reduces error rate of single-image face recognition by 58% at FAR=1e-5.
  arXiv  Detail & Related papers  (2021-06-08T05:25:03Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• The Elements of End-to-end Deep Face Recognition: A Survey of Recent Advances [56.432660252331495]
  Face recognition is one of the most popular and long-standing topics in computer vision. Deep face recognition has made remarkable progress and been widely used in many real-world applications. In this survey article, we present a comprehensive review about the recent advance of each element.
  arXiv  Detail & Related papers  (2020-09-28T13:02:17Z)
• On the Robustness of Face Recognition Algorithms Against Attacks and Bias [78.68458616687634]
  Face recognition algorithms have demonstrated very high recognition performance, suggesting suitability for real world applications. Despite the enhanced accuracies, robustness of these algorithms against attacks and bias has been challenged. This paper summarizes different ways in which the robustness of a face recognition algorithm is challenged.
  arXiv  Detail & Related papers  (2020-02-07T18:21:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.