Explainable Face Verification via Feature-Guided Gradient Backpropagation

• URL: http://arxiv.org/abs/2403.04549v1
• Date: Thu, 7 Mar 2024 14:43:40 GMT
• Title: Explainable Face Verification via Feature-Guided Gradient Backpropagation
• Authors: Yuhang Lu, Zewei Xu, and Touradj Ebrahimi
• Abstract summary: There is a growing need for reliable interpretations of decisions of face recognition systems. This paper first explores the spatial relationship between face image and its deep representation via gradient backpropagation. A new explanation approach has been conceived, which provides precise and insightful similarity and dissimilarity saliency maps to explain the "Accept" and "Reject" decision of an FR system.
• Score: 9.105950041800225
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recent years have witnessed significant advancement in face recognition (FR) techniques, with their applications widely spread in people's lives and security-sensitive areas. There is a growing need for reliable interpretations of decisions of such systems. Existing studies relying on various mechanisms have investigated the usage of saliency maps as an explanation approach, but suffer from different limitations. This paper first explores the spatial relationship between face image and its deep representation via gradient backpropagation. Then a new explanation approach FGGB has been conceived, which provides precise and insightful similarity and dissimilarity saliency maps to explain the "Accept" and "Reject" decision of an FR system. Extensive visual presentation and quantitative measurement have shown that FGGB achieves superior performance in both similarity and dissimilarity maps when compared to current state-of-the-art explainable face verification approaches.

Related papers

• Beyond Spatial Explanations: Explainable Face Recognition in the Frequency Domain [6.69421628320396]
  We take a step forward and investigate explainable face recognition in the unexplored frequency domain. This makes this work the first to propose explainability of verification-based decisions in the frequency domain.
  arXiv  Detail & Related papers  (2024-07-16T17:29:24Z)
• Towards A Comprehensive Visual Saliency Explanation Framework for AI-based Face Recognition Systems [9.105950041800225]
  This manuscript conceives a comprehensive explanation framework for face recognition tasks. An exhaustive definition of visual saliency map-based explanations for AI-based face recognition systems is provided. A new model-agnostic explanation method named CorrRISE is proposed to produce saliency maps.
  arXiv  Detail & Related papers  (2024-07-08T14:25:46Z)
• Rethinking the Domain Gap in Near-infrared Face Recognition [65.7871950460781]
  Heterogeneous face recognition (HFR) involves the intricate task of matching face images across the visual domains of visible (VIS) and near-infrared (NIR) Much of the existing literature on HFR identifies the domain gap as a primary challenge and directs efforts towards bridging it at either the input or feature level. We observe that large neural networks, unlike their smaller counterparts, when pre-trained on large scale homogeneous VIS data, demonstrate exceptional zero-shot performance in HFR.
  arXiv  Detail & Related papers  (2023-12-01T14:43:28Z)
• Discriminative Deep Feature Visualization for Explainable Face Recognition [9.105950041800225]
  This paper contributes to the problem of explainable face recognition by first conceiving a face reconstruction-based explanation module. To further interpret the decision of an FR model, a novel visual saliency explanation algorithm has been proposed.
  arXiv  Detail & Related papers  (2023-06-01T07:06:43Z)
• Towards Visual Saliency Explanations of Face Verification [10.234175295380107]
  This paper focuses on explainable face verification tasks using deep convolutional neural networks. A new model-agnostic explanation method named CorrRISE is proposed to produce saliency maps. Results show that the proposed CorrRISE method demonstrates promising results in comparison with other state-of-the-art explainable face verification approaches.
  arXiv  Detail & Related papers  (2023-05-15T11:17:17Z)
• Robust Saliency-Aware Distillation for Few-shot Fine-grained Visual Recognition [57.08108545219043]
  Recognizing novel sub-categories with scarce samples is an essential and challenging research topic in computer vision. Existing literature addresses this challenge by employing local-based representation approaches. This article proposes a novel model, Robust Saliency-aware Distillation (RSaD), for few-shot fine-grained visual recognition.
  arXiv  Detail & Related papers  (2023-05-12T00:13:17Z)
• Explanation of Face Recognition via Saliency Maps [13.334500258498798]
  This paper proposes a rigorous definition of explainable face recognition (XFR) It then introduces a similarity-based RISE algorithm (S-RISE) to produce high-quality visual saliency maps. An evaluation approach is proposed to systematically validate the reliability and accuracy of general visual saliency-based XFR methods.
  arXiv  Detail & Related papers  (2023-04-12T19:04:21Z)
• A Synthesis-Based Approach for Thermal-to-Visible Face Verification [105.63410428506536]
  This paper presents an algorithm that achieves state-of-the-art performance on the ARL-VTF and TUFTS multi-spectral face datasets. We also present MILAB-VTF(B), a challenging multi-spectral face dataset composed of paired thermal and visible videos.
  arXiv  Detail & Related papers  (2021-08-21T17:59:56Z)
• Face Anti-Spoofing Via Disentangled Representation Learning [90.90512800361742]
  Face anti-spoofing is crucial to security of face recognition systems. We propose a novel perspective of face anti-spoofing that disentangles the liveness features and content features from images.
  arXiv  Detail & Related papers  (2020-08-19T03:54:23Z)
• Multi-Margin based Decorrelation Learning for Heterogeneous Face Recognition [90.26023388850771]
  This paper presents a deep neural network approach to extract decorrelation representations in a hyperspherical space for cross-domain face images. The proposed framework can be divided into two components: heterogeneous representation network and decorrelation representation learning. Experimental results on two challenging heterogeneous face databases show that our approach achieves superior performance on both verification and recognition tasks.
  arXiv  Detail & Related papers  (2020-05-25T07:01:12Z)
• Dual-Attention GAN for Large-Pose Face Frontalization [59.689836951934694]
  We present a novel Dual-Attention Generative Adversarial Network (DA-GAN) for photo-realistic face frontalization. Specifically, a self-attention-based generator is introduced to integrate local features with their long-range dependencies. A novel face-attention-based discriminator is applied to emphasize local features of face regions.
  arXiv  Detail & Related papers  (2020-02-17T20:00:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.