Inducing Predictive Uncertainty Estimation for Face Recognition
- URL: http://arxiv.org/abs/2009.00603v1
- Date: Tue, 1 Sep 2020 17:52:00 GMT
- Title: Inducing Predictive Uncertainty Estimation for Face Recognition
- Authors: Weidi Xie, Jeffrey Byrne, Andrew Zisserman
- Abstract summary: We propose a method for generating image quality training data automatically from'mated-pairs' of face images.
We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
- Score: 102.58180557181643
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Knowing when an output can be trusted is critical for reliably using face
recognition systems. While there has been enormous effort in recent research on
improving face verification performance, understanding when a model's
predictions should or should not be trusted has received far less attention.
Our goal is to assign a confidence score for a face image that reflects its
quality in terms of recognizable information. To this end, we propose a method
for generating image quality training data automatically from 'mated-pairs' of
face images, and use the generated data to train a lightweight Predictive
Confidence Network, termed as PCNet, for estimating the confidence score of a
face image. We systematically evaluate the usefulness of PCNet with its error
versus reject performance, and demonstrate that it can be universally paired
with and improve the robustness of any verification model. We describe three
use cases on the public IJB-C face verification benchmark: (i) to improve 1:1
image-based verification error rates by rejecting low-quality face images; (ii)
to improve quality score based fusion performance on the 1:1 set-based
verification benchmark; and (iii) its use as a quality measure for selecting
high quality (unblurred, good lighting, more frontal) faces from a collection,
e.g. for automatic enrolment or display.
Related papers
- Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image.
We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
arXiv Detail & Related papers (2024-06-04T01:36:29Z) - DifFIQA: Face Image Quality Assessment Using Denoising Diffusion
Probabilistic Models [1.217503190366097]
Face image quality assessment (FIQA) techniques aim to mitigate these performance degradations.
We present a powerful new FIQA approach, named DifFIQA, which relies on denoising diffusion probabilistic models (DDPM)
Because the diffusion-based perturbations are computationally expensive, we also distill the knowledge encoded in DifFIQA into a regression-based quality predictor, called DifFIQA(R)
arXiv Detail & Related papers (2023-05-09T21:03:13Z) - Confidence-Calibrated Face and Kinship Verification [8.570969129199467]
We introduce an effective confidence measure that allows verification models to convert a similarity score into a confidence score for any given face pair.
We also propose a confidence-calibrated approach, termed Angular Scaling (ASC), which is easy to implement and can be readily applied to existing verification models.
To the best of our knowledge, our work presents the first comprehensive confidence-calibrated solution for modern face and kinship verification tasks.
arXiv Detail & Related papers (2022-10-25T10:43:46Z) - Conformer and Blind Noisy Students for Improved Image Quality Assessment [80.57006406834466]
Learning-based approaches for perceptual image quality assessment (IQA) usually require both the distorted and reference image for measuring the perceptual quality accurately.
In this work, we explore the performance of transformer-based full-reference IQA models.
We also propose a method for IQA based on semi-supervised knowledge distillation from full-reference teacher models into blind student models.
arXiv Detail & Related papers (2022-04-27T10:21:08Z) - FaceQgen: Semi-Supervised Deep Learning for Face Image Quality
Assessment [19.928262020265965]
FaceQgen is a No-Reference Quality Assessment approach for face images.
It generates a scalar quality measure related with the face recognition accuracy.
It is trained from scratch using the SCface database.
arXiv Detail & Related papers (2022-01-03T17:22:38Z) - Image Quality Assessment using Contrastive Learning [50.265638572116984]
We train a deep Convolutional Neural Network (CNN) using a contrastive pairwise objective to solve the auxiliary problem.
We show through extensive experiments that CONTRIQUE achieves competitive performance when compared to state-of-the-art NR image quality models.
Our results suggest that powerful quality representations with perceptual relevance can be obtained without requiring large labeled subjective image quality datasets.
arXiv Detail & Related papers (2021-10-25T21:01:00Z) - Deep Tiny Network for Recognition-Oriented Face Image Quality Assessment [26.792481400792376]
In many face recognition (FR) scenarios, face images are acquired from a sequence with huge intra-variations.
We present an efficient non-reference image quality assessment for FR that directly links image quality assessment (IQA) and FR.
Based on the proposed quality measurement, we propose a deep Tiny Face Quality network (tinyFQnet) to learn a quality prediction function from data.
arXiv Detail & Related papers (2021-06-09T07:20:54Z) - Uncertainty-Aware Blind Image Quality Assessment in the Laboratory and
Wild [98.48284827503409]
We develop a textitunified BIQA model and an approach of training it for both synthetic and realistic distortions.
We employ the fidelity loss to optimize a deep neural network for BIQA over a large number of such image pairs.
Experiments on six IQA databases show the promise of the learned method in blindly assessing image quality in the laboratory and wild.
arXiv Detail & Related papers (2020-05-28T13:35:23Z) - SER-FIQ: Unsupervised Estimation of Face Image Quality Based on
Stochastic Embedding Robustness [15.431761867166]
We propose a novel concept to measure face quality based on an arbitrary face recognition model.
We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
arXiv Detail & Related papers (2020-03-20T16:50:30Z) - Suppressing Uncertainties for Large-Scale Facial Expression Recognition [81.51495681011404]
This paper proposes a simple yet efficient Self-Cure Network (SCN) which suppresses the uncertainties efficiently and prevents deep networks from over-fitting uncertain facial images.
Results on public benchmarks demonstrate that our SCN outperforms current state-of-the-art methods with textbf88.14% on RAF-DB, textbf60.23% on AffectNet, and textbf89.35% on FERPlus.
arXiv Detail & Related papers (2020-02-24T17:24:36Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.