Boosting Cross-Quality Face Verification using Blind Face Restoration
- URL: http://arxiv.org/abs/2308.07967v1
- Date: Tue, 15 Aug 2023 18:05:19 GMT
- Title: Boosting Cross-Quality Face Verification using Blind Face Restoration
- Authors: Messaoud Bengherabi, Douaa Laib, Fella Souhila Lasnami, Ryma Boussaha
- Abstract summary: It is crucial for the task of face verification to enhance the perceptual quality of the low quality images.
In this paper, we investigate the impact of applying three state-of-the-art blind face restoration techniques on the performance of face verification system.
- Score: 0.13654846342364302
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: In recent years, various Blind Face Restoration (BFR) techniques were
developed. These techniques transform low quality faces suffering from multiple
degradations to more realistic and natural face images with high perceptual
quality. However, it is crucial for the task of face verification to not only
enhance the perceptual quality of the low quality images but also to improve
the biometric-utility face quality metrics. Furthermore, preserving the
valuable identity information is of great importance. In this paper, we
investigate the impact of applying three state-of-the-art blind face
restoration techniques namely, GFP-GAN, GPEN and SGPN on the performance of
face verification system under very challenging environment characterized by
very low quality images. Extensive experimental results on the recently
proposed cross-quality LFW database using three state-of-the-art deep face
recognition models demonstrate the effectiveness of GFP-GAN in boosting
significantly the face verification accuracy.
Related papers
- Analysis and Benchmarking of Extending Blind Face Image Restoration to Videos [99.42805906884499]
We first introduce a Real-world Low-Quality Face Video benchmark (RFV-LQ) to evaluate leading image-based face restoration algorithms.
We then conduct a thorough systematical analysis of the benefits and challenges associated with extending blind face image restoration algorithms to degraded face videos.
Our analysis identifies several key issues, primarily categorized into two aspects: significant jitters in facial components and noise-shape flickering between frames.
arXiv Detail & Related papers (2024-10-15T17:53:25Z) - Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image.
We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
arXiv Detail & Related papers (2024-06-04T01:36:29Z) - DeepFidelity: Perceptual Forgery Fidelity Assessment for Deepfake
Detection [67.3143177137102]
Deepfake detection refers to detecting artificially generated or edited faces in images or videos.
We propose a novel Deepfake detection framework named DeepFidelity to adaptively distinguish real and fake faces.
arXiv Detail & Related papers (2023-12-07T07:19:45Z) - NeutrEx: A 3D Quality Component Measure on Facial Expression Neutrality [7.736597471757526]
We propose a quality measure based on the accumulated distances of a 3D face reconstruction to a neutral expression anchor.
Our evaluations demonstrate the superiority of our proposed method compared to baseline approaches.
arXiv Detail & Related papers (2023-08-19T09:38:39Z) - Face Image Quality Enhancement Study for Face Recognition [6.916620974833163]
We assemble a large database with low quality photos, and examine the performance of face recognition algorithms for three different quality sets.
We develop a new protocol for recognition with low quality face photos and validate the performance experimentally.
arXiv Detail & Related papers (2023-07-08T08:51:26Z) - FaceQgen: Semi-Supervised Deep Learning for Face Image Quality
Assessment [19.928262020265965]
FaceQgen is a No-Reference Quality Assessment approach for face images.
It generates a scalar quality measure related with the face recognition accuracy.
It is trained from scratch using the SCface database.
arXiv Detail & Related papers (2022-01-03T17:22:38Z) - Network Architecture Search for Face Enhancement [82.25775020564654]
We present a multi-task face restoration network, called Network Architecture Search for Face Enhancement (NASFE)
NASFE can enhance poor quality face images containing a single degradation (i.e. noise or blur) or multiple degradations (noise+blur+low-light)
arXiv Detail & Related papers (2021-05-13T19:46:05Z) - Joint Face Image Restoration and Frontalization for Recognition [79.78729632975744]
In real-world scenarios, many factors may harm face recognition performance, e.g., large pose, bad illumination,low resolution, blur and noise.
Previous efforts usually first restore the low-quality faces to high-quality ones and then perform face recognition.
We propose an Multi-Degradation Face Restoration model to restore frontalized high-quality faces from the given low-quality ones.
arXiv Detail & Related papers (2021-05-12T03:52:41Z) - Inducing Predictive Uncertainty Estimation for Face Recognition [102.58180557181643]
We propose a method for generating image quality training data automatically from'mated-pairs' of face images.
We use the generated data to train a lightweight Predictive Confidence Network, termed as PCNet, for estimating the confidence score of a face image.
arXiv Detail & Related papers (2020-09-01T17:52:00Z) - SER-FIQ: Unsupervised Estimation of Face Image Quality Based on
Stochastic Embedding Robustness [15.431761867166]
We propose a novel concept to measure face quality based on an arbitrary face recognition model.
We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
arXiv Detail & Related papers (2020-03-20T16:50:30Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.