IFQA: Interpretable Face Quality Assessment

• URL: http://arxiv.org/abs/2211.07077v2
• Date: Thu, 17 Nov 2022 02:31:12 GMT
• Title: IFQA: Interpretable Face Quality Assessment
• Authors: Byungho Jo and Donghyeon Cho and In Kyu Park and Sungeun Hong
• Abstract summary: This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Our metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins.
• Score: 23.34924105158927
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Existing face restoration models have relied on general assessment metrics that do not consider the characteristics of facial regions. Recent works have therefore assessed their methods using human studies, which is not scalable and involves significant effort. This paper proposes a novel face-centric metric based on an adversarial framework where a generator simulates face restoration and a discriminator assesses image quality. Specifically, our per-pixel discriminator enables interpretable evaluation that cannot be provided by traditional metrics. Moreover, our metric emphasizes facial primary regions considering that even minor changes to the eyes, nose, and mouth significantly affect human cognition. Our face-oriented metric consistently surpasses existing general or facial image quality assessment metrics by impressive margins. We demonstrate the generalizability of the proposed strategy in various architectural designs and challenging scenarios. Interestingly, we find that our IFQA can lead to performance improvement as an objective function.

Related papers

• F-Bench: Rethinking Human Preference Evaluation Metrics for Benchmarking Face Generation, Customization, and Restoration [44.51237819287311]
  We introduce FaceQ, a large-scale, comprehensive database of AI-generated Face images with fine-grained Quality annotations reflecting human preferences. The FaceQ database comprises 12,255 images generated by 29 models across three tasks: (1) face generation, (2) face customization, and (3) face restoration. It includes 32,742 mean opinion scores (MOSs) from 180 annotators, assessed across multiple dimensions: quality, authenticity, identity (ID) fidelity, and text-image correspondence.
  arXiv  Detail & Related papers  (2024-12-17T18:28:48Z)
• Impact of Face Alignment on Face Image Quality [0.0]
  The impact of alignment on face image quality has not been thoroughly investigated. Our study examines the impact of face alignment on face image quality scores.
  arXiv  Detail & Related papers  (2024-12-16T13:49:57Z)
• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Robustness Disparities in Face Detection [64.71318433419636]
  We present the first of its kind detailed benchmark of face detection systems, specifically examining the robustness to noise of commercial and academic models. Across all the datasets and systems, we generally find that photos of individuals who are $textitmasculine presenting$, of $textitolder$, of $textitdarker skin type$, or have $textitdim lighting$ are more susceptible to errors than their counterparts in other identities.
  arXiv  Detail & Related papers  (2022-11-29T05:22:47Z)
• CIAO! A Contrastive Adaptation Mechanism for Non-Universal Facial Expression Recognition [80.07590100872548]
  We propose Contrastive Inhibitory Adaptati On (CIAO), a mechanism that adapts the last layer of facial encoders to depict specific affective characteristics on different datasets. CIAO presents an improvement in facial expression recognition performance over six different datasets with very unique affective representations.
  arXiv  Detail & Related papers  (2022-08-10T15:46:05Z)
• A Deep Insight into Measuring Face Image Utility with General and Face-specific Image Quality Metrics [5.770286315818393]
  General image quality metrics can be used on the global image and relate to human perceptions. Our results reveal a clear correlation between learned image metrics to face image utility even without being specifically trained as a face utility measure.
  arXiv  Detail & Related papers  (2021-10-21T12:56:38Z)
• Joint Face Image Restoration and Frontalization for Recognition [79.78729632975744]
  In real-world scenarios, many factors may harm face recognition performance, e.g., large pose, bad illumination,low resolution, blur and noise. Previous efforts usually first restore the low-quality faces to high-quality ones and then perform face recognition. We propose an Multi-Degradation Face Restoration model to restore frontalized high-quality faces from the given low-quality ones.
  arXiv  Detail & Related papers  (2021-05-12T03:52:41Z)
• Facial Expressions as a Vulnerability in Face Recognition [73.85525896663371]
  This work explores facial expression bias as a security vulnerability of face recognition systems. We present a comprehensive analysis of how facial expression bias impacts the performance of face recognition technologies.
  arXiv  Detail & Related papers  (2020-11-17T18:12:41Z)
• Face Quality Estimation and Its Correlation to Demographic and Non-Demographic Bias in Face Recognition [15.431761867166]
  Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. Currently, the high performance of these face recognition systems come with the cost of a strong bias against demographic and non-demographic sub-groups. Recent work has shown that face quality assessment algorithms should adapt to the deployed face recognition system, in order to achieve highly accurate and robust quality estimations.
  arXiv  Detail & Related papers  (2020-04-02T14:19:12Z)
• SER-FIQ: Unsupervised Estimation of Face Image Quality Based on Stochastic Embedding Robustness [15.431761867166]
  We propose a novel concept to measure face quality based on an arbitrary face recognition model. We compare our proposed solution on two face embeddings against six state-of-the-art approaches from academia and industry.
  arXiv  Detail & Related papers  (2020-03-20T16:50:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.