Eye Sclera for Fair Face Image Quality Assessment

• URL: http://arxiv.org/abs/2501.07158v1
• Date: Mon, 13 Jan 2025 09:33:03 GMT
• Title: Eye Sclera for Fair Face Image Quality Assessment
• Authors: Wassim Kabbani, Kiran Raja, Raghavendra Ramachandra, Christoph Busch,
• Abstract summary: The sclera region is agnostic to demographic variations and skin colour for assessing the quality of a face image. Our analysis of the face dataset of individuals representing different skin tones indicates sclera as an alternative to measure dynamic range, over- and under-exposure of face.
• Score: 6.765680388573267
• License:
• Abstract: Fair operational systems are crucial in gaining and maintaining society's trust in face recognition systems (FRS). FRS start with capturing an image and assessing its quality before using it further for enrollment or verification. Fair Face Image Quality Assessment (FIQA) schemes therefore become equally important in the context of fair FRS. This work examines the sclera as a quality assessment region for obtaining a fair FIQA. The sclera region is agnostic to demographic variations and skin colour for assessing the quality of a face image. We analyze three skin tone related ISO/IEC face image quality assessment measures and assess the sclera region as an alternative area for assessing FIQ. Our analysis of the face dataset of individuals from different demographic groups representing different skin tones indicates sclera as an alternative to measure dynamic range, over- and under-exposure of face using sclera region alone. The sclera region being agnostic to skin tone, i.e., demographic factors, provides equal utility as a fair FIQA as shown by our Error-vs-Discard Characteristic (EDC) curve analysis.

Related papers

• Demographic Variability in Face Image Quality Measures [6.765680388573267]
  Face image quality assessment (FIQA) algorithms are being integrated into online identity management applications. Concerns about demographic bias have been raised about biometric systems.
  arXiv  Detail & Related papers  (2025-01-14T07:26:55Z)
• Impact of Face Alignment on Face Image Quality [0.0]
  The impact of alignment on face image quality has not been thoroughly investigated. Our study examines the impact of face alignment on face image quality scores.
  arXiv  Detail & Related papers  (2024-12-16T13:49:57Z)
• FairSkin: Fair Diffusion for Skin Disease Image Generation [54.29840149709033]
  Diffusion Model (DM) has become a leading method in generating synthetic medical images, but it suffers from a critical twofold bias. We propose FairSkin, a novel DM framework that mitigates these biases through a three-level resampling mechanism. Our approach significantly improves the diversity and quality of generated images, contributing to more equitable skin disease detection in clinical settings.
  arXiv  Detail & Related papers  (2024-10-29T21:37:03Z)
• Rank-based No-reference Quality Assessment for Face Swapping [88.53827937914038]
  The metric of measuring the quality in most face swapping methods relies on several distances between the manipulated images and the source image. We present a novel no-reference image quality assessment (NR-IQA) method specifically designed for face swapping.
  arXiv  Detail & Related papers  (2024-06-04T01:36:29Z)
• Dual-Branch Network for Portrait Image Quality Assessment [76.27716058987251]
  We introduce a dual-branch network for portrait image quality assessment (PIQA) We utilize two backbone networks (textiti.e., Swin Transformer-B) to extract the quality-aware features from the entire portrait image and the facial image cropped from it. We leverage LIQE, an image scene classification and quality assessment model, to capture the quality-aware and scene-specific features as the auxiliary features.
  arXiv  Detail & Related papers  (2024-05-14T12:43:43Z)
• Robust Sclera Segmentation for Skin-tone Agnostic Face Image Quality Assessment [5.339861501796723]
  Face image quality assessment (FIQA) is crucial for obtaining good face recognition performance. This work proposes a robust sclera segmentation method that is suitable for face images in the enrolment and the border control face recognition scenarios.
  arXiv  Detail & Related papers  (2023-12-22T22:49:11Z)
• Assessing Bias in Face Image Quality Assessment [0.0]
  Face image quality assessment (FIQA) attempts to improve face recognition (FR) performance by providing additional information about sample quality. It is reasonable to assume that these methods are heavily influenced by the underlying face recognition system. Although modern face recognition systems are known to perform well, several studies have found that such systems often exhibit problems with demographic bias.
  arXiv  Detail & Related papers  (2022-11-28T12:41:59Z)
• Textural-Structural Joint Learning for No-Reference Super-Resolution Image Quality Assessment [59.91741119995321]
  We develop a dual stream network to jointly explore the textural and structural information for quality prediction, dubbed TSNet. By mimicking the human vision system (HVS) that pays more attention to the significant areas of the image, we develop the spatial attention mechanism to make the visual-sensitive areas more distinguishable. Experimental results show the proposed TSNet predicts the visual quality more accurate than the state-of-the-art IQA methods, and demonstrates better consistency with the human's perspective.
  arXiv  Detail & Related papers  (2022-05-27T09:20:06Z)
• Automatic Facial Skin Feature Detection for Everyone [60.31670960526022]
  We present an automatic facial skin feature detection method that works across a variety of skin tones and age groups for selfies in the wild. To be specific, we annotate the locations of acne, pigmentation, and wrinkle for selfie images with different skin tone colors, severity levels, and lighting conditions.
  arXiv  Detail & Related papers  (2022-03-30T04:52:54Z)
• Malignancy Prediction and Lesion Identification from Clinical Dermatological Images [65.1629311281062]
  We consider machine-learning-based malignancy prediction and lesion identification from clinical dermatological images. We first identify all lesions present in the image regardless of sub-type or likelihood of malignancy, then it estimates their likelihood of malignancy, and through aggregation, it also generates an image-level likelihood of malignancy.
  arXiv  Detail & Related papers  (2021-04-02T20:52:05Z)
• Face Quality Estimation and Its Correlation to Demographic and Non-Demographic Bias in Face Recognition [15.431761867166]
  Face quality assessment aims at estimating the utility of a face image for the purpose of recognition. Currently, the high performance of these face recognition systems come with the cost of a strong bias against demographic and non-demographic sub-groups. Recent work has shown that face quality assessment algorithms should adapt to the deployed face recognition system, in order to achieve highly accurate and robust quality estimations.
  arXiv  Detail & Related papers  (2020-04-02T14:19:12Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.