Fairness in Biometrics: a figure of merit to assess biometric verification systems

• URL: http://arxiv.org/abs/2011.02395v2
• Date: Tue, 30 Mar 2021 07:23:41 GMT
• Title: Fairness in Biometrics: a figure of merit to assess biometric verification systems
• Authors: Tiago de Freitas Pereira and S\'ebastien Marcel
• Abstract summary: We introduce the first figure of merit that is able to evaluate and compare fairness aspects between multiple biometric verification systems. A use case with two synthetic biometric systems is introduced and demonstrates the potential of this figure of merit. Second, a use case using face biometrics is presented where several systems are evaluated compared with this new figure of merit.
• Score: 1.218340575383456
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Machine learning-based (ML) systems are being largely deployed since the last decade in a myriad of scenarios impacting several instances in our daily lives. With this vast sort of applications, aspects of fairness start to rise in the spotlight due to the social impact that this can get in minorities. In this work aspects of fairness in biometrics are addressed. First, we introduce the first figure of merit that is able to evaluate and compare fairness aspects between multiple biometric verification systems, the so-called Fairness Discrepancy Rate (FDR). A use case with two synthetic biometric systems is introduced and demonstrates the potential of this figure of merit in extreme cases of fair and unfair behavior. Second, a use case using face biometrics is presented where several systems are evaluated compared with this new figure of merit using three public datasets exploring gender and race demographics.

Related papers

• Comprehensive Equity Index (CEI): Definition and Application to Bias Evaluation in Biometrics [47.762333925222926]
  We present a novel metric to quantify biased behaviors of machine learning models. We focus on and apply it to the operational evaluation of face recognition systems.
  arXiv  Detail & Related papers  (2024-09-03T14:19:38Z)
• Fairness Index Measures to Evaluate Bias in Biometric Recognition [0.0]
  A quantitative evaluation of demographic fairness is an important step towards understanding, assessment, and mitigation of demographic bias in biometric applications. We introduce multiple measures, based on the statistical characteristics of score distributions, for the evaluation of demographic fairness of a generic biometric verification system.
  arXiv  Detail & Related papers  (2023-06-19T13:28:37Z)
• Facial Soft Biometrics for Recognition in the Wild: Recent Works, Annotation, and COTS Evaluation [63.05890836038913]
  We study the role of soft biometrics to enhance person recognition systems in unconstrained scenarios. We consider two assumptions: 1) manual estimation of soft biometrics and 2) automatic estimation from two commercial off-the-shelf systems. Experiments are carried out fusing soft biometrics with two state-of-the-art face recognition systems based on deep learning.
  arXiv  Detail & Related papers  (2022-10-24T11:29:57Z)
• Fair Machine Learning in Healthcare: A Review [90.22219142430146]
  We analyze the intersection of fairness in machine learning and healthcare disparities. We provide a critical review of the associated fairness metrics from a machine learning standpoint. We propose several new research directions that hold promise for developing ethical and equitable ML applications in healthcare.
  arXiv  Detail & Related papers  (2022-06-29T04:32:10Z)
• Evaluating Proposed Fairness Models for Face Recognition Algorithms [0.0]
  This paper characterizes two proposed measures of face recognition algorithm fairness (fairness measures) from scientists in the U.S. and Europe. We propose a set of interpretability criteria, termed the Functional Fairness Measure Criteria (FFMC), that outlines a set of properties desirable in a face recognition algorithm fairness measure. We believe this is currently the largest open-source dataset of its kind.
  arXiv  Detail & Related papers  (2022-03-09T21:16:43Z)
• There is an elephant in the room: Towards a critique on the use of fairness in biometrics [0.0]
  We offer a critical reading of recent debates about biometric fairness. We show that biometric fairness criteria are mathematically mutually exclusive. We discuss the politics of fairness in biometrics by situating the debate at the border.
  arXiv  Detail & Related papers  (2021-12-16T10:32:41Z)
• Anatomizing Bias in Facial Analysis [86.79402670904338]
  Existing facial analysis systems have been shown to yield biased results against certain demographic subgroups. It has become imperative to ensure that these systems do not discriminate based on gender, identity, or skin tone of individuals. This has led to research in the identification and mitigation of bias in AI systems.
  arXiv  Detail & Related papers  (2021-12-13T09:51:13Z)
• Benchmarking Quality-Dependent and Cost-Sensitive Score-Level Multimodal Biometric Fusion Algorithms [58.156733807470395]
  This paper reports a benchmarking study carried out within the framework of the BioSecure DS2 (Access Control) evaluation campaign. The campaign targeted the application of physical access control in a medium-size establishment with some 500 persons. To the best of our knowledge, this is the first attempt to benchmark quality-based multimodal fusion algorithms.
  arXiv  Detail & Related papers  (2021-11-17T13:39:48Z)
• Biometrics: Trust, but Verify [49.9641823975828]
  Biometric recognition has exploded into a plethora of different applications around the globe. There are a number of outstanding problems and concerns pertaining to the various sub-modules of biometric recognition systems.
  arXiv  Detail & Related papers  (2021-05-14T03:07:25Z)
• Demographic Bias in Biometrics: A Survey on an Emerging Challenge [0.0]
  Biometric systems rely on the uniqueness of certain biological or forensics characteristics of human beings. There has been a wave of public and academic concerns regarding the existence of systemic bias in automated decision systems.
  arXiv  Detail & Related papers  (2020-03-05T09:07:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.