Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness

• URL: http://arxiv.org/abs/2304.09779v3
• Date: Fri, 19 Apr 2024 04:24:55 GMT
• Title: Equalised Odds is not Equal Individual Odds: Post-processing for Group and Individual Fairness
• Authors: Edward A. Small, Kacper Sokol, Daniel Manning, Flora D. Salim, Jeffrey Chan,
• Abstract summary: Group fairness is achieved by equalising prediction distributions between protected sub-populations. individual fairness requires treating similar individuals alike. This procedure may provide two similar individuals from the same protected group with classification odds that are disparately different.
• Score: 13.894631477590362
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Group fairness is achieved by equalising prediction distributions between protected sub-populations; individual fairness requires treating similar individuals alike. These two objectives, however, are incompatible when a scoring model is calibrated through discontinuous probability functions, where individuals can be randomly assigned an outcome determined by a fixed probability. This procedure may provide two similar individuals from the same protected group with classification odds that are disparately different -- a clear violation of individual fairness. Assigning unique odds to each protected sub-population may also prevent members of one sub-population from ever receiving equal chances of a positive outcome to another, which we argue is another type of unfairness called individual odds. We reconcile all this by constructing continuous probability functions between group thresholds that are constrained by their Lipschitz constant. Our solution preserves the model's predictive power, individual fairness and robustness while ensuring group fairness.

Related papers

• Equal Opportunity of Coverage in Fair Regression [50.76908018786335]
  We study fair machine learning (ML) under predictive uncertainty to enable reliable and trustworthy decision-making. We propose Equal Opportunity of Coverage (EOC) that aims to achieve two properties: (1) coverage rates for different groups with similar outcomes are close, and (2) the coverage rate for the entire population remains at a predetermined level.
  arXiv  Detail & Related papers  (2023-11-03T21:19:59Z)
• Auditing Predictive Models for Intersectional Biases [1.9346186297861747]
  Conditional Bias Scan (CBS) is a flexible auditing framework for detecting intersectional biases in classification models. CBS identifies the subgroup for which there is the most significant bias against the protected class, as compared to the equivalent subgroup in the non-protected class. We show that this methodology can detect previously unidentified intersectional and contextual biases in the COMPAS pre-trial risk assessment tool.
  arXiv  Detail & Related papers  (2023-06-22T17:32:12Z)
• DualFair: Fair Representation Learning at Both Group and Individual Levels via Contrastive Self-supervision [73.80009454050858]
  This work presents a self-supervised model, called DualFair, that can debias sensitive attributes like gender and race from learned representations. Our model jointly optimize for two fairness criteria - group fairness and counterfactual fairness.
  arXiv  Detail & Related papers  (2023-03-15T07:13:54Z)
• Reconciling Individual Probability Forecasts [78.0074061846588]
  We show that two parties who agree on the data cannot disagree on how to model individual probabilities. We conclude that although individual probabilities are unknowable, they are contestable via a computationally and data efficient process.
  arXiv  Detail & Related papers  (2022-09-04T20:20:35Z)
• Fair Bayes-Optimal Classifiers Under Predictive Parity [33.648053823193855]
  This paper considers predictive parity, which requires equalizing the probability of success given a positive prediction among different protected groups. We propose an algorithm we call FairBayes-DPP, aiming to ensure predictive parity when our condition is satisfied.
  arXiv  Detail & Related papers  (2022-05-15T04:58:10Z)
• Gerrymandering Individual Fairness [0.0]
  Individual fairness is a fairness measure that is supposed to prevent the unfair treatment of individuals on the subgroup level. The goal of the present paper is to explore the extent to which it is possible to gerrymander individual fairness itself.
  arXiv  Detail & Related papers  (2022-04-25T12:44:57Z)
• Group Fairness Is Not Derivable From Justice: a Mathematical Proof [0.0]
  'Group fairness' involves ensuring the same chances of acquittal or convictions to all innocent defendants independently of their morally arbitrary features. We show mathematically that only a perfect procedure (involving no mistake), a non-deterministic one, or a degenerate one can guarantee group fairness.
  arXiv  Detail & Related papers  (2022-02-08T14:10:47Z)
• Selective Classification Can Magnify Disparities Across Groups [89.14499988774985]
  We find that while selective classification can improve average accuracies, it can simultaneously magnify existing accuracy disparities. Increasing abstentions can even decrease accuracies on some groups. We train distributionally-robust models that achieve similar full-coverage accuracies across groups and show that selective classification uniformly improves each group.
  arXiv  Detail & Related papers  (2020-10-27T08:51:30Z)
• Distributional Individual Fairness in Clustering [7.303841123034983]
  We introduce a framework for assigning individuals, embedded in a metric space, to probability distributions over a bounded number of cluster centers. We provide an algorithm for clustering with $p$-norm objective and individual fairness constraints with provable approximation guarantee.
  arXiv  Detail & Related papers  (2020-06-22T20:02:09Z)
• Individual Calibration with Randomized Forecasting [116.2086707626651]
  We show that calibration for individual samples is possible in the regression setup if the predictions are randomized. We design a training objective to enforce individual calibration and use it to train randomized regression functions.
  arXiv  Detail & Related papers  (2020-06-18T05:53:10Z)
• Survival Cluster Analysis [93.50540270973927]
  There is an unmet need in survival analysis for identifying subpopulations with distinct risk profiles. An approach that addresses this need is likely to improve characterization of individual outcomes.
  arXiv  Detail & Related papers  (2020-02-29T22:41:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.