Prediction Sensitivity: Continual Audit of Counterfactual Fairness in Deployed Classifiers

• URL: http://arxiv.org/abs/2202.04504v1
• Date: Wed, 9 Feb 2022 15:06:45 GMT
• Title: Prediction Sensitivity: Continual Audit of Counterfactual Fairness in Deployed Classifiers
• Authors: Krystal Maughan, Ivoline C. Ngong, Joseph P. Near
• Abstract summary: Traditional group fairness metrics can miss discrimination against individuals and are difficult to apply after deployment. We present prediction sensitivity, an approach for continual audit of counterfactual fairness in deployed classifiers. Our empirical results demonstrate that prediction sensitivity is effective for detecting violations of counterfactual fairness.
• Score: 2.0625936401496237
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As AI-based systems increasingly impact many areas of our lives, auditing these systems for fairness is an increasingly high-stakes problem. Traditional group fairness metrics can miss discrimination against individuals and are difficult to apply after deployment. Counterfactual fairness describes an individualized notion of fairness but is even more challenging to evaluate after deployment. We present prediction sensitivity, an approach for continual audit of counterfactual fairness in deployed classifiers. Prediction sensitivity helps answer the question: would this prediction have been different, if this individual had belonged to a different demographic group -- for every prediction made by the deployed model. Prediction sensitivity can leverage correlations between protected status and other features and does not require protected status information at prediction time. Our empirical results demonstrate that prediction sensitivity is effective for detecting violations of counterfactual fairness.

Related papers

• Performative Prediction on Games and Mechanism Design [69.7933059664256]
  We study a collective risk dilemma where agents decide whether to trust predictions based on past accuracy. As predictions shape collective outcomes, social welfare arises naturally as a metric of concern. We show how to achieve better trade-offs and use them for mechanism design.
  arXiv  Detail & Related papers  (2024-08-09T16:03:44Z)
• Editable Fairness: Fine-Grained Bias Mitigation in Language Models [52.66450426729818]
  We propose a novel debiasing approach, Fairness Stamp (FAST), which enables fine-grained calibration of individual social biases. FAST surpasses state-of-the-art baselines with superior debiasing performance. This highlights the potential of fine-grained debiasing strategies to achieve fairness in large language models.
  arXiv  Detail & Related papers  (2024-08-07T17:14:58Z)
• Fairness-Accuracy Trade-Offs: A Causal Perspective [58.06306331390586]
  We analyze the tension between fairness and accuracy from a causal lens for the first time. We show that enforcing a causal constraint often reduces the disparity between demographic groups. We introduce a new neural approach for causally-constrained fair learning.
  arXiv  Detail & Related papers  (2024-05-24T11:19:52Z)
• Counterfactual Fairness for Predictions using Generative Adversarial Networks [28.65556399421874]
  We develop a novel deep neural network called Generative Counterfactual Fairness Network (GCFN) for making predictions under counterfactual fairness. Our method is mathematically guaranteed to ensure the notion of counterfactual fairness.
  arXiv  Detail & Related papers  (2023-10-26T17:58:39Z)
• Learning for Counterfactual Fairness from Observational Data [62.43249746968616]
  Fairness-aware machine learning aims to eliminate biases of learning models against certain subgroups described by certain protected (sensitive) attributes such as race, gender, and age. A prerequisite for existing methods to achieve counterfactual fairness is the prior human knowledge of the causal model for the data. In this work, we address the problem of counterfactually fair prediction from observational data without given causal models by proposing a novel framework CLAIRE.
  arXiv  Detail & Related papers  (2023-07-17T04:08:29Z)
• Towards Assumption-free Bias Mitigation [47.5131072745805]
  We propose an assumption-free framework to detect the related attributes automatically by modeling feature interaction for bias mitigation. Experimental results on four real-world datasets demonstrate that our proposed framework can significantly alleviate unfair prediction behaviors.
  arXiv  Detail & Related papers  (2023-07-09T05:55:25Z)
• Measuring Fairness of Text Classifiers via Prediction Sensitivity [63.56554964580627]
  ACCUMULATED PREDICTION SENSITIVITY measures fairness in machine learning models based on the model's prediction sensitivity to perturbations in input features. We show that the metric can be theoretically linked with a specific notion of group fairness (statistical parity) and individual fairness.
  arXiv  Detail & Related papers  (2022-03-16T15:00:33Z)
• Attainability and Optimality: The Equalized Odds Fairness Revisited [8.44348159032116]
  We consider the attainability of the Equalized Odds notion of fairness. For classification, we prove that compared to enforcing fairness by post-processing, one can always benefit from exploiting all available features. While performance prediction can attain Equalized Odds with theoretical guarantees, we also discuss its limitation and potential negative social impacts.
  arXiv  Detail & Related papers  (2022-02-24T01:30:31Z)
• Fair When Trained, Unfair When Deployed: Observable Fairness Measures are Unstable in Performative Prediction Settings [0.0]
  In performative prediction settings, predictors are precisely intended to induce distribution shift. In criminal justice, healthcare, and consumer finance, the purpose of building a predictor is to reduce the rate of adverse outcomes. We show how many of these issues can be avoided by using fairness definitions that depend on counterfactual rather than observable outcomes.
  arXiv  Detail & Related papers  (2022-02-10T14:09:02Z)
• Adversarial Learning for Counterfactual Fairness [15.302633901803526]
  In recent years, fairness has become an important topic in the machine learning research community. We propose to rely on an adversarial neural learning approach, that enables more powerful inference than with MMD penalties. Experiments show significant improvements in term of counterfactual fairness for both the discrete and the continuous settings.
  arXiv  Detail & Related papers  (2020-08-30T09:06:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.