FairBED: A Bayesian Experimental Design Approach to Gathering Fairer Data

• URL: http://arxiv.org/abs/2606.23515v1
• Date: Mon, 22 Jun 2026 16:02:08 GMT
• Title: FairBED: A Bayesian Experimental Design Approach to Gathering Fairer Data
• Abstract summary: We introduce FairBED, which provides novel formulations for quantifying the fairness of datasets themselves.<n>We then use this to construct practical fairness-aware Bayesian experimental design (BED) objectives.<n>We show empirically that models trained on data gathered using FairBED provide improved fairness-accuracy trade-offs.
• Score: 11.172982841654047
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Frameworks for ensuring fairness in machine learning typically focus on learning fair models from existing data. But this endeavor is often undermined by biases already present in that data. We therefore look to modify the data acquisition process itself to help gather fairer data that is inherently more suitable for training fair predictors. To this end, we introduce FairBED, which provides novel formulations for quantifying the fairness of datasets themselves based on the idea that fair datasets should be uninformative about sensitive attributes. We then use this to construct practical fairness-aware Bayesian experimental design (BED) objectives that maximize expected information gain about the target quantity of interest while minimizing expected information gain about sensitive attributes. We further derive a theoretical link between FairBED and demographic parity, and show empirically that models trained on data gathered using FairBED provide improved fairness-accuracy trade-offs compared to randomly acquired data and conventional BED.

Related papers

• Incentivizing Truthfulness and Collaborative Fairness in Bayesian Learning [68.76184067877499]
  Collaborative machine learning involves training high-quality models using datasets from a number of sources.<n>To incentivize sources to share data, existing data valuation methods fairly reward each source based on its data submitted as is.<n>This paper presents the first mechanism that ensures (F) collaborative fairness and incentivizes (T) truthfulness at equilibrium for Bayesian models.
  arXiv  Detail & Related papers  (2026-05-12T10:02:23Z)
• Targeted Learning for Data Fairness [52.59573714151884]
  We expand fairness inference by evaluating fairness in the data generating process itself.<n>We derive estimators demographic parity, equal opportunity, and conditional mutual information.<n>To validate our approach, we perform several simulations and apply our estimators to real data.
  arXiv  Detail & Related papers  (2025-02-06T18:51:28Z)
• Data Acquisition for Improving Model Fairness using Reinforcement Learning [3.3916160303055563]
  We focus on the task of acquiring additional labeled data points for training the downstream machine learning model to rapidly improve its fairness.<n>We present DataSift, a data acquisition framework based on the idea of data valuation that relies on partitioning and multi-armed bandits to determine the most valuable data points to acquire.<n>We empirically evaluate DataSift on several real-world and synthetic datasets and show that the fairness of a machine learning model can be significantly improved even while acquiring a few data points.
  arXiv  Detail & Related papers  (2024-12-04T03:56:54Z)
• FADE: Towards Fairness-aware Generation for Domain Generalization via Classifier-Guided Score-based Diffusion Models [14.962882545521675]
  Fairness-aware domain generalization (FairDG) has emerged as a critical challenge for deploying trustworthy AI systems.<n>Traditional methods for addressing fairness have failed in domain generalization due to their lack of consideration for distribution shifts.<n>We propose Fairness-aware Score-Guided Diffusion Models (FADE) as a novel approach to effectively address the FairDG issue.
  arXiv  Detail & Related papers  (2024-06-13T17:36:05Z)
• Intriguing Properties of Data Attribution on Diffusion Models [33.77847454043439]
  Data attribution seeks to trace desired outputs back to training data. Data attribution has become a module to properly assign for high-intuitive or copyrighted data.
  arXiv  Detail & Related papers  (2023-11-01T13:00:46Z)
• Learning for Counterfactual Fairness from Observational Data [62.43249746968616]
  Fairness-aware machine learning aims to eliminate biases of learning models against certain subgroups described by certain protected (sensitive) attributes such as race, gender, and age. A prerequisite for existing methods to achieve counterfactual fairness is the prior human knowledge of the causal model for the data. In this work, we address the problem of counterfactually fair prediction from observational data without given causal models by proposing a novel framework CLAIRE.
  arXiv  Detail & Related papers  (2023-07-17T04:08:29Z)
• Fair-CDA: Continuous and Directional Augmentation for Group Fairness [48.84385689186208]
  We propose a fine-grained data augmentation strategy for imposing fairness constraints. We show that group fairness can be achieved by regularizing the models on transition paths of sensitive features between groups. Our proposed method does not assume any data generative model and ensures good generalization for both accuracy and fairness.
  arXiv  Detail & Related papers  (2023-04-01T11:23:00Z)
• Chasing Fairness Under Distribution Shift: A Model Weight Perturbation Approach [72.19525160912943]
  We first theoretically demonstrate the inherent connection between distribution shift, data perturbation, and model weight perturbation. We then analyze the sufficient conditions to guarantee fairness for the target dataset. Motivated by these sufficient conditions, we propose robust fairness regularization (RFR)
  arXiv  Detail & Related papers  (2023-03-06T17:19:23Z)
• Improving Recommendation Fairness via Data Augmentation [66.4071365614835]
  Collaborative filtering based recommendation learns users' preferences from all users' historical behavior data, and has been popular to facilitate decision making. A recommender system is considered unfair when it does not perform equally well for different user groups according to users' sensitive attributes. In this paper, we study how to improve recommendation fairness from the data augmentation perspective.
  arXiv  Detail & Related papers  (2023-02-13T13:11:46Z)
• On Comparing Fair Classifiers under Data Bias [42.43344286660331]
  We study the effect of varying data biases on the accuracy and fairness of fair classifiers. Our experiments show how to integrate a measure of data bias risk in the existing fairness dashboards for real-world deployments.
  arXiv  Detail & Related papers  (2023-02-12T13:04:46Z)
• Fairness Reprogramming [42.65700878967251]
  We propose a new generic fairness learning paradigm, called FairReprogram, which incorporates the model reprogramming technique. Specifically, FairReprogram considers the case where models can not be changed and appends to the input a set of perturbations, called the fairness trigger. We show both theoretically and empirically that the fairness trigger can effectively obscure demographic biases in the output prediction of fixed ML models.
  arXiv  Detail & Related papers  (2022-09-21T09:37:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.