FairJob: A Real-World Dataset for Fairness in Online Systems

• URL: http://arxiv.org/abs/2407.03059v2
• Date: Fri, 01 Nov 2024 06:45:23 GMT
• Title: FairJob: A Real-World Dataset for Fairness in Online Systems
• Authors: Mariia Vladimirova, Federico Pavone, Eustache Diemert,
• Abstract summary: We introduce a fairness-aware dataset for job recommendations in advertising. It was collected and prepared to comply with privacy standards and business confidentiality. Despite being anonymized and including a proxy for a sensitive attribute, our dataset preserves predictive power.
• Score: 2.3622884172290255
• License:
• Abstract: We introduce a fairness-aware dataset for job recommendations in advertising, designed to foster research in algorithmic fairness within real-world scenarios. It was collected and prepared to comply with privacy standards and business confidentiality. An additional challenge is the lack of access to protected user attributes such as gender, for which we propose a solution to obtain a proxy estimate. Despite being anonymized and including a proxy for a sensitive attribute, our dataset preserves predictive power and maintains a realistic and challenging benchmark. This dataset addresses a significant gap in the availability of fairness-focused resources for high-impact domains like advertising -- the actual impact being having access or not to precious employment opportunities, where balancing fairness and utility is a common industrial challenge. We also explore various stages in the advertising process where unfairness can occur and introduce a method to compute a fair utility metric for the job recommendations in online systems case from a biased dataset. Experimental evaluations of bias mitigation techniques on the released dataset demonstrate potential improvements in fairness and the associated trade-offs with utility. The dataset is hosted at https://huggingface.co/datasets/criteo/FairJob. Source code for the experiments is hosted at https://github.com/criteo-research/FairJob-dataset/.

Related papers

• Thinking Racial Bias in Fair Forgery Detection: Models, Datasets and Evaluations [63.52709761339949]
  We first contribute a dedicated dataset called the Fair Forgery Detection (FairFD) dataset, where we prove the racial bias of public state-of-the-art (SOTA) methods. We design novel metrics including Approach Averaged Metric and Utility Regularized Metric, which can avoid deceptive results. We also present an effective and robust post-processing technique, Bias Pruning with Fair Activations (BPFA), which improves fairness without requiring retraining or weight updates.
  arXiv  Detail & Related papers  (2024-07-19T14:53:18Z)
• Toward Fairer Face Recognition Datasets [69.04239222633795]
  Face recognition and verification are computer vision tasks whose performance has progressed with the introduction of deep representations. Ethical, legal, and technical challenges due to the sensitive character of face data and biases in real training datasets hinder their development. We promote fairness by introducing a demographic attributes balancing mechanism in generated training datasets.
  arXiv  Detail & Related papers  (2024-06-24T12:33:21Z)
• AIM: Attributing, Interpreting, Mitigating Data Unfairness [40.351282126410545]
  Existing fair machine learning (FairML) research has predominantly focused on mitigating discriminative bias in the model prediction. We investigate a novel research problem: discovering samples that reflect biases/prejudices from the training data. We propose practical algorithms for measuring and countering sample bias.
  arXiv  Detail & Related papers  (2024-06-13T05:21:10Z)
• Lazy Data Practices Harm Fairness Research [49.02318458244464]
  We present a comprehensive analysis of fair ML datasets, demonstrating how unreflective practices hinder the reach and reliability of algorithmic fairness findings. Our analyses identify three main areas of concern: (1) a textbflack of representation for certain protected attributes in both data and evaluations; (2) the widespread textbf of minorities during data preprocessing; and (3) textbfopaque data processing threatening the generalization of fairness research. This study underscores the need for a critical reevaluation of data practices in fair ML and offers directions to improve both the sourcing and usage of datasets.
  arXiv  Detail & Related papers  (2024-04-26T09:51:24Z)
• Learning for Counterfactual Fairness from Observational Data [62.43249746968616]
  Fairness-aware machine learning aims to eliminate biases of learning models against certain subgroups described by certain protected (sensitive) attributes such as race, gender, and age. A prerequisite for existing methods to achieve counterfactual fairness is the prior human knowledge of the causal model for the data. In this work, we address the problem of counterfactually fair prediction from observational data without given causal models by proposing a novel framework CLAIRE.
  arXiv  Detail & Related papers  (2023-07-17T04:08:29Z)
• Fair Spatial Indexing: A paradigm for Group Spatial Fairness [6.640563753223598]
  We propose techniques to mitigate location bias in machine learning. We focus on spatial group fairness and we propose a spatial indexing algorithm that accounts for fairness.
  arXiv  Detail & Related papers  (2023-02-05T05:15:11Z)
• When Fairness Meets Privacy: Fair Classification with Semi-Private Sensitive Attributes [18.221858247218726]
  We study a novel and practical problem of fair classification in a semi-private setting. Most of the sensitive attributes are private and only a small amount of clean ones are available. We propose a novel framework FairSP that can achieve Fair prediction under the Semi-Private setting.
  arXiv  Detail & Related papers  (2022-07-18T01:10:25Z)
• Models and Mechanisms for Fairness in Location Data Processing [6.640563753223598]
  Location data use has become pervasive in the last decade due to the advent of mobile apps, as well as novel areas such as smart health, smart cities, etc. At the same time, significant concerns have surfaced with respect to fairness in data processing. In this paper, we adapt existing fairness models to suit the specific properties of location data and spatial processing.
  arXiv  Detail & Related papers  (2022-04-04T22:57:16Z)
• Representative & Fair Synthetic Data [68.8204255655161]
  We present a framework to incorporate fairness constraints into the self-supervised learning process. We generate a representative as well as fair version of the UCI Adult census data set. We consider representative & fair synthetic data a promising future building block to teach algorithms not on historic worlds, but rather on the worlds that we strive to live in.
  arXiv  Detail & Related papers  (2021-04-07T09:19:46Z)
• Causal Feature Selection for Algorithmic Fairness [61.767399505764736]
  We consider fairness in the integration component of data management. We propose an approach to identify a sub-collection of features that ensure the fairness of the dataset.
  arXiv  Detail & Related papers  (2020-06-10T20:20:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.