Locating disparities in machine learning
- URL: http://arxiv.org/abs/2208.06680v3
- Date: Mon, 4 Sep 2023 13:57:17 GMT
- Title: Locating disparities in machine learning
- Authors: Moritz von Zahn, Oliver Hinz, Stefan Feuerriegel
- Abstract summary: We propose a data-driven framework called Automatic Location of Disparities (ALD)
ALD aims at locating disparities in machine learning algorithms.
We demonstrate the effectiveness of ALD based on both synthetic and real-world datasets.
- Score: 24.519488484614953
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Machine learning can provide predictions with disparate outcomes, in which
subgroups of the population (e.g., defined by age, gender, or other sensitive
attributes) are systematically disadvantaged. In order to comply with upcoming
legislation, practitioners need to locate such disparate outcomes. However,
previous literature typically detects disparities through statistical
procedures for when the sensitive attribute is specified a priori. This limits
applicability in real-world settings where datasets are high dimensional and,
on top of that, sensitive attributes may be unknown. As a remedy, we propose a
data-driven framework called Automatic Location of Disparities (ALD) which aims
at locating disparities in machine learning. ALD meets several demands from
industry: ALD (1) is applicable to arbitrary machine learning classifiers; (2)
operates on different definitions of disparities (e.g., statistical parity or
equalized odds); and (3) deals with both categorical and continuous predictors
even if disparities arise from complex and multi-way interactions known as
intersectionality (e. g., age above 60 and female). ALD produces interpretable
audit reports as output. We demonstrate the effectiveness of ALD based on both
synthetic and real-world datasets. As a result, we empower practitioners to
effectively locate and mitigate disparities in machine learning algorithms,
conduct algorithmic audits, and protect individuals from discrimination.
Related papers
- Human-Centric Multimodal Machine Learning: Recent Advances and Testbed
on AI-based Recruitment [66.91538273487379]
There is a certain consensus about the need to develop AI applications with a Human-Centric approach.
Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes.
We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
arXiv Detail & Related papers (2023-02-13T16:44:44Z) - D-BIAS: A Causality-Based Human-in-the-Loop System for Tackling
Algorithmic Bias [57.87117733071416]
We propose D-BIAS, a visual interactive tool that embodies human-in-the-loop AI approach for auditing and mitigating social biases.
A user can detect the presence of bias against a group by identifying unfair causal relationships in the causal network.
For each interaction, say weakening/deleting a biased causal edge, the system uses a novel method to simulate a new (debiased) dataset.
arXiv Detail & Related papers (2022-08-10T03:41:48Z) - Understanding Unfairness in Fraud Detection through Model and Data Bias
Interactions [4.159343412286401]
We argue that algorithmic unfairness stems from interactions between models and biases in the data.
We study a set of hypotheses regarding the fairness-accuracy trade-offs that fairness-blind ML algorithms exhibit under different data bias settings.
arXiv Detail & Related papers (2022-07-13T15:18:30Z) - Statistical discrimination in learning agents [64.78141757063142]
Statistical discrimination emerges in agent policies as a function of both the bias in the training population and of agent architecture.
We show that less discrimination emerges with agents that use recurrent neural networks, and when their training environment has less bias.
arXiv Detail & Related papers (2021-10-21T18:28:57Z) - MultiFair: Multi-Group Fairness in Machine Learning [52.24956510371455]
We study multi-group fairness in machine learning (MultiFair)
We propose a generic end-to-end algorithmic framework to solve it.
Our proposed framework is generalizable to many different settings.
arXiv Detail & Related papers (2021-05-24T02:30:22Z) - Can Active Learning Preemptively Mitigate Fairness Issues? [66.84854430781097]
dataset bias is one of the prevailing causes of unfairness in machine learning.
We study whether models trained with uncertainty-based ALs are fairer in their decisions with respect to a protected class.
We also explore the interaction of algorithmic fairness methods such as gradient reversal (GRAD) and BALD.
arXiv Detail & Related papers (2021-04-14T14:20:22Z) - Domain-Incremental Continual Learning for Mitigating Bias in Facial
Expression and Action Unit Recognition [5.478764356647437]
We propose the novel usage of Continual Learning (CL) as a potent bias mitigation method to enhance the fairness of FER systems.
We compare different non-CL-based and CL-based methods for their classification accuracy and fairness scores on expression recognition and Action Unit (AU) detection tasks.
Our experimental results show that CL-based methods, on average, outperform other popular bias mitigation techniques on both accuracy and fairness metrics.
arXiv Detail & Related papers (2021-03-15T18:22:17Z) - Coping with Mistreatment in Fair Algorithms [1.2183405753834557]
We study the algorithmic fairness in a supervised learning setting and examine the effect of optimizing a classifier for the Equal Opportunity metric.
We propose a conceptually simple method to mitigate this bias.
We rigorously analyze the proposed method and evaluate it on several real world datasets demonstrating its efficacy.
arXiv Detail & Related papers (2021-02-22T03:26:06Z) - Bias in Multimodal AI: Testbed for Fair Automatic Recruitment [73.85525896663371]
We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
We train automatic recruitment algorithms using a set of multimodal synthetic profiles consciously scored with gender and racial biases.
Our methodology and results show how to generate fairer AI-based tools in general, and in particular fairer automated recruitment systems.
arXiv Detail & Related papers (2020-04-15T15:58:05Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.