AI Fairness Beyond Complete Demographics: Current Achievements and Future Directions

• URL: http://arxiv.org/abs/2511.13525v1
• Date: Mon, 17 Nov 2025 15:59:25 GMT
• Title: AI Fairness Beyond Complete Demographics: Current Achievements and Future Directions
• Authors: Zichong Wang, Zhipeng Yin, Roland H. C. Yap, Wenbin Zhang,
• Abstract summary: This survey examines fairness in AI when demographics are incomplete, addressing the gap between traditional approaches and real-world challenges.<n>We introduce a novel taxonomy of fairness notions in this setting, clarifying their relationships and distinctions.
• Score: 12.299304184943237
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Fairness in artificial intelligence (AI) has become a growing concern due to discriminatory outcomes in AI-based decision-making systems. While various methods have been proposed to mitigate bias, most rely on complete demographic information, an assumption often impractical due to legal constraints and the risk of reinforcing discrimination. This survey examines fairness in AI when demographics are incomplete, addressing the gap between traditional approaches and real-world challenges. We introduce a novel taxonomy of fairness notions in this setting, clarifying their relationships and distinctions. Additionally, we summarize existing techniques that promote fairness beyond complete demographics and highlight open research questions to encourage further progress in the field.

Related papers

• Partial Identification Approach to Counterfactual Fairness Assessment [50.88100567472179]
  We introduce a Bayesian approach to bound unknown counterfactual fairness measures with high confidence.<n>Our results reveal a positive (spurious) effect on the COMPAS score when changing race to African-American (from all others) and a negative (direct causal) effect when transitioning from young to old age.
  arXiv  Detail & Related papers  (2025-09-30T18:35:08Z)
• FairAIED: Navigating Fairness, Bias, and Ethics in Educational AI Applications [8.443431821420537]
  The integration of AI in education holds immense potential for personalizing learning experiences and transforming instructional practices.<n>As researchers have sought to understand and mitigate these biases, a growing body of work has emerged examining fairness in educational AI.<n>This survey provides a comprehensive systematic review of algorithmic fairness within educational AI.
  arXiv  Detail & Related papers  (2024-07-26T13:59:20Z)
• (Unfair) Norms in Fairness Research: A Meta-Analysis [6.395584220342517]
  We conduct a meta-analysis of algorithmic fairness papers from two leading conferences on AI fairness and ethics. Our investigation reveals two concerning trends: first, a US-centric perspective dominates throughout fairness research. Second, fairness studies exhibit a widespread reliance on binary codifications of human identity.
  arXiv  Detail & Related papers  (2024-06-17T17:14:47Z)
• Algorithmic Fairness: A Tolerance Perspective [31.882207568746168]
  This survey delves into the existing literature on algorithmic fairness, specifically highlighting its multifaceted social consequences. We introduce a novel taxonomy based on 'tolerance', a term we define as the degree to which variations in fairness outcomes are acceptable. Our systematic review covers diverse industries, revealing critical insights into the balance between algorithmic decision making and social equity.
  arXiv  Detail & Related papers  (2024-04-26T08:16:54Z)
• A Survey on Intersectional Fairness in Machine Learning: Notions, Mitigation, and Challenges [11.885166133818819]
  Adoption of Machine Learning systems has led to increased concerns about fairness implications. We present a taxonomy for intersectional notions of fairness and mitigation. We identify the key challenges and provide researchers with guidelines for future directions.
  arXiv  Detail & Related papers  (2023-05-11T16:49:22Z)
• Fairness in AI and Its Long-Term Implications on Society [68.8204255655161]
  We take a closer look at AI fairness and analyze how lack of AI fairness can lead to deepening of biases over time. We discuss how biased models can lead to more negative real-world outcomes for certain groups. If the issues persist, they could be reinforced by interactions with other risks and have severe implications on society in the form of social unrest.
  arXiv  Detail & Related papers  (2023-04-16T11:22:59Z)
• Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategies [11.323961700172175]
  This survey paper offers a succinct, comprehensive overview of fairness and bias in AI. We review sources of bias, such as data, algorithm, and human decision biases. We assess the societal impact of biased AI systems, focusing on the perpetuation of inequalities and the reinforcement of harmful stereotypes.
  arXiv  Detail & Related papers  (2023-04-16T03:23:55Z)
• Human-Centric Multimodal Machine Learning: Recent Advances and Testbed on AI-based Recruitment [66.91538273487379]
  There is a certain consensus about the need to develop AI applications with a Human-Centric approach. Human-Centric Machine Learning needs to be developed based on four main requirements: (i) utility and social good; (ii) privacy and data ownership; (iii) transparency and accountability; and (iv) fairness in AI-driven decision-making processes. We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data.
  arXiv  Detail & Related papers  (2023-02-13T16:44:44Z)
• Fair Decision-making Under Uncertainty [1.5688552250473473]
  We study a longitudinal censored learning problem subject to fairness constraints. We show how the newly devised fairness notions involving censored information and the general framework for fair predictions in the presence of censorship allow us to measure and discrimination under uncertainty.
  arXiv  Detail & Related papers  (2023-01-29T05:42:39Z)
• Causal Fairness Analysis [68.12191782657437]
  We introduce a framework for understanding, modeling, and possibly solving issues of fairness in decision-making settings. The main insight of our approach will be to link the quantification of the disparities present on the observed data with the underlying, and often unobserved, collection of causal mechanisms. Our effort culminates in the Fairness Map, which is the first systematic attempt to organize and explain the relationship between different criteria found in the literature.
  arXiv  Detail & Related papers  (2022-07-23T01:06:34Z)
• Fairness in Agreement With European Values: An Interdisciplinary Perspective on AI Regulation [61.77881142275982]
  This interdisciplinary position paper considers various concerns surrounding fairness and discrimination in AI, and discusses how AI regulations address them. We first look at AI and fairness through the lenses of law, (AI) industry, sociotechnology, and (moral) philosophy, and present various perspectives. We identify and propose the roles AI Regulation should take to make the endeavor of the AI Act a success in terms of AI fairness concerns.
  arXiv  Detail & Related papers  (2022-06-08T12:32:08Z)
• Bias and Discrimination in AI: a cross-disciplinary perspective [5.190307793476366]
  We show that finding solutions to bias and discrimination in AI requires robust cross-disciplinary collaborations. We survey relevant literature about bias and discrimination in AI from an interdisciplinary perspective that embeds technical, legal, social and ethical dimensions.
  arXiv  Detail & Related papers  (2020-08-11T10:02:04Z)
• Bias in Multimodal AI: Testbed for Fair Automatic Recruitment [73.85525896663371]
  We study how current multimodal algorithms based on heterogeneous sources of information are affected by sensitive elements and inner biases in the data. We train automatic recruitment algorithms using a set of multimodal synthetic profiles consciously scored with gender and racial biases. Our methodology and results show how to generate fairer AI-based tools in general, and in particular fairer automated recruitment systems.
  arXiv  Detail & Related papers  (2020-04-15T15:58:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.