Representativeness in Statistics, Politics, and Machine Learning

• URL: http://arxiv.org/abs/2101.03827v3
• Date: Wed, 10 Feb 2021 14:20:15 GMT
• Title: Representativeness in Statistics, Politics, and Machine Learning
• Abstract summary: Representativeness is a foundational yet slippery concept. We ask what representativeness means, how it is mobilized socially, and what values and ideals it communicates or confronts. We draw on these analyses to think through how representativeness is used in FAccT debates.
• Score: 0.720851507101878
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Representativeness is a foundational yet slippery concept. Though familiar at first blush, it lacks a single precise meaning. Instead, meanings range from typical or characteristic, to a proportionate match between sample and population, to a more general sense of accuracy, generalizability, coverage, or inclusiveness. Moreover, the concept has long been contested. In statistics, debates about the merits and methods of selecting a representative sample date back to the late 19th century; in politics, debates about the value of likeness as a logic of political representation are older still. Today, as the concept crops up in the study of fairness and accountability in machine learning, we need to carefully consider the term's meanings in order to communicate clearly and account for their normative implications. In this paper, we ask what representativeness means, how it is mobilized socially, and what values and ideals it communicates or confronts. We trace the concept's history in statistics and discuss normative tensions concerning its relationship to likeness, exclusion, authority, and aspiration. We draw on these analyses to think through how representativeness is used in FAccT debates, with emphasis on data, shift, participation, and power.

Related papers

• From Fair Representation to Just Recognition in Generative AI [1.1458853556386799]
  We show how moving from representational fairness to recognitional justice provides better conceptual and normative tools for governing central fairness challenges in generative AI.<n>We argue that the underlying problem is not simply misrepresentation but misrecognition. Drawing on political theory, we show how moving from representational fairness to recognitional justice provides better conceptual and normative tools for governing central fairness challenges in generative AI.
  arXiv  Detail & Related papers  (2026-08-13T00:08:17Z)
• The AI Fairness Myth: A Position Paper on Context-Aware Bias [0.0]
  We argue that fairness sometimes requires deliberate, context-aware preferential treatment of historically marginalized groups.<n>Rather than viewing bias solely as a flaw to eliminate, we propose a framework that embraces corrective, intentional biases.
  arXiv  Detail & Related papers  (2025-05-02T02:47:32Z)
• Reconciling Predictive and Statistical Parity: A Causal Approach [68.59381759875734]
  We propose a new causal decomposition formula for the fairness measures associated with predictive parity. We show that the notions of statistical and predictive parity are not really mutually exclusive, but complementary and spanning a spectrum of fairness notions.
  arXiv  Detail & Related papers  (2023-06-08T09:23:22Z)
• What-is and How-to for Fairness in Machine Learning: A Survey, Reflection, and Perspective [13.124434298120494]
  We review and reflect on various fairness notions previously proposed in machine learning literature. We also consider the long-term impact that is induced by current prediction and decision. This paper demonstrates the importance of matching the mission (which kind of fairness one would like to enforce) and the means (which spectrum of fairness analysis is of interest) to fulfill the intended purpose.
  arXiv  Detail & Related papers  (2022-06-08T18:05:46Z)
• On Disentangled and Locally Fair Representations [95.6635227371479]
  We study the problem of performing classification in a manner that is fair for sensitive groups, such as race and gender. We learn a locally fair representation, such that, under the learned representation, the neighborhood of each sample is balanced in terms of the sensitive attribute.
  arXiv  Detail & Related papers  (2022-05-05T14:26:50Z)
• Measuring Fairness of Text Classifiers via Prediction Sensitivity [63.56554964580627]
  ACCUMULATED PREDICTION SENSITIVITY measures fairness in machine learning models based on the model's prediction sensitivity to perturbations in input features. We show that the metric can be theoretically linked with a specific notion of group fairness (statistical parity) and individual fairness.
  arXiv  Detail & Related papers  (2022-03-16T15:00:33Z)
• Data Representativity for Machine Learning and AI Systems [2.588973722689844]
  Data representativity is crucial when drawing inference from data through machine learning models. This paper analyzes data representativity in scientific literature related to AI and sampling.
  arXiv  Detail & Related papers  (2022-03-09T13:34:52Z)
• Exhaustivity and anti-exhaustivity in the RSA framework: Testing the effect of prior beliefs [68.8204255655161]
  We focus on cases when sensitivity to priors leads to counterintuitive predictions of the Rational Speech Act (RSA) framework. We show that in the baseline RSA model, under certain conditions, anti-exhaustive readings are predicted. We find no anti-exhaustivity effects, but observed that message choice is sensitive to priors, as predicted by the RSA framework overall.
  arXiv  Detail & Related papers  (2022-02-14T20:35:03Z)
• Measuring a Texts Fairness Dimensions Using Machine Learning Based on Social Psychological Factors [0.0]
  We use psychology to determine the principal factors that humans use when making a fairness assessment. We digitise these using word embeddings into a multi-dimensioned sentence level fairness perceptions vector. A second approach, using PCA and ML based on the said fairness approximation vector produces an F1 score of 86.2.
  arXiv  Detail & Related papers  (2021-10-29T21:09:17Z)
• Mundus vult decipi, ergo decipiatur: Visual Communication of Uncertainty in Election Polls [56.8172499765118]
  We discuss potential sources of bias in nowcasting and forecasting. Concepts are presented to attenuate the issue of falsely perceived accuracy. One key idea is the use of Probabilities of Events instead of party shares.
  arXiv  Detail & Related papers  (2021-04-28T07:02:24Z)
• Statistical Equity: A Fairness Classification Objective [6.174903055136084]
  We propose a new fairness definition motivated by the principle of equity. We formalize our definition of fairness, and motivate it with its appropriate contexts. We perform multiple automatic and human evaluations to show the effectiveness of our definition.
  arXiv  Detail & Related papers  (2020-05-14T23:19:38Z)
• A Philosophy of Data [91.3755431537592]
  We work from the fundamental properties necessary for statistical computation to a definition of statistical data. We argue that the need for useful data to be commensurable rules out an understanding of properties as fundamentally unique or equal. With our increasing reliance on data and data technologies, these two characteristics of data affect our collective conception of reality.
  arXiv  Detail & Related papers  (2020-04-15T14:47:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.