Representative Social Choice: From Learning Theory to AI Alignment

• URL: http://arxiv.org/abs/2410.23953v1
• Date: Thu, 31 Oct 2024 14:07:26 GMT
• Title: Representative Social Choice: From Learning Theory to AI Alignment
• Authors: Tianyi Qiu,
• Abstract summary: In representative social choice, the population is represented by a finite sample of individual-issue pairs based on which social choice decisions are made. We show that many of the deepest questions in representative social choice can be naturally formulated as statistical learning problems. We further formulates for representative social choice, and prove Arrow-like axioms with new tools of generalization analysis.
• Score: 0.0
• License:
• Abstract: Social choice theory is the study of preference aggregation across a population, used both in mechanism design for human agents and in the democratic alignment of language models. In this study, we propose the representative social choice framework for the modeling of democratic representation in collective decisions, where the number of issues and individuals are too large for mechanisms to consider all preferences directly. These scenarios are widespread in real-world decision-making processes, such as jury trials, indirect elections, legislation processes, corporate governance, and, more recently, language model alignment. In representative social choice, the population is represented by a finite sample of individual-issue pairs based on which social choice decisions are made. We show that many of the deepest questions in representative social choice can be naturally formulated as statistical learning problems, and prove the generalization properties of social choice mechanisms using the theory of machine learning. We further formulate axioms for representative social choice, and prove Arrow-like impossibility theorems with new combinatorial tools of analysis. Our framework introduces the representative approach to social choice, opening up research directions at the intersection of social choice, learning theory, and AI alignment.

Related papers

• From Experts to the Public: Governing Multimodal Language Models in Politically Sensitive Video Analysis [48.14390493099495]
  This paper examines the governance of large language models (MM-LLMs) through individual and collective deliberation. We conducted a two-step study: first, interviews with 10 journalists established a baseline understanding of expert video interpretation; second, 114 individuals from the general public engaged in deliberation using Inclusive.AI.
  arXiv  Detail & Related papers  (2024-09-15T03:17:38Z)
• Representation Bias in Political Sample Simulations with Large Language Models [54.48283690603358]
  This study seeks to identify and quantify biases in simulating political samples with Large Language Models. Using the GPT-3.5-Turbo model, we leverage data from the American National Election Studies, German Longitudinal Election Study, Zuobiao dataset, and China Family Panel Studies.
  arXiv  Detail & Related papers  (2024-07-16T05:52:26Z)
• Generative Social Choice [30.23505343152816]
  We introduce generative social choice, a framework that combines the rigor of social choice theory with the capability of large language models to generate text and extrapolate preferences. We apply this framework to the problem of generating a slate of statements that is representative of opinions expressed as free-form text. We find that 93 out of 100 participants feel "mostly" or "perfectly" represented by the slate of five statements we extracted.
  arXiv  Detail & Related papers  (2023-09-03T23:47:21Z)
• Causal Fairness Analysis [68.12191782657437]
  We introduce a framework for understanding, modeling, and possibly solving issues of fairness in decision-making settings. The main insight of our approach will be to link the quantification of the disparities present on the observed data with the underlying, and often unobserved, collection of causal mechanisms. Our effort culminates in the Fairness Map, which is the first systematic attempt to organize and explain the relationship between different criteria found in the literature.
  arXiv  Detail & Related papers  (2022-07-23T01:06:34Z)
• Graph-Based Methods for Discrete Choice [27.874979682322376]
  We use graph learning to study choice in networked contexts. We show that incorporating social network structure can improve the predictions of the standard econometric choice model.
  arXiv  Detail & Related papers  (2022-05-23T14:51:23Z)
• Socially-Optimal Mechanism Design for Incentivized Online Learning [32.55657244414989]
  Multi-arm bandit (MAB) is a classic online learning framework that studies the sequential decision-making in an uncertain environment. It is a practically important scenario in many applications such as spectrum sharing, crowdsensing, and edge computing. This paper establishes the incentivized online learning (IOL) framework for this scenario.
  arXiv  Detail & Related papers  (2021-12-29T00:21:40Z)
• Randomized Classifiers vs Human Decision-Makers: Trustworthy AI May Have to Act Randomly and Society Seems to Accept This [0.8889304968879161]
  We feel that akin to human decisions, judgments of artificial agents should necessarily be grounded in some moral principles. Yet a decision-maker can only make truly ethical (based on any ethical theory) and fair (according to any notion of fairness) decisions if full information on all the relevant factors on which the decision is based are available at the time of decision-making.
  arXiv  Detail & Related papers  (2021-11-15T05:39:02Z)
• Towards Socially Intelligent Agents with Mental State Transition and Human Utility [97.01430011496576]
  We propose to incorporate a mental state and utility model into dialogue agents. The hybrid mental state extracts information from both the dialogue and event observations. The utility model is a ranking model that learns human preferences from a crowd-sourced social commonsense dataset.
  arXiv  Detail & Related papers  (2021-03-12T00:06:51Z)
• Indecision Modeling [50.00689136829134]
  It is important that AI systems act in ways which align with human values. People are often indecisive, and especially so when their decision has moral implications.
  arXiv  Detail & Related papers  (2020-12-15T18:32:37Z)
• Social Choice with Changing Preferences: Representation Theorems and Long-Run Policies [0.0]
  We show how representation theorems from social choice theory can be adapted to characterize optimal policies. We provide an axiomatic characterization of MDP reward functions that agree with the Utilitarianism social welfare functionals of social choice theory.
  arXiv  Detail & Related papers  (2020-11-04T21:21:04Z)
• Decentralized Reinforcement Learning: Global Decision-Making via Local Economic Transactions [80.49176924360499]
  We establish a framework for directing a society of simple, specialized, self-interested agents to solve sequential decision problems. We derive a class of decentralized reinforcement learning algorithms. We demonstrate the potential advantages of a society's inherent modular structure for more efficient transfer learning.
  arXiv  Detail & Related papers  (2020-07-05T16:41:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.