Mind the Gaps: Mixture-of-Minds for Human Simulation
- URL: http://arxiv.org/abs/2608.06115v1
- Date: Thu, 06 Aug 2026 14:48:09 GMT
- Title: Mind the Gaps: Mixture-of-Minds for Human Simulation
- Abstract summary: Anacreon is an audience simulation model that targets the individual level within a narrow, well-specified domain.<n>It harvests demographics, psychological traits, and survey responses from public text, and augments each record with a chain-of-emotion.<n>It reduces prompt brittleness by shuffling response options and reduces positive bias by balancing the training distribution.
- Score: 1.1844977816228046
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Predicting how a population will answer a new question is a long-standing goal. Statistical methods succeed at the level of the mass but falter at the level of the individual. Large language model simulators inherit this gap. They recover a population's central tendencies while flattening its heterogeneity, and they carry social biases and prompt brittleness that distort individual predictions. This paper introduces Anacreon, an audience simulation model that targets the individual level within a narrow, well-specified domain. Anacreon learns an authorship embedding that separates individuals, clusters a real qualitative corpus around seed people, and trains a dedicated adapter for each cluster, a mixture of minds, on a Gemma~4 12B base. It harvests demographics, psychological traits, and survey responses from public text, and augments each record with a chain-of-emotion. It reduces prompt brittleness by shuffling response options and reduces positive bias by balancing the training distribution. On a large, externally sourced survey, Anacreon reaches a state-of-the-art ordinal alignment of 0.775, the individual-level accuracy measure on which the field has converged, with a small residual bias. The work is a step toward drawing aggregate insight from faithfully simulated individuals.
Related papers
- Rethinking the Evaluation and Optimization of LLM-Based Social Simulation [56.18577997572273]
We use the subjectivity coefficient to analyze how accuracy-based evaluation and hard-label training fail as subjectivity grows.<n>We construct SUBJSIM, a benchmark of 19,300 contexts covering 193 annotators and 100 subjective questions.<n>Results on SUBJSIM demonstrate the advantages of our method.
arXiv Detail & Related papers (2026-08-20T06:26:03Z) - Emulate or Estimate? The Divergent Strengths of Base and Post-Trained Language Models for Opinion Simulation [7.947622351777421]
We show that some studies find promising alignment with human survey data, while others find persona collapse and weak demographic sensitivity.<n>We call the first task emulation, in which models generate individual responses that aggregate into a population distribution.<n>We call the second task estimation, in which models directly predict the population distribution.
arXiv Detail & Related papers (2026-08-04T02:51:38Z) - Analyzing and Correcting Benevolence Bias in Large Language Models [25.94213078450494]
Large language models (LLMs) are increasingly used as stand-ins for human respondents.<n>Here we identify and measure benevolence bias, a small but consistent tendency for aligned LLMs to lean toward the kinder, safer, more socially approved answer on value-laden survey questions.<n>We find that the bias is a stable model property, not a quirk of any one system.
arXiv Detail & Related papers (2026-07-26T08:37:58Z) - The Chameleon's Limit: Investigating Persona Collapse and Homogenization in Large Language Models [12.654067061944074]
Applications based on large language models (LLMs) require population diversity among agents.<n>We identify a pervasive failure mode we term emphPersona Collapse: agents each assigned a distinct profile nonetheless converge into a narrow behavioral mode, producing a homogeneous simulated population.
arXiv Detail & Related papers (2026-04-27T17:01:48Z) - From Human-Level AI Tales to AI Leveling Human Scales [36.62583289981655]
We build on a set of multi-level scales for different capabilities where each level should represent a probability of success of the whole world population.<n>We calibrate each scale for each capability by compiling publicly released human test data.<n>We evaluate the quality of different mappings using group slicing and post-stratification.
arXiv Detail & Related papers (2026-02-21T17:27:20Z) - Artificial Hivemind: The Open-Ended Homogeneity of Language Models (and Beyond) [90.45301024940329]
Language models (LMs) often struggle to generate diverse, human-like creative content.<n>We introduce Infinity-Chat, a large-scale dataset of 26K diverse, real-world, open-ended user queries.<n>We present a large-scale study of mode collapse in LMs, revealing a pronounced Artificial Hivemind effect.
arXiv Detail & Related papers (2025-10-27T03:16:21Z) - A Deep Generative Framework for Joint Households and Individuals Population Synthesis [0.562479170374811]
We propose a deep generative framework to generate a synthetic population with household-individual and individual-individual relationships.
Results for an application in Delaware, USA demonstrate the ability to ensure the realism of generated household-individual records.
arXiv Detail & Related papers (2024-06-30T23:01:58Z) - Spuriosity Rankings: Sorting Data to Measure and Mitigate Biases [62.54519787811138]
We present a simple but effective method to measure and mitigate model biases caused by reliance on spurious cues.
We rank images within their classes based on spuriosity, proxied via deep neural features of an interpretable network.
Our results suggest that model bias due to spurious feature reliance is influenced far more by what the model is trained on than how it is trained.
arXiv Detail & Related papers (2022-12-05T23:15:43Z) - Balancing out Bias: Achieving Fairness Through Training Reweighting [58.201275105195485]
Bias in natural language processing arises from models learning characteristics of the author such as gender and race.
Existing methods for mitigating and measuring bias do not directly account for correlations between author demographics and linguistic variables.
This paper introduces a very simple but highly effective method for countering bias using instance reweighting.
arXiv Detail & Related papers (2021-09-16T23:40:28Z) - JKOnet: Proximal Optimal Transport Modeling of Population Dynamics [69.89192135800143]
We propose a neural architecture that combines an energy model on measures, with (small) optimal displacements solved with input convex neural networks (ICNN)
We demonstrate the applicability of our model to explain and predict population dynamics.
arXiv Detail & Related papers (2021-06-11T12:30:43Z) - Completely Self-Supervised Crowd Counting via Distribution Matching [92.09218454377395]
We propose a complete self-supervision approach to training models for dense crowd counting.
The only input required to train, apart from a large set of unlabeled crowd images, is the approximate upper limit of the crowd count.
Our method dwells on the idea that natural crowds follow a power law distribution, which could be leveraged to yield error signals for backpropagation.
arXiv Detail & Related papers (2020-09-14T13:20:12Z) - Cumulative deviation of a subpopulation from the full population [0.0]
Assessing equity in treatment of a subpopulation often involves assigning numerical "scores" to all individuals in the full population.
Given such scores, individuals with similar scores may or may not attain similar outcomes independent of the individuals' memberships in the subpopulation.
The cumulative plots encode subpopulation deviation directly as the slopes of secant lines for the graphs.
arXiv Detail & Related papers (2020-08-04T19:30:02Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.