Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions
- URL: http://arxiv.org/abs/2606.07893v1
- Date: Fri, 05 Jun 2026 23:03:53 GMT
- Title: Beyond Individual Personas: Aligning Synthetic Dialogue to Population-Level Behavior Distributions
- Abstract summary: GroupPersona is a framework that aligns synthetic dialogue corpora to the behavior distribution of a reference corpus.<n>It separates each dialogue's core behavioral signature from predictable side effects, and uses the resulting behavioral groups to condition user agents on the interaction patterns that define the reference population.
- Score: 21.099809383806598
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Synthetic dialogue corpora are increasingly used as proxies for target dialogue data, yet persona-grounded generators optimize individual conversations rather than corpus composition, yielding locally plausible dialogues with distorted population-level behavior mixes. We introduce GroupPersona, a framework that aligns synthetic dialogue corpora to the behavior distribution of a reference corpus. GroupPersona turns population statistics into generation controls: it separates each dialogue's core behavioral signature from predictable side effects, and uses the resulting behavioral groups to condition user agents on the interaction patterns that define the reference population. We evaluate GroupPersona on four corpora crossing two dialogue sources, assistant-style and Reddit-derived, with two construction variants: structure-preserving and variation-enhanced. GroupPersona lowers Jensen-Shannon divergence between synthetic and reference distributions over 12 behavior attributes from 0.234 to 0.177 relative to the strongest average baseline, a 24.4% reduction, and is best or tied-best on all four corpora while preserving structural alignment. It also achieves the closest calibration to reference-conversation quality scores, reducing mean absolute deviation from the reference-conversation profile to 0.63 versus 0.91 for the next-best baseline.
Related papers
- DuplexGen: Adaptive Synthesis of Human-AI Turn-Taking Dialogues [49.82200425774426]
Turntaking is a central component of a full-adaptive interaction, yet current models apply regardless of context.<n>We present a framework for generating dialogues with scenario turntaking by calibrating predictions against a small set of human preference annotations.<n>These results show that human calibration, not prompting or prompt design alone, is what allows turn-taking synthesis to be scenario-specific.
arXiv Detail & Related papers (2026-07-28T18:36:46Z) - Mimetic Alignment with ASPECT: Evaluation of AI-inferred Personal Profiles [9.797234412839304]
We present ASPECT, a pipeline to assess constructs from a validated communication scale against behavioral evidence from workplace data.<n>ASPECT-generated profiles achieved moderate alignment with self-assessments, and ASPECT-generated responses were preferred over generic and self-report baselines.<n>We discuss implications for building inspectable, individually scoped communication profiles that let individuals control how agents represent them at work.
arXiv Detail & Related papers (2026-03-27T18:55:44Z) - SocialOmni: Benchmarking Audio-Visual Social Interactivity in Omni Models [86.19617358080016]
Social Omni is a benchmark that operationalizes the evaluation of conversational interactivity across three core dimensions.<n>Social Omni features 2,000 perception samples and a quality-controlled diagnostic set of 209 interaction-generation instances.<n>Our analysis reveals a pronounced decoupling between a model's perceptual accuracy and its ability to generate contextually appropriate interruptions.
arXiv Detail & Related papers (2026-03-17T17:58:44Z) - Learning Human-Object Interaction as Groups [52.28258599873394]
GroupHOI is a framework that propagates contextual information in terms of geometric proximity and semantic similarity.<n>It exhibits leading performance on the more challenging Nonverbal Interaction Detection task.
arXiv Detail & Related papers (2025-10-21T07:25:10Z) - Navigating the Synchrony-Stability Frontier in Adaptive Chatbots [0.0]
We present a computational evaluation framework that makes the core design tension explicit.<n>We simulate and compare explicit adaptation policies on a human-log dataset.<n>We find bounded policies achieve substantial gains in stability at a modest cost to synchrony.<n>We quantify "prompt legibility," showing that frontier policies reduce instruction churn and cut jarring register flips.
arXiv Detail & Related papers (2025-09-30T22:50:30Z) - Are Personalized Stochastic Parrots More Dangerous? Evaluating Persona
Biases in Dialogue Systems [103.416202777731]
We study "persona biases", which we define to be the sensitivity of dialogue models' harmful behaviors contingent upon the personas they adopt.
We categorize persona biases into biases in harmful expression and harmful agreement, and establish a comprehensive evaluation framework to measure persona biases in five aspects: Offensiveness, Toxic Continuation, Regard, Stereotype Agreement, and Toxic Agreement.
arXiv Detail & Related papers (2023-10-08T21:03:18Z) - Leveraging Implicit Feedback from Deployment Data in Dialogue [83.02878726357523]
We study improving social conversational agents by learning from natural dialogue between users and a deployed model.
We leverage signals like user response length, sentiment and reaction of the future human utterances in the collected dialogue episodes.
arXiv Detail & Related papers (2023-07-26T11:34:53Z) - Improving Personality Consistency in Conversation by Persona Extending [22.124187337032946]
We propose a novel retrieval-to-prediction paradigm consisting of two subcomponents, namely, Persona Retrieval Model (PRM) and Posterior-scored Transformer (PS-Transformer)
Our proposed model yields considerable improvements in both automatic metrics and human evaluations.
arXiv Detail & Related papers (2022-08-23T09:00:58Z) - Dual Task Framework for Debiasing Persona-grounded Dialogue Dataset [17.403065663306567]
We introduce a data-centric approach for the task of improving persona-conditioned dialogue agents.
Specifically, we augment relevant personas to improve dialogue dataset/agent, by leveraging the primal-dual structure of the two tasks.
Experiments on Persona-Chat show that our approach outperforms pre-trained LMs by an 11.7 point gain in terms of accuracy.
arXiv Detail & Related papers (2022-02-11T04:08:46Z) - Joint Turn and Dialogue level User Satisfaction Estimation on
Multi-Domain Conversations [6.129731338249762]
Current automated methods to estimate turn and dialogue level user satisfaction employ hand-crafted features.
We propose a novel user satisfaction estimation approach which minimizes an adaptive multi-task loss function.
The BiLSTM based deep neural net model automatically weighs each turn's contribution towards the estimated dialogue-level rating.
arXiv Detail & Related papers (2020-10-06T05:53:13Z) - Dialogue Response Ranking Training with Large-Scale Human Feedback Data [52.12342165926226]
We leverage social media feedback data to build a large-scale training dataset for feedback prediction.
We trained DialogRPT, a set of GPT-2 based models on 133M pairs of human feedback data.
Our ranker outperforms the conventional dialog perplexity baseline with a large margin on predicting Reddit feedback.
arXiv Detail & Related papers (2020-09-15T10:50:05Z) - Is this Dialogue Coherent? Learning from Dialogue Acts and Entities [82.44143808977209]
We create the Switchboard Coherence (SWBD-Coh) corpus, a dataset of human-human spoken dialogues annotated with turn coherence ratings.
Our statistical analysis of the corpus indicates how turn coherence perception is affected by patterns of distribution of entities.
We find that models combining both DA and entity information yield the best performances both for response selection and turn coherence rating.
arXiv Detail & Related papers (2020-06-17T21:02:40Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.