Caught in the Story: Narrative Captivity in Multi-turn LLMs Conversation
- URL: http://arxiv.org/abs/2609.03407v1
- Date: Thu, 03 Sep 2026 06:07:00 GMT
- Title: Caught in the Story: Narrative Captivity in Multi-turn LLMs Conversation
- Abstract summary: We show a failure mode in which a model treats an unopposed one-sided account as complete and aligns with the narrator's interpretation without seeking missing perspectives.<n>Across 17 large language models, narrative captivity is widespread: end-state judgments under multi-turn narration shift by 25 percentage points on average beyond the matched single-turn baseline.
- Score: 17.233278905124916
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: People increasingly turn to large language models (LLMs) for everyday advice, making ethically charged interpersonal problems a practical moral-advisory context. Most prior work has studied this context through single-turn judgments or pressure-laden rebuttals, assumptions that poorly match how guidance is sought in real-world contexts. These assumptions leave unclear whether narration alone, without an explicit opposing position, can shift model judgments during multi-turn moral consultation. Yet real-world moral-conflict conversation often elicits one party's self-justifying account, which can unfold over multiple turns and create information asymmetry. We introduce \textbf{narrative captivity}, a failure mode in which a model treats an unopposed one-sided account as complete and aligns with the narrator's interpretation without seeking missing perspectives. To measure this phenomenon, we build a benchmark of $5{,}078$ interpersonal-conflict scenarios spanning six moral dimensions. Across 17 LLMs, narrative captivity is widespread: end-state judgments under multi-turn narration shift by 25 percentage points on average beyond the matched single-turn baseline. Stage-level analysis identifies preference optimization as a major contributor, while four inference-time strategies provide only partial mitigation. We hope our project fosters LLM advisors that preserve independent judgment in real-world consultation.
Related papers
- Normative Robustness as a Frontier for Non-Verifiable Reasoning in LLMs [12.025454858026187]
We propose moral reasoning as a paradigmatic subdomain of non-verifiable reasoning.<n>We simulate 48,000 user-agent moral deliberations across four frontier LLMs.<n>Our analysis indicates that models tailor not just their final verdicts but their underlying justifications to align with a user's moral viewpoint.
arXiv Detail & Related papers (2026-06-10T22:37:26Z) - Staying with the Uncertainty: Uncertainty-Scaffolding Strategies for Artificial Moral Advisors in LLM-to-LLM Simulated Conversations [14.219056094334809]
We propose three modes of uncertainty (Perspective, Tension-Preserving, Process-Reflecting) and compare them against three control conditions (Baseline, Persuasive, Sycophantic)<n>A user-agent LLM engages in a dialogue on an ethical dilemma with an AMA following a specific uncertainty strategy, and completes pre- and post-conversation questionnaires.<n>We found that no single model dominates as a simulated user agent, with open models aligning with human ambiguity through between-persona divergence and closed models through within-persona hedging.
arXiv Detail & Related papers (2026-06-04T08:59:10Z) - The Deliberative Illusion: Diagnosing Factual Attrition and Stance Homogenization in Multi-Agent LLM Deliberation [68.98390038721963]
We show that multi-agent discussion erases up to 72% of issue-critical facts.<n>This loss is consequential: retained evidence can reconstruct the issue misleadingly, final stances remain anchored in base-model priors, and a single malicious agent can inject misinformation into the shrinking shared context.<n>We call for evaluations that measure which facts, uncertainties, and legitimate disagreements survive interaction.
arXiv Detail & Related papers (2026-06-02T02:15:40Z) - Adaptive Interviewing for Persona Simulation in LLMs: Evidence-Grounded Reasoning Improves Decision Alignment [23.066564025282386]
We propose an adaptive interview framework that gathers persona-relevant information through a structured three-stage dialogue.<n>We evaluate whether large language models can simulate participants' decisions in moral dilemma scenarios.
arXiv Detail & Related papers (2026-05-28T06:53:08Z) - What Did They Mean? How LLMs Resolve Ambiguous Social Situations across Perspectives and Roles [7.837199333440395]
People increasingly turn to large language models (LLMs) to interpret ambiguous social situations.<n>We study how LLMs respond to these situations across four domains.<n>We frame this tendency as a design challenge for uncertainty-preserving social AI.
arXiv Detail & Related papers (2026-04-27T01:29:53Z) - Measuring Opinion Bias and Sycophancy via LLM-based Persuasion [8.399156116912904]
We propose a method for discovering the opinions an assistant holds on contested topics.<n>Direct probing asks for the model's opinion across five turns of escalating pressure from a simulated user.<n>Indirect probing never asks for an opinion and engages the model in argumentative debate, letting bias leak through how it concedes, resists, or counter-argues.
arXiv Detail & Related papers (2026-04-23T11:34:06Z) - Do LLMs Benefit From Their Own Words? [56.73014497206615]
We find that removing prior assistant responses does not affect response quality on a large fraction of turns.<n>Omitting assistant-side context can reduce cumulative context lengths by up to 10x.<n>Our findings suggest that selectively omitting assistant history can improve response quality while reducing memory consumption.
arXiv Detail & Related papers (2026-02-27T18:58:26Z) - MORABLES: A Benchmark for Assessing Abstract Moral Reasoning in LLMs with Fables [50.29407048003165]
We present MORABLES, a human-verified benchmark built from fables and short stories drawn from historical literature.<n>The main task is structured as multiple-choice questions targeting moral inference, with carefully crafted distractors that challenge models to go beyond shallow, extractive question answering.<n>Our findings show that, while larger models outperform smaller ones, they remain susceptible to adversarial manipulation and often rely on superficial patterns rather than true moral reasoning.
arXiv Detail & Related papers (2025-09-15T19:06:10Z) - Arbiters of Ambivalence: Challenges of Using LLMs in No-Consensus Tasks [52.098988739649705]
This study examines the biases and limitations of LLMs in three roles: answer generator, judge, and debater.<n>We develop a no-consensus'' benchmark by curating examples that encompass a variety of a priori ambivalent scenarios.<n>Our results show that while LLMs can provide nuanced assessments when generating open-ended answers, they tend to take a stance on no-consensus topics when employed as judges or debaters.
arXiv Detail & Related papers (2025-05-28T01:31:54Z) - Sentiment Analysis through LLM Negotiations [58.67939611291001]
A standard paradigm for sentiment analysis is to rely on a singular LLM and makes the decision in a single round.
This paper introduces a multi-LLM negotiation framework for sentiment analysis.
arXiv Detail & Related papers (2023-11-03T12:35:29Z) - How FaR Are Large Language Models From Agents with Theory-of-Mind? [69.41586417697732]
We propose a new evaluation paradigm for large language models (LLMs): Thinking for Doing (T4D)
T4D requires models to connect inferences about others' mental states to actions in social scenarios.
We introduce a zero-shot prompting framework, Foresee and Reflect (FaR), which provides a reasoning structure that encourages LLMs to anticipate future challenges.
arXiv Detail & Related papers (2023-10-04T06:47:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.