Do Large Language Models Always Tell The Same Stories?

• URL: http://arxiv.org/abs/2606.17350v1
• Date: Mon, 15 Jun 2026 22:52:02 GMT
• Title: Do Large Language Models Always Tell The Same Stories?
• Abstract summary: We investigate the diversity of large language models-generated stories through the framework of narrative similarity.<n>Our findings reveal a consistent trend: LLM-generated narratives are consistently more similar to each other than human-written stories are.<n>We show that common mitigation strategies, including negative prompting and temperature scaling, fail to meaningfully address this homogeneity.
• Score: 2.4779770815686444
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: Recent advances in large language models (LLMs) have enabled the generation of high-quality prose, yet the question of whether these models are capable of generating diverse outputs remains contested. In this work, we investigate the diversity of LLM-generated stories through the framework of narrative similarity. Using a contrastive framework and a dataset of human-written stories and prompts from r/WritingPrompts, we collect narrative similarity judgments across 10 representative LLMs, utilizing both human evaluations and three different automatic annotation methods. Our findings reveal a consistent trend: LLM-generated narratives are consistently more similar to each other than human-written stories are. We demonstrate that frontier models in particular converge on a ``mean'' generic narrative that approximates individual human stories but lacks the collective diversity of human authors. Finally, we show that common mitigation strategies, including negative prompting and temperature scaling, fail to meaningfully address this homogeneity.

Related papers

• How LLMs Build Fictional Worlds: Setting and Narrative Space in AI-Generated Creative Storytelling [0.47954782871066737]
  We compare 1,000 AI-generated stories per model in English and German with human-authored fiction from Project Gutenberg.<n>We operationalize setting through five types of narrative space: "action", "perceived," "visual," "descriptive" and "no space"<n>We find that human-authored texts predominantly employ "action space," grounding narratives in embodied character-environment interaction, whereas LLMs systematically overproduce "perceived space," emphasizing atmosphere and affect.
  arXiv  Detail & Related papers  (2026-09-02T11:51:44Z)
• From Personas to Plot: Character-Grounded Multi-Agent Story Generation for Long-Form Narratives [3.0130431031064613]
  We introduce a unified framework for long-form narrative generation and verification.<n>We show that our framework produces coherent narratives compared to single-model prompting and IBSEN.<n>These results suggest that long-form narratives can emerge from explicit world-state tracking and goal-driven multi-agent generation.
  arXiv  Detail & Related papers  (2026-07-01T13:23:07Z)
• NARRA-Gym for Evaluating Interactive Narrative Agents [69.49891044929372]
  We introduce NARRA-Gym, an evaluation environment that turns a sparse emotional seed into a complete interactive story episode.<n>We evaluate nine frontier LLMs using a controlled LLM-as-judge sweep over eight benchmark personas and a human evaluation in which participants rate customized model outputs.
  arXiv  Detail & Related papers  (2026-05-08T21:36:23Z)
• Attention Flows: Tracing LLM Conceptual Engagement via Story Summaries [4.320927217095906]
  We evaluate whether models mirror human patterns of conceptual engagement with texts.<n>We align sentences from 150 human-written novel summaries with the specific chapters they reference.<n>We find both stylistic differences between the texts and differences in how humans and LLMs distribute their focus throughout a narrative.
  arXiv  Detail & Related papers  (2026-04-07T19:50:52Z)
• Humans vs Vision-Language Models: A Unified Measure of Narrative Coherence [4.301794127844445]
  We compare human-written narratives with those generated by vision-language models (VLMs) on the Visual Writing Prompts corpus.<n>We find that VLMs show broadly similar coherence profiles that differ systematically from those of humans.<n>Our results indicate that, despite human-like surface fluency, model narratives exhibit systematic differences from those of humans in how they organise discourse across a visually grounded story.
  arXiv  Detail & Related papers  (2026-03-26T15:13:04Z)
• Agents' Room: Narrative Generation through Multi-step Collaboration [54.98886593802834]
  We propose a generation framework inspired by narrative theory that decomposes narrative writing into subtasks tackled by specialized agents.<n>We show that Agents' Room generates stories preferred by expert evaluators over those produced by baseline systems.
  arXiv  Detail & Related papers  (2024-10-03T15:44:42Z)
• MirrorStories: Reflecting Diversity through Personalized Narrative Generation with Large Language Models [5.397565689903148]
  This study explores the effectiveness of Large Language Models (LLMs) in creating personalized "mirror stories" MirrorStories is a corpus of 1,500 personalized short stories generated by integrating elements such as name, gender, age, ethnicity, reader interest, and story moral.
  arXiv  Detail & Related papers  (2024-09-20T22:43:13Z)
• Are Large Language Models Capable of Generating Human-Level Narratives? [114.34140090869175]
  This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects. We show that explicit integration of discourse features can enhance storytelling, as is demonstrated by over 40% improvement in neural storytelling.
  arXiv  Detail & Related papers  (2024-07-18T08:02:49Z)
• Scaling Data Diversity for Fine-Tuning Language Models in Human Alignment [84.32768080422349]
  Alignment with human preference prevents large language models from generating misleading or toxic content. We propose a new formulation of prompt diversity, implying a linear correlation with the final performance of LLMs after fine-tuning.
  arXiv  Detail & Related papers  (2024-03-17T07:08:55Z)
• The Next Chapter: A Study of Large Language Models in Storytelling [51.338324023617034]
  The application of prompt-based learning with large language models (LLMs) has exhibited remarkable performance in diverse natural language processing (NLP) tasks. This paper conducts a comprehensive investigation, utilizing both automatic and human evaluation, to compare the story generation capacity of LLMs with recent models. The results demonstrate that LLMs generate stories of significantly higher quality compared to other story generation models.
  arXiv  Detail & Related papers  (2023-01-24T02:44:02Z)
• UNION: An Unreferenced Metric for Evaluating Open-ended Story Generation [92.42032403795879]
  UNION is a learnable unreferenced metric for evaluating open-ended story generation. It is trained to distinguish human-written stories from negative samples and recover the perturbation in negative stories. Experiments on two story datasets demonstrate that UNION is a reliable measure for evaluating the quality of generated stories.
  arXiv  Detail & Related papers  (2020-09-16T11:01:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.