Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytelling

• URL: http://arxiv.org/abs/2310.12902v2
• Date: Mon, 04 Nov 2024 05:11:46 GMT
• Title: Experimental Narratives: A Comparison of Human Crowdsourced Storytelling and AI Storytelling
• Authors: Nina Begus,
• Abstract summary: The study analyzes 250 stories authored by crowdworkers in June 2019 and 80 stories generated by GPT-3.5 and GPT-4. Both crowdworkers and large language models responded to identical prompts about creating and falling in love with an artificial human. The analysis reveals that narratives from GPT-3.5 and particularly GPT-4 are more progressive in terms of gender roles and sexuality than those written by humans.
• Score: 0.0
• License:
• Abstract: The paper proposes a framework that combines behavioral and computational experiments employing fictional prompts as a novel tool for investigating cultural artifacts and social biases in storytelling both by humans and generative AI. The study analyzes 250 stories authored by crowdworkers in June 2019 and 80 stories generated by GPT-3.5 and GPT-4 in March 2023 by merging methods from narratology and inferential statistics. Both crowdworkers and large language models responded to identical prompts about creating and falling in love with an artificial human. The proposed experimental paradigm allows a direct and controlled comparison between human and LLM-generated storytelling. Responses to the Pygmalionesque prompts confirm the pervasive presence of the Pygmalion myth in the collective imaginary of both humans and large language models. All solicited narratives present a scientific or technological pursuit. The analysis reveals that narratives from GPT-3.5 and particularly GPT-4 are more progressive in terms of gender roles and sexuality than those written by humans. While AI narratives with default settings and no additional prompting can occasionally provide innovative plot twists, they offer less imaginative scenarios and rhetoric than human-authored texts. The proposed framework argues that fiction can be used as a window into human and AI-based collective imaginary and social dimensions.

Related papers

• Agents' Room: Narrative Generation through Multi-step Collaboration [54.98886593802834]
  We propose a generation framework inspired by narrative theory that decomposes narrative writing into subtasks tackled by specialized agents. We show that Agents' Room generates stories preferred by expert evaluators over those produced by baseline systems.
  arXiv  Detail & Related papers  (2024-10-03T15:44:42Z)
• Are Large Language Models Capable of Generating Human-Level Narratives? [114.34140090869175]
  This paper investigates the capability of LLMs in storytelling, focusing on narrative development and plot progression. We introduce a novel computational framework to analyze narratives through three discourse-level aspects. We show that explicit integration of discourse features can enhance storytelling, as is demonstrated by over 40% improvement in neural storytelling.
  arXiv  Detail & Related papers  (2024-07-18T08:02:49Z)
• The GPT-WritingPrompts Dataset: A Comparative Analysis of Character Portrayal in Short Stories [17.184517720465404]
  We quantify and compare the emotional and descriptive features of storytelling from both generative processes, human and machine, along a set of six dimensions. We find that generated stories differ significantly from human stories along all six dimensions, and that human and machine generations display similar biases when grouped according to the narrative point-of-view and gender of the main protagonist.
  arXiv  Detail & Related papers  (2024-06-24T16:24:18Z)
• Measuring Psychological Depth in Language Models [50.48914935872879]
  We introduce the Psychological Depth Scale (PDS), a novel framework rooted in literary theory that measures an LLM's ability to produce authentic and narratively complex stories. We empirically validate our framework by showing that humans can consistently evaluate stories based on PDS (0.72 Krippendorff's alpha) Surprisingly, GPT-4 stories either surpassed or were statistically indistinguishable from highly-rated human-written stories sourced from Reddit.
  arXiv  Detail & Related papers  (2024-06-18T14:51:54Z)
• Creating Suspenseful Stories: Iterative Planning with Large Language Models [2.6923151107804055]
  We propose a novel iterative-prompting-based planning method that is grounded in two theoretical foundations of story suspense. To the best of our knowledge, this paper is the first attempt at suspenseful story generation with large language models.
  arXiv  Detail & Related papers  (2024-02-27T01:25:52Z)
• Affective and Dynamic Beam Search for Story Generation [50.3130767805383]
  We propose Affective Story Generator (AffGen) for generating interesting narratives. AffGen employs two novel techniques-Dynamic Beam Sizing and Affective Reranking.
  arXiv  Detail & Related papers  (2023-10-23T16:37:14Z)
• Computational Storytelling and Emotions: A Survey [56.95572957863576]
  This survey paper is intended to summarize and contribute to the development of research being conducted on the relationship between stories and emotions. We believe creativity research is not to replace humans with computers, but to find a way of collaboration between humans and computers to enhance the creativity.
  arXiv  Detail & Related papers  (2022-05-23T00:21:59Z)
• Persona-Guided Planning for Controlling the Protagonist's Persona in Story Generation [71.24817035071176]
  We propose a planning-based generation model named CONPER to explicitly model the relationship between personas and events. Both automatic and manual evaluation results demonstrate that CONPER outperforms state-of-the-art baselines for generating more coherent and persona-controllable stories.
  arXiv  Detail & Related papers  (2022-04-22T13:45:02Z)
• Collaborative Storytelling with Human Actors and AI Narrators [2.8575516056239576]
  We report on using GPT-3 citebrown 2020 to co-narrate stories. The AI system must track plot progression and character arcs while the human actors perform scenes.
  arXiv  Detail & Related papers  (2021-09-29T21:21:35Z)
• Unsupervised Enrichment of Persona-grounded Dialog with Background Stories [27.52543925693796]
  We equip dialog models with 'background stories' related to a persona by leveraging fictional narratives from existing story datasets. We perform an unsupervised adaptation of a retrieved story for generating a dialog response using a gradient-based rewriting technique. Our method can generate responses that are more diverse, and are rated more engaging and human-like by human evaluators.
  arXiv  Detail & Related papers  (2021-06-15T18:20:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.