Evaluating Quality of Gaming Narratives Co-created with AI

• URL: http://arxiv.org/abs/2509.04239v1
• Date: Thu, 04 Sep 2025 14:13:42 GMT
• Title: Evaluating Quality of Gaming Narratives Co-created with AI
• Abstract summary: Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction.<n>The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.
• Score: 1.3320917259299652
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper proposes a structured methodology to evaluate AI-generated game narratives, leveraging the Delphi study structure with a panel of narrative design experts. Our approach synthesizes story quality dimensions from literature and expert insights, mapping them into the Kano model framework to understand their impact on player satisfaction. The results can inform game developers on prioritizing quality aspects when co-creating game narratives with generative AI.

Related papers

• Towards a Linguistic Evaluation of Narratives: A Quantitative Stylistic Framework [51.56484100374058]
  This work proposes a quantitative approach to narrative assessment by focusing on the linguistic dimension as a primary indicator of quality.<n>The paper presents a methodology for the automatic evaluation of narrative based on the extraction of a comprehensive set of 33 quantitative linguistic features.
  arXiv  Detail & Related papers  (2026-04-21T09:21:40Z)
• Large Language Models in Game Development: Implications for Gameplay, Playability, and Player Experience [2.2833627959494045]
  This paper investigates how the integration of large language models influences gameplay, playability, and player experience in game development.<n>The study provides preliminary empirical insight into how generative AI integration reshapes established game constructs and introduces new architectural and quality considerations within game engineering practice.
  arXiv  Detail & Related papers  (2026-03-29T22:30:50Z)
• The Rise of the Knowledge Sculptor: A New Archetype for Knowledge Work in the Age of Generative AI [0.0]
  This paper introduces the Knowledge Sculptor (KS), a new professional archetype for Human-GenAI collaboration.<n>The KS is conceptualised through a framework of competencies, including architecting a vision.<n>A practice-based vignette illustrates the KS role in action, and in a self-referential approach, the paper itself serves as an artefact of the sculpting process it describes.
  arXiv  Detail & Related papers  (2025-10-09T06:19:17Z)
• Multi-Actor Generative Artificial Intelligence as a Game Engine [49.360775442760314]
  Generative AI can be used in multi-actor environments with purposes ranging from social science modeling to interactive narrative and AI evaluation.<n>We argue here that a good approach is to take inspiration from tabletop role-playing games (TTRPGs), where a Game Master (GM) is responsible for the environment and generates all parts of the story not directly determined by the voluntary actions of player characters.
  arXiv  Detail & Related papers  (2025-07-10T22:31:09Z)
• Tinker Tales: Interactive Storytelling Framework for Early Childhood Narrative Development and AI Literacy [9.415578811438992]
  The framework integrates tangible and speech-based interactions with AI through NFC chip-attached pawns and tokens.<n>Children select and define key story elements-such as characters, places, items, and emotions-using the pawns and tokens.<n>For evaluation, several game sessions were simulated with a child AI agent, and the quality and safety of the generated stories were assessed.
  arXiv  Detail & Related papers  (2025-04-17T17:47:55Z)
• SCORE: Story Coherence and Retrieval Enhancement for AI Narratives [19.77258262917032]
  SCORE is a framework for Story Coherence and Retrieval Enhancement.<n>It tracks key item statuses and generates episode summaries.<n>It incorporates TF-IDF and cosine similarity to identify related episodes and enhance the overall story structure.
  arXiv  Detail & Related papers  (2025-03-30T16:48:27Z)
• WhatELSE: Shaping Narrative Spaces at Configurable Level of Abstraction for AI-bridged Interactive Storytelling [11.210282687859534]
  WhatELSE is an AI-bridged IN authoring system that creates narrative possibility spaces from example stories.<n>We show that WhatELSE enables authors to perceive and edit the narrative space and generates engaging interactive narratives at play-time.
  arXiv  Detail & Related papers  (2025-02-25T21:02:15Z)
• Charting the Shapes of Stories with Game Theory [41.8376313099588]
  We use AI to model the structure of stories as game-theoretic objects, amenable to quantitative analysis.<n>We demonstrate our proposed technique on Shakespeare's famous Romeo and Juliet.
  arXiv  Detail & Related papers  (2024-12-07T21:12:16Z)
• Agents' Room: Narrative Generation through Multi-step Collaboration [54.98886593802834]
  We propose a generation framework inspired by narrative theory that decomposes narrative writing into subtasks tackled by specialized agents.<n>We show that Agents' Room generates stories preferred by expert evaluators over those produced by baseline systems.
  arXiv  Detail & Related papers  (2024-10-03T15:44:42Z)
• What Makes a Good Story and How Can We Measure It? A Comprehensive Survey of Story Evaluation [57.550045763103334]
  evaluating a story can be more challenging than other generation evaluation tasks. We first summarize existing storytelling tasks, including text-to-text, visual-to-text, and text-to-visual. We propose a taxonomy to organize evaluation metrics that have been developed or can be adopted for story evaluation.
  arXiv  Detail & Related papers  (2024-08-26T20:35:42Z)
• Knowledge-Aware Bayesian Deep Topic Model [50.58975785318575]
  We propose a Bayesian generative model for incorporating prior domain knowledge into hierarchical topic modeling. Our proposed model efficiently integrates the prior knowledge and improves both hierarchical topic discovery and document representation.
  arXiv  Detail & Related papers  (2022-09-20T09:16:05Z)
• Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Games [64.11746320061965]
  We study reinforcement learning for text-based games, which are interactive simulations in the context of natural language. We aim to conduct explicit reasoning with knowledge graphs for decision making, so that the actions of an agent are generated and supported by an interpretable inference procedure. We extensively evaluate our method on a number of man-made benchmark games, and the experimental results demonstrate that our method performs better than existing text-based agents.
  arXiv  Detail & Related papers  (2020-10-22T12:40:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.