ChatPCG: Large Language Model-Driven Reward Design for Procedural Content Generation

• URL: http://arxiv.org/abs/2406.11875v1
• Date: Fri, 7 Jun 2024 08:18:42 GMT
• Title: ChatPCG: Large Language Model-Driven Reward Design for Procedural Content Generation
• Authors: In-Chang Baek, Tae-Hwa Park, Jin-Ha Noh, Cheong-Mok Bae, Kyung-Joong Kim,
• Abstract summary: This paper proposes ChatPCG, a large language model (LLM)-driven reward design framework. It leverages human-level insights, coupled with game expertise, to generate rewards tailored to specific game features automatically. ChatPCG is integrated with deep reinforcement learning, demonstrating its potential for multiplayer game content generation tasks.
• Score: 3.333383360927007
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Driven by the rapid growth of machine learning, recent advances in game artificial intelligence (AI) have significantly impacted productivity across various gaming genres. Reward design plays a pivotal role in training game AI models, wherein researchers implement concepts of specific reward functions. However, despite the presence of AI, the reward design process predominantly remains in the domain of human experts, as it is heavily reliant on their creativity and engineering skills. Therefore, this paper proposes ChatPCG, a large language model (LLM)-driven reward design framework.It leverages human-level insights, coupled with game expertise, to generate rewards tailored to specific game features automatically. Moreover, ChatPCG is integrated with deep reinforcement learning, demonstrating its potential for multiplayer game content generation tasks. The results suggest that the proposed LLM exhibits the capability to comprehend game mechanics and content generation tasks, enabling tailored content generation for a specified game. This study not only highlights the potential for improving accessibility in content generation but also aims to streamline the game AI development process.

Related papers

• Game Plot Design with an LLM-powered Assistant: An Empirical Study with Game Designers [29.54980724240688]
  We introduce GamePlot, an LLM-powered assistant that supports game designers in crafting immersive narratives for turn-based games. Our user study with 14 game designers shows high levels of both satisfaction with the generated game plots and sense of ownership over the narratives.
  arXiv  Detail & Related papers  (2024-11-05T01:26:35Z)
• Grammar-based Game Description Generation using Large Language Models [12.329521804287259]
  We introduce the grammar of game descriptions, which effectively structures the game design space, into the reasoning process. Our experiments demonstrate that this approach performs well in generating game descriptions.
  arXiv  Detail & Related papers  (2024-07-24T16:36:02Z)
• Affordance-Guided Reinforcement Learning via Visual Prompting [51.361977466993345]
  Keypoint-based Affordance Guidance for Improvements (KAGI) is a method leveraging rewards shaped by vision-language models (VLMs) for autonomous RL. On real-world manipulation tasks specified by natural language descriptions, KAGI improves the sample efficiency of autonomous RL and enables successful task completion in 20K online fine-tuning steps.
  arXiv  Detail & Related papers  (2024-07-14T21:41:29Z)
• Instruction-Driven Game Engines on Large Language Models [59.280666591243154]
  The IDGE project aims to democratize game development by enabling a large language model to follow free-form game rules. We train the IDGE in a curriculum manner that progressively increases the model's exposure to complex scenarios. Our initial progress lies in developing an IDGE for Poker, a universally cherished card game.
  arXiv  Detail & Related papers  (2024-03-30T08:02:16Z)
• The Ink Splotch Effect: A Case Study on ChatGPT as a Co-Creative Game Designer [2.778721019132512]
  This paper studies how large language models (LLMs) can act as effective, high-level creative collaborators and muses'' for game design. Our goal is to determine whether AI-assistance can improve, hinder, or provide an alternative quality to games when compared to the creative intents implemented by human designers.
  arXiv  Detail & Related papers  (2024-03-04T20:14:38Z)
• ArchiGuesser -- AI Art Architecture Educational Game [0.5919433278490629]
  generative AI can create educational content from text, speech, to images based on simple input prompts. In this paper we present the multisensory educational game ArchiGuesser that combines various AI technologies to serve a single purpose.
  arXiv  Detail & Related papers  (2023-12-14T20:48:26Z)
• Exploration with Principles for Diverse AI Supervision [88.61687950039662]
  Training large transformers using next-token prediction has given rise to groundbreaking advancements in AI. While this generative AI approach has produced impressive results, it heavily leans on human supervision. This strong reliance on human oversight poses a significant hurdle to the advancement of AI innovation. We propose a novel paradigm termed Exploratory AI (EAI) aimed at autonomously generating high-quality training data.
  arXiv  Detail & Related papers  (2023-10-13T07:03:39Z)
• Technical Challenges of Deploying Reinforcement Learning Agents for Game Testing in AAA Games [58.720142291102135]
  We describe an effort to add an experimental reinforcement learning system to an existing automated game testing solution based on scripted bots. We show a use-case of leveraging reinforcement learning in game production and cover some of the largest time sinks anyone who wants to make the same journey for their game may encounter. We propose a few research directions that we believe will be valuable and necessary for making machine learning, and especially reinforcement learning, an effective tool in game production.
  arXiv  Detail & Related papers  (2023-07-19T18:19:23Z)
• A Comprehensive Survey of AI-Generated Content (AIGC): A History of Generative AI from GAN to ChatGPT [63.58711128819828]
  ChatGPT and other Generative AI (GAI) techniques belong to the category of Artificial Intelligence Generated Content (AIGC) The goal of AIGC is to make the content creation process more efficient and accessible, allowing for the production of high-quality content at a faster pace.
  arXiv  Detail & Related papers  (2023-03-07T20:36:13Z)
• The MineRL BASALT Competition on Learning from Human Feedback [58.17897225617566]
  The MineRL BASALT competition aims to spur forward research on this important class of techniques. We design a suite of four tasks in Minecraft for which we expect it will be hard to write down hardcoded reward functions. We provide a dataset of human demonstrations on each of the four tasks, as well as an imitation learning baseline.
  arXiv  Detail & Related papers  (2021-07-05T12:18:17Z)
• AI in (and for) Games [0.9920773256693857]
  This chapter outlines the relation between artificial intelligence (AI) / machine learning (ML) algorithms and digital games. On one hand, AI/ML researchers can generate large, in-the-wild datasets of human affective activity, player behaviour. On the other hand, games can utilise intelligent algorithms to automate testing of game levels, generate content, develop intelligent and responsive non-player characters (NPCs) or predict and respond player behaviour.
  arXiv  Detail & Related papers  (2021-05-07T08:57:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.