Personalized Dynamic Difficulty Adjustment -- Imitation Learning Meets Reinforcement Learning

• URL: http://arxiv.org/abs/2408.06818v1
• Date: Tue, 13 Aug 2024 11:24:12 GMT
• Title: Personalized Dynamic Difficulty Adjustment -- Imitation Learning Meets Reinforcement Learning
• Authors: Ronja Fuchs, Robin Gieseke, Alexander Dockhorn,
• Abstract summary: In this work, we explore balancing game difficulty using machine learning-based agents to challenge players based on their current behavior. This is achieved by a combination of two agents, in which one learns to imitate the player, while the second is trained to beat the first. In our demo, we investigate the proposed framework for personalized dynamic difficulty adjustment of AI agents in the context of the fighting game AI competition.
• Score: 44.99833362998488
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Balancing game difficulty in video games is a key task to create interesting gaming experiences for players. Mismatching the game difficulty and a player's skill or commitment results in frustration or boredom on the player's side, and hence reduces time spent playing the game. In this work, we explore balancing game difficulty using machine learning-based agents to challenge players based on their current behavior. This is achieved by a combination of two agents, in which one learns to imitate the player, while the second is trained to beat the first. In our demo, we investigate the proposed framework for personalized dynamic difficulty adjustment of AI agents in the context of the fighting game AI competition.

Related papers

• Reinforcement Learning for High-Level Strategic Control in Tower Defense Games [47.618236610219554]
  In strategy games, one of the most important aspects of game design is maintaining a sense of challenge for players. We propose an automated approach that combines traditional scripted methods with reinforcement learning. Results show that combining a learned approach, such as reinforcement learning, with a scripted AI produces a higher-performing and more robust agent than using only AI.
  arXiv  Detail & Related papers  (2024-06-12T08:06:31Z)
• DanZero+: Dominating the GuanDan Game through Reinforcement Learning [95.90682269990705]
  We develop an AI program for an exceptionally complex and popular card game called GuanDan. We first put forward an AI program named DanZero for this game. In order to further enhance the AI's capabilities, we apply policy-based reinforcement learning algorithm to GuanDan.
  arXiv  Detail & Related papers  (2023-12-05T08:07:32Z)
• All by Myself: Learning Individualized Competitive Behaviour with a Contrastive Reinforcement Learning optimization [57.615269148301515]
  In a competitive game scenario, a set of agents have to learn decisions that maximize their goals and minimize their adversaries' goals at the same time. We propose a novel model composed of three neural layers that learn a representation of a competitive game, learn how to map the strategy of specific opponents, and how to disrupt them. Our experiments demonstrate that our model achieves better performance when playing against offline, online, and competitive-specific models, in particular when playing against the same opponent multiple times.
  arXiv  Detail & Related papers  (2023-10-02T08:11:07Z)
• Continuous Reinforcement Learning-based Dynamic Difficulty Adjustment in a Visual Working Memory Game [5.857929080874288]
  Reinforcement Learning (RL) methods have been employed for Dynamic Difficulty Adjustment (DDA) in non-competitive games. We propose a continuous RL-based DDA methodology for a visual working memory (VWM) game to handle the complex search space for the difficulty of memorization.
  arXiv  Detail & Related papers  (2023-08-24T12:05:46Z)
• Diversity-based Deep Reinforcement Learning Towards Multidimensional Difficulty for Fighting Game AI [0.9645196221785693]
  We introduce a diversity-based deep reinforcement learning approach for generating a set of agents of similar difficulty. We find this approach outperforms a baseline trained with specialized, human-authored reward functions in both diversity and performance.
  arXiv  Detail & Related papers  (2022-11-04T21:49:52Z)
• Generating Diverse and Competitive Play-Styles for Strategy Games [58.896302717975445]
  We propose Portfolio Monte Carlo Tree Search with Progressive Unpruning for playing a turn-based strategy game (Tribes) We show how it can be parameterized so a quality-diversity algorithm (MAP-Elites) is used to achieve different play-styles while keeping a competitive level of play. Our results show that this algorithm is capable of achieving these goals even for an extensive collection of game levels beyond those used for training.
  arXiv  Detail & Related papers  (2021-04-17T20:33:24Z)
• Predicting Game Difficulty and Churn Without Players [0.0]
  We propose a novel simulation model that is able to predict the per-level churn and pass rates of Angry Birds Dream Blast. Our work demonstrates that player behavior predictions produced by DRL gameplay can be significantly improved by even a very simple population-level simulation of individual player differences.
  arXiv  Detail & Related papers  (2020-08-29T08:37:47Z)
• Exploring Dynamic Difficulty Adjustment in Videogames [0.0]
  We will present Dynamic Difficulty Adjustment (DDA), a recently arising research topic. DDA aims to develop an automated difficulty selection mechanism that keeps the player engaged and properly challenged. We will present some recent research addressing this issue, as well as an overview of how to implement it.
  arXiv  Detail & Related papers  (2020-07-06T15:05:20Z)
• Learning from Learners: Adapting Reinforcement Learning Agents to be Competitive in a Card Game [71.24825724518847]
  We present a study on how popular reinforcement learning algorithms can be adapted to learn and to play a real-world implementation of a competitive multiplayer card game. We propose specific training and validation routines for the learning agents, in order to evaluate how the agents learn to be competitive and explain how they adapt to each others' playing style.
  arXiv  Detail & Related papers  (2020-04-08T14:11:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.