Towards Action Model Learning for Player Modeling
- URL: http://arxiv.org/abs/2103.05682v1
- Date: Tue, 9 Mar 2021 19:32:30 GMT
- Title: Towards Action Model Learning for Player Modeling
- Authors: Abhijeet Krishnan, Aaron Williams, Chris Martens
- Abstract summary: Player modeling attempts to create a computational model which accurately approximates a player's behavior in a game.
Most player modeling techniques rely on domain knowledge and are not transferable across games.
We present our findings with using action model learning (AML) to learn a player model in a domain-agnostic manner.
- Score: 1.9659095632676098
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Player modeling attempts to create a computational model which accurately
approximates a player's behavior in a game. Most player modeling techniques
rely on domain knowledge and are not transferable across games. Additionally,
player models do not currently yield any explanatory insight about a player's
cognitive processes, such as the creation and refinement of mental models. In
this paper, we present our findings with using action model learning (AML), in
which an action model is learned given data in the form of a play trace, to
learn a player model in a domain-agnostic manner. We demonstrate the utility of
this model by introducing a technique to quantitatively estimate how well a
player understands the mechanics of a game. We evaluate an existing AML
algorithm (FAMA) for player modeling and develop a novel algorithm called
Blackout that is inspired by player cognition. We compare Blackout with FAMA
using the puzzle game Sokoban and show that Blackout generates better player
models.
Related papers
- Emergent World Models and Latent Variable Estimation in Chess-Playing Language Models [0.0]
We train a GPT model on Othello games and find that the model learned an internal representation of the board state.
We extend this work into the more complex domain of chess, training on real games and investigating our model's internal representations.
Unlike Li et al.'s prior synthetic dataset approach, our analysis finds that the model also learns to estimate latent variables like player skill to better predict the next character.
arXiv Detail & Related papers (2024-03-21T18:53:23Z) - On Automating Video Game Regression Testing by Planning and Learning [3.746904317622708]
We propose a method and workflow for automating regression testing of certain video game aspects.
The basic idea is to use detailed game logs and incremental action model learning techniques to maintain a formal model.
This paper presents the first step towards minimizing or even eliminating the need for a modeling expert in the workflow.
arXiv Detail & Related papers (2024-02-16T14:28:25Z) - Promptable Game Models: Text-Guided Game Simulation via Masked Diffusion
Models [68.85478477006178]
We present a Promptable Game Model (PGM) for neural video game simulators.
It allows a user to play the game by prompting it with high- and low-level action sequences.
Most captivatingly, our PGM unlocks the director's mode, where the game is played by specifying goals for the agents in the form of a prompt.
Our method significantly outperforms existing neural video game simulators in terms of rendering quality and unlocks applications beyond the capabilities of the current state of the art.
arXiv Detail & Related papers (2023-03-23T17:43:17Z) - Infusing Commonsense World Models with Graph Knowledge [89.27044249858332]
We study the setting of generating narratives in an open world text adventure game.
A graph representation of the underlying game state can be used to train models that consume and output both grounded graph representations and natural language descriptions and actions.
arXiv Detail & Related papers (2023-01-13T19:58:27Z) - Learning to Scaffold: Optimizing Model Explanations for Teaching [74.25464914078826]
We train models on three natural language processing and computer vision tasks.
We find that students trained with explanations extracted with our framework are able to simulate the teacher significantly more effectively than ones produced with previous methods.
arXiv Detail & Related papers (2022-04-22T16:43:39Z) - Visualising Deep Network's Time-Series Representations [93.73198973454944]
Despite the popularisation of machine learning models, more often than not they still operate as black boxes with no insight into what is happening inside the model.
In this paper, a method that addresses that issue is proposed, with a focus on visualising multi-dimensional time-series data.
Experiments on a high-frequency stock market dataset show that the method provides fast and discernible visualisations.
arXiv Detail & Related papers (2021-03-12T09:53:34Z) - Player Modeling via Multi-Armed Bandits [6.64975374754221]
We present a novel approach to player modeling based on multi-armed bandits (MABs)
We present an approach to evaluating and fine-tuning these algorithms prior to generating data in a user study.
arXiv Detail & Related papers (2021-02-10T05:04:45Z) - Teach me to play, gamer! Imitative learning in computer games via
linguistic description of complex phenomena and decision tree [55.41644538483948]
We present a new machine learning model by imitation based on the linguistic description of complex phenomena.
The method can be a good alternative to design and implement the behaviour of intelligent agents in video game development.
arXiv Detail & Related papers (2021-01-06T21:14:10Z) - Neural Game Engine: Accurate learning of generalizable forward models
from pixels [0.0]
This paper introduces the Neural Game Engine, as a way to learn models directly from pixels.
Results on 10 deterministic General Video Game AI games demonstrate competitive performance.
arXiv Detail & Related papers (2020-03-23T20:04:55Z) - Model-Based Reinforcement Learning for Atari [89.3039240303797]
We show how video prediction models can enable agents to solve Atari games with fewer interactions than model-free methods.
Our experiments evaluate SimPLe on a range of Atari games in low data regime of 100k interactions between the agent and the environment.
arXiv Detail & Related papers (2019-03-01T15:40:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.