An Analysis of Deep Reinforcement Learning Agents for Text-based Games
- URL: http://arxiv.org/abs/2209.04105v2
- Date: Mon, 12 Sep 2022 12:40:19 GMT
- Title: An Analysis of Deep Reinforcement Learning Agents for Text-based Games
- Authors: Chen Chen, Yue Dai, Josiah Poon, Caren Han
- Abstract summary: Text-based games (TBG) are complex environments which allow users or computer agents to make textual interactions and achieve game goals.
Finding TBG agent deep learning modules' performance in standardized environments, and testing their performance among different evaluation types is also important for TBG agent research.
We constructed a standardized TBG agent with no hand-crafted rules, formally categorized TBG evaluation types, and analyzed selected methods in our environment.
- Score: 4.9702715037812055
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Text-based games(TBG) are complex environments which allow users or computer
agents to make textual interactions and achieve game goals.In TBG agent design
and training process, balancing the efficiency and performance of the agent
models is a major challenge. Finding TBG agent deep learning modules'
performance in standardized environments, and testing their performance among
different evaluation types is also important for TBG agent research. We
constructed a standardized TBG agent with no hand-crafted rules, formally
categorized TBG evaluation types, and analyzed selected methods in our
environment.
Related papers
- Exploring Effective Strategies for Building a Customised GPT Agent for Coding Classroom Dialogues [0.0]
This study investigates effective strategies for developing a customised GPT agent to code classroom dialogue.<n>Using GPT-4's MyGPT agent as a case, it evaluates its baseline performance in coding classroom dialogue with a human codebook.<n>The findings suggest that, despite some limitations, a MyGPT agent developed with these strategies can serve as a useful coding assistant.
arXiv Detail & Related papers (2025-06-08T15:29:05Z) - A modular framework for automated evaluation of procedural content generation in serious games with deep reinforcement learning agents [0.2796197251957244]
This study proposes a methodology for automated evaluation of PCG integration in Serious Games.<n>Three different versions of PCG for nonplayer character (NPC) creation have been tested.<n>Results highlight the superiority of the DRL game testing agents trained on Versions 2 and 3 over those trained on Version 1 in terms of win rate and training time.
arXiv Detail & Related papers (2025-05-22T15:40:56Z) - FAIRGAME: a Framework for AI Agents Bias Recognition using Game Theory [51.96049148869987]
We present FAIRGAME, a Framework for AI Agents Bias Recognition using Game Theory.
We describe its implementation and usage, and we employ it to uncover biased outcomes in popular games among AI agents.
Overall, FAIRGAME allows users to reliably and easily simulate their desired games and scenarios.
arXiv Detail & Related papers (2025-04-19T15:29:04Z) - Preference-based opponent shaping in differentiable games [3.373994463906893]
We propose a novel Preference-based Opponent Shaping (PBOS) method to enhance the strategy learning process by shaping agents' preferences towards cooperation.
We verify the performance of PBOS algorithm in a variety of differentiable games.
arXiv Detail & Related papers (2024-12-04T06:49:21Z) - Toward Optimal LLM Alignments Using Two-Player Games [86.39338084862324]
In this paper, we investigate alignment through the lens of two-agent games, involving iterative interactions between an adversarial and a defensive agent.
We theoretically demonstrate that this iterative reinforcement learning optimization converges to a Nash Equilibrium for the game induced by the agents.
Experimental results in safety scenarios demonstrate that learning in such a competitive environment not only fully trains agents but also leads to policies with enhanced generalization capabilities for both adversarial and defensive agents.
arXiv Detail & Related papers (2024-06-16T15:24:50Z) - Teamwork Dimensions Classification Using BERT [0.8566457170664924]
An automated natural language processing approach was developed to identify teamwork dimensions of students' online team chat.
Developments in the field of natural language processing and artificial intelligence have resulted in advanced deep transfer learning approaches.
This model will contribute towards an enhanced learning analytics tool for teamwork assessment and feedback.
arXiv Detail & Related papers (2023-12-09T07:18:41Z) - JoTR: A Joint Transformer and Reinforcement Learning Framework for
Dialog Policy Learning [53.83063435640911]
Dialogue policy learning (DPL) is a crucial component of dialogue modelling.
We introduce a novel framework, JoTR, to generate flexible dialogue actions.
Unlike traditional methods, JoTR formulates a word-level policy that allows for a more dynamic and adaptable dialogue action generation.
arXiv Detail & Related papers (2023-09-01T03:19:53Z) - A Reinforcement Learning-assisted Genetic Programming Algorithm for Team
Formation Problem Considering Person-Job Matching [70.28786574064694]
A reinforcement learning-assisted genetic programming algorithm (RL-GP) is proposed to enhance the quality of solutions.
The hyper-heuristic rules obtained through efficient learning can be utilized as decision-making aids when forming project teams.
arXiv Detail & Related papers (2023-04-08T14:32:12Z) - A Framework for Understanding and Visualizing Strategies of RL Agents [0.0]
We present a framework for learning comprehensible models of sequential decision tasks in which agent strategies are characterized using temporal logic formulas.
We evaluate our framework on combat scenarios in StarCraft II (SC2) using traces from a handcrafted expert policy and a trained reinforcement learning agent.
arXiv Detail & Related papers (2022-08-17T21:58:19Z) - Meta-Referential Games to Learn Compositional Learning Behaviours [0.20482269513546458]
A central problem to learning compositional learning behaviours (CLBs) is the resolution of a binding problem (BP)
We propose a benchmark to investigate agents' abilities to exhibit CLBs by solving a domain-agnostic version of the BP.
We provide baseline results and error analysis showing that our benchmark is a compelling challenge that we hope will spur the research community towards developing more capable artificial agents.
arXiv Detail & Related papers (2022-07-16T20:37:46Z) - Realistic simulation of users for IT systems in cyber ranges [63.20765930558542]
We instrument each machine by means of an external agent to generate user activity.
This agent combines both deterministic and deep learning based methods to adapt to different environment.
We also propose conditional text generation models to facilitate the creation of conversations and documents.
arXiv Detail & Related papers (2021-11-23T10:53:29Z) - Generalization in Text-based Games via Hierarchical Reinforcement
Learning [42.70991837415775]
We introduce a hierarchical framework built upon the knowledge graph-based RL agent.
In the high level, a meta-policy is executed to decompose the whole game into a set of subtasks specified by textual goals.
In the low level, a sub-policy is executed to conduct goal-conditioned reinforcement learning.
arXiv Detail & Related papers (2021-09-21T05:27:33Z) - DAGA: Data Augmentation with a Generation Approach for Low-resource
Tagging Tasks [88.62288327934499]
We propose a novel augmentation method with language models trained on the linearized labeled sentences.
Our method is applicable to both supervised and semi-supervised settings.
arXiv Detail & Related papers (2020-11-03T07:49:15Z) - Deep Reinforcement Learning with Stacked Hierarchical Attention for
Text-based Games [64.11746320061965]
We study reinforcement learning for text-based games, which are interactive simulations in the context of natural language.
We aim to conduct explicit reasoning with knowledge graphs for decision making, so that the actions of an agent are generated and supported by an interpretable inference procedure.
We extensively evaluate our method on a number of man-made benchmark games, and the experimental results demonstrate that our method performs better than existing text-based agents.
arXiv Detail & Related papers (2020-10-22T12:40:22Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.