Generation of Games for Opponent Model Differentiation

• URL: http://arxiv.org/abs/2311.16781v1
• Date: Tue, 28 Nov 2023 13:45:03 GMT
• Title: Generation of Games for Opponent Model Differentiation
• Authors: David Milec, Viliam Lis\'y, Christopher Kiekintveld
• Abstract summary: Previous results show that modeling human behavior can significantly improve the performance of the algorithms. In this work, we use data gathered by psychologists who identified personality types that increase the likelihood of performing malicious acts. We created a novel model that links its parameters to psychological traits.
• Score: 2.164100958962259
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Protecting against adversarial attacks is a common multiagent problem. Attackers in the real world are predominantly human actors, and the protection methods often incorporate opponent models to improve the performance when facing humans. Previous results show that modeling human behavior can significantly improve the performance of the algorithms. However, modeling humans correctly is a complex problem, and the models are often simplified and assume humans make mistakes according to some distribution or train parameters for the whole population from which they sample. In this work, we use data gathered by psychologists who identified personality types that increase the likelihood of performing malicious acts. However, in the previous work, the tests on a handmade game could not show strategic differences between the models. We created a novel model that links its parameters to psychological traits. We optimized over parametrized games and created games in which the differences are profound. Our work can help with automatic game generation when we need a game in which some models will behave differently and to identify situations in which the models do not align.

Related papers

• Who's Gaming the System? A Causally-Motivated Approach for Detecting Strategic Adaptation [12.528928000871405]
  We consider a multi-agent setting where the goal is to identify the "worst offenders:" agents that are gaming most aggressively. We introduce a framework in which each agent's tendency to game is parameterized via a scalar. By recasting the problem as a causal effect estimation problem where different agents represent different "treatments," we prove that a ranking of all agents by their gaming parameters is identifiable.
  arXiv  Detail & Related papers  (2024-12-02T22:07:48Z)
• Expectation vs. Reality: Towards Verification of Psychological Games [18.30789345402813]
  Psychological games (PGs) were developed as a way to model and analyse agents with belief-dependent motivations. This paper proposes methods to solve PGs and implementing them within PRISM-games, a formal verification tool for games.
  arXiv  Detail & Related papers  (2024-11-08T14:41:52Z)
• Behavioural Cloning in VizDoom [1.4999444543328293]
  This paper describes methods for training autonomous agents to play the game "Doom 2" through Imitation Learning (IL) We also explore how Reinforcement Learning (RL) compares to IL for humanness by comparing camera movement and trajectory data.
  arXiv  Detail & Related papers  (2024-01-08T16:15:43Z)
• Incorporating Rivalry in Reinforcement Learning for a Competitive Game [65.2200847818153]
  This work proposes a novel reinforcement learning mechanism based on the social impact of rivalry behavior. Our proposed model aggregates objective and social perception mechanisms to derive a rivalry score that is used to modulate the learning of artificial agents.
  arXiv  Detail & Related papers  (2022-08-22T14:06:06Z)
• Detecting Individual Decision-Making Style: Exploring Behavioral Stylometry in Chess [4.793072503820555]
  We present a transformer-based approach to behavioral stylometry in the context of chess. Our method operates in a few-shot classification framework, and can correctly identify a player from among thousands of candidate players. We consider more broadly what our resulting embeddings reveal about human style in chess, as well as the potential ethical implications.
  arXiv  Detail & Related papers  (2022-08-02T11:18:16Z)
• Multi-Game Decision Transformers [49.257185338595434]
  We show that a single transformer-based model can play a suite of up to 46 Atari games simultaneously at close-to-human performance. We compare several approaches in this multi-game setting, such as online and offline RL methods and behavioral cloning. We find that our Multi-Game Decision Transformer models offer the best scalability and performance.
  arXiv  Detail & Related papers  (2022-05-30T16:55:38Z)
• Learning to Attack: Towards Textual Adversarial Attacking in Real-world Situations [81.82518920087175]
  Adversarial attacking aims to fool deep neural networks with adversarial examples. We propose a reinforcement learning based attack model, which can learn from attack history and launch attacks more efficiently.
  arXiv  Detail & Related papers  (2020-09-19T09:12:24Z)
• Adversarial Imitation Attack [63.76805962712481]
  A practical adversarial attack should require as little as possible knowledge of attacked models. Current substitute attacks need pre-trained models to generate adversarial examples. In this study, we propose a novel adversarial imitation attack.
  arXiv  Detail & Related papers  (2020-03-28T10:02:49Z)
• DaST: Data-free Substitute Training for Adversarial Attacks [55.76371274622313]
  We propose a data-free substitute training method (DaST) to obtain substitute models for adversarial black-box attacks. To achieve this, DaST utilizes specially designed generative adversarial networks (GANs) to train the substitute models. Experiments demonstrate the substitute models can achieve competitive performance compared with the baseline models.
  arXiv  Detail & Related papers  (2020-03-28T04:28:13Z)
• Model-Based Reinforcement Learning for Atari [89.3039240303797]
  We show how video prediction models can enable agents to solve Atari games with fewer interactions than model-free methods. Our experiments evaluate SimPLe on a range of Atari games in low data regime of 100k interactions between the agent and the environment.
  arXiv  Detail & Related papers  (2019-03-01T15:40:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.