More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play

• URL: http://arxiv.org/abs/2406.04643v1
• Date: Fri, 7 Jun 2024 05:03:44 GMT
• Title: More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play
• Authors: Wichayaporn Wongkamjan, Feng Gu, Yanze Wang, Ulf Hermjakob, Jonathan May, Brandon M. Stewart, Jonathan K. Kummerfeld, Denis Peskoff, Jordan Lee Boyd-Graber,
• Abstract summary: This work seeks to understand the degree to which Cicero succeeds at communication. We run two dozen games with humans and Cicero, totaling over 200 human-player hours of competition. While AI can consistently outplay human players, AI-Human communication is still limited because of AI's difficulty with deception and persuasion.
• Score: 28.004172388400132
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The boardgame Diplomacy is a challenging setting for communicative and cooperative artificial intelligence. The most prominent communicative Diplomacy AI, Cicero, has excellent strategic abilities, exceeding human players. However, the best Diplomacy players master communication, not just tactics, which is why the game has received attention as an AI challenge. This work seeks to understand the degree to which Cicero succeeds at communication. First, we annotate in-game communication with abstract meaning representation to separate in-game tactics from general language. Second, we run two dozen games with humans and Cicero, totaling over 200 human-player hours of competition. While AI can consistently outplay human players, AI-Human communication is still limited because of AI's difficulty with deception and persuasion. This shows that Cicero relies on strategy and has not yet reached the full promise of communicative and cooperative AI.

Related papers

• Prompting Fairness: Artificial Intelligence as Game Players [0.0]
  Utilitarian games to measure fairness have been studied in the social sciences for decades. Over 101 rounds of the dictator game, I conclude that AI has a strong sense of fairness that is dependant on it. There may be evidence that AI experiences inequality aversion just as humans.
  arXiv  Detail & Related papers  (2024-02-08T16:24:40Z)
• CivRealm: A Learning and Reasoning Odyssey in Civilization for Decision-Making Agents [63.79739920174535]
  We introduce CivRealm, an environment inspired by the Civilization game. CivRealm stands as a unique learning and reasoning challenge for decision-making agents.
  arXiv  Detail & Related papers  (2024-01-19T09:14:11Z)
• DanZero+: Dominating the GuanDan Game through Reinforcement Learning [95.90682269990705]
  We develop an AI program for an exceptionally complex and popular card game called GuanDan. We first put forward an AI program named DanZero for this game. In order to further enhance the AI's capabilities, we apply policy-based reinforcement learning algorithm to GuanDan.
  arXiv  Detail & Related papers  (2023-12-05T08:07:32Z)
• Adversarial Policies Beat Superhuman Go AIs [54.15639517188804]
  We attack the state-of-the-art Go-playing AI system KataGo by training adversarial policies against it. Our adversaries do not win by playing Go well. Instead, they trick KataGo into making serious blunders. Our results demonstrate that even superhuman AI systems may harbor surprising failure modes.
  arXiv  Detail & Related papers  (2022-11-01T03:13:20Z)
• Mastering the Game of No-Press Diplomacy via Human-Regularized Reinforcement Learning and Planning [95.78031053296513]
  No-press Diplomacy is a complex strategy game involving both cooperation and competition. We introduce a planning algorithm we call DiL-piKL that regularizes a reward-maximizing policy toward a human imitation-learned policy. We show that DiL-piKL can be extended into a self-play reinforcement learning algorithm we call RL-DiL-piKL.
  arXiv  Detail & Related papers  (2022-10-11T14:47:35Z)
• The NPC AI of \textit{The Last of Us}: A case study [0.0]
  The Last of Us is a game focused on stealth, companionship and strategy. There are three main NPCs the game has - Infected, Human enemy and Buddy AIs. This case study talks about the challenges in front of the developers to create AI for these NPCs and the AI techniques they used to solve them.
  arXiv  Detail & Related papers  (2022-07-01T23:10:40Z)
• No-Press Diplomacy from Scratch [26.36204634856853]
  We describe an algorithm for action exploration and equilibrium approximation in games with superhuman action spaces. We train an agent, DORA, completely from scratch for a popular two-player variant of Diplomacy and show that it achieves superhuman performance. We extend our methods to full-scale no-press Diplomacy and for the first time train an agent from scratch with no human data.
  arXiv  Detail & Related papers  (2021-10-06T17:12:50Z)
• Human-Level Performance in No-Press Diplomacy via Equilibrium Search [29.858369754530905]
  We describe an agent for the no-press variant of Diplomacy that combines supervised learning on human data with one-step lookahead search via regret minimization. We show that our agent greatly exceeds the performance of past no-press Diplomacy bots, is unexploitable by expert humans, and ranks in the top 2% of human players when playing anonymous games on a popular Diplomacy website.
  arXiv  Detail & Related papers  (2020-10-06T01:28:34Z)
• Suphx: Mastering Mahjong with Deep Reinforcement Learning [114.68233321904623]
  We design an AI for Mahjong, named Suphx, based on deep reinforcement learning with some newly introduced techniques. Suphx has demonstrated stronger performance than most top human players in terms of stable rank. This is the first time that a computer program outperforms most top human players in Mahjong.
  arXiv  Detail & Related papers  (2020-03-30T16:18:16Z)
• Learning to Resolve Alliance Dilemmas in Many-Player Zero-Sum Games [22.38765498549914]
  We argue that a systematic study of many-player zero-sum games is a crucial element of artificial intelligence research. Using symmetric zero-sum matrix games, we demonstrate formally that alliance formation may be seen as a social dilemma. We show how reinforcement learning may be augmented with a peer-to-peer contract mechanism to discover and enforce alliances.
  arXiv  Detail & Related papers  (2020-02-27T10:32:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.