Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections

• URL: http://arxiv.org/abs/2604.00284v1
• Date: Tue, 31 Mar 2026 22:16:25 GMT
• Title: Improvisational Games as a Benchmark for Social Intelligence of AI Agents: The Case of Connections
• Abstract summary: Playing Connections combines skills in knowledge retrieval, summarization and awareness of cognitive states of other agents.<n>We show how the game serves as a good benchmark for social intelligence abilities of language model based agents.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We formally introduce a improvisational wordplay game called Connections to explore reasoning capabilities of AI agents. Playing Connections combines skills in knowledge retrieval, summarization and awareness of cognitive states of other agents. We show how the game serves as a good benchmark for social intelligence abilities of language model based agents that go beyond the agents' own memory and deductive reasoning and also involve gauging the understanding capabilities of other agents. Finally, we show how through communication with other agents in a constrained environment, AI agents must demonstrate social awareness and intelligence in games involving collaboration.

Related papers

• When Should AI Read the Room? Public Perceptions of Social Intelligence in AI Agents [61.06747336710885]
  Social-AI agents are increasingly deployed in everyday settings.<n>Public perceptions of social intelligence in AI agents and the acceptability of these agents remain largely understudied.<n>We present a mixed-methods survey of adults in the United States.
  arXiv  Detail & Related papers  (2026-05-28T13:49:47Z)
• The AI in the Mirror: LLM Self-Recognition in an Iterated Public Goods Game [0.8594140167290097]
  We analyze the behavior of four reasoning and non-reasoning models across two conditions.<n>We find that, across different settings, telling LLMs that they are playing against themselves significantly changes their tendency to cooperate.<n>While our study is conducted in a toy environment, our results may provide insights into multi-agent settings where agents "unconsciously" discriminating against each other could inexplicably increase or decrease cooperation.
  arXiv  Detail & Related papers  (2025-08-25T20:35:03Z)
• FAIRGAME: a Framework for AI Agents Bias Recognition using Game Theory [51.96049148869987]
  We present FAIRGAME, a Framework for AI Agents Bias Recognition using Game Theory.<n>We describe its implementation and usage, and we employ it to uncover biased outcomes in popular games among AI agents.<n>Overall, FAIRGAME allows users to reliably and easily simulate their desired games and scenarios.
  arXiv  Detail & Related papers  (2025-04-19T15:29:04Z)
• Promoting Cooperation in the Public Goods Game using Artificial Intelligent Agents [0.0]
  Using a computational evolutionary model, we find that only when AI agents mimic player behavior does the critical synergy threshold for cooperation decrease.<n>This suggests that we can leverage AI to promote collective well-being in societal dilemmas by designing AI agents to mimic human players.
  arXiv  Detail & Related papers  (2024-12-06T22:16:21Z)
• Position Paper: Agent AI Towards a Holistic Intelligence [53.35971598180146]
  We emphasize developing Agent AI -- an embodied system that integrates large foundation models into agent actions. In this paper, we propose a novel large action model to achieve embodied intelligent behavior, the Agent Foundation Model.
  arXiv  Detail & Related papers  (2024-02-28T16:09:56Z)
• The Rise and Potential of Large Language Model Based Agents: A Survey [91.71061158000953]
  Large language models (LLMs) are regarded as potential sparks for Artificial General Intelligence (AGI) We start by tracing the concept of agents from its philosophical origins to its development in AI, and explain why LLMs are suitable foundations for agents. We explore the extensive applications of LLM-based agents in three aspects: single-agent scenarios, multi-agent scenarios, and human-agent cooperation.
  arXiv  Detail & Related papers  (2023-09-14T17:12:03Z)
• CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model Society [58.04479313658851]
  This paper explores the potential of building scalable techniques to facilitate autonomous cooperation among communicative agents. We propose a novel communicative agent framework named role-playing. Our contributions include introducing a novel communicative agent framework, offering a scalable approach for studying the cooperative behaviors and capabilities of multi-agent systems.
  arXiv  Detail & Related papers  (2023-03-31T01:09:00Z)
• Extended Intelligence [10.758382402269982]
  We argue that intelligence, construed as the disposition to perform tasks successfully, is a property of systems composed of agents and their contexts. In virtue of the thesis of extended intelligence, we contend that intelligence is context-bound, task-particular and incommensurable among agents.
  arXiv  Detail & Related papers  (2022-09-15T16:53:49Z)
• Cooperative Artificial Intelligence [0.0]
  We argue that there is a need for research on the intersection between game theory and artificial intelligence. We discuss the problem of how an external agent can promote cooperation between artificial learners. We show that the resulting cooperative outcome is stable in certain games even if the planning agent is turned off.
  arXiv  Detail & Related papers  (2022-02-20T16:50:37Z)
• Towards Socially Intelligent Agents with Mental State Transition and Human Utility [97.01430011496576]
  We propose to incorporate a mental state and utility model into dialogue agents. The hybrid mental state extracts information from both the dialogue and event observations. The utility model is a ranking model that learns human preferences from a crowd-sourced social commonsense dataset.
  arXiv  Detail & Related papers  (2021-03-12T00:06:51Z)
• A Proposal for Intelligent Agents with Episodic Memory [0.9236074230806579]
  We argue that an agent would benefit from an episodic memory. This memory encodes the agent's experience in such a way that the agent can relive the experience. We propose an architecture combining ANNs and standard Computer Science techniques for supporting storage and retrieval of episodic memories.
  arXiv  Detail & Related papers  (2020-05-07T00:26:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.