Establishing Shared Query Understanding in an Open Multi-Agent System
- URL: http://arxiv.org/abs/2305.09349v1
- Date: Tue, 16 May 2023 11:07:05 GMT
- Title: Establishing Shared Query Understanding in an Open Multi-Agent System
- Authors: Nikolaos Kondylidis, Ilaria Tiddi and Annette ten Teije
- Abstract summary: We propose a method that allows to develop shared understanding between two agents for the purpose of performing a task that requires cooperation.
Our method focuses on efficiently establishing successful task-oriented communication in an open multi-agent system.
- Score: 1.2031796234206138
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We propose a method that allows to develop shared understanding between two
agents for the purpose of performing a task that requires cooperation. Our
method focuses on efficiently establishing successful task-oriented
communication in an open multi-agent system, where the agents do not know
anything about each other and can only communicate via grounded interaction.
The method aims to assist researchers that work on human-machine interaction or
scenarios that require a human-in-the-loop, by defining interaction
restrictions and efficiency metrics. To that end, we point out the challenges
and limitations of such a (diverse) setup, while also restrictions and
requirements which aim to ensure that high task performance truthfully reflects
the extent to which the agents correctly understand each other. Furthermore, we
demonstrate a use-case where our method can be applied for the task of
cooperative query answering. We design the experiments by modifying an
established ontology alignment benchmark. In this example, the agents want to
query each other, while representing different databases, defined in their own
ontologies that contain different and incomplete knowledge. Grounded
interaction here has the form of examples that consists of common instances,
for which the agents are expected to have similar knowledge. Our experiments
demonstrate successful communication establishment under the required
restrictions, and compare different agent policies that aim to solve the task
in an efficient manner.
Related papers
- Communication Learning in Multi-Agent Systems from Graph Modeling Perspective [62.13508281188895]
We introduce a novel approach wherein we conceptualize the communication architecture among agents as a learnable graph.
We introduce a temporal gating mechanism for each agent, enabling dynamic decisions on whether to receive shared information at a given time.
arXiv Detail & Related papers (2024-11-01T05:56:51Z) - A Survey on Complex Tasks for Goal-Directed Interactive Agents [60.53915548970061]
This survey compiles relevant tasks and environments for evaluating goal-directed interactive agents.
An up-to-date compilation of relevant resources can be found on our project website.
arXiv Detail & Related papers (2024-09-27T08:17:53Z) - AntEval: Evaluation of Social Interaction Competencies in LLM-Driven
Agents [65.16893197330589]
Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios.
However, their capability in handling complex, multi-character social interactions has yet to be fully explored.
We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
arXiv Detail & Related papers (2024-01-12T11:18:00Z) - Multi-Agent Consensus Seeking via Large Language Models [6.922356864800498]
Multi-agent systems driven by large language models (LLMs) have shown promising abilities for solving complex tasks in a collaborative manner.
This work considers a fundamental problem in multi-agent collaboration: consensus seeking.
arXiv Detail & Related papers (2023-10-31T03:37:11Z) - Cooperation, Competition, and Maliciousness: LLM-Stakeholders Interactive Negotiation [52.930183136111864]
We propose using scorable negotiation to evaluate Large Language Models (LLMs)
To reach an agreement, agents must have strong arithmetic, inference, exploration, and planning capabilities.
We provide procedures to create new games and increase games' difficulty to have an evolving benchmark.
arXiv Detail & Related papers (2023-09-29T13:33:06Z) - Local Minima Drive Communications in Cooperative Interaction [6.709659274527638]
It is hypothesised that in cooperative tasks, the function of communication is to coordinate actions in a complex search space that contains local minima.
These principles have been verified in a computer-based simulation environment in which two independent one-dimensional agents are obliged to cooperate.
arXiv Detail & Related papers (2023-07-18T15:48:37Z) - CAMEL: Communicative Agents for "Mind" Exploration of Large Language
Model Society [58.04479313658851]
This paper explores the potential of building scalable techniques to facilitate autonomous cooperation among communicative agents.
We propose a novel communicative agent framework named role-playing.
Our contributions include introducing a novel communicative agent framework, offering a scalable approach for studying the cooperative behaviors and capabilities of multi-agent systems.
arXiv Detail & Related papers (2023-03-31T01:09:00Z) - Towards Collaborative Question Answering: A Preliminary Study [63.91687114660126]
We propose CollabQA, a novel QA task in which several expert agents coordinated by a moderator work together to answer questions that cannot be answered with any single agent alone.
We make a synthetic dataset of a large knowledge graph that can be distributed to experts.
We show that the problem can be challenging without introducing prior to the collaboration structure, unless experts are perfect and uniform.
arXiv Detail & Related papers (2022-01-24T14:27:00Z) - Domain-Robust Visual Imitation Learning with Mutual Information
Constraints [0.0]
We introduce a new algorithm called Disentangling Generative Adversarial Imitation Learning (DisentanGAIL)
Our algorithm enables autonomous agents to learn directly from high dimensional observations of an expert performing a task.
arXiv Detail & Related papers (2021-03-08T21:18:58Z) - Modeling the Interaction between Agents in Cooperative Multi-Agent
Reinforcement Learning [2.9360071145551068]
We propose a novel cooperative MARL algorithm named as interactive actor-critic(IAC)
IAC models the interaction of agents from perspectives of policy and value function.
We extend the value decomposition methods to continuous control tasks and evaluate IAC on benchmark tasks including classic control and multi-agent particle environments.
arXiv Detail & Related papers (2021-02-10T01:58:28Z) - Counterfactual Multi-Agent Reinforcement Learning with Graph Convolution
Communication [5.5438676149999075]
We consider a fully cooperative multi-agent system where agents cooperate to maximize a system's utility.
We propose that multi-agent systems must have the ability to communicate and understand the inter-plays between agents.
We develop an architecture that allows for communication among agents and tailors the system's reward for each individual agent.
arXiv Detail & Related papers (2020-04-01T14:36:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.