A Practical Guide to Studying Emergent Communication through Grounded Language Games

• URL: http://arxiv.org/abs/2004.09218v1
• Date: Mon, 20 Apr 2020 11:48:24 GMT
• Title: A Practical Guide to Studying Emergent Communication through Grounded Language Games
• Authors: Jens Nevens and Paul Van Eecke and Katrien Beuls
• Abstract summary: This paper introduces a high-level robot interface that extends the Babel software system. It presents for the first time a toolkit that provides flexible modules for dealing with each subtask involved in running advanced grounded language game experiments.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The question of how an effective and efficient communication system can emerge in a population of agents that need to solve a particular task attracts more and more attention from researchers in many fields, including artificial intelligence, linguistics and statistical physics. A common methodology for studying this question consists of carrying out multi-agent experiments in which a population of agents takes part in a series of scripted and task-oriented communicative interactions, called 'language games'. While each individual language game is typically played by two agents in the population, a large series of games allows the population to converge on a shared communication system. Setting up an experiment in which a rich system for communicating about the real world emerges is a major enterprise, as it requires a variety of software components for running multi-agent experiments, for interacting with sensors and actuators, for conceptualising and interpreting semantic structures, and for mapping between these semantic structures and linguistic utterances. The aim of this paper is twofold. On the one hand, it introduces a high-level robot interface that extends the Babel software system, presenting for the first time a toolkit that provides flexible modules for dealing with each subtask involved in running advanced grounded language game experiments. On the other hand, it provides a practical guide to using the toolkit for implementing such experiments, taking a grounded colour naming game experiment as a didactic example.

Related papers

• Aviary: training language agents on challenging scientific tasks [3.166958237958637]
  We introduce Aviary, a language-grounded Markov gymnasium for language agents. We formalize agents as policies solving language-grounded partially observable decision processes. We show that language agents backed by open-source, non-frontier LLMs can match and exceed both frontier LLM agents and human experts on multiple tasks at up to 100x lower inference cost.
  arXiv  Detail & Related papers  (2024-12-30T18:33:28Z)
• Bidirectional Emergent Language in Situated Environments [4.950411915351642]
  We introduce two novel cooperative environments: Multi-Agent Pong and Collectors. optimal performance requires the emergence of a communication protocol, but moderate success can be achieved without one. We find that the emerging communication is sparse, with the agents only generating meaningful messages and acting upon incoming messages in states where they cannot succeed without coordination.
  arXiv  Detail & Related papers  (2024-08-26T21:25:44Z)
• Symbolic Learning Enables Self-Evolving Agents [55.625275970720374]
  We introduce agent symbolic learning, a systematic framework that enables language agents to optimize themselves on their own. Agent symbolic learning is designed to optimize the symbolic network within language agents by mimicking two fundamental algorithms in connectionist learning. We conduct proof-of-concept experiments on both standard benchmarks and complex real-world tasks.
  arXiv  Detail & Related papers  (2024-06-26T17:59:18Z)
• Scaling Instructable Agents Across Many Simulated Worlds [70.97268311053328]
  Our goal is to develop an agent that can accomplish anything a human can do in any simulated 3D environment. Our approach focuses on language-driven generality while imposing minimal assumptions. Our agents interact with environments in real-time using a generic, human-like interface.
  arXiv  Detail & Related papers  (2024-03-13T17:50:32Z)
• Learning to Model the World with Language [100.76069091703505]
  To interact with humans and act in the world, agents need to understand the range of language that people use and relate it to the visual world. Our key idea is that agents should interpret such diverse language as a signal that helps them predict the future. We instantiate this in Dynalang, an agent that learns a multimodal world model to predict future text and image representations.
  arXiv  Detail & Related papers  (2023-07-31T17:57:49Z)
• ChatDev: Communicative Agents for Software Development [84.90400377131962]
  ChatDev is a chat-powered software development framework in which specialized agents are guided in what to communicate. These agents actively contribute to the design, coding, and testing phases through unified language-based communication.
  arXiv  Detail & Related papers  (2023-07-16T02:11:34Z)
• Collecting Interactive Multi-modal Datasets for Grounded Language Understanding [66.30648042100123]
  We formalized the collaborative embodied agent using natural language task. We developed a tool for extensive and scalable data collection. We collected the first dataset for interactive grounded language understanding.
  arXiv  Detail & Related papers  (2022-11-12T02:36:32Z)
• Learning to Ground Multi-Agent Communication with Autoencoders [43.22048280036316]
  Communication requires a common language, a lingua franca, between agents. We demonstrate a simple way to ground language in learned representations. We find that a standard representation learning algorithm is sufficient for arriving at a grounded common language.
  arXiv  Detail & Related papers  (2021-10-28T17:57:26Z)
• Emergent Communication of Generalizations [13.14792537601313]
  We argue that communicating about a single object in a shared visual context is prone to overfitting and does not encourage language useful beyond concrete reference. We propose games that require communicating generalizations over sets of objects representing abstract visual concepts. We find that these games greatly improve systematicity and interpretability of the learned languages.
  arXiv  Detail & Related papers  (2021-06-04T19:02:18Z)
• ReferentialGym: A Nomenclature and Framework for Language Emergence & Grounding in (Visual) Referential Games [0.30458514384586394]
  Natural languages are powerful tools wielded by human beings to communicate information and co-operate towards common goals. computational linguists have been researching the emergence of in artificial languages induced by language games. The AI community has started to investigate language emergence and grounding working towards better human-machine interfaces.
  arXiv  Detail & Related papers  (2020-12-17T10:22:15Z)
• On the interaction between supervision and self-play in emergent communication [82.290338507106]
  We investigate the relationship between two categories of learning signals with the ultimate goal of improving sample efficiency. We find that first training agents via supervised learning on human data followed by self-play outperforms the converse.
  arXiv  Detail & Related papers  (2020-02-04T02:35:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.