Incorporating Pragmatic Reasoning Communication into Emergent Language
- URL: http://arxiv.org/abs/2006.04109v2
- Date: Tue, 15 Dec 2020 18:19:21 GMT
- Title: Incorporating Pragmatic Reasoning Communication into Emergent Language
- Authors: Yipeng Kang, Tonghan Wang, Gerard de Melo
- Abstract summary: We study the dynamics of linguistic communication along substantially different intelligence and intelligence levels.
We propose computational models that combine short-term mutual reasoning-based pragmatics with long-term language emergentism.
Our results shed light on their importance for making inroads towards getting more natural, accurate, robust, fine-grained, and succinct utterances.
- Score: 38.134221799334426
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Emergentism and pragmatics are two research fields that study the dynamics of
linguistic communication along substantially different timescales and
intelligence levels. From the perspective of multi-agent reinforcement
learning, they correspond to stochastic games with reinforcement training and
stage games with opponent awareness. Given that their combination has been
explored in linguistics, we propose computational models that combine
short-term mutual reasoning-based pragmatics with long-term language
emergentism. We explore this for agent communication referential games as well
as in Starcraft II, assessing the relative merits of different kinds of mutual
reasoning pragmatics models both empirically and theoretically. Our results
shed light on their importance for making inroads towards getting more natural,
accurate, robust, fine-grained, and succinct utterances.
Related papers
- Reframing linguistic bootstrapping as joint inference using visually-grounded grammar induction models [31.006803764376475]
Semantic and syntactic bootstrapping posit that children use their prior knowledge of one linguistic domain, say syntactic relations, to help later acquire another, such as the meanings of new words.
Here, we argue that they are instead both contingent on a more general learning strategy for language acquisition: joint learning.
Using a series of neural visually-grounded grammar induction models, we demonstrate that both syntactic and semantic bootstrapping effects are strongest when syntax and semantics are learnt simultaneously.
arXiv Detail & Related papers (2024-06-17T18:01:06Z) - Igniting Language Intelligence: The Hitchhiker's Guide From
Chain-of-Thought Reasoning to Language Agents [80.5213198675411]
Large language models (LLMs) have dramatically enhanced the field of language intelligence.
LLMs leverage the intriguing chain-of-thought (CoT) reasoning techniques, obliging them to formulate intermediate steps en route to deriving an answer.
Recent research endeavors have extended CoT reasoning methodologies to nurture the development of autonomous language agents.
arXiv Detail & Related papers (2023-11-20T14:30:55Z) - Regularized Conventions: Equilibrium Computation as a Model of Pragmatic
Reasoning [72.21876989058858]
We present a model of pragmatic language understanding, where utterances are produced and understood by searching for regularized equilibria of signaling games.
In this model speakers and listeners search for contextually appropriate utterance--meaning mappings that are both close to game-theoretically optimal conventions and close to a shared, ''default'' semantics.
arXiv Detail & Related papers (2023-11-16T09:42:36Z) - Emergent Communication for Rules Reasoning [38.24159397787027]
We propose the Reasoning Game, a cognition-oriented environment that encourages agents to reason and communicate high-level rules.
Experimental results show that, in the Reasoning Game, a semantically stable and compositional language emerges to solve reasoning problems.
arXiv Detail & Related papers (2023-11-08T05:57:39Z) - From Heuristic to Analytic: Cognitively Motivated Strategies for
Coherent Physical Commonsense Reasoning [66.98861219674039]
Heuristic-Analytic Reasoning (HAR) strategies drastically improve the coherence of rationalizations for model decisions.
Our findings suggest that human-like reasoning strategies can effectively improve the coherence and reliability of PLM reasoning.
arXiv Detail & Related papers (2023-10-24T19:46:04Z) - From Word Models to World Models: Translating from Natural Language to
the Probabilistic Language of Thought [124.40905824051079]
We propose rational meaning construction, a computational framework for language-informed thinking.
We frame linguistic meaning as a context-sensitive mapping from natural language into a probabilistic language of thought.
We show that LLMs can generate context-sensitive translations that capture pragmatically-appropriate linguistic meanings.
We extend our framework to integrate cognitively-motivated symbolic modules.
arXiv Detail & Related papers (2023-06-22T05:14:00Z) - DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning [89.92601337474954]
Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations.
We introduce a novel challenge, DiPlomat, aiming at benchmarking machines' capabilities on pragmatic reasoning and situated conversational understanding.
arXiv Detail & Related papers (2023-06-15T10:41:23Z) - Emergent Communication of Generalizations [13.14792537601313]
We argue that communicating about a single object in a shared visual context is prone to overfitting and does not encourage language useful beyond concrete reference.
We propose games that require communicating generalizations over sets of objects representing abstract visual concepts.
We find that these games greatly improve systematicity and interpretability of the learned languages.
arXiv Detail & Related papers (2021-06-04T19:02:18Z) - Extending rational models of communication from beliefs to actions [10.169856458866088]
Speakers communicate to influence their partner's beliefs and shape their actions.
We develop three speaker models: a belief-oriented speaker with a purely informative objective; an action-oriented speaker with an instrumental objective; and a combined speaker which integrates the two.
We show that grounding production choices in future listener actions results in relevance effects and flexible uses of nonliteral language.
arXiv Detail & Related papers (2021-05-25T13:58:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.