Improving How Agents Cooperate: Attention Schemas in Artificial Neural Networks

• URL: http://arxiv.org/abs/2411.00983v1
• Date: Fri, 01 Nov 2024 19:18:07 GMT
• Title: Improving How Agents Cooperate: Attention Schemas in Artificial Neural Networks
• Authors: Kathryn T. Farrell, Kirsten Ziman, Michael S. A. Graziano,
• Abstract summary: Growing evidence suggests that the brain uses an "attention schema" to monitor, predict, and help control attention. It has also been suggested that an attention schema improves social intelligence by allowing one person to better predict another. Given their potential advantages, attention schemas have been increasingly tested in machine learning.
• Score: 0.0
• License:
• Abstract: Growing evidence suggests that the brain uses an "attention schema" to monitor, predict, and help control attention. It has also been suggested that an attention schema improves social intelligence by allowing one person to better predict another. Given their potential advantages, attention schemas have been increasingly tested in machine learning. Here we test small deep learning networks to determine how the addition of an attention schema may affect performance on a range of tasks. First, we found that an agent with an attention schema is better at judging or categorizing the attention states of other agents. Second, we found that an agent with an attention schema develops a pattern of attention that is easier for other agents to judge and categorize. Third, we found that in a joint task where two agents paint a scene together and must predict each other's behavior for best performance, adding an attention schema improves that performance. Finally, we find that the performance improvements caused by an attention schema are not a non-specific result of an increase in network complexity. Not all performance, on all tasks, is improved. Instead, improvement is specific to "social" tasks involving judging, categorizing, or predicting the attention of other agents. These results suggest that an attention schema may be useful in machine learning for improving cooperativity and social behavior.

Related papers

• Attention Schema in Neural Agents [66.43628974353683]
  In cognitive neuroscience, Attention Theory (AST) supports the idea of distinguishing attention from AS. AST predicts that an agent can use its own AS to also infer the states of other agents' attention. We explore different ways in which attention and AS interact with each other.
  arXiv  Detail & Related papers  (2023-05-27T05:40:34Z)
• Attention in Reasoning: Dataset, Analysis, and Modeling [31.3104693230952]
  We propose an Attention with Reasoning capability (AiR) framework that uses attention to understand and improve the process leading to task outcomes. We first define an evaluation metric based on a sequence of atomic reasoning operations, enabling a quantitative measurement of attention. We then collect human eye-tracking and answer correctness data, and analyze various machine and human attention mechanisms on their reasoning capability.
  arXiv  Detail & Related papers  (2022-04-20T20:32:31Z)
• Alignment Attention by Matching Key and Query Distributions [48.93793773929006]
  This paper introduces alignment attention that explicitly encourages self-attention to match the distributions of the key and query within each head. It is simple to convert any models with self-attention, including pre-trained ones, to the proposed alignment attention. On a variety of language understanding tasks, we show the effectiveness of our method in accuracy, uncertainty estimation, generalization across domains, and robustness to adversarial attacks.
  arXiv  Detail & Related papers  (2021-10-25T00:54:57Z)
• Counterfactual Attention Learning for Fine-Grained Visual Categorization and Re-identification [101.49122450005869]
  We present a counterfactual attention learning method to learn more effective attention based on causal inference. Specifically, we analyze the effect of the learned visual attention on network prediction. We evaluate our method on a wide range of fine-grained recognition tasks.
  arXiv  Detail & Related papers  (2021-08-19T14:53:40Z)
• Understanding top-down attention using task-oriented ablation design [0.22940141855172028]
  Top-down attention allows neural networks, both artificial and biological, to focus on the information most relevant for a given task. We aim to answer this with a computational experiment based on a general framework called task-oriented ablation design. We compare the performance of two neural networks, one with top-down attention and one without.
  arXiv  Detail & Related papers  (2021-06-08T21:01:47Z)
• Joint Attention for Multi-Agent Coordination and Social Learning [108.31232213078597]
  We show that joint attention can be useful as a mechanism for improving multi-agent coordination and social learning. Joint attention leads to higher performance than a competitive centralized critic baseline across multiple environments. Taken together, these findings suggest that joint attention may be a useful inductive bias for multi-agent learning.
  arXiv  Detail & Related papers  (2021-04-15T20:14:19Z)
• AiR: Attention with Reasoning Capability [31.3104693230952]
  We propose an Attention with Reasoning capability (AiR) framework that uses attention to understand and improve the process leading to task outcomes. We first define an evaluation metric based on a sequence of atomic reasoning operations, enabling quantitative measurement of attention that considers the reasoning process. We then collect human eye-tracking and answer correctness data, and analyze various machine and human attentions on their reasoning capability and how they impact task performance.
  arXiv  Detail & Related papers  (2020-07-28T18:09:45Z)
• Deep Reinforced Attention Learning for Quality-Aware Visual Recognition [73.15276998621582]
  We build upon the weakly-supervised generation mechanism of intermediate attention maps in any convolutional neural networks. We introduce a meta critic network to evaluate the quality of attention maps in the main network.
  arXiv  Detail & Related papers  (2020-07-13T02:44:38Z)
• Exploring Self-attention for Image Recognition [151.12000247183636]
  We consider two forms of self-attention for image recognition. One is pairwise self-attention, which generalizes standard dot-product attention. The other is patchwise self-attention, which is strictly more powerful than convolution.
  arXiv  Detail & Related papers  (2020-04-28T16:01:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.