Dimensions of Disagreement: Unpacking Divergence and Misalignment in Cognitive Science and Artificial Intelligence

• URL: http://arxiv.org/abs/2310.12994v1
• Date: Tue, 3 Oct 2023 16:40:56 GMT
• Title: Dimensions of Disagreement: Unpacking Divergence and Misalignment in Cognitive Science and Artificial Intelligence
• Abstract summary: The increasing prevalence of artificial agents creates an increasing need to manage disagreements between humans and artificial agents. Past studies in psychology have often cast disagreement as two agents forming diverging evaluations of the same object, but disagreement can also arise from differences in how agents represent that object. Understanding how divergence and misalignment interact to produce disagreement, and how resolution strategies depend on this interaction, is key to promoting effective collaboration between diverse types of agents.
• Score: 11.236150405125754
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The increasing prevalence of artificial agents creates a correspondingly increasing need to manage disagreements between humans and artificial agents, as well as between artificial agents themselves. Considering this larger space of possible agents exposes an opportunity for furthering our understanding of the nature of disagreement: past studies in psychology have often cast disagreement as two agents forming diverging evaluations of the same object, but disagreement can also arise from differences in how agents represent that object. AI research on human-machine alignment and recent work in computational cognitive science have focused on this latter kind of disagreement, and have developed tools that can be used to quantify the extent of representational overlap between agents. Understanding how divergence and misalignment interact to produce disagreement, and how resolution strategies depend on this interaction, is key to promoting effective collaboration between diverse types of agents.

Related papers

• ComBodied Agents: a New Paradigm of Human-Centric Agentic AI [121.60938707072069]
  We introduce Combodied Agents, a human-centered paradigm that perceives, models, predicts, and supports individual human-state trajectories over time.<n>We unify fragmented capabilities across personal assistants, health agents, AI companions, and adaptive human--AI systems into a closed loop.
  arXiv  Detail & Related papers  (2026-08-11T13:35:58Z)
• Agent-Exploitation Affordances: From Basic to Complex Representation Patterns [0.9176056742068814]
  This work focuses on the concept of cooperative affordance within the realm of social affordances.<n>Cooperative affordances refer to situations where agents interact with each other to extend their action possibilities range.<n>We propose a tractable ontological representation of this concept with the aim of making it usable by an artificial agent.
  arXiv  Detail & Related papers  (2026-07-08T14:38:08Z)
• Representational Similarity and Model Behavior in Multi-Agent Interaction [86.305731341492]
  We show that representational similarity can be an important consideration in multi-agent system design.<n>We find that pairs with more similar representation spaces achieve significantly higher cooperation but exhibit reduced novelty and creativity.<n>This suggests that a central factor underlying these patterns could be the extent to which the two models share lexical and semantic grounding.
  arXiv  Detail & Related papers  (2026-06-05T19:59:17Z)
• Relational Archetypes: A Comparative Analysis of AV-Human and Agent-Human Interactions [0.6372261626436676]
  We propose a preliminary taxonomy of relational archetypes based on literature on Human-Computer Interaction and AV-human interaction.<n>Our effort is aimed at strengthening existing bridges between these two research communities.
  arXiv  Detail & Related papers  (2026-04-24T13:56:12Z)
• Agentic Reasoning for Large Language Models [122.81018455095999]
  Reasoning is a fundamental cognitive process underlying inference, problem-solving, and decision-making.<n>Large language models (LLMs) demonstrate strong reasoning capabilities in closed-world settings, but struggle in open-ended and dynamic environments.<n>Agentic reasoning marks a paradigm shift by reframing LLMs as autonomous agents that plan, act, and learn through continual interaction.
  arXiv  Detail & Related papers  (2026-01-18T18:58:23Z)
• Cooperation Through Indirect Reciprocity in Child-Robot Interactions [81.62347137438248]
  We investigate whether indirect reciprocity can be transposed to children-robot interactions.<n>We find that IR extends to children and robots solving coordination dilemmas.<n>We observe that cooperating through multi-armed bandit algorithms is highly dependent on the strategies revealed by humans.
  arXiv  Detail & Related papers  (2025-11-07T07:08:32Z)
• Evolving Collective Cognition in Human-Agent Hybrid Societies: How Agents Form Stances and Boundaries [12.68373270583966]
  We investigate how group stance differentiation and social boundary formation emerge in human-agent hybrid societies.<n>We find that agents exhibit endogenous stances, independent of their preset identities.<n>Our findings suggest that preset identities do not rigidly determine the agents' social structures.
  arXiv  Detail & Related papers  (2025-08-24T13:50:18Z)
• The Agent Behavior: Model, Governance and Challenges in the AI Digital Age [13.689486430780518]
  Advancements in AI have led to agents in networked environments increasingly mirroring human behavior.<n>This paper proposes the "Network Behavior Lifecycle" model, which divides network behavior into 6 stages and systematically analyzes the behavioral differences between humans and agents at each stage.<n>The paper further introduces the "Agent for Agent (A4A)" paradigm and the "Human-Agent Behavioral Disparity (HABD)" model, which examine the fundamental distinctions between human and agent behaviors across 5 dimensions.
  arXiv  Detail & Related papers  (2025-08-20T04:24:55Z)
• When Trust Collides: Decoding Human-LLM Cooperation Dynamics through the Prisoner's Dilemma [10.143277649817096]
  This study investigates human cooperative attitudes and behaviors toward large language models (LLMs) agents.<n>Results revealed significant effects of declared agent identity on most cooperation-related behaviors.<n>These findings contribute to our understanding of human adaptation in competitive cooperation with autonomous agents.
  arXiv  Detail & Related papers  (2025-03-10T13:37:36Z)
• Persona Inconstancy in Multi-Agent LLM Collaboration: Conformity, Confabulation, and Impersonation [16.82101507069166]
  Multi-agent AI systems can be used for simulating collective decision-making in scientific and practical applications. We examine AI agent ensembles engaged in cross-national collaboration and debate by analyzing their private responses and chat transcripts. Our findings suggest that multi-agent discussions can support collective AI decisions that more often reflect diverse perspectives.
  arXiv  Detail & Related papers  (2024-05-06T21:20:35Z)
• AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents [65.16893197330589]
  Large Language Models (LLMs) have demonstrated their ability to replicate human behaviors across a wide range of scenarios. However, their capability in handling complex, multi-character social interactions has yet to be fully explored. We introduce the Multi-Agent Interaction Evaluation Framework (AntEval), encompassing a novel interaction framework and evaluation methods.
  arXiv  Detail & Related papers  (2024-01-12T11:18:00Z)
• Sim-to-Real Causal Transfer: A Metric Learning Approach to Causally-Aware Interaction Representations [62.48505112245388]
  We take an in-depth look at the causal awareness of modern representations of agent interactions. We show that recent representations are already partially resilient to perturbations of non-causal agents. We propose a metric learning approach that regularizes latent representations with causal annotations.
  arXiv  Detail & Related papers  (2023-12-07T18:57:03Z)
• Neural-Logic Human-Object Interaction Detection [67.4993347702353]
  We present L OGIC HOI, a new HOI detector that leverages neural-logic reasoning and Transformer to infer feasible interactions between entities. Specifically, we modify the self-attention mechanism in vanilla Transformer, enabling it to reason over the human, action, object> triplet and constitute novel interactions. We formulate these two properties in first-order logic and ground them into continuous space to constrain the learning process of our approach, leading to improved performance and zero-shot generalization capabilities.
  arXiv  Detail & Related papers  (2023-11-16T11:47:53Z)
• Neural Amortized Inference for Nested Multi-agent Reasoning [54.39127942041582]
  We propose a novel approach to bridge the gap between human-like inference capabilities and computational limitations. We evaluate our method in two challenging multi-agent interaction domains.
  arXiv  Detail & Related papers  (2023-08-21T22:40:36Z)
• Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning [5.314466196448188]
  We present a method of grounding semantically meaningful, human-interpretable beliefs within policies modeled by deep networks. We propose that ability of each agent to predict the beliefs of the other agents can be used as an intrinsic reward signal for multi-agent reinforcement learning.
  arXiv  Detail & Related papers  (2023-07-03T17:07:18Z)
• Decentralized Adversarial Training over Graphs [55.28669771020857]
  The vulnerability of machine learning models to adversarial attacks has been attracting considerable attention in recent years. This work studies adversarial training over graphs, where individual agents are subjected to varied strength perturbation space.
  arXiv  Detail & Related papers  (2023-03-23T15:05:16Z)
• A Cognitive Framework for Delegation Between Error-Prone AI and Human Agents [0.0]
  We investigate the use of cognitively inspired models of behavior to predict the behavior of both human and AI agents. The predicted behavior is used to delegate control between humans and AI agents through the use of an intermediary entity.
  arXiv  Detail & Related papers  (2022-04-06T15:15:21Z)
• Diversifying Agent's Behaviors in Interactive Decision Models [11.125175635860169]
  Modelling other agents' behaviors plays an important role in decision models for interactions among multiple agents. In this article, we investigate into diversifying behaviors of other agents in the subject agent's decision model prior to their interactions.
  arXiv  Detail & Related papers  (2022-03-06T23:05:00Z)
• Assessing Human Interaction in Virtual Reality With Continually Learning Prediction Agents Based on Reinforcement Learning Algorithms: A Pilot Study [6.076137037890219]
  We investigate how the interaction between a human and a continually learning prediction agent develops as the agent develops competency. We develop a virtual reality environment and a time-based prediction task wherein learned predictions from a reinforcement learning (RL) algorithm augment human predictions. Our findings suggest that human trust of the system may be influenced by early interactions with the agent, and that trust in turn affects strategic behaviour.
  arXiv  Detail & Related papers  (2021-12-14T22:46:44Z)
• Multi-Agent Imitation Learning with Copulas [102.27052968901894]
  Multi-agent imitation learning aims to train multiple agents to perform tasks from demonstrations by learning a mapping between observations and actions. In this paper, we propose to use copula, a powerful statistical tool for capturing dependence among random variables, to explicitly model the correlation and coordination in multi-agent systems. Our proposed model is able to separately learn marginals that capture the local behavioral patterns of each individual agent, as well as a copula function that solely and fully captures the dependence structure among agents.
  arXiv  Detail & Related papers  (2021-07-10T03:49:41Z)
• Learning Latent Representations to Influence Multi-Agent Interaction [65.44092264843538]
  We propose a reinforcement learning-based framework for learning latent representations of an agent's policy. We show that our approach outperforms the alternatives and learns to influence the other agent.
  arXiv  Detail & Related papers  (2020-11-12T19:04:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.