Automated Adversarial Collaboration for Advancing Theory Building in the Cognitive Sciences

• URL: http://arxiv.org/abs/2604.25521v1
• Date: Tue, 28 Apr 2026 11:41:08 GMT
• Title: Automated Adversarial Collaboration for Advancing Theory Building in the Cognitive Sciences
• Abstract summary: We introduce an automated adversarial collaboration framework for adjudicating among competing theories.<n>The system combines LLM-based theory agents, program synthesis, and information-theoretic experimental design in a closed loop.
• Score: 9.858210301644549
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cognitive science often evaluates theories through narrow paradigms and local model comparisons, limiting the integration of evidence across tasks and realizations. We introduce an automated adversarial collaboration framework for adjudicating among competing theories even when the candidate models and experiments must be discovered during the adjudication process. The system combines LLM-based theory agents, program synthesis, and information-theoretic experimental design in a closed loop. In a simulation study spanning three classic categorization theories, the framework recovered the ground-truth theory across noise settings with weaker reliability in the hardest settings. Together, the framework and findings provide a concrete proof of concept for closed-loop, in-silico theory adjudication in cognitive science.

Related papers

• ECLAIR: A Causally-Grounded AI Framework for Scientific Discovery in Empirical Software Engineering [51.19819833971252]
  This paper introduces ECLAIR, a causally grounded AI framework that integrates Large Language Models into every stage of the scientific process.<n>ECLAIR treats LLMs as active scientific agents operating under the principles of causal inference.
  arXiv  Detail & Related papers  (2026-08-03T14:47:03Z)
• Theoretical adversarial collaboration: a template [0.0]
  We propose a five-step template for conducting theoretical adversarial collaborations.<n>The procedure is designed to move disputants beyond familiar critique-reply-rejoinder exchanges.<n>The template was developed through reflection on, and implemented in, our own adversarial collaboration in philosophy and foundations of physics.
  arXiv  Detail & Related papers  (2026-07-17T15:17:37Z)
• CDFM: Towards a General-Purpose Causal Discovery Foundation Model [62.32138962508216]
  Causal discovery is the process of recovering underlying causal structures from observational data.<n>We formulate the Causal Discovery Foundation Model (CDFM) as a unified, general-purpose framework for zero-shot structural inference.<n>CDFM consistently outperforms traditional algorithms, driving a paradigm shift toward a general-purpose causal discovery foundation model.
  arXiv  Detail & Related papers  (2026-07-13T12:58:28Z)
• Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientist [26.846270187624636]
  We present the Automated Cognitive Scientist (AutoCog), a fully autonomous agentic-AI system.<n>We show how it can be used to turn cognitive theory-building into an explicit, executable, and cumulative science.
  arXiv  Detail & Related papers  (2026-06-24T23:20:58Z)
• Operationalizing Software Engineering Theories for Practical Validation [2.465742022428245]
  Software Engineering often adapts theory-building frameworks from the social sciences to address socio-technical complexity.<n> Operationalization translates abstract concepts into measurable elements for empirical validation.<n>We propose a systematic procedure for the operationalization phase that bridges the gap between abstract concepts and empirical validation.
  arXiv  Detail & Related papers  (2026-05-05T01:09:34Z)
• Beyond the Black Box: Theory and Mechanism of Large Language Models [39.10631426330405]
  The rapid emergence of Large Language Models (LLMs) has precipitated a profound paradigm shift in Artificial Intelligence.<n>This survey proposes a unified lifecycle-based taxonomy that organizes the research landscape into six distinct stages: Data Preparation, Model Preparation, Training, Alignment, Inference, and Evaluation.
  arXiv  Detail & Related papers  (2026-01-06T10:45:53Z)
• Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows [203.3527268311731]
  We present an operational SGI definition grounded in the Practical Inquiry Model (PIM)<n>We operationalize it via four scientist-aligned tasks: deep research, idea generation, dry/wet experiments, and experimental reasoning.<n>Our PIM-grounded definition, workflow-centric benchmark, and empirical insights establish a foundation for AI systems that genuinely participate in scientific discovery.
  arXiv  Detail & Related papers  (2025-12-18T12:44:36Z)
• Newton to Einstein: Axiom-Based Discovery via Game Design [55.30047000068118]
  We propose a game design framework in which scientific inquiry is recast as a rule-evolving system.<n>Unlike conventional ML approaches that operate within fixed assumptions, our method enables the discovery of new theoretical structures.
  arXiv  Detail & Related papers  (2025-09-05T18:59:18Z)
• Emergent Cognitive Convergence via Implementation: A Structured Loop Reflecting Four Theories of Mind [0.0]
  We report a structural convergence among four influential theories of mind.<n>The convergence emerges unintentionally within a practical AI architecture known as Agentic Flow.<n>This paper proposes that intelligent architectures may evolve toward shared structural patterns shaped by practical constraints.
  arXiv  Detail & Related papers  (2025-07-22T02:54:45Z)
• Hypothesis-Driven Theory-of-Mind Reasoning for Large Language Models [76.6028674686018]
  We introduce thought-tracing, an inference-time reasoning algorithm to trace the mental states of agents.<n>Our algorithm is modeled after the Bayesian theory-of-mind framework.<n>We evaluate thought-tracing on diverse theory-of-mind benchmarks, demonstrating significant performance improvements.
  arXiv  Detail & Related papers  (2025-02-17T15:08:50Z)
• Learning Discrete Concepts in Latent Hierarchical Models [73.01229236386148]
  Learning concepts from natural high-dimensional data holds potential in building human-aligned and interpretable machine learning models.<n>We formalize concepts as discrete latent causal variables that are related via a hierarchical causal model.<n>We substantiate our theoretical claims with synthetic data experiments.
  arXiv  Detail & Related papers  (2024-06-01T18:01:03Z)
• Bayesian Co-navigation: Dynamic Designing of the Materials Digital Twins via Active Learning [1.1057473962658189]
  Integration of theory into automated and autonomous experimental setups is emerging as a crucial objective for accelerating scientific research. Here, we introduce a method for integrating theory into the loop through Bayesian co-navigation of theoretical model space and experimentation. While demonstrated here within the context of functional responses in ferroelectric materials, our approach holds promise for broader applications.
  arXiv  Detail & Related papers  (2024-04-19T14:11:32Z)
• Active Inference in Robotics and Artificial Agents: Survey and Challenges [51.29077770446286]
  We review the state-of-the-art theory and implementations of active inference for state-estimation, control, planning and learning. We showcase relevant experiments that illustrate its potential in terms of adaptation, generalization and robustness.
  arXiv  Detail & Related papers  (2021-12-03T12:10:26Z)
• Interpretable Reinforcement Learning Inspired by Piaget's Theory of Cognitive Development [1.7778609937758327]
  This paper entertains the idea that theories such as language of thought hypothesis (LOTH), script theory, and Piaget's cognitive development theory provide complementary approaches. The proposed framework can be viewed as a step towards achieving human-like cognition in artificial intelligent systems.
  arXiv  Detail & Related papers  (2021-02-01T00:29:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.