Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientist

• URL: http://arxiv.org/abs/2606.26448v1
• Date: Wed, 24 Jun 2026 23:20:58 GMT
• Title: Closing the Loop to Discover Psychological Theories with an Automated Cognitive Scientist
• Abstract summary: We present the Automated Cognitive Scientist (AutoCog), a fully autonomous agentic-AI system.<n>We show how it can be used to turn cognitive theory-building into an explicit, executable, and cumulative science.
• Score: 26.846270187624636
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Across the sciences, autonomous systems are increasingly being used in closed-loop discovery, proposing new theories and designing and running experiments to test them. This approach is yet to be applied in the field of cognitive science, where the central bottleneck is theory-building: the creative step of turning the accumulated failures of existing models into better ones. Theory generation has remained manual even as data collection, modeling, and experiment design have been automated. We present the Automated Cognitive Scientist (AutoCog), a fully autonomous agentic-AI system that closes this loop. Large-language-model agents advocate competing theories, each expressed as an executable cognitive model, design experiments that best discriminate them, collect behavioral data from participants recruited online, score theories against collected data based on their generative performance, diagnose why they fail, and synthesize a better successor. Repeating this cycle allows them to search the space of theories, models, and experiments. In the domain of decision-making, AutoCog recovered known decision-making strategies from simulated behavior, including unconventional ones, showing that its discoveries are ultimately driven by the data rather than strictly bound by the priors of the underlying language models. When run with human participants, it produced theories that outperformed the established theories it was seeded with and generalized to held-out studies in two different experimental settings. It also surfaced a novel theory of multi-cue decision-making in which choices show diminishing sensitivity to feature values. The distinctive predictions of this theory were confirmed in a preregistered study with new participants. AutoCog demonstrates how an automated discovery system can be used to turn cognitive theory-building into an explicit, executable, and cumulative science.

Related papers

• Sparks of In Silico Cognitive Science: Theories from Simulated Data Can Generalize to Humans [27.855847876496238]
  Behavioral foundation models have been proposed as stand-ins for human participants across settings.<n>It is unclear whether theories discovered on them generalize to humans or merely characterize the simulator.<n>We run a closed-loop discovery system in which agents design experiments, collect responses, arbitrate between competing theories, and synthesize successors.
  arXiv  Detail & Related papers  (2026-09-07T21:35:50Z)
• Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence [114.82582862454052]
  Mechanist is an agentic system that uses AI as a scientific instrument for the autonomous discovery of mechanisms underlying AI intelligence.<n>Compared with Claude Code and existing AI-scientist systems, Mechanist generates more valuable mechanism hypotheses and executes experiments more reliably.
  arXiv  Detail & Related papers  (2026-08-12T13:19:42Z)
• auto-psych: Automating the science of mind using agent-driven theory discovery and experimentation [30.489563356452255]
  We apply automated discovery techniques to the project of generating theories in computational cognitive science.<n>We use a classic case study from cognitive psychology: judging which sequences of coin flips seem subjectively more random.<n>Our system, auto-psych, uses nested agent-based discovery loops to generate explanatory theories of human behavior.
  arXiv  Detail & Related papers  (2026-06-24T23:43:01Z)
• Externalizing Research Synthesis and Validation in AI Scientists through a Research Harness [22.631467433443362]
  Xcientist is a research harness that externalizes research synthesis and experimental validation into inspectable, contract-governed processes.<n>Xcientist literature organizes evidence, idea states, implementation plans, ablation records and repair traces as persistent research artifacts.
  arXiv  Detail & Related papers  (2026-06-17T09:52:14Z)
• Automated Adversarial Collaboration for Advancing Theory Building in the Cognitive Sciences [9.858210301644549]
  We introduce an automated adversarial collaboration framework for adjudicating among competing theories.<n>The system combines LLM-based theory agents, program synthesis, and information-theoretic experimental design in a closed loop.
  arXiv  Detail & Related papers  (2026-04-28T11:41:08Z)
• Can we automatize scientific discovery in the cognitive sciences? [20.166894780789725]
  We propose a paradigm shift toward a fully automated, in silico science of the mind.<n>This framework implements every stage of the discovery cycle using Large Language Models (LLMs)
  arXiv  Detail & Related papers  (2026-03-22T00:15:58Z)
• Embodied Science: Closing the Discovery Loop with Agentic Embodied AI [73.54118756665221]
  We argue for embodied science, a paradigm that reframes scientific discovery as a closed loop tightly coupling agentic reasoning with physical execution.<n>We propose a unified Perception-Language-Action-Discovery (PLAD) framework, wherein embodied agents perceive experimental environments, reason over scientific knowledge, execute physical interventions, and internalize outcomes to drive subsequent exploration.
  arXiv  Detail & Related papers  (2026-03-20T09:20:12Z)
• Accelerating Scientific Research with Gemini: Case Studies and Common Techniques [105.15622072347811]
  Large language models (LLMs) have opened new avenues for accelerating scientific research.<n>We present a collection of case studies demonstrating how researchers have successfully collaborated with advanced AI models.
  arXiv  Detail & Related papers  (2026-02-03T18:56:17Z)
• Open-ended Scientific Discovery via Bayesian Surprise [63.26412847240136]
  AutoDS is a method for open-ended scientific discovery that instead drives scientific exploration using Bayesian surprise.<n>We evaluate AutoDS in the setting of data-driven discovery across 21 real-world datasets spanning domains such as biology, economics, finance, and behavioral science.
  arXiv  Detail & Related papers  (2025-06-30T22:53:59Z)
• Active Inference AI Systems for Scientific Discovery [1.450405446885067]
  This perspective contends that progress turns on closing three mutually reinforcing gaps in abstraction, reasoning and empirical grounding.<n>Design principles are proposed for systems that reason in imaginary spaces and learn from the world.
  arXiv  Detail & Related papers  (2025-06-26T14:43:04Z)
• A Neuro-mimetic Realization of the Common Model of Cognition via Hebbian Learning and Free Energy Minimization [55.11642177631929]
  Large neural generative models are capable of synthesizing semantically rich passages of text or producing complex images. We discuss the COGnitive Neural GENerative system, such an architecture that casts the Common Model of Cognition.
  arXiv  Detail & Related papers  (2023-10-14T23:28:48Z)
• Online simulator-based experimental design for cognitive model selection [74.76661199843284]
  We propose BOSMOS: an approach to experimental design that can select between computational models without tractable likelihoods. In simulated experiments, we demonstrate that the proposed BOSMOS technique can accurately select models in up to 2 orders of magnitude less time than existing LFI alternatives.
  arXiv  Detail & Related papers  (2023-03-03T21:41:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.