Mechanism Plausibility in Generative Agent-Based Modeling

• URL: http://arxiv.org/abs/2605.12824v2
• Date: Sun, 17 May 2026 05:34:27 GMT
• Title: Mechanism Plausibility in Generative Agent-Based Modeling
• Abstract summary: Large language models (LLMs) can generate high-level diverse phenomena without explicitly programmed rules.<n>Recent studies investigate their ability to generate different phenomena of interest, for example, human behavior on social media platforms or alien behavior in game-theoretic scenarios.<n>We use recent work on LLM-ABMs with contemporary philosophy of science literature to operationalize a definition of 'plausibility' in a four-level scale.
• Score: 3.8124330987881137
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large language models (LLMs) can generate high-level diverse phenomena without explicitly programmed rules. This capability has led to their adoption within different agent-based models (ABMs) and social simulations. Recent studies investigate their ability to generate different phenomena of interest, for example, human behavior on social media platforms or alien behavior in game-theoretic scenarios. However, capability, prediction, and explanation are different--drawing from the philosophy of science and mechanisms literature, explanation requires showing, to some degree, how a phenomenon is produced by related organized entities and activities. For modelers, describing the characteristics of an experiment or whether a simulation provides progress in capability (or explanation), can be difficult without being grounded in potentially distant research areas. We integrate recent work on LLM-ABMs with contemporary philosophy of science literature and use it to operationalize a definition of 'plausibility' in a four-level scale. Our scale separates the evaluation of a model's generative sufficiency (ability to reproduce a phenomenon) from its mechanistic plausibility (how the phenomenon could be produced), and clarifies the distinct roles of different models, such as predictive and explanatory ones. We introduce this as the Mechanism Plausibility Scale.

Related papers

• Mechanist: AI as a Scientific Instrument for Discovering the Mechanisms of Intelligence [114.82582862454052]
  Mechanist is an agentic system that uses AI as a scientific instrument for the autonomous discovery of mechanisms underlying AI intelligence.<n>Compared with Claude Code and existing AI-scientist systems, Mechanist generates more valuable mechanism hypotheses and executes experiments more reliably.
  arXiv  Detail & Related papers  (2026-08-12T13:19:42Z)
• From Observation to Insight: Mechanistic World Models and the Quest for Autonomous Discovery [60.11725132433485]
  We argue that scientific discovery is fundamentally a problem of knowledge organisation.<n>We introduce Mechanistic World Models, a new design paradigm that places reusable mechanisms at the centre of representation, computation and learning.
  arXiv  Detail & Related papers  (2026-07-14T08:03:27Z)
• Hierarchical Latent Structures in Data Generation Process Unify Mechanistic Phenomena across Scale [50.33952894976367]
  We use context-free grammars to generate synthetic corpora that are faithful and computationally efficient proxies for web-scale text corpora.<n>We investigate the emergence of three mechanistic phenomena: induction heads, function vectors, and the Hydra effect, under our designed data generation process.<n>Our findings suggest that hierarchical structures in the data generation process serve as the X-factor in explaining the emergence of these phenomena.
  arXiv  Detail & Related papers  (2026-02-04T14:49:13Z)
• Learning Local Causal World Models with State Space Models and Attention [1.5498250598583487]
  We show that a SSM can model the dynamics of a simple environment and learn a causal model at the same time.<n>We pave the way for further experiments that lean into the strength of SSMs and further enhance them with causal awareness.
  arXiv  Detail & Related papers  (2025-05-04T11:57:02Z)
• Learning Discrete Concepts in Latent Hierarchical Models [73.01229236386148]
  Learning concepts from natural high-dimensional data holds potential in building human-aligned and interpretable machine learning models.<n>We formalize concepts as discrete latent causal variables that are related via a hierarchical causal model.<n>We substantiate our theoretical claims with synthetic data experiments.
  arXiv  Detail & Related papers  (2024-06-01T18:01:03Z)
• LLM and Simulation as Bilevel Optimizers: A New Paradigm to Advance Physical Scientific Discovery [141.39722070734737]
  We propose to enhance the knowledge-driven, abstract reasoning abilities of Large Language Models with the computational strength of simulations. We introduce Scientific Generative Agent (SGA), a bilevel optimization framework. We conduct experiments to demonstrate our framework's efficacy in law discovery and molecular design.
  arXiv  Detail & Related papers  (2024-05-16T03:04:10Z)
• Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspective [2.61072980439312]
  Devising formalisms to develop internal world models is a critical research challenge in the domains of artificial intelligence and machine learning.<n>This thesis identifies several limitations with the prevalent use of state space models as internal world models.<n>The structure of models in formalisms facilitates exact probabilistic inference using belief propagation, as well as end-to-end learning via backpropagation through time.<n>These formalisms integrate the concept of uncertainty in world states, thus improving the system's capacity to emulate the nature of the real world and quantify the confidence in its predictions.
  arXiv  Detail & Related papers  (2024-04-24T12:41:04Z)
• Language Models Represent Beliefs of Self and Others [14.630775330165529]
  We show that it is possible to linearly decode the belief status from the perspectives of various agents through neural activations of language models. We observe dramatic changes in the models' ToM performance, underscoring their pivotal role in the social reasoning process.
  arXiv  Detail & Related papers  (2024-02-28T17:25:59Z)
• Explainability for Large Language Models: A Survey [59.67574757137078]
  Large language models (LLMs) have demonstrated impressive capabilities in natural language processing. This paper introduces a taxonomy of explainability techniques and provides a structured overview of methods for explaining Transformer-based language models.
  arXiv  Detail & Related papers  (2023-09-02T22:14:26Z)
• AI-Assisted Discovery of Quantitative and Formal Models in Social Science [6.39651637213537]
  We show that our system can be used to discover interpretable models from real-world data in economics and sociology. We propose that this AI-assisted framework can bridge parametric and non-parametric models commonly employed in social science research.
  arXiv  Detail & Related papers  (2022-10-02T16:25:47Z)
• Models we Can Trust: Toward a Systematic Discipline of (Agent-Based) Model Interpretation and Validation [0.0]
  We advocate the development of a discipline of interacting with and extracting information from models. We outline some directions for the development of a such a discipline.
  arXiv  Detail & Related papers  (2021-02-23T10:52:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.