Socratic agents for autonomous scientific discovery in high-dimensional physical systems
- URL: http://arxiv.org/abs/2606.26722v1
- Date: Thu, 25 Jun 2026 08:01:07 GMT
- Title: Socratic agents for autonomous scientific discovery in high-dimensional physical systems
- Abstract summary: AHOIS embeds Socratic midwifery into closed-loop experimentation.<n>A physics-critic agent interrogates hypotheses through causal questioning.<n> AHOIS autonomously proposed and validated a random-interference encoding hypothesis.
- Score: 24.054349223347966
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The automation of scientific discovery has reached an inflection point. While AI systems now operate instruments, optimize parameters and generate hypotheses, most remain procedural: they execute workflows fixed by human designers. True autonomous science demands epistemic autonomy--the capacity to construct, challenge and revise physical explanations in response to evidence. Here we introduce AHOIS, a multi-agent AI scientist that embeds Socratic midwifery into closed-loop experimentation. A physics-critic agent interrogates hypotheses through causal questioning, constraint checking, counterexample generation and falsification-criteria formulation. We evaluate AHOIS on a real multimode-fibre optical platform, a high-dimensional system with complex wave transformations, indirect detection, environmental drift and multi-modal acquisition. Without prior encoding schemes, classifiers or speckle models, the system autonomously proposed and validated a random-interference encoding hypothesis, discovered task-adaptive sparse-measurement strategies, diagnosed distinct failure modes (encoding instability, fluorescence contamination and detector noise) and translated a published imaging protocol into an executable workflow on a non-original configuration. The discovered encoding yielded 16x16 measurements with effective rank 56.9 and classification accuracies of 76.97% on MNIST and 83.17% on Fashion-MNIST. Ablations show that Socratic interrogation improves physical consistency, hypothesis completeness, uncertainty calibration and experimental-plan validity. These results establish a route from workflow automation towards evidence-grounded, self-correcting autonomous discovery in complex physical environments.
Related papers
- One Reflection Is Not Enough: Self-Correcting Autonomous Research via Multi-Hypothesis Failure Attribution [85.65263343588026]
We propose SAGE, a Self-correcting, Autonomous, Grounded Experimenter.<n>Its core mechanism, Multi-Hypothesis Failure Attribution (MHFA), treats recovery as a structured causal diagnosis.<n>On a 12-topic, 5-domain benchmark, SAGE increases metrics-bearing outputs from 42% to 92% over a baseline reflection.
arXiv Detail & Related papers (2026-06-30T10:54:16Z) - The Calibration Turn in AI-Assisted Research: A Conceptual and Methodological Framework for Evidence-Licensed Claims [0.9805949492148788]
This paper develops a conceptual framework for evidence-licensed claims in AI-assisted research.<n>It represents AI-assisted research as five operators: hypothesis generation, model-mediated consequence derivation, external validation, belief update, and claim calibration.
arXiv Detail & Related papers (2026-06-30T07:46:54Z) - Science Earth: Towards A Planet-Scale Operating System for AI-Native Scientific Discovery [51.70607714288616]
Science Earth is a planet-scale scientific runtime in which any capability can connect to any other.<n>Its underlying EACN protocol lets capabilities discover one another, negotiate task ownership, and adjudicate across incompatible evidentiary standards.<n>Two runs validate this under structurally distinct conditions.
arXiv Detail & Related papers (2026-05-31T16:05:41Z) - LLM-Guided Open Hypothesis Learning from Autonomous Scanning Probe Microscopy Experiments [3.783505208172849]
We introduce an open hypothesis-learning framework that combines symbolic regression with large-language-model-based physical evaluation.<n>We demonstrate the approach on autonomous piezoresponse force microscopy measurements of ferroelectric domain switching in a PZT thin film.
arXiv Detail & Related papers (2026-05-07T18:44:46Z) - Procela: Epistemic Governance in Mechanistic Simulations Under Structural Uncertainty [0.0]
Procela is the first framework where simulations test their own assumptions.<n>We instantiate Procela for AMR in a hospital network with three competing families.<n>Results show 20.4% error reduction and 69% cumulative regret improvement over baseline.
arXiv Detail & Related papers (2026-04-01T09:22:32Z) - Anatomy of a Lie: A Multi-Stage Diagnostic Framework for Tracing Hallucinations in Vision-Language Models [62.932580559941414]
Vision-Language Models (VLMs) frequently "hallucinate" - generate plausible yet factually incorrect statements.<n>We propose a new paradigm for diagnosing hallucinations, recasting them from static output errors into dynamic pathologies of a model's computational cognition.
arXiv Detail & Related papers (2026-03-16T17:20:38Z) - Probing Scientific General Intelligence of LLMs with Scientist-Aligned Workflows [203.3527268311731]
We present an operational SGI definition grounded in the Practical Inquiry Model (PIM)<n>We operationalize it via four scientist-aligned tasks: deep research, idea generation, dry/wet experiments, and experimental reasoning.<n>Our PIM-grounded definition, workflow-centric benchmark, and empirical insights establish a foundation for AI systems that genuinely participate in scientific discovery.
arXiv Detail & Related papers (2025-12-18T12:44:36Z) - Hierarchical Multi-agent Large Language Model Reasoning for Autonomous Functional Materials Discovery [0.0]
We introduce Materials Agents for Simulation and Theory in Electronic-structure Reasoning (Master)<n>In MASTER, a multimodal system translates natural language into density functional theory, while higher-level reasoning agents guide discovery through a hierarchy of strategies.<n> Reasoning trajectories reveal chemically grounded decisions that cannot be explained by sampling or semantic bias.
arXiv Detail & Related papers (2025-12-15T22:08:18Z) - NewtonBench: Benchmarking Generalizable Scientific Law Discovery in LLM Agents [65.85967483058705]
Large language models are emerging as powerful tools for scientific law discovery.<n>Existing benchmarks for this task suffer from a fundamental methodological trilemma.<n>We introduce NewtonBench, a benchmark comprising 324 scientific law discovery tasks across 12 physics domains.
arXiv Detail & Related papers (2025-10-08T16:12:11Z) - Position: Intelligent Science Laboratory Requires the Integration of Cognitive and Embodied AI [98.19195693735487]
We propose the paradigm of Intelligent Science Laboratories (ISLs)<n>ISLs are a multi-layered, closed-loop framework that deeply integrates cognitive and embodied intelligence.<n>We argue that such systems are essential for overcoming the current limitations of scientific discovery.
arXiv Detail & Related papers (2025-06-24T13:31:44Z) - PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration [9.216546947535244]
We introduce PiFlow, an information-theoretical framework for automated scientific discovery.<n>Our method significantly improves discovery efficiency, reflected by a 73.55% increase in the Area Under the Curve.<n>Overall, PiFlow serves as a Plug-and-Play method, establishing a novel paradigm shift in highly efficient automated scientific discovery.
arXiv Detail & Related papers (2025-05-21T03:09:39Z) - SUOD: Accelerating Large-Scale Unsupervised Heterogeneous Outlier
Detection [63.253850875265115]
Outlier detection (OD) is a key machine learning (ML) task for identifying abnormal objects from general samples.
We propose a modular acceleration system, called SUOD, to address it.
arXiv Detail & Related papers (2020-03-11T00:22:50Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.