Grading the Unspoken: Evaluating Tacit Reasoning in Quantum Field Theory and String Theory with LLMs

• URL: http://arxiv.org/abs/2604.14188v1
• Date: Wed, 01 Apr 2026 02:03:15 GMT
• Title: Grading the Unspoken: Evaluating Tacit Reasoning in Quantum Field Theory and String Theory with LLMs
• Abstract summary: Large language models have demonstrated impressive performance across many domains of mathematics and physics.<n>One natural question is whether such models can support research in highly abstract theoretical fields such as quantum field theory and string theory.<n>We construct a compact expert-curated dataset of twelve questions spanning core areas of quantum field theory and string theory.
• Score: 6.723992068753028
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language models have demonstrated impressive performance across many domains of mathematics and physics. One natural question is whether such models can support research in highly abstract theoretical fields such as quantum field theory and string theory. Evaluating this possibility faces an immediate challenge: correctness in these domains is layered, tacit, and fundamentally non-binary. Standard answer-matching metrics fail to capture whether intermediate conceptual steps are properly reconstructed or whether implicit structural constraints are respected. We construct a compact expert-curated dataset of twelve questions spanning core areas of quantum field theory and string theory, and introduce a five-level grading rubric separating statement correctness, key concept awareness, reasoning chain presence, tacit step reconstruction, and enrichment. Evaluating multiple contemporary LLMs, we observe near-ceiling performance on explicit derivations within stable conceptual frames, but systematic degradation when tasks require reconstruction of omitted reasoning steps or reorganization of representations under global consistency constraints. These failures are driven not only by missing intermediate steps, but by an instability in representation selection: models often fail to identify the correct conceptual framing required to resolve implicit tensions. We argue that highly abstract theoretical physics provides a uniquely sensitive lens on the epistemic limits of current evaluation paradigms.

Related papers

• INSPIRE: An Internalize-Then-Improve Approach for Example-Driven Mathematical Reasoning [61.60016491769943]
  In human mathematics education, example-based reasoning such as constructing counterexamples to test theorem boundaries reflects deep conceptual understanding.<n>We propose INSPIRE, an Internalize-Then-Improve approach combining Reference-Guided Student Internalization (RGSI) with a stage-wise preference training strategy.<n>Experiments across multiple model scales and families demonstrate consistent improvements, even surpassing larger open-source models.
  arXiv  Detail & Related papers  (2026-08-27T03:24:03Z)
• Demystifying Relativistic Quantum Collapse [0.0]
  Non-relativistic objective collapse theories have been remarkably successful in addressing the conceptual problems of quantum mechanics.<n>Project of extending them to the relativistic domain remains burdened by significant conceptual objections and technical challenges.<n>We offer a systematic rebuttal of the conceptual objections and provide a structured account of the remaining technical challenges.
  arXiv  Detail & Related papers  (2026-08-27T00:05:57Z)
• Hyperbolic Multimodal Continual Learning [90.3699346061366]
  This work provides a theoretical foundation for representation preservation in hyperbolic space.<n>We show that forgetting in hyperbolic continual learning involves both semantic relation drift and hierarchy-related distortion.<n>We propose a principled continual learning framework that preserves essential geometric structure while allowing effective adaptation to new tasks.
  arXiv  Detail & Related papers  (2026-08-10T13:07:26Z)
• Constrained latent state modeling: A unifying perspective on representation learning under competing constraints [0.6496997624776696]
  Learning latent representations from complex data is central to modern machine learning.<n>Current approaches remain fragmented, relying on distinct -- and often implicit -- assumptions about what these states should represent.<n>We argue that latent representations are typically learned from underconstrained objectives that fail to specify the properties that meaningful latent states should satisfy.
  arXiv  Detail & Related papers  (2026-05-15T14:25:40Z)
• Understanding Quantum Theory: An Operational Reconstructive Approach [0.0]
  One hundred years after the creation of quantum theory, there is no consensus on the kind of reality that is described by the theory.<n>The prevailing methodology offers little protection against undue influence by metaphysically-laden language.<n>I describe the reconstruction of the identical particle formalism, and its step-by-step interpretation.
  arXiv  Detail & Related papers  (2026-04-01T16:21:45Z)
• OMNIFLOW: A Physics-Grounded Multimodal Agent for Generalized Scientific Reasoning [51.33849811496781]
  Large Language Models (LLMs) have demonstrated exceptional logical reasoning capabilities but frequently struggle with the continuous dynamics by Partial Differential Equations (PDEs)<n>We propose OMNIFLOW, a multimodal-symbolic architecture designed to ground frozen LLMs in fundamental physical laws without requiring domain-specific parameter updates.<n>We evaluate it on a benchmark spanning microscopic turbulence, theoretical Navier-Stokes, and macroscopic global weather forecasting.
  arXiv  Detail & Related papers  (2026-03-16T18:29:01Z)
• Beyond the Black Box: Theory and Mechanism of Large Language Models [39.10631426330405]
  The rapid emergence of Large Language Models (LLMs) has precipitated a profound paradigm shift in Artificial Intelligence.<n>This survey proposes a unified lifecycle-based taxonomy that organizes the research landscape into six distinct stages: Data Preparation, Model Preparation, Training, Alignment, Inference, and Evaluation.
  arXiv  Detail & Related papers  (2026-01-06T10:45:53Z)
• On the Fundamental Limits of LLMs at Scale [15.459708840379975]
  Large Language Models (LLMs) have benefited enormously from scaling, yet these gains are bounded by five fundamental limitations.<n>This work presents a unified, proof-informed framework that formalizes the innate theoretical ceilings of LLM scaling.<n>We show how likelihood-based training favors pattern completion over inference, how retrieval under token limits suffers from semantic drift and coupling noise, and how multimodal scaling inherits shallow cross-modal alignment.
  arXiv  Detail & Related papers  (2025-11-17T01:55:33Z)
• Provably Transformers Harness Multi-Concept Word Semantics for Efficient In-Context Learning [53.685764040547625]
  Transformer-based large language models (LLMs) have displayed remarkable creative prowess and emergence capabilities.<n>This work provides a fine mathematical analysis to show how transformers leverage the multi-concept semantics of words to enable powerful ICL and excellent out-of-distribution ICL abilities.
  arXiv  Detail & Related papers  (2024-11-04T15:54:32Z)
• Hierarchical Invariance for Robust and Interpretable Vision Tasks at Larger Scales [54.78115855552886]
  We show how to construct over-complete invariants with a Convolutional Neural Networks (CNN)-like hierarchical architecture. With the over-completeness, discriminative features w.r.t. the task can be adaptively formed in a Neural Architecture Search (NAS)-like manner. For robust and interpretable vision tasks at larger scales, hierarchical invariant representation can be considered as an effective alternative to traditional CNN and invariants.
  arXiv  Detail & Related papers  (2024-02-23T16:50:07Z)
• Quantum realism: axiomatization and quantification [77.34726150561087]
  We build an axiomatization for quantum realism -- a notion of realism compatible with quantum theory. We explicitly construct some classes of entropic quantifiers that are shown to satisfy almost all of the proposed axioms.
  arXiv  Detail & Related papers  (2021-10-10T18:08:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.