Emergence via Phase Transitions: Mechanism Landscapes and Universal Convergence Across Complex Systems

• URL: http://arxiv.org/abs/2606.07563v1
• Date: Mon, 25 May 2026 18:32:52 GMT
• Title: Emergence via Phase Transitions: Mechanism Landscapes and Universal Convergence Across Complex Systems
• Abstract summary: Across machine learning, biology, and physics, independently evolving systems often converge toward strikingly similar high-level structures.<n>We propose the Hierarchical Emergence Framework (HEF) as a candidate universality framework for such convergence phenomena.<n>HEF is not presented as a universal theory of emergence, but as a falsifiable mathematical scaffold for studying convergence phenomena across complex systems.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Across machine learning, biology, and physics, independently evolving systems often converge toward strikingly similar high-level structures despite radically different microscopic details. Grokking circuits converge across random seeds, evolutionary lineages rediscover similar metabolic solutions, and renormalization flows approach common fixed points. We propose the Hierarchical Emergence Framework (HEF) as a candidate universality framework for such convergence phenomena. HEF models emergence as a phase transition in a mechanism landscape constrained by thermodynamic and information-theoretic laws. The framework introduces a critical energy threshold Ec separating an exploration regime with competing mechanisms from a convergence regime governed by a unique minimum-cost mechanism. Under structural assumptions, we prove physical feasibility, derive strict metric contraction, and establish convergence toward a unique fixed-point representation independent of initial conditions. We further connect this convergence structure to causal emergence through Effective Information and mechanism competition entropy. To test the framework, we study delayed generalization ("grokking") in modular arithmetic transformers across 111 experiments. We identify a reproducible empirical fingerprint of the Ec transition: the weight norm peaks systematically before grokking in 92% of runs. Normalized accuracy curves collapse onto a tanh kink (R^2=0.93) consistent with a Landau-Ginzburg universality class, and all grokked models converge to 0.9745+/-0.014 regardless of initialization, weight decay, or training fraction (ANOVA p>0.13). HEF is not presented as a universal theory of emergence, but as a falsifiable mathematical scaffold for studying convergence phenomena across complex systems.

Related papers

• Phase Transitions in Driven Informational Systems: A Two-Field Perspective on Learning Theory and Non-Equilibrium Chemistry [0.0]
  Non-equilibrium statistical physics has identified phase transitions in driven chemical reaction networks underlying prebiotic selection.<n>We propose a perspective in which both classes of phenomena admit a common description as driven informational systems.<n>We outline the geometric structure of this framework, identify falsifiable predictions distinguishing it from single-field alternatives, and show consistency with recent empirical findings.
  arXiv  Detail & Related papers  (2026-05-05T05:33:57Z)
• Anomalous Mixed-State Floquet Topology in One-Dimensional Open Quantum Systems [41.99844472131922]
  We investigate the non-equilibrium topology of a periodically driven, dissipative Su-Schrieffer-Heeger chain.<n>We show that the steady state can be characterised by a Hermitian purity spectrum.<n>We identify a pair of topological invariants $(0_mathrmEGP, _mathrmEGP)$, revealing a structure consistent with a $mathbbZtimesmathbbZ$ classification known from isolated Floquet SSH systems.
  arXiv  Detail & Related papers  (2026-04-28T05:54:40Z)
• Beyond Perturbation Theory: A Resolvent-Based Framework for Strongly Correlated Many-Body Systems [1.4824891788575416]
  Traditional perturbation theory fails in many-body systems with exponentially small energy gaps and strong interactions.<n>This work presents an alternative methodological framework built on two core principles.<n>It is applicable to the quantitative analysis of global properties in nonintegrable many-body systems.
  arXiv  Detail & Related papers  (2026-04-01T08:11:58Z)
• Exactly Solvable RD Model: RG Cycles Meet Fractality [45.88028371034407]
  We consider the Bethe ansatz integrable Russian Doll (RD) model of superconductivity with time-reversal symmetry breaking.<n>By obtaining an exact solution for the renormalization group flows, we investigate the phase structure in the one-pair sector.<n>We show that the quantum number Q, arising from the Bethe ansatz equations, counts the number of cycles and parametrizes the towers of states.
  arXiv  Detail & Related papers  (2026-03-18T12:54:21Z)
• Cohomological Obstructions to Global Counterfactuals: A Sheaf-Theoretic Foundation for Generative Causal Models [7.073238726507493]
  We formalize structural causal models as cellular sheaves over Wasserstein spaces.<n>To ensure tractability, we introduce entropic regularization and derive the Entropic Wasserstein Causal Sheaf Laplacian.<n>Our framework successfully leverages thermodynamic noise to navigate topological barriers in high-dimensional scRNA-seq counterfactuals.
  arXiv  Detail & Related papers  (2026-03-18T06:07:07Z)
• Architectural Proprioception in State Space Models: Thermodynamic Training Induces Anticipatory Halt Detection [0.0]
  We introduce the Probability Navigation Architecture (PNA), which treats computation as navigation through a probability manifold governed by thermodynamic principles.<n>We train State Space Models (SSMs) and Transformers with a novel thermodynamic loss function that penalizes computational waste alongside standard cross-entropy.
  arXiv  Detail & Related papers  (2026-03-04T15:36:40Z)
• Random-Matrix-Induced Simplicity Bias in Over-parameterized Variational Quantum Circuits [72.0643009153473]
  We show that expressive variational ansatze enter a Haar-like universality class in which both observable expectation values and parameter gradients concentrate exponentially with system size.<n>As a consequence, the hypothesis class induced by such circuits collapses with high probability to a narrow family of near-constant functions.<n>We further show that this collapse is not unavoidable: tensor-structured VQCs, including tensor-network-based and tensor-hypernetwork parameterizations, lie outside the Haar-like universality class.
  arXiv  Detail & Related papers  (2026-01-05T08:04:33Z)
• Tensor product random matrix theory [39.58317527488534]
  We introduce a real-time field theory approach to the evolution of correlated quantum systems. We describe the full range of such crossover dynamics, from initial product states to a maximum entropy ergodic state.
  arXiv  Detail & Related papers  (2024-04-16T21:40:57Z)
• Machine learning in and out of equilibrium [58.88325379746631]
  Our study uses a Fokker-Planck approach, adapted from statistical physics, to explore these parallels. We focus in particular on the stationary state of the system in the long-time limit, which in conventional SGD is out of equilibrium. We propose a new variation of Langevin dynamics (SGLD) that harnesses without replacement minibatching.
  arXiv  Detail & Related papers  (2023-06-06T09:12:49Z)
• Generalized Sliced Distances for Probability Distributions [47.543990188697734]
  We introduce a broad family of probability metrics, coined as Generalized Sliced Probability Metrics (GSPMs) GSPMs are rooted in the generalized Radon transform and come with a unique geometric interpretation. We consider GSPM-based gradient flows for generative modeling applications and show that under mild assumptions, the gradient flow converges to the global optimum.
  arXiv  Detail & Related papers  (2020-02-28T04:18:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.