On the Structure of Stationary Solutions to McKean-Vlasov Equations with Applications to Noisy Transformers

• URL: http://arxiv.org/abs/2510.20094v2
• Date: Mon, 27 Oct 2025 17:12:03 GMT
• Title: On the Structure of Stationary Solutions to McKean-Vlasov Equations with Applications to Noisy Transformers
• Authors: Krishnakumar Balasubramanian, Sayan Banerjee, Philippe Rigollet,
• Abstract summary: We study stationary solutions of McKean-Vlasov equations on the circle.<n>Our main contributions stem from observing an exact equivalence between solutions of the stationary McKean-Vlasov equation and an infinite-dimensional quadratic system of equations over Fourier coefficients.
• Score: 9.75933108960865
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We study stationary solutions of McKean-Vlasov equations on the circle. Our main contributions stem from observing an exact equivalence between solutions of the stationary McKean-Vlasov equation and an infinite-dimensional quadratic system of equations over Fourier coefficients, which allows explicit characterization of the stationary states in a sequence space rather than a function space. This framework provides a transparent description of local bifurcations, characterizing their periodicity, and resonance structures, while accommodating singular potentials. We derive analytic expressions that characterize the emergence, form and shape (supercritical, critical, subcritical or transcritical) of bifurcations involving possibly multiple Fourier modes and connect them with discontinuous phase transitions. We also characterize, under suitable assumptions, the detailed structure of the stationary bifurcating solutions that are accurate upto an arbitrary number of Fourier modes. At the global level, we establish regularity and concavity properties of the free energy landscape, proving existence, compactness, and coexistence of globally minimizing stationary measures, further identifying discontinuous phase transitions with points of non-differentiability of the minimum free energy map. As an application, we specialize the theory to the Noisy Mean-Field Transformer model, where we show how changing the inverse temperature parameter $\beta$ affects the geometry of the infinitely many bifurcations from the uniform measure. We also explain how increasing $\beta$ can lead to a rich class of approximate multi-mode stationary solutions which can be seen as `metastable states'. Further, a sharp transition from continuous to discontinuous (first-order) phase behavior is observed as $\beta$ increases.

Related papers

• Stabilizing Fixed-Point Iteration for Markov Chain Poisson Equations [49.702772230127465]
  We study finite-state Markov chains with $n$ states and transition matrix $P$.<n>We show that all non-decaying modes are captured by a real peripheral invariant subspace $mathcalK(P)$, and that the induced operator on the quotient space $mathbbRn/mathcalK(P) is strictly contractive, yielding a unique quotient solution.
  arXiv  Detail & Related papers  (2026-01-31T02:57:01Z)
• Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds [0.5729426778193398]
  We study the emergence of multi-step reasoning in deep Transformer language models through a geometric and statistical-physics lens.<n>We formalize the forward pass as a discrete coarse-graining map and relate the appearance of stable "concept basins" to fixed points of this renormalization-like dynamics.<n>The resulting low-entropy regime is characterized by a spectral tail collapse and by the formation of transient, reusable object-like structures in representation space.
  arXiv  Detail & Related papers  (2026-01-16T23:11:02Z)
• Symmetries, Conservation Laws and Entanglement in Non-Hermitian Fermionic Lattices [37.69303106863453]
  Non-Hermitian quantum many-body systems feature steady-state entanglement transitions driven by unitary dynamics and dissipation.<n>We show that the steady state is obtained by filling single-particle right eigenstates with the largest imaginary part of the eigenvalue.<n>We illustrate these principles in the Hatano-Nelson model with periodic boundary conditions and the non-Hermitian Su-Schrieffer-Heeger model.
  arXiv  Detail & Related papers  (2025-04-11T14:06:05Z)
• Characterizing phase transitions and criticality in non-Hermitian extensions of the XY model [0.0]
  We study non-Hermitian extensions of the paradigmatic spin-1/2 XY chain in a magnetic field.<n>Using the mapping of the model to free fermion form, we provide analytical insights into the energy spectrum of the non-Hermitian model.
  arXiv  Detail & Related papers  (2025-01-23T13:36:38Z)
• Superradiant phase transitions in the quantum Rabi model: Overcoming the no-go theorem through anisotropy [30.342686040430962]
  Superradiant phase transition (SRPT) is prohibited in the paradigmatic quantum Rabi model.<n>We show two distinct types of SRPTs emerging from the normal phase in the anisotropic quantum Rabi model.
  arXiv  Detail & Related papers  (2024-12-11T11:33:29Z)
• Finite time path field theory perturbative methods for local quantum spin chain quenches [0.0]
  We discuss local magnetic field quenches using perturbative methods of finite time path field theory.<n>We show how to: (i) calculate the basic bubble'' diagram in the Loschmidt echo (LE) of a quenched chain to any order in the perturbation; and (ii) resum the generalized Schwinger--Dyson equation for the fermion two-point retarded functions in the bubble'' diagram.
  arXiv  Detail & Related papers  (2024-09-05T18:00:08Z)
• Measurement phase transitions in the no-click limit as quantum phase transitions of a non-hermitean vacuum [77.34726150561087]
  We study phase transitions occurring in the stationary state of the dynamics of integrable many-body non-Hermitian Hamiltonians. We observe that the entanglement phase transitions occurring in the stationary state have the same nature as that occurring in the vacuum of the non-hermitian Hamiltonian.
  arXiv  Detail & Related papers  (2023-01-18T09:26:02Z)
• Dynamical transitions from slow to fast relaxation in random open quantum systems [0.0]
  We study a model in which the system Hamiltonian and its couplings to the noise are random matrices whose entries decay as power laws of distance. The steady state is always featureless, but the rate at which it is approached exhibits three phases depending on $alpha_H$ and $alpha_L$. Within perturbation theory, the phase boundaries in the $(alpha_H, alpha_L)$ plane differ for weak and strong dissipation, suggesting phase transitions as a function of noise strength.
  arXiv  Detail & Related papers  (2022-11-23T20:56:46Z)
• Quantum critical behavior of entanglement in lattice bosons with cavity-mediated long-range interactions [0.0]
  We analyze the ground-state entanglement entropy of the extended Bose-Hubbard model with infinite-range interactions. This model describes the low-energy dynamics of ultracold bosons tightly bound to an optical lattice and dispersively coupled to a cavity mode.
  arXiv  Detail & Related papers  (2022-04-16T04:10:57Z)
• Topological transitions with continuously monitored free fermions [68.8204255655161]
  We show the presence of a topological phase transition that is of a different universality class than that observed in stroboscopic projective circuits. We find that this entanglement transition is well identified by a combination of the bipartite entanglement entropy and the topological entanglement entropy.
  arXiv  Detail & Related papers  (2021-12-17T22:01:54Z)
• Spectrum of localized states in fermionic chains with defect and adiabatic charge pumping [68.8204255655161]
  We study the localized states of a generic quadratic fermionic chain with finite-range couplings. We analyze the robustness of the connection between bands against perturbations of the Hamiltonian.
  arXiv  Detail & Related papers  (2021-07-20T18:44:06Z)
• Lifting the Convex Conjugate in Lagrangian Relaxations: A Tractable Approach for Continuous Markov Random Fields [53.31927549039624]
  We show that a piecewise discretization preserves better contrast from existing discretization problems. We apply this theory to the problem of matching two images.
  arXiv  Detail & Related papers  (2021-07-13T12:31:06Z)
• Exact thermal properties of free-fermionic spin chains [68.8204255655161]
  We focus on spin chain models that admit a description in terms of free fermions. Errors stemming from the ubiquitous approximation are identified in the neighborhood of the critical point at low temperatures.
  arXiv  Detail & Related papers  (2021-03-30T13:15:44Z)
• Signatures of a critical point in the many-body localization transition [0.0]
  We show a possible finite-size precursor of a critical point that shows a typical finite-size scaling. We show that this singular point is found at the same disorder strength at which the Thouless and the Heisenberg energies coincide.
  arXiv  Detail & Related papers  (2020-10-17T10:33:13Z)
• Tuning the topology of $p$-wave superconductivity in an analytically solvable two-band model [0.0]
  We introduce and solve a two-band model of spinless fermions with $p_x$-wave pairing on a square lattice. We show that its phase diagram contains a topologically nontrivial weak pairing phase as well as a trivial strong pairing phase.
  arXiv  Detail & Related papers  (2020-10-01T01:20:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.