Operator Spectroscopy of Trained Lattice Samplers
- URL: http://arxiv.org/abs/2605.11199v1
- Date: Mon, 11 May 2026 20:06:15 GMT
- Title: Operator Spectroscopy of Trained Lattice Samplers
- Abstract summary: We analyze the trained field-space function itself.<n>We project these functions onto operator bases fixed before the fit.<n>The operator basis is model- and symmetry-dependent, but the test is common.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Trained lattice samplers are usually judged by the ensembles they generate. Here we instead analyze the trained field-space function itself: a flow-matching velocity, a diffusion score, or a normalizing-flow action residual. We project these functions onto operator bases fixed before the fit, chosen from symmetry, exact Gaussian path limits, finite-volume modes, and gauge covariance. For two-dimensional lattice \(φ^4\), a trained straight-flow teacher is not described by a local force basis alone. After the local transport basis, the residual separates into a zero-mode Binder component and a lowest-shell finite-\(k\) correlator component. The deflated zero-mode polynomial \(P_5(M;t)\) reduces the dominant Binder-tail component, while \(φ^\perp_{|n|^2=1}\) reduces the finite-\(k\) correlator component; wrong-parity, off-zero-mode, and random controls do not produce the same reductions. The same projection distinguishes other sampler classes. Diffusion follows the force-resolvent ordering predicted by the free theory, reverse-KL normalizing-flow collapse appears as a forbidden odd zero-mode residual, and gauge-equivariant teachers are resolved by Wilson-loop-force tangent directions. The operator basis is model- and symmetry-dependent, but the test is common: project the trained field-space function and retain sectors that lower held-out residuals and pass the available controls.
Related papers
- Learning Spectral-Like Mesh-Free Discretisations [0.0]
We introduce Spectral-like Modal Neural Discretisation (SpeND) in which the choice of those degrees of freedom is cast as a learning problem.<n>A hard-constrained projection layer maps the network output onto the affine subspace of consistent weights, so that consistency holds exactly by construction rather than as a penalty.
arXiv Detail & Related papers (2026-09-02T17:16:16Z) - Intrinsic Structure: Spectral Identifiability for Mechanistic Interpretability [51.56484100374058]
We prove the first identifiability theorem for a mechanistic-interpretability primitive.<n>The spectrum is an identifiable, model-intrinsic fingerprint with a stated error bar, not a legible decomposition.
arXiv Detail & Related papers (2026-08-10T19:42:01Z) - Quotient Dynamics, Effective Curvature, and Implicit Bias in Positive Quadratic Networks [0.0]
Positive quadratic networks admit the lowrank representation f_U(x)=xtop UUtop x, where UinmathbbRdtimes r is identifiable only up to right multiplication.<n>We study how this quotient structure governs training dynamics, curvature, recovery, and bias.
arXiv Detail & Related papers (2026-07-28T12:04:46Z) - CoCurve: Cross-Module Co-Pruning Curvature for Training-Free Structured LLM Pruning [47.406985340436925]
CoCurve is a calibration-only, fine-tuning-free method that prunes attention and FFN units jointly.<n>It reduces to one budgeted quadratic program, solved in a single shot under a shared attention--FFN budget, with no labels, fine-tuning, or recovery.
arXiv Detail & Related papers (2026-07-20T05:27:57Z) - Why Zeroth-Order Adaptation May Forget Less: A Randomized Shaping Theory [23.912005398880293]
Continual learning requires new-task adaptation without damaging previously acquired capabilities.<n>Recent forward-pass and zeroth-order (ZO) results show that low-query adaptation may retain better than first-order descent.<n>We give a local randomized gradient-shaping analysis: finite differences expose a raw shape that is mean-aligned with FO.<n>For norm-matched ZO, the expected shaped retention curvature obeys an exact identity that preserves the isotropic retention floor while contracting only the anisotropic component.<n>Projecting this identity onto the incoming gradient yields the observable FO--ZO quadratic forgetting gap.
arXiv Detail & Related papers (2026-05-11T14:41:08Z) - The Extrapolation Cliff in On-Policy Distillation of Near-Deterministic Structured Outputs [52.709361620508595]
ListOPD brings a student to in-domain with an 8B-SFT baseline at one-fifth the parameters.<n>On Amazon Fashion, three pre-registered tests--a fine-grid cliff interval test, and a small-clip cross-prediction--fall within their locked prediction windows--with the small-clip value matching the closed-form prediction below grid resolution.
arXiv Detail & Related papers (2026-05-09T06:48:00Z) - Conditional Diffusion Under Linear Constraints: Langevin Mixing and Information-Theoretic Guarantees [10.73598638822051]
We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems.<n>We prove that the error from replacing this score by the unconditional tangent score is upper bounded by a dimension-free conditional mutual information between observed and unobserved components.
arXiv Detail & Related papers (2026-05-06T19:19:54Z) - Symmetry-Protected Lyapunov Neutral Modes in Equivariant Recurrent Networks [0.0]
Recurrent networks that store position, phase, or other continuous variables need state-space directions that remain neutral over long horizons.<n>We prove that any compact invariant set carrying a uniformly nondegenerate group-orbit bundle with stabilizer type (H) has, at least (dim(G/H)) zero Lyapunov exponents tangent to the group orbit.
arXiv Detail & Related papers (2026-05-05T03:59:56Z) - Exact Loop Controllers for ReLU Realization of Homogeneous Curve Refinements [0.0]
We study homogeneous refinement operators ((V)(t)=sum_jinmathbb ZA_j(Mt-j)), acting on compactly supported continuous piecewise linear curves (:mathbb Rtomathbb Rp), where (Mge2) and only finitely many matrices (A_jinmathbb Rptimes p) are nonzero.<n>We prove that the iterates (Vn) admit exact Re
arXiv Detail & Related papers (2026-05-03T00:44:46Z) - Scale-Dependent Radial Geometry and Metric Mismatch in Wasserstein Propagation for Reverse Diffusion [20.064604732340037]
We formalize a metric mismatch between the geometry that contracts early and the geometry in which the terminal error is measured.<n>We exploit this mismatch through an explicit radial lower profile for the learned reverse drift.<n>For discretizations of the learned reverse SDE under (L2) score-error control, we obtain explicit non-asymptotic end-to-end (Wtwo) guarantees.
arXiv Detail & Related papers (2026-03-20T06:08:29Z) - Refined Risk Bounds for Unbounded Losses via Transductive Priors [67.12679195076387]
We revisit the sequential variants of linear regression with the squared loss, classification problems with hinge loss, and logistic regression.<n>Our key tools are based on the exponential weights algorithm with carefully chosen transductive priors.
arXiv Detail & Related papers (2024-10-29T00:01:04Z) - Unified Fourier-based Kernel and Nonlinearity Design for Equivariant
Networks on Homogeneous Spaces [52.424621227687894]
We introduce a unified framework for group equivariant networks on homogeneous spaces.
We take advantage of the sparsity of Fourier coefficients of the lifted feature fields.
We show that other methods treating features as the Fourier coefficients in the stabilizer subgroup are special cases of our activation.
arXiv Detail & Related papers (2022-06-16T17:59:01Z) - Optimal policy evaluation using kernel-based temporal difference methods [78.83926562536791]
We use kernel Hilbert spaces for estimating the value function of an infinite-horizon discounted Markov reward process.
We derive a non-asymptotic upper bound on the error with explicit dependence on the eigenvalues of the associated kernel operator.
We prove minimax lower bounds over sub-classes of MRPs.
arXiv Detail & Related papers (2021-09-24T14:48:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.