Non-Asymptotic Variational Learning for Monotone Nonlinear Multiscale Elliptic Equations: Scale-Robust Primal-Dual Bounds and Strong-Form Statistical Ill-Conditioning
- URL: http://arxiv.org/abs/2607.15702v2
- Date: Wed, 22 Jul 2026 04:37:50 GMT
- Title: Non-Asymptotic Variational Learning for Monotone Nonlinear Multiscale Elliptic Equations: Scale-Robust Primal-Dual Bounds and Strong-Form Statistical Ill-Conditioning
- Abstract summary: We develop a non-asymptotic approximation, sampling, and finite-iteration optimization theory for variational physics-informed approximations of uniformly nonlinear multiscale elliptic equations.<n>For boundary-compatible neural feature classes, the population error splits into approximation, empirical quadreration, and projected-gradient terms, with all non-approximation constants uniform in the microscopic scale (varepsilon)
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: We develop a non-asymptotic approximation, sampling, and finite-iteration optimization theory for variational physics-informed approximation of uniformly monotone nonlinear multiscale elliptic equations. For boundary-compatible neural feature classes, the population error splits into approximation, empirical quadrature, and projected-gradient terms, with all non-approximation constants uniform in the microscopic scale \(\varepsilon\). Assuming a quantitative corrected \(H^1\)-estimate, a two-scale state class yields \[ \mathcal A_m^\varepsilon \le C\bigl(\varepsilon+Φ_{0,m_0}^2+Φ_{1,m_1}^2\bigr) \] in arbitrary dimension. We further introduce a convex primal-dual physics loss whose population value is a computable upper certificate for the state error. With additional flux-corrector regularity, a divergence-compatible two-scale flux class gives a certified state-flux bound combining \(O(\varepsilon)\) approximation, state and flux feature errors, empirical sampling error, and an \(O(K^{-1})\) optimization term. In contrast, for general periodic nonlinear fluxes satisfying a natural nondegeneracy condition, the empirical Rademacher complexities of strong-residual and squared-residual classes are bounded below by constant multiples of \((\varepsilon\sqrt N)^{-1}\) and \((\varepsilon^2\sqrt N)^{-1}\), respectively. These optimizer-independent lower bounds hold in every spatial dimension. Numerical experiments confirm the predicted \(\varepsilon\)- and \(N\)-scalings for nonlinear fluxes in \(d=1,2,3\), validate every computed primal-dual certificate, and show that corrector-enriched classes substantially reduce energy and \(H^1\) errors as the microscopic scale is refined.
Related papers
- How to Make the Gradient Mapping Small for Constrained Stochastic Min-Max Problems and Beyond [9.865174381229927]
We focus on the case when suboptimality is measured in terms of the gradient mapping.<n>We bridge this gap to improve the gradient mapping complexity for constrained convex-concave min-max problems.
arXiv Detail & Related papers (2026-09-08T07:51:34Z) - Uniform Statistical Convergence of Empirical Sinkhorn Potentials with Exponential and Polynomial Dependence on the Regularization Parameter [3.6552781109515853]
We study the empirical Sinkhorn estimator of the entropic optimal transport potentials under the uniform loss.<n>For a fixed regularization parameter $varepsilon>0$, we establish a non-asymptotic statistical rate of $n-1/2$.<n>Key requirement is a residual-stability estimate for the population Sinkhorn map.
arXiv Detail & Related papers (2026-08-29T08:59:00Z) - Stability of Finite-Batch Particle Mean-Field Variational Inference Beyond Strong Convexity [3.0678195074387706]
We study the implementable finitebatch particle algorithm for mean-field variational inference as a fully discrete approximation of the projected Wasserstein dynamics.<n>We prove a nonasymotic Wasserstein stability bound that separates product, contraction, finitebatch error time drifttization, and the defects accumulated along the coupled particle trajectories.
arXiv Detail & Related papers (2026-08-11T22:56:36Z) - Exact Finite-Dimensional Evaluation of Homodyne Quantum Trajectories for Single-Quadrature Hamiltonian [0.0]
We identify an exactly solvable class of continuously monitored systems.<n>We derive an exact finite-angle representation of the conditional dynamics for arbitrary finite-order quadrature moments.<n>The resulting equations depend only on the Hamiltonian degree and moment order, with computational complexity independent of the Hilbert-space dimension.
arXiv Detail & Related papers (2026-07-28T00:32:22Z) - Statistical inverse learning and $\ell^1$-regularization [0.27998963147546135]
We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning.<n>We establish almost-sure exponents and derive non-asymptotic high-probability convergence rates in both prediction and $ell1$ reconstruction norms.
arXiv Detail & Related papers (2026-07-08T14:32:08Z) - Is Spurious Correlation Removal Always Learnable? [56.28155520961125]
Invariant learning can fail even when the structure is statistically identifiable.<n>We show a conditional computational barrier: under a black-box samplable supervised sparse recovery primitive, there exist emphamplable multi-dimensional environments.<n>Synthetic and real datasets illustrate the predicted gaps and transitions and motivate simple diversity diagnostics.
arXiv Detail & Related papers (2026-06-11T05:49:43Z) - Optimal Dimension-Free Sampling for Regularized Classification [56.72526267755301]
We prove optimal sampling bounds achieving $(1pmvarepsilon)$-relative error for a broad class of Lipschitz continuous classification loss functions.<n>This includes important functions such as logistic and sigmoid loss, hinge loss, and ReLU loss, as prominent and popular representative examples.
arXiv Detail & Related papers (2026-05-22T15:05:33Z) - Wavelet Variance Equipartition as a Threshold for World-Model Quality and Quantum Kernel TN-Simulability [0.0]
We identify the wavelet scaling exponent $$ as a critical diagnostic.<n>We establish $= 1/2$ as a sharp transition boundary for the classical simulability of amplitude-encoded quantum kernels.<n>We prove this variance scales strictly as $Var[X] = (d-2)$.
arXiv Detail & Related papers (2026-05-12T05:41:12Z) - Hardness of High-Dimensional Linear Classification [58.29089693778071]
We establish new exponential in dimension lower bounds for the Maximum Halfspace Discrepancy problem.<n>Both are fundamental problems in computational geometry and machine learning in their exact and approximate forms.
arXiv Detail & Related papers (2026-03-19T15:53:41Z) - Anisotropic local law for non-separable sample covariance matrices [10.181748307494608]
We establish local laws for sample covariance matrices $K = N-1sum_i=1N g_ig_ig_i*$ where the random vectors $g_1, ldots, g_N in Rn$ are independent with common covariance $$.<n>We discuss several classes of non-separable examples satisfying our assumptions, including conditionally mean-zero distributions, the random features model $g = (Xw)$ arising in machine learning, and Gaussian measures with
arXiv Detail & Related papers (2026-02-20T03:28:51Z) - Stabilizing Fixed-Point Iteration for Markov Chain Poisson Equations [49.702772230127465]
We study finite-state Markov chains with $n$ states and transition matrix $P$.<n>We show that all non-decaying modes are captured by a real peripheral invariant subspace $mathcalK(P)$, and that the induced operator on the quotient space $mathbbRn/mathcalK(P) is strictly contractive, yielding a unique quotient solution.
arXiv Detail & Related papers (2026-01-31T02:57:01Z) - A Regularized Newton Method for Nonconvex Optimization with Global and Local Complexity Guarantees [34.85903827323451]
We propose a new class of regularizers constructed from the current and previous gradients to solve regularized Newton equation.<n>The proposed algorithm is adaptive, requiring no prior knowledge of the Hessian Lipschitz constant.
arXiv Detail & Related papers (2025-02-07T10:10:10Z) - Learning with Norm Constrained, Over-parameterized, Two-layer Neural Networks [54.177130905659155]
Recent studies show that a reproducing kernel Hilbert space (RKHS) is not a suitable space to model functions by neural networks.
In this paper, we study a suitable function space for over- parameterized two-layer neural networks with bounded norms.
arXiv Detail & Related papers (2024-04-29T15:04:07Z) - High-Probability Bounds for Stochastic Optimization and Variational
Inequalities: the Case of Unbounded Variance [59.211456992422136]
We propose algorithms with high-probability convergence results under less restrictive assumptions.
These results justify the usage of the considered methods for solving problems that do not fit standard functional classes in optimization.
arXiv Detail & Related papers (2023-02-02T10:37:23Z) - Spectral clustering under degree heterogeneity: a case for the random
walk Laplacian [83.79286663107845]
This paper shows that graph spectral embedding using the random walk Laplacian produces vector representations which are completely corrected for node degree.
In the special case of a degree-corrected block model, the embedding concentrates about K distinct points, representing communities.
arXiv Detail & Related papers (2021-05-03T16:36:27Z) - Generalized moduli of continuity under irregular or random deformations via multiscale analysis [0.0]
We prove that for signals in multiresolution approximation spaces $U_s$ at scale $s$, stability in $L2$ holds in the regime $|tau|_Linfty/sll 1$.<n>Instability occurs when $|tau|_Linfty/sgg 1$, and we provide a sharp upper bound for the growth rate.
arXiv Detail & Related papers (2021-04-24T16:16:30Z) - On Linear Stochastic Approximation: Fine-grained Polyak-Ruppert and
Non-Asymptotic Concentration [115.1954841020189]
We study the inequality and non-asymptotic properties of approximation procedures with Polyak-Ruppert averaging.
We prove a central limit theorem (CLT) for the averaged iterates with fixed step size and number of iterations going to infinity.
arXiv Detail & Related papers (2020-04-09T17:54:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.