When Rates Are Geometric: Rate-Certificate Transfer for Contact Splittings in Optimization
- URL: http://arxiv.org/abs/2607.23642v1
- Date: Sun, 26 Jul 2026 13:12:58 GMT
- Title: When Rates Are Geometric: Rate-Certificate Transfer for Contact Splittings in Optimization
- Abstract summary: A contact Hamiltonian $H$ on $J1(mathbbRn)$ obeys the intrinsic decay identity $dot H = -H,partial_s H$.<n>An augmented energy $mathcalE$ built from $H$ is a continuous-time rate certificate whenever $mathcalE$ controls the objective gap.
- Score: 0.0
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Discrete optimization algorithms are often analyzed through continuous-time limiting ODEs, but a convergence certificate for the ODE is not automatically one for the discrete algorithm. We develop contact Hamiltonian systems as a setting where the transfer can be made precise. A contact Hamiltonian $H$ on $J^1(\mathbb{R}^n)$ obeys the intrinsic decay identity $\dot H = -H\,\partial_s H$, so an augmented energy $\mathcal{E}$ built from $H$, together with the conformal rate $\partial_s H$, is a continuous-time rate certificate whenever $\mathcal{E}$ controls the objective gap. Our main theorem states, under three named and independently checkable hypotheses, that an order-$r$ contact splitting with step $h$ transfers this certificate over the finite horizon set by backward error analysis. The discrete decay envelope is governed by the modified conformal factor up to $O(h^r)$ perturbations plus a backward-error shadowing defect, and the mechanism is inherited exactly because the modified Hamiltonian is itself a contact Hamiltonian. Quadratic heavy ball is a fully solvable example: its projected dissipative-leapfrog spectrum agrees with established conformal-symplectic optimization theory, while the augmented contact Hamiltonian yields a sharp objective-to-certificate comparison that verifies the transfer hypotheses. For strongly convex objectives with state-dependent damping, an explicit Bregman-type Lyapunov certificate instead transfers by an auxiliary-shadowing corollary. The decomposition $H=K+V+D$ into kinetic, objective-encoding potential, and dissipation terms serves as a design template, with a catalogue of closed-form sub-flows including contact-specific damping families. Numerical experiments confirm the predicted conformal-factor tracking orders and show competitive performance on ill-conditioned benchmarks and deep-learning tasks.
Related papers
- Modular-Annihilator Parent Hamiltonians for Purified Gibbs States: Spectral Design and Controlled Approximation [0.0]
We study the exact finite sum-of-squares (SoS) construction of their parent Hamiltonians and the associated Lindbladian based on modular annihilators.<n>The purified Gibbs state remains a common zero mode while the freedom to choose and combine the generators can be used to optimize the spectral properties of the parent Hamiltonian.
arXiv Detail & Related papers (2026-08-31T05:33:17Z) - Convergence analysis of a family of Zermelo-type iterations for the Bradley--Terry model [6.011136456835614]
We show that Zermelo's algorithm converges substantially faster under the Bradley--Terry (BT) model.<n>We further establish approximation results for the population convergence under the BT model, justifying their practical relevance.
arXiv Detail & Related papers (2026-07-24T11:39:24Z) - Statistical inverse learning and $\ell^1$-regularization [0.27998963147546135]
We study the recovery of sparse functions from finite, noisy, and indirect observations in the framework of statistical inverse learning.<n>We establish almost-sure exponents and derive non-asymptotic high-probability convergence rates in both prediction and $ell1$ reconstruction norms.
arXiv Detail & Related papers (2026-07-08T14:32:08Z) - Optimization Geometrodynamics: Variational Reduction and Interaction Curvature [0.0]
We develop geometrodynamics as a variational theory of this hidden determinant pushforward.<n>For affine pre-reductions, the induced interaction curvature is the negative-semidefinite operator $-G*H-1G$.<n>We prove a global analytic bundle with closed totally geodesic fibers and a unique analytic nearest-controller section.
arXiv Detail & Related papers (2026-07-07T18:42:00Z) - What Does a Discrete Diffusion Model Learn? [71.03603607324338]
discrete diffusion model learns: a denoiser, a score ratio, or a bridge plug-in predictor.<n>We start with a rigorous derivation of the continuous-time Markov chain (CTMC) ELBO for any noising process.<n>Every identity is verified numerically, without approximation, on an exactly solvable model.
arXiv Detail & Related papers (2026-07-06T17:56:11Z) - AI-Assisted Discovery of Convex Relaxations via Dual Agents [56.60366723277675]
We show that a lower bound holds for every admissible function and follows from a convex relaxation giving stronger bounds.<n>A theory verifies each agent one and searches for counterexamples, and every reported bound is certified by an explicit dual-feasible point in the interval.
arXiv Detail & Related papers (2026-06-30T06:10:25Z) - Quantum Differential Equation Solver via Hybrid Oscillator-Qubit Linear Combination of Hamiltonian Simulations [7.438217717051814]
We introduce a hybrid oscillator-qubit formulation of linear combination of Hamiltonian simulation (LCHS)<n>Instead of representing the quadrature rule with a discrete-variable (DV) ancilla register in qubit-only LCHS, the method encodes the LCHS kernel in a continuous-variable ancillary mode.<n>In the heat-equation benchmarks, the Law--Eberly protocol achieves end-to-end solution fidelity at least 99.90%.
arXiv Detail & Related papers (2026-05-11T15:20:35Z) - Tokens-per-Parameter Coverage Is Critical for Robust LLM Scaling Law Extrapolation [45.56738584872585]
Neural scaling laws approximate a language model's loss as a power-law function of parameter count $N$ and token count $D$.<n>We show that a collinear design induces an inherent ill-conditioning in the Gauss-Newton least-squares problem.<n>We prove this for four scaling-law formalisms and derive a closed-form TPP-diversity threshold that is necessary and sufficient for well-conditioned estimation.
arXiv Detail & Related papers (2026-05-08T23:00:17Z) - High-Probability Convergence in Decentralized Stochastic Optimization with Gradient Tracking [69.90407799170687]
We study high-probability (HP) convergence guarantees in decentralized optimization.<n>Our results establish the same conditions on the horizon as in achieving comparable times.
arXiv Detail & Related papers (2026-04-30T22:45:21Z) - The Feedback Hamiltonian is the Score Function: A Diffusion-Model Framework for Quantum Trajectory Reversal [0.0]
We show that a Hamiltonian $H_mathrmmeas = r A / $ tilts the distribution of measurement trajectories, with $X -2$ producing statistically time-reversed outcomes.<n>This mechanism relates to score-based diffusion models in machine learning.
arXiv Detail & Related papers (2026-04-23T02:02:13Z) - Stability and Generalization of Push-Sum Based Decentralized Optimization over Directed Graphs [55.77845440440496]
Push-based decentralized communication enables optimization over communication networks, where information exchange may be asymmetric.<n>We develop a unified uniform-stability framework for the Gradient Push (SGP) algorithm.<n>A key technical ingredient is an imbalance-aware generalization bound through two quantities.
arXiv Detail & Related papers (2026-02-24T05:32:03Z) - Approximation of diffeomorphisms for quantum state transfers [49.1574468325115]
We seek to combine two emerging standpoints in control theory.<n>We numerically find control laws driving state transitions in small time in a bilinear Schr"odinger PDE posed on the torus.
arXiv Detail & Related papers (2025-03-18T17:28:59Z) - PROMISE: Preconditioned Stochastic Optimization Methods by Incorporating Scalable Curvature Estimates [17.777466668123886]
We introduce PROMISE ($textbfPr$econditioned $textbfO$ptimization $textbfM$ethods by $textbfI$ncorporating $textbfS$calable Curvature $textbfE$stimates), a suite of sketching-based preconditioned gradient algorithms.
PROMISE includes preconditioned versions of SVRG, SAGA, and Katyusha.
arXiv Detail & Related papers (2023-09-05T07:49:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.