Two-Sided Bounds for Entropic Optimal Transport via a Rate-Distortion Integral
- URL: http://arxiv.org/abs/2604.14061v1
- Date: Wed, 15 Apr 2026 16:37:00 GMT
- Title: Two-Sided Bounds for Entropic Optimal Transport via a Rate-Distortion Integral
- Abstract summary: We show that the maximum expected inner product between a random vector and the standard normal vector is equivalent to a truncated integral involving the rate-distortion function.<n>The proof is based on a lifting technique, which constructs a Gaussian process indexed by a random subset of the type class of the probability distribution involved in the information-theoretic inequality.
- Score: 17.319855487817257
- License: http://creativecommons.org/publicdomain/zero/1.0/
- Abstract: We show that the maximum expected inner product between a random vector and the standard normal vector over all couplings subject to a mutual information constraint or regularization is equivalent to a truncated integral involving the rate-distortion function, up to universal multiplicative constants. The proof is based on a lifting technique, which constructs a Gaussian process indexed by a random subset of the type class of the probability distribution involved in the information-theoretic inequality, and then applying a form of the majorizing measure theorem.
Related papers
- Generalized Splines and Gaussian Processes [15.333202915986627]
We show that generalized splines take the role of linear regressors and generalized Gaussian processes on a nuclear space $S$ are the counterpart of Gaussian random vectors.<n>Our formalism involves a whitening/regularization operator $L: Sto S'$ whose continuous extension induces a native Hilbert space $Hsubset S'$ that plays a central role in our characterization.
arXiv Detail & Related papers (2026-08-28T15:34:46Z) - Nested Integral Generator Theorem: From Operator Tautologies to Families of Exact Integral Identities [0.0]
An exact integral representation of a Kerr-squeezed coherent-state overlap and exact Fock-basis elements for a composite two-mode Gaussian network is presented.<n>The taut theorem yields exact representations for individual operator functions.<n>Its scope is illustrated through elementary, analytic and single-mode operators, as well as single- and two-mode unitaries, including squeezing and beam splitting.
arXiv Detail & Related papers (2026-07-25T14:53:28Z) - Projective Maximum Entropy: Universality and Acceptance-Region Calibration [2.639737913330821]
We formulate maximum entropy on the projective space of nonnegative measures.<n>Every admissible monotone transform of the same normalized power functional has exactly the same universality under linear moment constraints.<n>The resulting affine-equivariant reference density is the unique projective maximum-entropy solution.
arXiv Detail & Related papers (2026-07-17T22:50:47Z) - Error bounds for splitting methods in unitary problems [45.88028371034407]
We present a systematic analysis of both local and global errors arising from arbitrary splitting methods applied to unitary problems.<n>The first is expressed in terms of operator norms, while the second is formulated using norms of commutators and can, under suitable assumptions, be extended to certain classes of operators.
arXiv Detail & Related papers (2026-04-01T15:33:05Z) - Deterministic Zeroth-Order Mirror Descent via Vector Fields with A Posteriori Certification [45.85698554568285]
We develop a deterministic zeroth-order mirror descent framework by replacing gradients with a general vector field.<n>Our analysis provides an evaluation template for last-rate inequality evaluations.<n>Together, these results expose a hidden geometric linking Bregman identities, deterministic certification, and robust conic geometry in zeroth-order mirror descent.
arXiv Detail & Related papers (2026-01-31T10:05:05Z) - Theoretical Guarantees for High Order Trajectory Refinement in Generative Flows [40.884514919698596]
Flow matching has emerged as a powerful framework for generative modeling.<n>We prove that higher-order flow matching preserves worst case optimality as a distribution estimator.
arXiv Detail & Related papers (2025-03-12T05:07:07Z) - Sampling and estimation on manifolds using the Langevin diffusion [45.57801520690309]
Two estimators of linear functionals of $mu_phi $ based on the discretized Markov process are considered.<n>Error bounds are derived for sampling and estimation using a discretization of an intrinsically defined Langevin diffusion.
arXiv Detail & Related papers (2023-12-22T18:01:11Z) - Universal coding, intrinsic volumes, and metric complexity [3.4265828682659705]
In this assignment, the goal is to predict, or equivalently, a sequence of real-valued observations almost as well as the best distribution with mean-valued subsets of $mathbbRn.<n>As part of our analysis, we also characterize the minimax redundancy for a general constraint set.<n>We contrast our findings with classical results in information theory.
arXiv Detail & Related papers (2023-03-13T16:54:04Z) - Uniform Convergence of Interpolators: Gaussian Width, Norm Bounds, and
Benign Overfitting [35.78863301525758]
We prove a generic uniform convergence guarantee on the generalization error of interpolators in an arbitrary hypothesis class.
Applying the generic bound to Euclidean norm balls recovers the consistency result of Bartlett et al. ( 2020) for minimum-norm interpolators.
We show how norm-based generalization bounds can explain and be used to analyze benign overfitting, at least in some settings.
arXiv Detail & Related papers (2021-06-17T06:58:10Z) - Spectral clustering under degree heterogeneity: a case for the random
walk Laplacian [83.79286663107845]
This paper shows that graph spectral embedding using the random walk Laplacian produces vector representations which are completely corrected for node degree.
In the special case of a degree-corrected block model, the embedding concentrates about K distinct points, representing communities.
arXiv Detail & Related papers (2021-05-03T16:36:27Z) - Curvature-Dependant Global Convergence Rates for Optimization on
Manifolds of Bounded Geometry [6.85316573653194]
We give curvature-dependant convergence rates for weakly convex functions defined on a manifold of 1-bounded geometry.
We compute these bounds explicitly for some manifold commonly used in the optimization literature.
We present self-contained proofs of fully general bounds on the norm of the differential of the exponential map.
arXiv Detail & Related papers (2020-08-06T08:30:35Z) - Understanding Implicit Regularization in Over-Parameterized Single Index
Model [55.41685740015095]
We design regularization-free algorithms for the high-dimensional single index model.
We provide theoretical guarantees for the induced implicit regularization phenomenon.
arXiv Detail & Related papers (2020-07-16T13:27:47Z) - The semiring of dichotomies and asymptotic relative submajorization [0.0]
We study quantum dichotomies and the resource theory of asymmetric distinguishability using a generalization of Strassen's theorem on preordered semirings.
We find that an variant of relative submajorization, defined on unnormalized dichotomies, is characterized by real-valued monotones that are multiplicative under the tensor product and additive under the direct sum.
arXiv Detail & Related papers (2020-04-22T14:13:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.