Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities
- URL: http://arxiv.org/abs/2604.06065v1
- Date: Tue, 07 Apr 2026 16:46:40 GMT
- Title: Lipschitz regularity in Flow Matching and Diffusion Models: sharp sampling rates and functional inequalities
- Abstract summary: We establish a sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores.<n>We show that the one-sided Lipschitz control yields a globally Lipschitz transport map from the standard Gaussian to $pstar$.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Under general assumptions on the target distribution $p^\star$, we establish a sharp Lipschitz regularity theory for flow-matching vector fields and diffusion-model scores, with optimal dependence on time and dimension. As applications, we obtain Wasserstein discretization bounds for Euler-type samplers in dimension $d$: with $N$ discretization steps, the error achieves the optimal rate $\sqrt{d}/N$ up to logarithmic factors. Moreover, the constants do not deteriorate exponentially with the spatial extent of $p^\star$. We also show that the one-sided Lipschitz control yields a globally Lipschitz transport map from the standard Gaussian to $p^\star$, which implies Poincaré and log-Sobolev inequalities for a broad class of probability measures.
Related papers
- Non-asymptotic quantisation of spherically symmetric distributions [1.2031796234206138]
Zador's celebrated theorem is a cornerstone of optimal quantisation.<n>We show that for moderate $n$ random quantisers uniformly distributed on a sphere of suitable radius $r$ achieve exceptional performance.<n>We derive approximations for $r$, particularly in scenarios where $n$ scales with $d$.
arXiv Detail & Related papers (2026-05-12T10:01:41Z) - Expressivity of Bi-Lipschitz Normalizing Flows: A Score-Based Diffusion Perspective [22.909795047222755]
We study the expressivity of bi-Lipschitz normalizing flows through the lens of score-based diffusion models.<n>Our key idea is to use the probability flow ODE to link regularity of the score to regularity of the induced transport maps.
arXiv Detail & Related papers (2026-05-07T12:54:49Z) - Provably Adaptive Linear Approximation for the Shapley Value and Beyond [73.0940890296463]
A fundamental and long-standing challenge is their efficient approximation.<n>We develop a linear-space algorithm that requires $P(|hatboldsymbol-boldsymbol|_2geq)leq $ for all commonly used semi-values.<n>Our algorithm allows explicit minimization of the mean square error for each specific utility function.
arXiv Detail & Related papers (2026-04-09T16:38:14Z) - Optimal Unconstrained Self-Distillation in Ridge Regression: Strict Improvements, Precise Asymptotics, and One-Shot Tuning [61.07540493350384]
Self-distillation (SD) is the process of retraining a student on a mixture of ground-truth and the teacher's own predictions.<n>We show that for any prediction risk, the optimally mixed student improves upon the ridge teacher for every regularization level.<n>We propose a consistent one-shot tuning method to estimate $star$ without grid search, sample splitting, or refitting.
arXiv Detail & Related papers (2026-02-19T17:21:15Z) - Pathway to $O(\sqrt{d})$ Complexity bound under Wasserstein metric of flow-based models [1.724966705006084]
We provide tools to estimate the error of flow-based generative models under the Wasserstein metric.<n>We show this error can be explicitly controlled by two parts: the Lipschitzness of the push-forward maps of the backward flow which scales independently of the dimension.
arXiv Detail & Related papers (2025-12-07T07:26:39Z) - Complexity Analysis of Normalizing Constant Estimation: from Jarzynski Equality to Annealed Importance Sampling and beyond [40.79840141270367]
Given an unnormalized probability density $piproptomathrme-V$, estimating its normalizing constant $Z=int_mathbbRdmathrme-V(x)mathrmdx$ or free energy $F=-log Z$ is a crucial problem in Bayesian statistics, statistical mechanics, and machine learning.<n>We propose a new algorithm based on reverse diffusion samplers, establish a framework for analyzing its complexity, and empirically demonstrate its efficiency in tackling multimodality.
arXiv Detail & Related papers (2025-02-07T00:05:28Z) - Global Well-posedness and Convergence Analysis of Score-based Generative Models via Sharp Lipschitz Estimates [1.3124513975412255]
We establish global well-posedness and convergence of the score-based generative models (SGM)
For the smooth case, we start from a Lipschitz bound of the score function with optimal time length.
The optimality is validated by an example whose Lipschitz constant of scores is bounded at initial but blows up in finite time.
arXiv Detail & Related papers (2024-05-25T07:31:24Z) - Closed-form Filtering for Non-linear Systems [83.91296397912218]
We propose a new class of filters based on Gaussian PSD Models, which offer several advantages in terms of density approximation and computational efficiency.
We show that filtering can be efficiently performed in closed form when transitions and observations are Gaussian PSD Models.
Our proposed estimator enjoys strong theoretical guarantees, with estimation error that depends on the quality of the approximation and is adaptive to the regularity of the transition probabilities.
arXiv Detail & Related papers (2024-02-15T08:51:49Z) - Optimal score estimation via empirical Bayes smoothing [13.685846094715364]
We study the problem of estimating the score function of an unknown probability distribution $rho*$ from $n$ independent and identically distributed observations in $d$ dimensions.
We show that a regularized score estimator based on a Gaussian kernel attains this rate, shown optimal by a matching minimax lower bound.
arXiv Detail & Related papers (2024-02-12T16:17:40Z) - A Law of Robustness beyond Isoperimetry [84.33752026418045]
We prove a Lipschitzness lower bound $Omega(sqrtn/p)$ of robustness of interpolating neural network parameters on arbitrary distributions.
We then show the potential benefit of overparametrization for smooth data when $n=mathrmpoly(d)$.
We disprove the potential existence of an $O(1)$-Lipschitz robust interpolating function when $n=exp(omega(d))$.
arXiv Detail & Related papers (2022-02-23T16:10:23Z) - Optimal policy evaluation using kernel-based temporal difference methods [78.83926562536791]
We use kernel Hilbert spaces for estimating the value function of an infinite-horizon discounted Markov reward process.
We derive a non-asymptotic upper bound on the error with explicit dependence on the eigenvalues of the associated kernel operator.
We prove minimax lower bounds over sub-classes of MRPs.
arXiv Detail & Related papers (2021-09-24T14:48:20Z) - On the expressivity of bi-Lipschitz normalizing flows [49.92565116246822]
An invertible function is bi-Lipschitz if both the function and its inverse have bounded Lipschitz constants.
Most Normalizing Flows are bi-Lipschitz by design or by training to limit numerical errors.
arXiv Detail & Related papers (2021-07-15T10:13:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.