Limit Points of Reflow with Minibatch Optimal Transport
- URL: http://arxiv.org/abs/2608.07042v1
- Date: Fri, 07 Aug 2026 09:51:33 GMT
- Title: Limit Points of Reflow with Minibatch Optimal Transport
- Abstract summary: Rectified flows are generative models that learn a time-dependent vector field steering a probability curve between two probability distributions.<n>We study the behavior of this iteration and characterize its limit points.<n>Such $N$-cyclically monotone couplings enjoy favorable structural and stability properties such as rectifiability and straightness.
- Score: 5.12067518301035
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Rectified flows, also called flow matching or stochastic interpolants, are generative models that learn a time-dependent vector field steering a probability curve between two probability distributions, usually referred to as latent and target distributions. Reflow accelerates inference by iteratively straightening the trajectories induced by this vector field. We study the asymptotic behavior of this iteration and characterize its limit points. First, we define weak rectified couplings which always exist. Next, when rectified flow updates are alternated with minibatch optimal transport steps of fixed batch size, we show that any limit is $N$-cyclically monotone, where $N$ is the batch size. Such $N$-cyclically monotone couplings enjoy favorable structural and stability properties such as rectifiability and straightness. Finally, restricting velocities to gradient fields and assuming additional support conditions, we prove that reflow limits coincide with the optimal transport map between the endpoint distributions.
Related papers
- Computational and Statistical Guarantees of the \textit{c}-Rectified flow [4.787815288113813]
We study textitc-rectified flow, a cost-aware class of rectified flow that projects velocity fields onto a gradient class while preserving endpoint marginals.<n>We establish quantitative one-step contraction and exponential convergence guarantees under projection-stability assumptions for both quadratic and strongly convex displacement costs.<n>We show that, when combined with iterative textitc-rectified flow, they yield a rate-optimal estimator of the optimal transport for the dimension (d ge 3) and a nearly parametric rate for (d=1,2)
arXiv Detail & Related papers (2026-08-03T16:53:29Z) - Lagrangian Flow Matching: A Least-Action Framework for Principled Path Design [14.77320535984857]
Flow matching trains a neural velocity field by regression against a target velocity associated with a prescribed probability path.<n>We propose Lagrangian flow matching, a physics-based framework in which the probability path and velocity field are determined by minimizing the action of a general Lagrangian.
arXiv Detail & Related papers (2026-05-14T21:05:03Z) - Direct Estimation of Schrödinger Bridge Time-Series Drifts: Finite-Sample, Asymptotic, and Adaptive Guarantees [0.0]
We study nonparametric estimation of Schrdinger bridge drifts from i.i.d. data.<n>Our approach works directly at the drift level and isolates emphstatistical error from optimization, approximation, and discretization error.
arXiv Detail & Related papers (2026-05-06T20:44:44Z) - Properties and limitations of geometric tempering for gradient flow dynamics [0.0]
We consider the effect of replacing $$ with a sequence of moving targets $(_t)_tge0$ defined via geometric tempering on the Wasserstein and Fisher--Rao gradient flows.<n>We show that convergence occurs exponentially in continuous time, providing novel bounds in both cases.<n>In the Fisher--Rao case, replacing the target distribution with a geometric mixture of initial and target distribution never leads to a convergence speed up both in continuous time and in discrete time.
arXiv Detail & Related papers (2026-04-22T07:59:28Z) - Riemannian MeanFlow for One-Step Generation on Manifolds [54.09734511705173]
Flow Matching enables simulation-free training of generative models.<n>MeanFlow can be extended to manifold-valued generation where velocities lie in location-dependent tangent spaces.<n>Experiments on spheres, tori, and SO(3) demonstrate competitive one-step sampling with improved quality-efficiency trade-offs and substantially reduced sampling cost.
arXiv Detail & Related papers (2026-03-11T12:41:46Z) - FlowConsist: Make Your Flow Consistent with Real Trajectory [99.22869983378062]
We argue that current fast-flow training paradigms suffer from two fundamental issues.<n> conditional velocities constructed from randomly paired noise-data samples introduce systematic trajectory drift.<n>We propose FlowConsist, a training framework designed to enforce trajectory consistency in fast flows.
arXiv Detail & Related papers (2026-02-06T03:24:23Z) - Tilt Matching for Scalable Sampling and Fine-Tuning [4.14348726233299]
We propose a scalable algorithm for using interpolants to sample from unnormalized densities and for fine-tuning generative models.<n>The approach, Tilt Matching, arises from a dynamical equation relating the flow matching velocity to one targeting the same distribution tilted by a reward.<n>We empirically verify that the approach is efficient and highly scalable, providing state-of-the-art results on sampling under Lennard-Jones potentials and is competitive on fine-tuning Stable Diffusion.
arXiv Detail & Related papers (2025-12-26T02:12:10Z) - Revisiting Zeroth-Order Optimization: Minimum-Variance Two-Point Estimators and Directionally Aligned Perturbations [57.179679246370114]
We identify the distribution of random perturbations that minimizes the estimator's variance as the perturbation stepsize tends to zero.<n>Our findings reveal that such desired perturbations can align directionally with the true gradient, instead of maintaining a fixed length.
arXiv Detail & Related papers (2025-10-22T19:06:39Z) - On the Wasserstein Convergence and Straightness of Rectified Flow [54.580605276017096]
Rectified Flow (RF) is a generative model that aims to learn straight flow trajectories from noise to data.<n>We provide a theoretical analysis of the Wasserstein distance between the sampling distribution of RF and the target distribution.<n>We present general conditions guaranteeing uniqueness and straightness of 1-RF, which is in line with previous empirical findings.
arXiv Detail & Related papers (2024-10-19T02:36:11Z) - Broadening Target Distributions for Accelerated Diffusion Models via a Novel Analysis Approach [49.97755400231656]
We show that a new accelerated DDPM sampler achieves accelerated performance for three broad distribution classes not considered before.<n>Our results show an improved dependency on the data dimension $d$ among accelerated DDPM type samplers.
arXiv Detail & Related papers (2024-02-21T16:11:47Z) - Adaptive Annealed Importance Sampling with Constant Rate Progress [68.8204255655161]
Annealed Importance Sampling (AIS) synthesizes weighted samples from an intractable distribution.
We propose the Constant Rate AIS algorithm and its efficient implementation for $alpha$-divergences.
arXiv Detail & Related papers (2023-06-27T08:15:28Z) - Minibatch vs Local SGD with Shuffling: Tight Convergence Bounds and
Beyond [63.59034509960994]
We study shuffling-based variants: minibatch and local Random Reshuffling, which draw gradients without replacement.
For smooth functions satisfying the Polyak-Lojasiewicz condition, we obtain convergence bounds which show that these shuffling-based variants converge faster than their with-replacement counterparts.
We propose an algorithmic modification called synchronized shuffling that leads to convergence rates faster than our lower bounds in near-homogeneous settings.
arXiv Detail & Related papers (2021-10-20T02:25:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.