Velocity Scheduled Flow Matching
- URL: http://arxiv.org/abs/2607.11442v1
- Date: Mon, 13 Jul 2026 11:50:06 GMT
- Title: Velocity Scheduled Flow Matching
- Abstract summary: Flow matching trains a neural network to regress the conditional velocity along a linear interpolant between noise and data.<n>We introduce Velocity Scheduled Flow Matching, which replaces the conditional target.<n>VSFM can be sampled under any admissible profile by integrating its ODE on a non-uniform profile.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Flow matching trains a neural network to regress the conditional velocity along a linear interpolant between noise and data, and the number of network evaluations~(NFE) sets the cost of sampling. The straight-line interpolant carries an implicit choice: the sample moves at constant speed throughout the trajectory. We relax this choice and introduce Velocity Scheduled Flow Matching~(VSFM), which replaces the conditional target $x_1 - x_0$ with $v(t)(x_1 - x_0)$ for any nonnegative profile $v:[0,1]\to\mathbb{R}_{\geq 0}$ satisfying $\int_0^1 v\,dt = 1$. We study six polynomial profiles drawn from motion planning. The first use of VSFM is at inference time: a pretrained linear flow-matching model can be sampled under any admissible profile by integrating its ODE on a non-uniform $τ$-schedule, with no retraining and no additional computation; on CIFAR-10 this lowers FID by up to $19.8\%$. Training from scratch under a braking profile gives a further reduction of $17.4\%$ at $4$~NFE. Both gains follow from the local truncation error of the Euler integrator on the induced grid.
Related papers
- Same Flow, Different Paths: Variance Reduction in Flow Matching [67.12978375116599]
We study the choice of this path from an optimization perspective.<n>Our main finding is that the choice of path $g_t$ can fundamentally change the convergence rate of SGD.
arXiv Detail & Related papers (2026-09-15T15:01:04Z) - Round-Trip Consistency: Bidirectional Diffusion Models Can Predict Their Own Rollout Errors [51.56484100374058]
Autoregressive models accumulate error over long rollouts, yet at deployment there is no ground truth to measure it against.<n>We train a single conditional latent diffusion model that steps a dynamical system forward or backward in time via a direction flag.<n>We show that this bidirectionality supplies a measurement-free test-time error signal.
arXiv Detail & Related papers (2026-08-01T13:49:46Z) - Conditioning Tree-Based Diffusions and Flows for Probabilistic Tabular Regression [0.0]
Tree-based diffusion models fit flexible conditional predictive distributions for regression without a neural density estimator.<n>We show these defaults are the binding constraint: what a gradient-boosted ensemble actually solves is a supervised regression problem.<n>We present DiffGBM, which makes them explicit along two axes.
arXiv Detail & Related papers (2026-07-30T22:08:02Z) - x-Prediction Is All You Need:Training-Free Accelerated Generation via Endpoint Decodability [7.28668585578288]
Diffusion and flow matching models generate high-quality samples, but their ODE samplers often need tens of hundreds of neural function evaluations (NFEs)<n>This remains a practical challenge for released checkpoints, since many accelerators require additional design choices and training cost through retraining, distillation, or trajectory redesign.<n>We investigate a different route based on $x$-prediction.<n>Across SDXL, SD3.5M, Z-Image-Turbo, and three class-conditional benchmarks, it reduces NFEs by 20--70% with near-matched quality.
arXiv Detail & Related papers (2026-07-07T10:24:38Z) - Asymptotic-Preserving A Posteriori Analysis of Diffusion and Flow-Matching Samplers [0.6768558752130311]
Diffusion and flow-matching samplers integrate a learned probability-flow ODE from a large noise scale down to a small terminal floor $_min$, at which the score is stiff and the flow develops a boundary layer.<n>We treat $_min$ as a singular-perturbation parameter and determine which fixed-step samplers are solvable.
arXiv Detail & Related papers (2026-07-05T04:48:33Z) - Riemannian MeanFlow for One-Step Generation on Manifolds [54.09734511705173]
Flow Matching enables simulation-free training of generative models.<n>MeanFlow can be extended to manifold-valued generation where velocities lie in location-dependent tangent spaces.<n>Experiments on spheres, tori, and SO(3) demonstrate competitive one-step sampling with improved quality-efficiency trade-offs and substantially reduced sampling cost.
arXiv Detail & Related papers (2026-03-11T12:41:46Z) - INC: An Indirect Neural Corrector for Auto-Regressive Hybrid PDE Solvers [61.84396402100827]
We propose the Indirect Neural Corrector ($mathrmINC$), which integrates learned corrections into the governing equations.<n>$mathrmINC$ reduces the error amplification on the order of $t-1 + L$, where $t$ is the timestep and $L$ the Lipschitz constant.<n>We test $mathrmINC$ in extensive benchmarks, covering numerous differentiable solvers, neural backbones, and test cases ranging from a 1D chaotic system to 3D turbulence.
arXiv Detail & Related papers (2025-11-16T20:14:28Z) - Flow Matching with Semidiscrete Couplings [29.980130720112726]
Flow models parameterized as time-dependent velocity fields can generate data from noise by integrating an ODE.<n>These models are often trained using flow matching, i.e. by sampling random pairs of noise and target points.<n>Although promising in theory, the OT flow matching (OT-FM) approach is not widely used in practice.
arXiv Detail & Related papers (2025-09-29T21:22:35Z) - Distilling Two-Timed Flow Models by Separately Matching Initial and Terminal Velocities [8.766883138603765]
We present a new loss function for TTFM distillation called the emphinitial/terminal velocity matching (ITVM) loss.<n>Preliminary experiments show that our loss leads to better few-step generation performance on multiple types of datasets.
arXiv Detail & Related papers (2025-05-02T10:17:49Z) - IT$^3$: Idempotent Test-Time Training [95.78053599609044]
Deep learning models often struggle when deployed in real-world settings due to distribution shifts between training and test data.<n>We present Idempotent Test-Time Training (IT$3$), a novel approach that enables on-the-fly adaptation to distribution shifts using only the current test instance.<n>Our results suggest that idempotence provides a universal principle for test-time adaptation that generalizes across domains and architectures.
arXiv Detail & Related papers (2024-10-05T15:39:51Z) - Simulation-free Schr\"odinger bridges via score and flow matching [89.4231207928885]
We present simulation-free score and flow matching ([SF]$2$M)
Our method generalizes both the score-matching loss used in the training of diffusion models and the recently proposed flow matching loss used in the training of continuous flows.
Notably, [SF]$2$M is the first method to accurately model cell dynamics in high dimensions and can recover known gene regulatory networks simulated data.
arXiv Detail & Related papers (2023-07-07T15:42:35Z) - Optimal Robust Linear Regression in Nearly Linear Time [97.11565882347772]
We study the problem of high-dimensional robust linear regression where a learner is given access to $n$ samples from the generative model $Y = langle X,w* rangle + epsilon$
We propose estimators for this problem under two settings: (i) $X$ is L4-L2 hypercontractive, $mathbbE [XXtop]$ has bounded condition number and $epsilon$ has bounded variance and (ii) $X$ is sub-Gaussian with identity second moment and $epsilon$ is
arXiv Detail & Related papers (2020-07-16T06:44:44Z) - Sample Complexity of Asynchronous Q-Learning: Sharper Analysis and
Variance Reduction [63.41789556777387]
Asynchronous Q-learning aims to learn the optimal action-value function (or Q-function) of a Markov decision process (MDP)
We show that the number of samples needed to yield an entrywise $varepsilon$-accurate estimate of the Q-function is at most on the order of $frac1mu_min (1-gamma)5varepsilon2+ fract_mixmu_min (1-gamma)$ up to some logarithmic factor.
arXiv Detail & Related papers (2020-06-04T17:51:00Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.