VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation

• URL: http://arxiv.org/abs/2605.23381v1
• Date: Fri, 22 May 2026 08:50:10 GMT
• Title: VDE: Training-Free Accelerating Rectified Flow Model via Velocity Decomposition and Estimation
• Abstract summary: Velocity Decomposition and Estimation (VDE) is a training-free acceleration method that shifts the paradigm from caching-and-reusing to decomposing-and-estimating.<n>VDE decomposes the model's velocity into components parallel and to the input, exploiting their temporal predictability and directional stability for precise, input-adaptive estimation.<n>Experiments on image and video generation tasks demonstrate that VDE achieves substantial acceleration with minimal loss in visual quality.
• Score: 8.316969785282303
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Though rectified flow models have achieved remarkable performance in image, video, and 3D generation, their practical deployments are challenged by slow inference speeds. Prior acceleration methods reuse cached features from previous steps, which neglects the growing mismatch between static caches and the evolving input, leading to reduced output fidelity. This work proposes Velocity Decomposition and Estimation (VDE), a training-free acceleration method that shifts the paradigm from caching-and-reusing to decomposing-and-estimating. Specifically, VDE decomposes the model's velocity into components parallel and orthogonal to the input, exploiting their temporal predictability and directional stability for precise, input-adaptive estimation. To prevent error accumulation, it periodically anchors the model's state via full forward passes. Extensive experiments on image and video generation tasks demonstrate that VDE achieves substantial acceleration with minimal loss in visual quality. Notably, VDE accelerates Flux by 3.22 times and achieves an LPIPS of 0.069 on Qwen-Image, outperforming the best baseline with a 52.2% reduction.

Related papers

• Rethinking Pixel Mean Flows via Interval Denoiser [95.11499828543344]
  We propose the Interval Denoiser, a framework for latent-free generation.<n>Our model achieves an FID of 4.55 in one step (1-NFE) and 3.98 in two steps (2-NFE) without perceptual losses.
  arXiv  Detail & Related papers  (2026-08-05T13:22:43Z)
• Parallel Decoding Distillation for Fast Image and Video Generation [35.18845060233149]
  We introduce Parallel Decoding Distillation (PDD) for fast inference of diffusion and flow matching models.<n>PDD accelerates generation by predicting multiple denoising steps per network evaluation.<n>Our method achieves SOTA performance with 4-8 NFE on LTX-2.3 Text-to-Video/Audio, Wan 14B Text-to-Video, and Qwen-Image Text-to-Image.
  arXiv  Detail & Related papers  (2026-07-28T17:20:00Z)
• Accelerating Rectified Flow Models via Trajectory-Aware Caching [35.13071059415995]
  We propose TACache, a training-free acceleration framework following a skip-then-compensate paradigm.<n>Trajectory-Aware Cache achieves up to 4.14 speedup on text-to-image generation and 2.11 speedup on text-to-video generation.
  arXiv  Detail & Related papers  (2026-05-16T03:44:58Z)
• Differentiable Vector Quantization for Rate-Distortion Optimization of Generative Image Compression [53.041405703471895]
  We propose RDVQ, a unified framework that enables end-to-end RD optimization for low-bitrate image compression.<n>We develop an autoregressive entropy model that supports accurate entropy modeling and test-time rate control.<n>Compared with RD2K-val, RDVQ reduces by up to 75.71% on DISTS and 37.63% on LPIPS on DIV2K-val.
  arXiv  Detail & Related papers  (2026-04-12T09:25:24Z)
• $D^3$-RSMDE: 40$\times$ Faster and High-Fidelity Remote Sensing Monocular Depth Estimation [72.9912717963138]
  Real-time, high-fidelity monocular depth estimation from remote sensing imagery is crucial for numerous applications.<n>Although using Vision Transformer (ViT) backbones for dense prediction is fast, they often exhibit poor perceptual quality.<n>We propose Depth Detail Diffusion for Remote Sensing Monocular Depth Estimation ($D3$-RSMDE) to overcome these limitations.<n>$D3$-RSMDE achieves a notable 11.85% reduction in the Learned Perceptual Image Patch Similarity (LPIPS) perceptual metric.
  arXiv  Detail & Related papers  (2026-03-17T10:50:36Z)
• Adaptive Visual Autoregressive Acceleration via Dual-Linkage Entropy Analysis [50.48301331112126]
  We propose NOVA, a training-free token reduction acceleration framework for Visual AutoRegressive modeling.<n>NOVA adaptively determines the acceleration activation scale during inference by online identifying the inflection point of scale entropy growth.<n>Experiments and analyses validate NOVA as a simple yet effective training-free acceleration framework.
  arXiv  Detail & Related papers  (2026-02-01T17:29:42Z)
• Fast3Dcache: Training-free 3D Geometry Synthesis Acceleration [16.87269278147738]
  We propose Fast3Dcache, a training-free geometry-aware caching framework for 3D diffusion inference.<n>Our method achieves up to a 27.12% speed-up and a 54.8% reduction in FLOPs, with minimal degradation in geometric quality as measured by Chamfer Distance (2.48%) and F-Score (1.95%)
  arXiv  Detail & Related papers  (2025-11-27T15:13:32Z)
• Few-step Flow for 3D Generation via Marginal-Data Transport Distillation [104.76254102015794]
  We propose a novel framework, MDT-dist, for few-step 3D flow distillation.<n>Our approach is built upon a primary objective: distilling the pretrained model to learn the Marginal-Data Transport.<n>Our method reduces sampling steps of each flow transformer from 25 to 1 or 2, achieving 0.68s (1 step x 2) and 0.94s (2 steps x 2) latency with 9.0x and 6.5x speedup on A800.
  arXiv  Detail & Related papers  (2025-09-04T17:24:31Z)
• A-FloPS: Accelerating Diffusion Sampling with Adaptive Flow Path Sampler [21.134678093577193]
  A-FloPS is a principled, training-free framework for flow-based generative models.<n>We show that A-FloPS consistently outperforms state-of-the-art training-free samplers in both sample quality and efficiency.<n>With as few as $5$ function evaluations, A-FloPS achieves substantially lower FID and generates sharper, more coherent images.
  arXiv  Detail & Related papers  (2025-08-22T13:28:16Z)
• Forecast then Calibrate: Feature Caching as ODE for Efficient Diffusion Transformers [19.107716099809707]
  Diffusion Transformers (DiTs) have demonstrated exceptional performance in high-fidelity image and video generation.<n>Current methods often struggle to maintain generation quality at high acceleration ratios.<n>We propose FoCa, which treats feature caching as a feature-ODE solving problem.
  arXiv  Detail & Related papers  (2025-08-22T08:34:03Z)
• Machine Learning Accelerated PDE Backstepping Observers [56.65019598237507]
  We propose a framework for accelerating PDE observer computations using learning-based approaches. We employ the recently-developed Fourier Neural Operator (FNO) to learn the functional mapping from the initial observer state to the state estimate. We consider the state estimation for three benchmark PDE examples motivated by applications.
  arXiv  Detail & Related papers  (2022-11-28T04:06:43Z)
• StreamYOLO: Real-time Object Detection for Streaming Perception [84.2559631820007]
  We endow the models with the capacity of predicting the future, significantly improving the results for streaming perception. We consider multiple velocities driving scene and propose Velocity-awared streaming AP (VsAP) to jointly evaluate the accuracy. Our simple method achieves the state-of-the-art performance on Argoverse-HD dataset and improves the sAP and VsAP by 4.7% and 8.2% respectively.
  arXiv  Detail & Related papers  (2022-07-21T12:03:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.