Frequency-Conditioned Flow Matching for Vision-Language-Action Models

• URL: http://arxiv.org/abs/2609.10405v1
• Date: Wed, 09 Sep 2026 16:24:40 GMT
• Title: Frequency-Conditioned Flow Matching for Vision-Language-Action Models
• Abstract summary: We introduce emphFreqFM, a frequency-conditioned Flow Matching framework for VLA models.<n>It raises action frequency from an implicit trajectory property to an explicit conditioning dimension that spans the entire generation pipeline.<n>Across LIBERO, LIBERO-Plus, and VLA-Arena, FreqFM consistently improves performance, including a 9.3-point gain on LIBERO-Plus.
• Score: 4.8301678754431325
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Robot actions are temporally correlated trajectories whose frequency components encode motion at different scales with highly non-uniform energy distributions. Yet Flow Matching--based vision-language-action (VLA) models typically generate actions in temporal coordinates, without explicitly modeling or systematically leveraging this frequency heterogeneity. We introduce \emph{FreqFM}, a frequency-conditioned Flow Matching framework for VLA models. It raises action frequency from an implicit trajectory property to an explicit conditioning dimension that spans the entire generation pipeline. Concretely, in DCT frequency coordinates, FreqFM constructs a spectrum-matched source distribution, adaptively balances the objective across frequencies, and constrains per-frequency guidance residuals using the corresponding reference transport scales. FreqFM integrates into existing Flow Matching action experts without changing the VLA backbone. Across LIBERO, LIBERO-Plus, and VLA-Arena, FreqFM consistently improves performance, including a 9.3-point gain on LIBERO-Plus, and further demonstrates its effectiveness on six real-robot tasks.

Related papers

• Frequency-Domain Multi-Modality Transportation Modeling [14.714894831849934]
  We propose a lightweight yet effective Frequency-Domain Multi-Modality modeling (FreMo) that exploits the frequency domain.<n>FreMo disentangles modality-wise spectral refinement from cross-modality synergy and supports plug-and-play integration with general time series backbones.<n>Experiments on real-world datasets show that FreMo consistently outperforms state-of-the-art baselines.
  arXiv  Detail & Related papers  (2026-07-09T13:30:42Z)
• Frequency-Aware Flow Matching for Continuous and Consistent Robotic Action Generation [46.998628831231194]
  Existing methods rely on discretized action chunks, making them brittle to demonstrations collected at heterogeneous control.<n>We propose Frequency-Aware Flow Matching (FAFM), which outputs continuous, temporally consistent actions.<n>FAFM improves success rates, multimodal expressivity, motion smoothness, convergence speed, robustness to mechanical bias and mixed-frequency input.
  arXiv  Detail & Related papers  (2026-06-18T11:58:30Z)
• Frequency-Domain Regularized Adversarial Alignment for Transferable Attacks against Closed-Source MLLMs [59.973833105841685]
  A key challenge for improving adversarial transferability is to effectively capture the intrinsic visual focus shared across different models.<n>We propose FRA-Attack, which addresses both challenges from a unified frequency-domain regularization perspective.<n>For feature alignment, a high-pass DCT objective on patch features suppresses redundant global structures and concentrates the loss on the high-frequency band that carries the MLLMs' intrinsic visual focus.<n>For gradient optimization, we introduce Frequency-domain Gradient Regularization (FGR), a textitmodel-agnostic low-pass regularizer that modulates the surrogate gradient using
  arXiv  Detail & Related papers  (2026-05-20T08:15:56Z)
• FeRA: Frequency-Energy Constrained Routing for Effective Diffusion Adaptation Fine-Tuning [124.5975705334805]
  FeRA establishes a comprehensive frequency energy framework for effective diffusion adaptation fine tuning.<n>It integrates seamlessly with adapter based tuning schemes and generalizes well across diffusion backbones and resolutions.
  arXiv  Detail & Related papers  (2025-11-22T08:46:18Z)
• FreqFlow: Long-term forecasting using lightweight flow matching [3.5235875824926346]
  We introduce FreqFlow, a novel framework that leverages conditional flow matching in the frequency domain for deterministic MTS forecasting.<n>FreqFlow transforms the forecasting problem into the spectral domain, where it learns to model amplitude and phase shifts.<n>Experiments on real-world traffic speed, volume, and flow datasets demonstrate that FreqFlow achieves state-of-the-art forecasting performance.
  arXiv  Detail & Related papers  (2025-11-20T14:50:13Z)
• Freqformer: Image-Demoiréing Transformer via Efficient Frequency Decomposition [83.40450475728792]
  We present Freqformer, a Transformer-based framework specifically designed for image demoir'eing through targeted frequency separation.<n>Our method performs an effective frequency decomposition that explicitly splits moir'e patterns into high-frequency spatially-localized textures and low-frequency scale-robust color distortions.<n>Experiments on various demoir'eing benchmarks demonstrate that Freqformer achieves state-of-the-art performance with a compact model size.
  arXiv  Detail & Related papers  (2025-05-25T12:23:10Z)
• FLEX: A Backbone for Diffusion-Based Modeling of Spatio-temporal Physical Systems [51.15230303652732]
  FLEX (F Low EXpert) is a backbone architecture for generative modeling of-temporal physical systems.<n>It reduces the variance of the velocity field in the diffusion model, which helps stabilize training.<n>It achieves accurate predictions for super-resolution and forecasting tasks using as few features as two reverse diffusion steps.
  arXiv  Detail & Related papers  (2025-05-23T00:07:59Z)
• Frequency-Integrated Transformer for Arbitrary-Scale Super-Resolution [8.303267303436613]
  Methods based on implicit neural representation have demonstrated remarkable capabilities in arbitrary-scale super-resolution (ASSR) tasks.<n>We propose a novel network called Frequency-Integrated Transformer (FIT) to incorporate frequency information to enhance ASSR performance.
  arXiv  Detail & Related papers  (2025-04-26T06:12:49Z)
• Frequency Guidance Matters: Skeletal Action Recognition by Frequency-Aware Mixed Transformer [18.459822172890473]
  We introduce a frequency-aware attention module to unweave skeleton frequency representations. We also develop a mixed transformer architecture to incorporate spatial features with frequency features. Experiments show that FreqMiXFormer outperforms SOTA on 3 popular skeleton recognition datasets.
  arXiv  Detail & Related papers  (2024-07-17T05:47:27Z)
• FreDF: Learning to Forecast in the Frequency Domain [54.2091536822376]
  Time series modeling presents unique challenges due to autocorrelation in both historical data and future sequences.<n>We propose the Frequency-enhanced Direct Forecast (FreDF) which mitigates label autocorrelation by learning to forecast in the frequency domain.
  arXiv  Detail & Related papers  (2024-02-04T08:23:41Z)
• Federated Learning in the Sky: Joint Power Allocation and Scheduling with UAV Swarms [98.78553146823829]
  Unmanned aerial vehicle (UAV) swarms must exploit machine learning (ML) in order to execute various tasks. In this paper, a novel framework is proposed to implement distributed learning (FL) algorithms within a UAV swarm.
  arXiv  Detail & Related papers  (2020-02-19T14:04:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.