InjectFlow: Weak Guides Strong via Orthogonal Injection for Flow Matching

• URL: http://arxiv.org/abs/2603.20303v1
• Date: Thu, 19 Mar 2026 11:07:14 GMT
• Title: InjectFlow: Weak Guides Strong via Orthogonal Injection for Flow Matching
• Abstract summary: Flow Matching (FM) has emerged as a leading approach for high-fidelity visual generation.<n>FM models are sensitive to dataset biases, which cause severe semantic degradation when generating out-of-distribution or minority-class samples.<n>We introduce InjectFlow, a novel, training-free method by injecting semantics during the initial velocity field.
• Score: 1.974921946982281
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Flow Matching (FM) has recently emerged as a leading approach for high-fidelity visual generation, offering a robust continuous-time alternative to ordinary differential equation (ODE) based models. However, despite their success, FM models are highly sensitive to dataset biases, which cause severe semantic degradation when generating out-of-distribution or minority-class samples. In this paper, we provide a rigorous mathematical formalization of the ``Bias Manifold'' within the FM framework. We identify that this performance drop is driven by conditional expectation smoothing, a mechanism that inevitably leads to trajectory lock-in during inference. To resolve this, we introduce InjectFlow, a novel, training-free method by injecting orthogonal semantics during the initial velocity field computation, without requiring any changes to the random seeds. This design effectively prevents the latent drift toward majority modes while maintaining high generative quality. Extensive experiments demonstrate the effectiveness of our approach. Notably, on the GenEval dataset, InjectFlow successfully fixes 75% of the prompts that standard flow matching models fail to generate correctly. Ultimately, our theoretical analysis and algorithm provide a ready-to-use solution for building more fair and robust visual foundation models.

Related papers

• Perceptual Flow Matching for Few-Step Generative Modeling [64.26537634881244]
  Perceptual Flow Matching is a framework for few-step generation in flow-matching models.<n>We show that PFM produces high-quality few-step generators when supervised in an appropriate representation space.
  arXiv  Detail & Related papers  (2026-07-03T17:55:01Z)
• Curvature-Adaptive Consistency Flow Matching: Autonomous Trajectory Optimization via Reinforcement Learning [8.422673935994451]
  consistency distillation has significantly accelerated the inference of diffusion models.<n>We propose Curvature-Adaptive Consistency Flow Matching to address the limitations of static sampling.<n>Our approach achieves new state-of-the-art results on large-scale models such as FLUX and SDXL.
  arXiv  Detail & Related papers  (2026-06-21T08:49:50Z)
• Modular MeanFlow: Towards Stable and Scalable One-Step Generative Modeling [0.07646713951724012]
  One-step generative modeling seeks to generate high-quality data samples in a single function evaluation.<n>In this work, we introduce Modular MeanFlow, a flexible and theoretically grounded approach for learning time-averaged velocity fields.
  arXiv  Detail & Related papers  (2025-08-24T16:00:08Z)
• Solving Inverse Problems with FLAIR [68.87167940623318]
  We present FLAIR, a training-free variational framework that leverages flow-based generative models as prior for inverse problems.<n>Results on standard imaging benchmarks demonstrate that FLAIR consistently outperforms existing diffusion- and flow-based methods in terms of reconstruction quality and sample diversity.
  arXiv  Detail & Related papers  (2025-06-03T09:29:47Z)
• One-for-More: Continual Diffusion Model for Anomaly Detection [63.50488826645681]
  Anomaly detection methods utilize diffusion models to generate or reconstruct normal samples when given arbitrary anomaly images.<n>Our study found that the diffusion model suffers from severe faithfulness hallucination'' and catastrophic forgetting''<n>We propose a continual diffusion model that uses gradient projection to achieve stable continual learning.
  arXiv  Detail & Related papers  (2025-02-27T07:47:27Z)
• Heavy-Tailed Diffusion Models [38.713884992630675]
  We show that traditional diffusion and flow-matching models fail to capture heavy-tailed behavior. We address this by repurposing the diffusion framework for heavy-tail estimation. We introduce t-EDM and t-Flow, extensions of existing diffusion and flow models that employ a Student-t prior.
  arXiv  Detail & Related papers  (2024-10-18T04:29:46Z)
• Derivative-Free Guidance in Continuous and Discrete Diffusion Models with Soft Value-Based Decoding [84.3224556294803]
  Diffusion models excel at capturing the natural design spaces of images, molecules, DNA, RNA, and protein sequences. We aim to optimize downstream reward functions while preserving the naturalness of these design spaces. Our algorithm integrates soft value functions, which looks ahead to how intermediate noisy states lead to high rewards in the future.
  arXiv  Detail & Related papers  (2024-08-15T16:47:59Z)
• Learning Diffusion Priors from Observations by Expectation Maximization [10.704978219090039]
  We present DiEM, a novel method for training diffusion models from incomplete and noisy observations only.<n>Unlike previous works, DiEM leads to proper diffusion models, which is crucial for downstream tasks.
  arXiv  Detail & Related papers  (2024-05-22T15:04:06Z)
• Guided Flows for Generative Modeling and Decision Making [55.42634941614435]
  We show that Guided Flows significantly improves the sample quality in conditional image generation and zero-shot text synthesis-to-speech. Notably, we are first to apply flow models for plan generation in the offline reinforcement learning setting ax speedup in compared to diffusion models.
  arXiv  Detail & Related papers  (2023-11-22T15:07:59Z)
• Reflected Diffusion Models [93.26107023470979]
  We present Reflected Diffusion Models, which reverse a reflected differential equation evolving on the support of the data. Our approach learns the score function through a generalized score matching loss and extends key components of standard diffusion models.
  arXiv  Detail & Related papers  (2023-04-10T17:54:38Z)
• Improving and generalizing flow-based generative models with minibatch optimal transport [90.01613198337833]
  We introduce the generalized conditional flow matching (CFM) technique for continuous normalizing flows (CNFs) CFM features a stable regression objective like that used to train the flow in diffusion models but enjoys the efficient inference of deterministic flow models. A variant of our objective is optimal transport CFM (OT-CFM), which creates simpler flows that are more stable to train and lead to faster inference.
  arXiv  Detail & Related papers  (2023-02-01T14:47:17Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.