SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing
- URL: http://arxiv.org/abs/2604.01715v1
- Date: Thu, 02 Apr 2026 07:26:13 GMT
- Title: SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing
- Abstract summary: SteerFlow is a model-agnostic editing framework with strong theoretical guarantees on source fidelity.<n>We introduce Trajectory Interpolation, which adaptively blends target-editing and source-reconstruction velocities to keep the editing trajectory anchored to the source.<n>Experiments on FLUX.1-dev and Stable Diffusion 3.5 Medium demonstrate that SteerFlow consistently achieves better editing quality than existing methods.
- Score: 9.343095346668665
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Recent advances in flow-based generative models have enabled training-free, text-guided image editing by inverting an image into its latent noise and regenerating it under a new target conditional guidance. However, existing methods struggle to preserve source fidelity: higher-order solvers incur additional model inferences, truncated inversion constrains editability, and feature injection methods lack architectural transferability. To address these limitations, we propose SteerFlow, a model-agnostic editing framework with strong theoretical guarantees on source fidelity. In the forward process, we introduce an Amortized Fixed-Point Solver that implicitly straightens the forward trajectory by enforcing velocity consistency across consecutive timesteps, yielding a high-fidelity inverted latent. In the backward process, we introduce Trajectory Interpolation, which adaptively blends target-editing and source-reconstruction velocities to keep the editing trajectory anchored to the source. To further improve background preservation, we introduce an Adaptive Masking mechanism that spatially constrains the editing signal with concept-guided segmentation and source-target velocity differences. Extensive experiments on FLUX.1-dev and Stable Diffusion 3.5 Medium demonstrate that SteerFlow consistently achieves better editing quality than existing methods. Finally, we show that SteerFlow extends naturally to a complex multi-turn editing paradigm without accumulating drift.
Related papers
- FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion [52.3830227666301]
FlowPainter is a diffusion-based optical flow framework that reformulates dense-flow generation as confidence-guided soft inpainting.<n>Our approach offers a practical way to integrate reliable discriminative priors with diffusion-based refinement for optical flow estimation.
arXiv Detail & Related papers (2026-07-11T05:59:22Z) - DirectEdit: Step-Level Accurate Inversion for Flow-Based Image Editing [51.56484100374058]
We propose DirectEdit, a training-free editing method for pre-trained text-to-image (T2I) models.<n>DirectEdit eliminates the inherent reconstruction error without introducing additional neural function evaluations (NFEs)<n>Experiments demonstrate that DirectEdit achieves efficient and accurate image editing, delivering superior performance that outperforms state-of-the-art methods.
arXiv Detail & Related papers (2026-05-04T10:09:18Z) - FlowBypass: Rectified Flow Trajectory Bypass for Training-Free Image Editing [10.304374060580828]
Training-free image editing has attracted increasing attention for its efficiency and independence from training data.<n>Previous attempts to address this issue typically employ backbone-specific feature manipulations, limiting general applicability.<n>We propose FlowBypass, a novel and analytical framework grounded in Rectified Flow that constructs a bypass directly connecting inversion and reconstruction trajectories.
arXiv Detail & Related papers (2026-02-02T08:37:00Z) - On Exact Editing of Flow-Based Diffusion Models [97.0633397035926]
We propose Conditioned Velocity Correction (CVC) to reformulate flow-based editing as a distribution transformation problem driven by a known source prior.<n>CVC rethinks the role of velocity in inter-distribution transformation by introducing a dual-perspective velocity conversion mechanism.<n>We show that CVC consistently achieves superior fidelity, better semantic alignment, and more reliable editing behavior across diverse tasks.
arXiv Detail & Related papers (2025-12-30T06:29:20Z) - SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing [15.234877788378563]
Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs.<n>Despite their strong generative capabilities, they face critical limitations in image editing tasks.<n>Recent efforts have attempted to directly map source and target distributions via ODE-based approaches without inversion.<n>We propose a flow decomposition-and-aggregation framework built upon an inversion-free formulation to address these limitations.
arXiv Detail & Related papers (2025-10-29T21:12:58Z) - EditInfinity: Image Editing with Binary-Quantized Generative Models [64.05135380710749]
We investigate the parameter-efficient adaptation of binary-quantized generative models for image editing.<n>Specifically, we propose EditInfinity, which adapts emphInfinity, a binary-quantized generative model, for image editing.<n>We propose an efficient yet effective image inversion mechanism that integrates text prompting rectification and image style preservation.
arXiv Detail & Related papers (2025-10-23T05:06:24Z) - FlowCycle: Pursuing Cycle-Consistent Flows for Text-based Editing [12.424207508842192]
We propose FlowCycle, a novel inversion-free and flow-based editing framework.<n>We show that FlowCycle achieves superior editing quality and consistency over state-of-the-art methods.
arXiv Detail & Related papers (2025-10-23T04:58:29Z) - Delta Velocity Rectified Flow for Text-to-Image Editing [15.665085495430313]
We propose Delta Velocity Rectified Flow (DVRF), a novel inversion-free, path-aware editing framework for text-to-image editing.<n> Experimental results indicate that DVRF achieves superior editing quality, fidelity, and controllability while requiring no architectural modifications.
arXiv Detail & Related papers (2025-09-01T21:51:24Z) - FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing [47.908940130654535]
FlowAlign is an inversion-free flow-based framework for consistent image editing with optimal control-based trajectory control.<n>Our terminal point regularization is shown to balance semantic alignment with the edit prompt and structural consistency with the source image along the trajectory.<n>FlowAlign outperforms existing methods in both source preservation and editing controllability.
arXiv Detail & Related papers (2025-05-29T06:33:16Z) - Stable Flow: Vital Layers for Training-Free Image Editing [74.52248787189302]
Diffusion models have revolutionized the field of content synthesis and editing.<n>Recent models have replaced the traditional UNet architecture with the Diffusion Transformer (DiT)<n>We propose an automatic method to identify "vital layers" within DiT, crucial for image formation.<n>Next, to enable real-image editing, we introduce an improved image inversion method for flow models.
arXiv Detail & Related papers (2024-11-21T18:59:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.