FlowOpt: Fast Optimization Through Whole Flow Processes for Training-Free Editing

• URL: http://arxiv.org/abs/2510.22010v1
• Date: Fri, 24 Oct 2025 20:24:26 GMT
• Title: FlowOpt: Fast Optimization Through Whole Flow Processes for Training-Free Editing
• Authors: Or Ronai, Vladimir Kulikov, Tomer Michaeli,
• Abstract summary: FlowOpt is a zero-order (gradient-free) optimization framework that treats the entire flow process as a black box.<n>We show how FlowOpt can be used for image editing, showcasing two options: (i) inversion (determining the initial noise that generates a given image), and (ii) directly steering the edited image to be similar to the source image.
• Score: 37.12178941086993
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The remarkable success of diffusion and flow-matching models has ignited a surge of works on adapting them at test time for controlled generation tasks. Examples range from image editing to restoration, compression and personalization. However, due to the iterative nature of the sampling process in those models, it is computationally impractical to use gradient-based optimization to directly control the image generated at the end of the process. As a result, existing methods typically resort to manipulating each timestep separately. Here we introduce FlowOpt - a zero-order (gradient-free) optimization framework that treats the entire flow process as a black box, enabling optimization through the whole sampling path without backpropagation through the model. Our method is both highly efficient and allows users to monitor the intermediate optimization results and perform early stopping if desired. We prove a sufficient condition on FlowOpt's step-size, under which convergence to the global optimum is guaranteed. We further show how to empirically estimate this upper bound so as to choose an appropriate step-size. We demonstrate how FlowOpt can be used for image editing, showcasing two options: (i) inversion (determining the initial noise that generates a given image), and (ii) directly steering the edited image to be similar to the source image while conforming to a target text prompt. In both cases, FlowOpt achieves state-of-the-art results while using roughly the same number of neural function evaluations (NFEs) as existing methods. Code and examples are available on the project's webpage.

Related papers

• Balanced conic rectified flow [19.226787997122987]
  Rectified flow is a generative model that learns smooth transport mappings between two distributions through an ordinary differential equation (ODE)<n>In this work, we experimentally expose the limitations of the original rectified flow and propose a novel approach that incorporates real images into the training process.
  arXiv  Detail & Related papers  (2025-10-29T07:06:01Z)
• FlowEdit: Inversion-Free Text-Based Editing Using Pre-Trained Flow Models [20.46531356084352]
  editing real images using a pre-trained text-to-image (T2I) diffusion/flow model often involves inverting the image into its corresponding noise map.<n>Here, we introduce FlowEdit, a text-based editing method for pre-trained T2I flow models, which is inversion-free, optimization-free and model agnostic.
  arXiv  Detail & Related papers  (2024-12-11T18:50:29Z)
• Fast constrained sampling in pre-trained diffusion models [80.99262780028015]
  We propose an algorithm that enables fast, high-quality generation under arbitrary constraints.<n>Our approach produces results that rival or surpass the state-of-the-art training-free inference methods.
  arXiv  Detail & Related papers  (2024-10-24T14:52:38Z)
• COT Flow: Learning Optimal-Transport Image Sampling and Editing by Contrastive Pairs [7.542892664684078]
  Contrastive Optimal Transport Flow (COT Flow) is a new method that achieves fast and high-quality generation with improved zero-shot editing flexibility. In terms of quality, COT Flow can generate competitive results in merely one step compared to previous state-of-the-art unpaired image-to-image (I2I) translation methods. COT Flow can generate competitive results in merely one step compared to previous state-of-the-art unpaired image-to-image (I2I) translation methods.
  arXiv  Detail & Related papers  (2024-06-17T23:02:20Z)
• OrientDream: Streamlining Text-to-3D Generation with Explicit Orientation Control [66.03885917320189]
  OrientDream is a camera orientation conditioned framework for efficient and multi-view consistent 3D generation from textual prompts. Our strategy emphasizes the implementation of an explicit camera orientation conditioned feature in the pre-training of a 2D text-to-image diffusion module. Our experiments reveal that our method not only produces high-quality NeRF models with consistent multi-view properties but also achieves an optimization speed significantly greater than existing methods.
  arXiv  Detail & Related papers  (2024-06-14T13:16:18Z)
• Wavelet-Guided Acceleration of Text Inversion in Diffusion-Based Image Editing [24.338298020188155]
  We introduce an innovative method that maintains the principles of the Null-text Inversion (NTI) while accelerating the image editing process. We propose the Wave-Estimator, which determines the text optimization endpoint based on frequency characteristics. This approach maintains performance comparable to NTI while reducing the average editing time by over 80% compared to the NTI method.
  arXiv  Detail & Related papers  (2024-01-18T08:26:37Z)
• Guided Flows for Generative Modeling and Decision Making [55.42634941614435]
  We show that Guided Flows significantly improves the sample quality in conditional image generation and zero-shot text synthesis-to-speech. Notably, we are first to apply flow models for plan generation in the offline reinforcement learning setting ax speedup in compared to diffusion models.
  arXiv  Detail & Related papers  (2023-11-22T15:07:59Z)
• High-Fidelity Guided Image Synthesis with Latent Diffusion Models [50.39294302741698]
  The proposed approach outperforms the previous state-of-the-art by over 85.32% on the overall user satisfaction scores. Human user study results show that the proposed approach outperforms the previous state-of-the-art by over 85.32% on the overall user satisfaction scores.
  arXiv  Detail & Related papers  (2022-11-30T15:43:20Z)
• Towards An End-to-End Framework for Flow-Guided Video Inpainting [68.71844500391023]
  We propose an End-to-End framework for Flow-Guided Video Inpainting (E$2$FGVI) The proposed method outperforms state-of-the-art methods both qualitatively and quantitatively.
  arXiv  Detail & Related papers  (2022-04-06T08:24:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.