Continuous Control of Editing Models via Adaptive-Origin Guidance

• URL: http://arxiv.org/abs/2602.03826v1
• Date: Tue, 03 Feb 2026 18:33:39 GMT
• Title: Continuous Control of Editing Models via Adaptive-Origin Guidance
• Abstract summary: Diffusion-based editing models have emerged as a powerful tool for semantic and image editing.<n>We introduce Adaptive-Origin Guidance (AdaOr), a method that adjusts the standard guidance origin with an identity-conditioned adaptive origin.<n>We evaluate our method on image and video editing tasks, demonstrating that it provides smoother and more consistent control compared to current slider-based editing approaches.
• Score: 27.623081798640907
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned generation, Classifier-Free Guidance (CFG) impacts prompt adherence, suggesting it as a potential control for edit intensity in editing models. However, we show that scaling CFG in these models does not produce a smooth transition between the input and the edited result. We attribute this behavior to the unconditional prediction, which serves as the guidance origin and dominates the generation at low guidance scales, while representing an arbitrary manipulation of the input content. To enable continuous control, we introduce Adaptive-Origin Guidance (AdaOr), a method that adjusts this standard guidance origin with an identity-conditioned adaptive origin, using an identity instruction corresponding to the identity manipulation. By interpolating this identity prediction with the standard unconditional prediction according to the edit strength, we ensure a continuous transition from the input to the edited result. We evaluate our method on image and video editing tasks, demonstrating that it provides smoother and more consistent control compared to current slider-based editing approaches. Our method incorporates an identity instruction into the standard training framework, enabling fine-grained control at inference time without per-edit procedure or reliance on specialized datasets.

Related papers

• KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing [24.315720861063397]
  KGEdit is a structured semantic control framework for text-to-video (T2V) diffusion models.<n>We first construct an ambiguity-aware knowledge graph (AAKG) to disentangle and disambiguate the input prompt.<n>We then design a structured semantic injection module (SSIM) to inject semantic signals into key layers of the diffusion Transformer.
  arXiv  Detail & Related papers  (2026-05-28T07:31:22Z)
• Semantic Granularity Navigation in Image Editing [4.8073791571301125]
  NaviEdit is a training-free inference-time controller for real-image editing.<n>It decouples edit progress from model scale through a strict self-consistency contract.<n>It treats scale as a control input and reallocates a fixed step budget toward semantically responsive intermediate scales.
  arXiv  Detail & Related papers  (2026-05-20T13:53:13Z)
• The Unreasonable Effectiveness of Text Embedding Interpolation for Continuous Image Steering [18.29130390175963]
  We present a training-free framework for continuous and controllable image editing at test time for text-conditioned generative models.<n>We find that a simple steering in the text-embedding space is sufficient to produce smooth edit control.<n>Our approach is comparable to training-based alternatives, outperforming other training-free methods.
  arXiv  Detail & Related papers  (2026-03-18T17:57:53Z)
• SliderEdit: Continuous Image Editing with Fine-Grained Instruction Control [50.76070785417023]
  We introduce SliderEdit, a framework for continuous image editing with fine-grained, interpretable instruction control.<n>Given a multi-part edit instruction, SliderEdit disentangles the individual instructions and exposes each as a globally trained slider.<n>Our results pave the way for interactive, instruction-driven image manipulation with continuous and compositional control.
  arXiv  Detail & Related papers  (2025-11-12T20:21:37Z)
• Group Relative Attention Guidance for Image Editing [38.299491082179905]
  Group Relative Attention Guidance (GRAG) is a simple yet effective method that modulates the focus of the model on the input image relative to the editing instruction.<n>Our code will be released at https://www.littlemisfit.com/little-misfit/GRAG-Image-Editing.
  arXiv  Detail & Related papers  (2025-10-28T17:22:44Z)
• EditInfinity: Image Editing with Binary-Quantized Generative Models [64.05135380710749]
  We investigate the parameter-efficient adaptation of binary-quantized generative models for image editing.<n>Specifically, we propose EditInfinity, which adapts emphInfinity, a binary-quantized generative model, for image editing.<n>We propose an efficient yet effective image inversion mechanism that integrates text prompting rectification and image style preservation.
  arXiv  Detail & Related papers  (2025-10-23T05:06:24Z)
• Kontinuous Kontext: Continuous Strength Control for Instruction-based Image Editing [76.44219733285898]
  Kontinuous Kontext is an instruction-driven editing model that provides a new dimension of control over edit strength.<n>A lightweight projector network maps the input scalar and the edit instruction to coefficients in the model's modulation space.<n>For training our model, we synthesize a diverse dataset of image-edit-instruction-strength quadruplets using existing generative models.
  arXiv  Detail & Related papers  (2025-10-09T17:51:03Z)
• SAEdit: Token-level control for continuous image editing via Sparse AutoEncoder [52.754326452329956]
  We introduce a method for disentangled and continuous editing through token-level manipulation of text embeddings.<n>The edits are applied by manipulating the embeddings along carefully chosen directions, which control the strength of the target attribute.<n>Our method operates directly on text embeddings without modifying the diffusion process, making it model agnostic and broadly applicable to various image backbones.
  arXiv  Detail & Related papers  (2025-10-06T17:51:04Z)
• Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model [60.82962950960996]
  We introduce UnifyEdit, a tuning-free method that performs diffusion latent optimization.<n>We develop two attention-based constraints: a self-attention (SA) preservation constraint for structural fidelity, and a cross-attention (CA) alignment constraint to enhance text alignment.<n>Our approach achieves a robust balance between structure preservation and text alignment across various editing tasks, outperforming other state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-04-08T01:02:50Z)
• Unveil Inversion and Invariance in Flow Transformer for Versatile Image Editing [43.97960454977206]
  In this paper, we analyze the diffusion inversion and invariance control based on the flow transformer.<n>We propose a two-stage inversion to first refine the velocity estimation and then compensate for the leftover error.<n>This mechanism can simultaneously preserve the non-target contents while allowing rigid and non-rigid manipulation.
  arXiv  Detail & Related papers  (2024-11-24T13:48:16Z)
• Tuning-Free Inversion-Enhanced Control for Consistent Image Editing [44.311286151669464]
  We present a novel approach called Tuning-free Inversion-enhanced Control (TIC) TIC correlates features from the inversion process with those from the sampling process to mitigate the inconsistency in DDIM reconstruction. We also propose a mask-guided attention concatenation strategy that combines contents from both the inversion and the naive DDIM editing processes.
  arXiv  Detail & Related papers  (2023-12-22T11:13:22Z)
• Fine-grained Controllable Video Generation via Object Appearance and Context [74.23066823064575]
  We propose fine-grained controllable video generation (FACTOR) to achieve detailed control. FACTOR aims to control objects' appearances and context, including their location and category. Our method achieves controllability of object appearances without finetuning, which reduces the per-subject optimization efforts for the users.
  arXiv  Detail & Related papers  (2023-12-05T17:47:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.