Semantic Granularity Navigation in Image Editing

• URL: http://arxiv.org/abs/2605.21190v2
• Date: Sat, 23 May 2026 12:57:01 GMT
• Title: Semantic Granularity Navigation in Image Editing
• Abstract summary: NaviEdit is a training-free inference-time controller for real-image editing.<n>It decouples edit progress from model scale through a strict self-consistency contract.<n>It treats scale as a control input and reallocates a fixed step budget toward semantically responsive intermediate scales.
• Score: 4.8073791571301125
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Despite the generative capabilities of diffusion and flow models, real-image editing remains constrained by a persistent trade-off between semantic editability and structural fidelity. We trace a primary cause of this limitation to the implicit coupling of edit progress with model scale in existing paradigms. Under this coupling, stronger edits typically require visiting noisier states, which spends computation on destabilizing layout before the semantic change is well localized. We introduce NaviEdit, a training-free inference-time controller that decouples edit progress from model scale traversal through a strict self-consistency contract. NaviEdit operates at the rollout level and leaves the underlying pretrained model unchanged. It treats scale as a control input and reallocates a fixed step budget toward semantically responsive intermediate scales instead of destructive high-noise regimes. Experiments show positive average gains across compatible editors and flow backbones, supporting decoupling as a portable inference-time control principle.

Related papers

• Consistent-Inversion: Reverse Consistency Guidance for Structure-Preserving Visual Editing [41.38183848746174]
  Consistent-Inversion is a training-free reverse consistency guidance framework for structure-preserving visual editing.<n>It improves background and structural fidelity under a unified SD3.5 protocol while maintaining target-prompt alignment.
  arXiv  Detail & Related papers  (2026-06-05T11:00:12Z)
• DirectEdit: Step-Level Accurate Inversion for Flow-Based Image Editing [51.56484100374058]
  We propose DirectEdit, a training-free editing method for pre-trained text-to-image (T2I) models.<n>DirectEdit eliminates the inherent reconstruction error without introducing additional neural function evaluations (NFEs)<n>Experiments demonstrate that DirectEdit achieves efficient and accurate image editing, delivering superior performance that outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-05-04T10:09:18Z)
• GeoEdit: Local Frames for Fast, Training-Free On-Manifold Editing in Diffusion Models [9.1810262671279]
  Training-free editing typically re-runs the full denoising trajectory for every edit strength, making iterative refinement expensive.<n>We instead edit near the data manifold, where small local updates can replace repeated re-synthesis.<n>Our algorithm constructs a tangent frame via small perturbations to the initial noise and alternates small tangent moves with diffusion-based projections.
  arXiv  Detail & Related papers  (2026-04-27T09:47:02Z)
• FlowSlider: Training-Free Continuous Image Editing via Fidelity-Steering Decomposition [0.07646713951724009]
  Continuous image editing aims to provide slider-style control of edit strength while preserving source-image fidelity and maintaining a consistent edit direction.<n>We propose textitFlowSlider, a training-free method for continuous editing in Rectified Flow that requires no post-training.
  arXiv  Detail & Related papers  (2026-04-02T14:16:06Z)
• SteerFlow: Steering Rectified Flows for Faithful Inversion-Based Image Editing [9.343095346668665]
  SteerFlow is a model-agnostic editing framework with strong theoretical guarantees on source fidelity.<n>We introduce Trajectory Interpolation, which adaptively blends target-editing and source-reconstruction velocities to keep the editing trajectory anchored to the source.<n>Experiments on FLUX.1-dev and Stable Diffusion 3.5 Medium demonstrate that SteerFlow consistently achieves better editing quality than existing methods.
  arXiv  Detail & Related papers  (2026-04-02T07:26:13Z)
• SAMA: Factorized Semantic Anchoring and Motion Alignment for Instruction-Guided Video Editing [76.349958946335]
  We present SAMA (factorized Semantic Anchoring and Motion Alignment), a framework that factorizes video editing into semantic anchoring and motion modeling.<n>First, we introduce Semantic Anchoring, which establishes a reliable visual anchor by jointly predicting semantic tokens and video latents at sparse anchor frames.<n>Second, Motion Alignment pre-trains the same backbone on motion-centric video restoration pretext tasks.
  arXiv  Detail & Related papers  (2026-03-19T17:59:51Z)
• Continuous Control of Editing Models via Adaptive-Origin Guidance [27.623081798640907]
  Diffusion-based editing models have emerged as a powerful tool for semantic and image editing.<n>We introduce Adaptive-Origin Guidance (AdaOr), a method that adjusts the standard guidance origin with an identity-conditioned adaptive origin.<n>We evaluate our method on image and video editing tasks, demonstrating that it provides smoother and more consistent control compared to current slider-based editing approaches.
  arXiv  Detail & Related papers  (2026-02-03T18:33:39Z)
• On Exact Editing of Flow-Based Diffusion Models [97.0633397035926]
  We propose Conditioned Velocity Correction (CVC) to reformulate flow-based editing as a distribution transformation problem driven by a known source prior.<n>CVC rethinks the role of velocity in inter-distribution transformation by introducing a dual-perspective velocity conversion mechanism.<n>We show that CVC consistently achieves superior fidelity, better semantic alignment, and more reliable editing behavior across diverse tasks.
  arXiv  Detail & Related papers  (2025-12-30T06:29:20Z)
• The Devil is in Attention Sharing: Improving Complex Non-rigid Image Editing Faithfulness via Attention Synergy [71.39358554558667]
  We introduce SynPS, a method that Synergistically leverages Positional embeddings and Semantic information for faithful non-rigid image editing.<n>We propose an editing measurement that quantifies the required editing magnitude at each denoising step.<n>By adaptively integrating positional and semantic cues, SynPS effectively avoids both over- and under-editing.
  arXiv  Detail & Related papers  (2025-12-16T14:08:00Z)
• FlowAlign: Trajectory-Regularized, Inversion-Free Flow-based Image Editing [47.908940130654535]
  FlowAlign is an inversion-free flow-based framework for consistent image editing with optimal control-based trajectory control.<n>Our terminal point regularization is shown to balance semantic alignment with the edit prompt and structural consistency with the source image along the trajectory.<n>FlowAlign outperforms existing methods in both source preservation and editing controllability.
  arXiv  Detail & Related papers  (2025-05-29T06:33:16Z)
• Tuning-Free Image Editing with Fidelity and Editability via Unified Latent Diffusion Model [60.82962950960996]
  We introduce UnifyEdit, a tuning-free method that performs diffusion latent optimization.<n>We develop two attention-based constraints: a self-attention (SA) preservation constraint for structural fidelity, and a cross-attention (CA) alignment constraint to enhance text alignment.<n>Our approach achieves a robust balance between structure preservation and text alignment across various editing tasks, outperforming other state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-04-08T01:02:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.