Diffusion Image Editing via Asynchronous Token Decoding

• URL: http://arxiv.org/abs/2608.09322v1
• Date: Mon, 10 Aug 2026 09:02:13 GMT
• Title: Diffusion Image Editing via Asynchronous Token Decoding
• Abstract summary: ATDEdit is an inference-time framework that views each sampler step as a parallel update of a globally coupled token matrix.<n>It estimates editable locations using token-wise conditional surprisal and applies target-conditioned corrections to the selected token set.<n>It supplies source key/value memory at keep-token positions and projects selected keep-token latent rows back to their source values.
• Score: 9.39531887626368
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Text-guided diffusion image editing aims to modify semantic attributes of an image while preserving its identity, layout, and background. However, naïvely switching the text condition during sampling often causes global drift, as denoising dynamics propagate changes across tokens and can disrupt unedited regions. To address this issue, we propose \textbf{A}synchronous \textbf{T}oken \textbf{D}ecoding \textbf{Edit} (ATDEdit), an inference-time framework that views each sampler step as a parallel update of a globally coupled token matrix and enables token-indexed condition switching with differentiated update policies. Instead of applying synchronous target-conditioned updates to all tokens, ATDEdit estimates editable locations using token-wise conditional surprisal and applies target-conditioned corrections to the selected token set. It supplies source key/value memory at keep-token positions and projects selected keep-token latent rows back to their source values; these operations promote background preservation but do not constitute a pixel-level invariance guarantee. This approach combines local editing and background preservation without external or user-provided spatial masks and without model fine-tuning. On PIE-Bench, ATDEdit achieves the strongest reported preservation metrics, including 27.44~dB PSNR and 0.055 LPIPS, while retaining competitive semantic alignment.

Related papers

• PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing [6.411145731142763]
  PC-Edit is a prompt-contrastive framework for training-free MM-DiT editing.<n>We show that PC-Edit achieves the best editing quality and background preservation among methods without user-specified edit regions.
  arXiv  Detail & Related papers  (2026-07-23T13:42:03Z)
• BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing [8.542586773614113]
  Real image editing enables precise manipulation of visual content, yet existing methods often fail in complex multi-object scenarios.<n>We propose BindEdit, which enforces attention-level constraints within a single diffusion trajectory.<n>BindEdit consistently outperforms existing methods within a single diffusion trajectory.
  arXiv  Detail & Related papers  (2026-06-17T10:32:14Z)
• Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models [85.59447229497101]
  BitResEdit is a training-free editor for bitwise-residual VAR generators such as Infinity.<n>It performs source-negative guidance by tilting the post-CFG per-bit log-odds along a source--target contrast computed on a shared edited prefix.<n>It converts the sampled bits into per-scale continuous-code residuals, gates them with a localization mask, and re-injects them through the generator's native sum-of-scales.
  arXiv  Detail & Related papers  (2026-06-11T16:41:25Z)
• MaskAlign: Token-Subset Representation Alignment for Efficient Diffusion Training [53.777757218665386]
  MaskAlign is a token-subset representation alignment method that applies alignment to randomly sampled token subsets during training.<n>We show that MaskAlign reduces the dependence of representation alignment on the complete token set and encourages alignment behavior that is more stable under token-subset perturbations.
  arXiv  Detail & Related papers  (2026-06-07T19:11:22Z)
• SpotEdit: Selective Region Editing in Diffusion Transformers [66.44912649206553]
  SpotEdit is a training-free diffusion editing framework that selectively updates only the modified regions.<n>By reducing unnecessary computation and maintaining high fidelity in unmodified areas, SpotEdit achieves efficient and precise image editing.
  arXiv  Detail & Related papers  (2025-12-26T14:59:41Z)
• Training-Free Disentangled Text-Guided Image Editing via Sparse Latent Constraints [2.4140502941897544]
  Text-driven image manipulation often suffers from attribute entanglement, where modifying a target attribute unintentionally alters other semantic properties such as identity or appearance.<n>The Predict, Prevent, and Evaluate framework addresses this issue by leveraging pre-trained vision-language models for disentangled editing.<n> Experimental results demonstrate that the proposed approach enforces more focused and controlled edits, effectively reducing unintended changes in non-target attributes while preserving facial identity.
  arXiv  Detail & Related papers  (2025-12-25T11:38:10Z)
• ContextDrag: Precise Drag-Based Image Editing via Context-Preserving Token Injection and Position-Consistent Attention [81.12932992203885]
  We introduce ContextDrag, a new paradigm for drag-based editing.<n>By incorporating VAE-encoded features from the reference image, ContextDrag can leverage rich contextual cues and preserve fine-grained details.
  arXiv  Detail & Related papers  (2025-12-09T10:51:45Z)
• SAEdit: Token-level control for continuous image editing via Sparse AutoEncoder [52.754326452329956]
  We introduce a method for disentangled and continuous editing through token-level manipulation of text embeddings.<n>The edits are applied by manipulating the embeddings along carefully chosen directions, which control the strength of the target attribute.<n>Our method operates directly on text embeddings without modifying the diffusion process, making it model agnostic and broadly applicable to various image backbones.
  arXiv  Detail & Related papers  (2025-10-06T17:51:04Z)
• Addressing Text Embedding Leakage in Diffusion-based Image Editing [33.1686050396517]
  We introduce Attribute-Leakage-free Editing (ALE), a framework that tackles attribute leakage at its source.<n>ALE combines Object-Restricted Embeddings (ORE) to disentangle text embeddings, Region-Guided Blending for Cross-Attention Masking (RGB-CAM) for spatially precise attention, and Background Blending (BB) to preserve non-edited content.
  arXiv  Detail & Related papers  (2024-12-06T02:10:07Z)
• iEdit: Localised Text-guided Image Editing with Weak Supervision [53.082196061014734]
  We propose a novel learning method for text-guided image editing. It generates images conditioned on a source image and a textual edit prompt. It shows favourable results against its counterparts in terms of image fidelity, CLIP alignment score and qualitatively for editing both generated and real images.
  arXiv  Detail & Related papers  (2023-05-10T07:39:14Z)
• DiffEdit: Diffusion-based semantic image editing with mask guidance [64.555930158319]
  DiffEdit is a method to take advantage of text-conditioned diffusion models for the task of semantic image editing. Our main contribution is able to automatically generate a mask highlighting regions of the input image that need to be edited.
  arXiv  Detail & Related papers  (2022-10-20T17:16:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.