PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing
- URL: http://arxiv.org/abs/2607.21318v1
- Date: Thu, 23 Jul 2026 13:42:03 GMT
- Title: PC-Edit: Prompt-Contrastive Region Discovery and Region-Guided Editing
- Abstract summary: PC-Edit is a prompt-contrastive framework for training-free MM-DiT editing.<n>We show that PC-Edit achieves the best editing quality and background preservation among methods without user-specified edit regions.
- Score: 6.411145731142763
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Replacing an object with one that differs in category or shape requires complete source removal, natural target formation unconstrained by the source silhouette, and preservation of unrelated content. Existing training-free editors either localize edits from terminal predictions under source and target prompts or preserve unrelated content through spatially unselective source-feature reuse without explicit region discovery. Before reaching the terminal predictions, prompt-induced semantic differences undergo additional network transformations that may obscure their spatial localization, reducing localization precision. Spatially unselective feature reuse forces a trade-off between edit completeness and background preservation. Therefore, we propose PC-Edit, a prompt-contrastive framework for training-free MM-DiT editing. PC-Edit contrasts the image-token attention outputs under the source and target prompts, capturing prompt-induced semantic differences directly where text-conditioned information is delivered to image tokens. The same contrast identifies a source-erasure region during inversion and a target-emergence region during denoising. Their union suppresses source remnants while allowing the target object to form naturally. PC-Edit further couples region discovery and background preservation within each sampling step by estimating the current edit region from preceding attention blocks and immediately injecting cached source K/V features outside it in subsequent blocks, thereby protecting unrelated content before the latent update. Experiments on PIE-Bench and our EditRegion-Bench, with human-verified edit-region annotations for single- and multi-object addition and replacement, show that PC-Edit achieves the best editing quality and background preservation among methods without user-specified edit regions.
Related papers
- Diffusion Image Editing via Asynchronous Token Decoding [9.39531887626368]
ATDEdit is an inference-time framework that views each sampler step as a parallel update of a globally coupled token matrix.<n>It estimates editable locations using token-wise conditional surprisal and applies target-conditioned corrections to the selected token set.<n>It supplies source key/value memory at keep-token positions and projects selected keep-token latent rows back to their source values.
arXiv Detail & Related papers (2026-08-10T09:02:13Z) - BindEdit: Taming Attention Leakage for Precise Multi-Object Image Editing [8.542586773614113]
Real image editing enables precise manipulation of visual content, yet existing methods often fail in complex multi-object scenarios.<n>We propose BindEdit, which enforces attention-level constraints within a single diffusion trajectory.<n>BindEdit consistently outperforms existing methods within a single diffusion trajectory.
arXiv Detail & Related papers (2026-06-17T10:32:14Z) - Edit Where You Mean: Region-Aware Adapter Injection for Mask-Free Local Image Editing [28.295031615161136]
Large diffusion transformers (DiTs) follow global editing instructions well but consistently leak local edits into unrelated regions.<n>We introduce AdaptEdit, a co-trained, instruction- and region-aware adapter framework.<n> AdaptEdit achieves state-of-the-art results, simultaneously outperforming mask-free and oracle-mask baselines.
arXiv Detail & Related papers (2026-04-26T15:28:02Z) - Rethinking Where to Edit: Task-Aware Localization for Instruction-Based Image Editing [30.23368654238746]
We propose a training-free, task-aware edit localization framework for instruction-based image editing.<n>Our framework consistently improves non-edit region consistency while maintaining strong instruction-following performance.
arXiv Detail & Related papers (2026-04-22T07:08:01Z) - CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing [51.73433734209541]
Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
arXiv Detail & Related papers (2026-03-12T11:15:11Z) - ProEdit: Inversion-based Editing From Prompts Done Right [63.554692704101]
Inversion-based visual editing provides an effective and training-free way to edit an image or a video based on user instructions.<n>Existing methods typically inject source image information during the sampling process to maintain editing consistency.<n>We propose ProEdit to address this issue both in the attention and the latent aspects.
arXiv Detail & Related papers (2025-12-26T18:59:14Z) - SpotEdit: Selective Region Editing in Diffusion Transformers [66.44912649206553]
SpotEdit is a training-free diffusion editing framework that selectively updates only the modified regions.<n>By reducing unnecessary computation and maintaining high fidelity in unmodified areas, SpotEdit achieves efficient and precise image editing.
arXiv Detail & Related papers (2025-12-26T14:59:41Z) - Re-Attentional Controllable Video Diffusion Editing [48.052781838711994]
We propose a Re-Attentional Controllable Video Diffusion Editing (ReAtCo) method.<n>To align the spatial placement of the target objects with the edited text prompt in a training-free manner, we propose a Re-Attentional Diffusion (RAD)<n>RAD refocuses the cross-attention activation responses between the edited text prompt and the target video during the denoising stage, resulting in a spatially location-aligned and semantically high-fidelity manipulated video.
arXiv Detail & Related papers (2024-12-16T12:32:21Z) - Addressing Text Embedding Leakage in Diffusion-based Image Editing [33.1686050396517]
We introduce Attribute-Leakage-free Editing (ALE), a framework that tackles attribute leakage at its source.<n>ALE combines Object-Restricted Embeddings (ORE) to disentangle text embeddings, Region-Guided Blending for Cross-Attention Masking (RGB-CAM) for spatially precise attention, and Background Blending (BB) to preserve non-edited content.
arXiv Detail & Related papers (2024-12-06T02:10:07Z) - Customize your NeRF: Adaptive Source Driven 3D Scene Editing via
Local-Global Iterative Training [61.984277261016146]
We propose a CustomNeRF model that unifies a text description or a reference image as the editing prompt.
To tackle the first challenge, we propose a Local-Global Iterative Editing (LGIE) training scheme that alternates between foreground region editing and full-image editing.
For the second challenge, we also design a class-guided regularization that exploits class priors within the generation model to alleviate the inconsistency problem.
arXiv Detail & Related papers (2023-12-04T06:25:06Z) - iEdit: Localised Text-guided Image Editing with Weak Supervision [53.082196061014734]
We propose a novel learning method for text-guided image editing.
It generates images conditioned on a source image and a textual edit prompt.
It shows favourable results against its counterparts in terms of image fidelity, CLIP alignment score and qualitatively for editing both generated and real images.
arXiv Detail & Related papers (2023-05-10T07:39:14Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.