Training-Free Image Editing with Visual Context Integration and Concept Alignment

• URL: http://arxiv.org/abs/2604.04487v1
• Date: Mon, 06 Apr 2026 07:26:18 GMT
• Title: Training-Free Image Editing with Visual Context Integration and Concept Alignment
• Abstract summary: VicoEdit is a training-free and inversion-free method to inject the visual context into the pretrained text-prompted editing model.<n>We show that our training-free method achieves even better editing performance than the state-of-the-art training-based models.
• Score: 45.18177214621628
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In image editing, it is essential to incorporate a context image to convey the user's precise requirements, such as subject appearance or image style. Existing training-based visual context-aware editing methods incur data collection effort and training cost. On the other hand, the training-free alternatives are typically established on diffusion inversion, which struggles with consistency and flexibility. In this work, we propose VicoEdit, a training-free and inversion-free method to inject the visual context into the pretrained text-prompted editing model. More specifically, VicoEdit directly transforms the source image into the target one based on the visual context, thereby eliminating the need for inversion that can lead to deviated trajectories. Moreover, we design a posterior sampling approach guided by concept alignment to enhance the editing consistency. Empirical results demonstrate that our training-free method achieves even better editing performance than the state-of-the-art training-based models.

Related papers

• EditTransfer++: Toward Faithful and Efficient Visual-Prompt-Guided Image Editing [43.64132452334661]
  We present EditTransfer++, a framework that combines structured training with an efficient conditioning scheme to improve both visual prompt faithfulness and inference efficiency.<n>We show that EditTransfer++ achieves state-of-the-art visual prompt faithfulness with substantially faster inference than prior methods.
  arXiv  Detail & Related papers  (2026-05-08T09:01:20Z)
• Training-Free Multi-Concept Image Editing [14.75123947134721]
  Concept Distillation Sampling (CDS) is a training-free framework for target-less, multi-concept image editing.<n>It overcomes the linguistic bottleneck of previous methods by integrating a highly stable distillation backbone.<n>Our method preserves instance fidelity without requiring reference samples of the desired edit.
  arXiv  Detail & Related papers  (2026-02-24T12:27:51Z)
• Training-Free Reward-Guided Image Editing via Trajectory Optimal Control [55.64204232819136]
  We introduce a novel framework for training-free, reward-guided image editing.<n>We demonstrate that our approach significantly outperforms existing inversion-based training-free baselines.
  arXiv  Detail & Related papers  (2025-09-30T06:34:37Z)
• SPIE: Semantic and Structural Post-Training of Image Editing Diffusion Models with AI feedback [28.807572302899004]
  SPIE is a novel approach for semantic and structural post-training of instruction-based image editing diffusion models.<n>We introduce an online reinforcement learning framework that aligns the diffusion model with human preferences without relying on extensive human annotations.<n> Experimental results demonstrate that SPIE can perform intricate edits in complex scenes, after just 10 training steps.
  arXiv  Detail & Related papers  (2025-04-17T10:46:39Z)
• Concept Lancet: Image Editing with Compositional Representation Transplant [58.9421919837084]
  Concept Lancet is a zero-shot plug-and-play framework for principled representation manipulation in image editing.<n>We decompose the source input in the latent (text embedding or diffusion score) space as a sparse linear combination of the representations of the collected visual concepts.<n>We perform a customized concept transplant process to impose the corresponding editing direction.
  arXiv  Detail & Related papers  (2025-04-03T17:59:58Z)
• Edicho: Consistent Image Editing in the Wild [90.42395533938915]
  Edicho steps in with a training-free solution based on diffusion models.<n>It features a fundamental design principle of using explicit image correspondence to direct editing.
  arXiv  Detail & Related papers  (2024-12-30T16:56:44Z)
• UIP2P: Unsupervised Instruction-based Image Editing via Edit Reversibility Constraint [87.20985852686785]
  We propose an unsupervised instruction-based image editing approach that removes the need for ground-truth edited images during training.<n>Our approach addresses these challenges by introducing a novel editing mechanism called Edit Reversibility Constraint (ERC), which applies forward and reverse edits in one training step.<n>This allows us to bypass the need for ground-truth edited images and unlock training for the first time on datasets comprising either real image-caption pairs or image-caption-instruction triplets.
  arXiv  Detail & Related papers  (2024-12-19T18:59:58Z)
• AdapEdit: Spatio-Temporal Guided Adaptive Editing Algorithm for Text-Based Continuity-Sensitive Image Editing [24.9487669818162]
  We propose atemporal guided adaptive editing algorithm AdapEdit, which realizes adaptive image editing. Our approach has a significant advantage in preserving model priors and does not require model training, fine-tuning extra data, or optimization. We present our results over a wide variety of raw images and editing instructions, demonstrating competitive performance and showing it significantly outperforms the previous approaches.
  arXiv  Detail & Related papers  (2023-12-13T09:45:58Z)
• BARET : Balanced Attention based Real image Editing driven by Target-text Inversion [36.59406959595952]
  We propose a novel editing technique that only requires an input image and target text for various editing types including non-rigid edits without fine-tuning diffusion model. Our method contains three novelties: (I) Targettext Inversion Schedule (TTIS) is designed to fine-tune the input target text embedding to achieve fast image reconstruction without image caption and acceleration of convergence; (II) Progressive Transition Scheme applies progressive linear approaches between target text embedding and its fine-tuned version to generate transition embedding for maintaining non-rigid editing capability; (III) Balanced Attention Module (BAM) balances the tradeoff between textual description and image semantics
  arXiv  Detail & Related papers  (2023-12-09T07:18:23Z)
• Zero-shot Image-to-Image Translation [57.46189236379433]
  We propose pix2pix-zero, an image-to-image translation method that can preserve the original image without manual prompting. We propose cross-attention guidance, which aims to retain the cross-attention maps of the input image throughout the diffusion process. Our method does not need additional training for these edits and can directly use the existing text-to-image diffusion model.
  arXiv  Detail & Related papers  (2023-02-06T18:59:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.