MaskFlow: Precise, Consistent and Seamless Regional Image Editing

• URL: http://arxiv.org/abs/2608.06929v1
• Date: Fri, 07 Aug 2026 08:03:41 GMT
• Title: MaskFlow: Precise, Consistent and Seamless Regional Image Editing
• Abstract summary: We propose a training framework for precise localization, consistent background preservation, and seamless boundary transitions.<n>MaskFlow incorporates the mask into the probability path and flow-matching objective, coordinating generation within the editable region with source preservation outside it.<n>We also design a data synthesis pipeline to construct MEData, a mask-based image editing dataset.
• Score: 16.88162067523766
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Regional image editing has attracted considerable attention for its spatial controllability. Although instruction-based and mask-reference-based editing methods can achieve strong semantic alignment, reliable regional control remains challenging, where an edit must be accurately localized and naturally integrated with the preserved context. We propose \textbf{MaskFlow}, a training framework for precise localization, consistent background preservation, and seamless boundary transitions. MaskFlow incorporates the mask into the probability path and flow-matching objective, coordinating generation within the editable region with source preservation outside it. The proposed Soft-Poisson de-seaming module further refines the predicted vector field during both training and sampling to improve the smooth integration of the edited foreground with the preserved background. We also design a data synthesis pipeline to construct MEData, a mask-based image editing dataset for training regional image editing models and facilitating further research. Experiments on natural scenes and infographic images demonstrate consistent improvements over competing methods in both quantitative and qualitative evaluations.

Related papers

• WhereEdit: Mask-aware Local Latent Editing for One-Step Image Editing [16.758428220880734]
  One-step text-to-image (T2I) models enable efficient image synthesis and provide new opportunities for real-time image editing.<n>Existing one-step editing methods rely on text conditioning for semantic transformation, lacking explicit spatial control over textitwhere to edit.<n>We propose textbfWhereEdit, a framework that reformulates one-step editing as localized adaptive editing.
  arXiv  Detail & Related papers  (2026-07-23T03:11:25Z)
• SAM-Flow: Source-Anchored Masked Flow for Training-Free Image Editing [11.868477331606911]
  SAM-Flow is a source-anchored masked flow framework for localized training-free image editing.<n>It achieves accurate semantic editing while significantly improving background preservation.<n>It can be integrated with mainstream flow-matching backbones such as Stable Diffusion 3 and FLUX without any fine-tuning.
  arXiv  Detail & Related papers  (2026-06-04T14:36:19Z)
• Follow-Your-Shape: Shape-Aware Image Editing via Trajectory-Guided Region Control [52.87568958372421]
  Follow-Your-Shape is a training-free and mask-free framework that supports precise and controllable editing of object shapes.<n>We compute a Trajectory Divergence Map (TDM) by comparing token-wise velocity differences between the inversion and denoising paths.<n>Our method achieves superior editability and visual fidelity, particularly in tasks requiring large-scale shape replacement.
  arXiv  Detail & Related papers  (2025-08-11T16:10:00Z)
• Flux-Sculptor: Text-Driven Rich-Attribute Portrait Editing through Decomposed Spatial Flow Control [24.057959328107387]
  Flux-Sculptor is a flux-based framework designed for precise text-driven portrait editing.<n>Our framework introduces a Prompt-Aligned Spatial Locator (PASL) to accurately identify relevant editing regions.<n>Experiments demonstrate that Flux-Sculptor surpasses existing methods in rich-attribute editing and facial information preservation.
  arXiv  Detail & Related papers  (2025-07-05T10:08:39Z)
• CPAM: Context-Preserving Adaptive Manipulation for Zero-Shot Real Image Editing [24.68304617869157]
  Context-Preserving Adaptive Manipulation (CPAM) is a novel framework for complicated, non-rigid real image editing.<n>We develop a preservation adaptation module that adjusts self-attention mechanisms to preserve and independently control the object and background effectively.<n>We also introduce various mask-guidance strategies to facilitate diverse image manipulation tasks in a simple manner.
  arXiv  Detail & Related papers  (2025-06-23T09:19:38Z)
• DCEdit: Dual-Level Controlled Image Editing via Precisely Localized Semantics [71.78350994830885]
  We present a novel approach to improving text-guided image editing using diffusion-based models.<n>Our method uses visual and textual self-attention to enhance the cross-attention map, which can serve as a regional cues to improve editing performance.<n>To fully compare our methods with other DiT-based approaches, we construct the RW-800 benchmark, featuring high resolution images, long descriptive texts, real-world images, and a new text editing task.
  arXiv  Detail & Related papers  (2025-03-21T02:14:03Z)
• PartEdit: Fine-Grained Image Editing using Pre-Trained Diffusion Models [80.98455219375862]
  We present the first text-based image editing approach for object parts based on pre-trained diffusion models.<n>Our approach is preferred by users 66-90% of the time in conducted user studies.
  arXiv  Detail & Related papers  (2025-02-06T13:08:43Z)
• MAG-Edit: Localized Image Editing in Complex Scenarios via Mask-Based Attention-Adjusted Guidance [28.212908146852197]
  We develop MAG-Edit, a training-free, inference-stage optimization method, which enables localized image editing in complex scenarios. In particular, MAG-Edit optimize the noise latent feature in diffusion models by maximizing two mask-based cross-attention constraints.
  arXiv  Detail & Related papers  (2023-12-18T17:55:44Z)
• iEdit: Localised Text-guided Image Editing with Weak Supervision [53.082196061014734]
  We propose a novel learning method for text-guided image editing. It generates images conditioned on a source image and a textual edit prompt. It shows favourable results against its counterparts in terms of image fidelity, CLIP alignment score and qualitatively for editing both generated and real images.
  arXiv  Detail & Related papers  (2023-05-10T07:39:14Z)
• Region-Aware Diffusion for Zero-shot Text-driven Image Editing [78.58917623854079]
  We propose a novel region-aware diffusion model (RDM) for entity-level image editing. To strike a balance between image fidelity and inference speed, we design the intensive diffusion pipeline. The results show that RDM outperforms the previous approaches in terms of visual quality, overall harmonization, non-editing region content preservation, and text-image semantic consistency.
  arXiv  Detail & Related papers  (2023-02-23T06:20:29Z)
• DiffEdit: Diffusion-based semantic image editing with mask guidance [64.555930158319]
  DiffEdit is a method to take advantage of text-conditioned diffusion models for the task of semantic image editing. Our main contribution is able to automatically generate a mask highlighting regions of the input image that need to be edited.
  arXiv  Detail & Related papers  (2022-10-20T17:16:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.