ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment

• URL: http://arxiv.org/abs/2509.17818v1
• Date: Mon, 22 Sep 2025 14:13:31 GMT
• Title: ContextFlow: Training-Free Video Object Editing via Adaptive Context Enrichment
• Abstract summary: Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion.<n>Existing methods suffer from two primary limitations: inaccurate inversion due to first-order solvers, and contextual conflicts caused by crude "hard" feature replacement.<n>We introduce ContextFlow, a novel training-free framework for DiT-based video object editing.
• Score: 13.125899660835813
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Training-free video object editing aims to achieve precise object-level manipulation, including object insertion, swapping, and deletion. However, it faces significant challenges in maintaining fidelity and temporal consistency. Existing methods, often designed for U-Net architectures, suffer from two primary limitations: inaccurate inversion due to first-order solvers, and contextual conflicts caused by crude "hard" feature replacement. These issues are more challenging in Diffusion Transformers (DiTs), where the unsuitability of prior layer-selection heuristics makes effective guidance challenging. To address these limitations, we introduce ContextFlow, a novel training-free framework for DiT-based video object editing. In detail, we first employ a high-order Rectified Flow solver to establish a robust editing foundation. The core of our framework is Adaptive Context Enrichment (for specifying what to edit), a mechanism that addresses contextual conflicts. Instead of replacing features, it enriches the self-attention context by concatenating Key-Value pairs from parallel reconstruction and editing paths, empowering the model to dynamically fuse information. Additionally, to determine where to apply this enrichment (for specifying where to edit), we propose a systematic, data-driven analysis to identify task-specific vital layers. Based on a novel Guidance Responsiveness Metric, our method pinpoints the most influential DiT blocks for different tasks (e.g., insertion, swapping), enabling targeted and highly effective guidance. Extensive experiments show that ContextFlow significantly outperforms existing training-free methods and even surpasses several state-of-the-art training-based approaches, delivering temporally coherent, high-fidelity results.

Related papers

• CoT-Edit: Let CoT Guide Instruction Video Editing [13.600094788792633]
  We propose a plan--guide--edit framework that bridges semantic intent and spatial execution.<n>In our framework, a Chain-of-Thought (CoT)-enhanced multimodal large language model (MLLM) serves as a planner.<n>These spatial priors then guide a box-conditioned mask generator, transforming ambiguous global retrieval into localized, context-aware refinement.
  arXiv  Detail & Related papers  (2026-08-02T09:20:15Z)
• MT-EditFlow: Reinforcement Learning for Multi-Turn Image Editing with Flow Matching [91.83651402045108]
  MT-EditFlow is a flow-matching reinforcement learning framework designed to optimize reward signals for sequential image editing.<n>We show that MT-EditFlow significantly improves performance across diverse base models.
  arXiv  Detail & Related papers  (2026-06-01T09:46:10Z)
• KGEdit: Ambiguity-Aware Knowledge Graphs for Training-Free Precise Video Generation and Editing [24.315720861063397]
  KGEdit is a structured semantic control framework for text-to-video (T2V) diffusion models.<n>We first construct an ambiguity-aware knowledge graph (AAKG) to disentangle and disambiguate the input prompt.<n>We then design a structured semantic injection module (SSIM) to inject semantic signals into key layers of the diffusion Transformer.
  arXiv  Detail & Related papers  (2026-05-28T07:31:22Z)
• Reasoning to Align: Implicit Reasoning in Diffusion Transformers for Video Editing [55.211537893248675]
  We propose RVEDiT, an implicit Reasoning Video Editing DiT framework built around two complementary components.<n> RVEDiT consistently outperforms state-of-the-art baselines, with particularly strong gains on localized and compositional edits.
  arXiv  Detail & Related papers  (2026-05-23T17:22:14Z)
• Consistency-Aware Editing for Entity-level Unlearning in Language Models [53.522931419965424]
  We introduce a novel consistency-aware editing (CAE) framework for entity-level unlearning.<n>CAE aggregates a diverse set of prompts related to a target entity, including its attributes, relations, and adversarial paraphrases.<n>It then jointly learns a low-rank update guided by a consistency regularizer that aligns the editing directions across prompts.
  arXiv  Detail & Related papers  (2025-12-19T15:18:07Z)
• Semantic Prioritization in Visual Counterfactual Explanations with Weighted Segmentation and Auto-Adaptive Region Selection [50.68751788132789]
  This study introduces an innovative methodology named as Weighted Semantic Map with Auto-adaptive Candidate Editing Network (WSAE-Net)<n>The generation of the weighted semantic map is designed to maximize the reduction of non-semantic feature units that need to be computed.<n>The auto-adaptive candidate editing sequences are designed to determine the optimal computational order among the feature units to be processed.
  arXiv  Detail & Related papers  (2025-11-17T05:34:10Z)
• SplitFlow: Flow Decomposition for Inversion-Free Text-to-Image Editing [15.234877788378563]
  Rectified flow models have become a de facto standard in image generation due to their stable sampling trajectories and high-fidelity outputs.<n>Despite their strong generative capabilities, they face critical limitations in image editing tasks.<n>Recent efforts have attempted to directly map source and target distributions via ODE-based approaches without inversion.<n>We propose a flow decomposition-and-aggregation framework built upon an inversion-free formulation to address these limitations.
  arXiv  Detail & Related papers  (2025-10-29T21:12:58Z)
• FlowCycle: Pursuing Cycle-Consistent Flows for Text-based Editing [12.424207508842192]
  We propose FlowCycle, a novel inversion-free and flow-based editing framework.<n>We show that FlowCycle achieves superior editing quality and consistency over state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-10-23T04:58:29Z)
• ConsistEdit: Highly Consistent and Precise Training-free Visual Editing [17.162316662697965]
  We propose ConsistEdit, a novel attention control method specifically tailored for MM-DiT.<n>It incorporates vision-only attention control, mask-guided pre-attention fusion, and differentiated manipulation of the query, key, and value tokens.<n>It achieves state-of-the-art performance across a wide range of image and video editing tasks, including both structure-consistent and structure-inconsistent scenarios.
  arXiv  Detail & Related papers  (2025-10-20T17:59:52Z)
• Low-Cost Test-Time Adaptation for Robust Video Editing [4.707015344498921]
  Video editing is a critical component of content creation that transforms raw footage into coherent works aligned with specific visual and narrative objectives.<n>Existing approaches face two major challenges: temporal inconsistencies due to failure in capturing complex motion patterns, and overfitting to simple prompts arising from limitations in UNet backbone architectures.<n>We present Vid-TTA, a lightweight test-time adaptation framework that personalizes optimization for each test video during inference through self-supervised auxiliary tasks.
  arXiv  Detail & Related papers  (2025-07-29T14:31:17Z)
• AttentionDrag: Exploiting Latent Correlation Knowledge in Pre-trained Diffusion Models for Image Editing [33.74477787349966]
  We propose a novel one-step point-based image editing method, named AttentionDrag.<n>This framework enables semantic consistency and high-quality manipulation without the need for extensive re-optimization or retraining.<n>Our results demonstrate a performance that surpasses most state-of-the-art methods with significantly faster speeds.
  arXiv  Detail & Related papers  (2025-06-16T09:42:38Z)
• InComeS: Integrating Compression and Selection Mechanisms into LLMs for Efficient Model Editing [77.47790551485721]
  In-context learning is a promising editing method by comprehending edit information through context encoding.<n>This method is constrained by the limited context window of large language models.<n>We propose InComeS, a flexible framework that enhances LLMs' ability to process editing contexts.
  arXiv  Detail & Related papers  (2025-05-28T09:20:18Z)
• In-Context Edit: Enabling Instructional Image Editing with In-Context Generation in Large Scale Diffusion Transformer [42.44787022143543]
  ICEdit is an in-context editing paradigm with minimal parameter-efficient fine-tuning for quality improvement.<n>It achieves state-of-the-art editing performance with only 0.1% of the training data and 1% trainable parameters compared to previous methods.
  arXiv  Detail & Related papers  (2025-04-29T12:14:47Z)
• Towards Transformer-Based Aligned Generation with Self-Coherence Guidance [51.42269790543461]
  We introduce a training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs)<n>Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex text prompts or multi-concept attribute binding challenges.<n>Our method addresses these challenges by directly optimizing cross-attention maps during the generation process.
  arXiv  Detail & Related papers  (2025-03-22T07:03:57Z)
• OmniPaint: Mastering Object-Oriented Editing via Disentangled Insertion-Removal Inpainting [54.525583840585305]
  We introduce OmniPaint, a unified framework that re-conceptualizes object removal and insertion as interdependent processes.<n>Our novel CFD metric offers a robust, reference-free evaluation of context consistency and object hallucination.
  arXiv  Detail & Related papers  (2025-03-11T17:55:27Z)
• Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing [60.730661748555214]
  We introduce textbfTask-textbfOriented textbfDiffusion textbfInversion (textbfTODInv), a novel framework that inverts and edits real images tailored to specific editing tasks. ToDInv seamlessly integrates inversion and editing through reciprocal optimization, ensuring both high fidelity and precise editability.
  arXiv  Detail & Related papers  (2024-08-23T22:16:34Z)
• CorDA: Context-Oriented Decomposition Adaptation of Large Language Models for Task-Aware Parameter-Efficient Fine-tuning [101.81127587760831]
  Current fine-tuning methods build adapters widely of the context of downstream task to learn, or the context of important knowledge to maintain.<n>We propose CorDA, a Context-oriented Decomposition Adaptation method that builds learnable task-aware adapters.<n>Our method enables two options, the knowledge-preserved adaptation and the instruction-previewed adaptation.
  arXiv  Detail & Related papers  (2024-06-07T19:10:35Z)
• Tuning-Free Inversion-Enhanced Control for Consistent Image Editing [44.311286151669464]
  We present a novel approach called Tuning-free Inversion-enhanced Control (TIC) TIC correlates features from the inversion process with those from the sampling process to mitigate the inconsistency in DDIM reconstruction. We also propose a mask-guided attention concatenation strategy that combines contents from both the inversion and the naive DDIM editing processes.
  arXiv  Detail & Related papers  (2023-12-22T11:13:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.