AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance

• URL: http://arxiv.org/abs/2606.01362v1
• Date: Sun, 31 May 2026 17:33:14 GMT
• Title: AlbedoEdit: Unified Instance-Level Video Editing with Albedo Guidance
• Abstract summary: Video generative models have achieved remarkable progress in synthesizing video sequences.<n>Fine-grained instance-level video editing, including object insertion, object removal, and texture editing, has emerged as a prominent yet challenging problem.<n>We propose AlbedoEdit, a unified generative video editing framework that jointly supports object insertion, object removal, and texture editing.
• Score: 42.3107762497025
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video generative models have achieved remarkable progress in synthesizing photorealistic video sequences. However, enabling broader and more creative downstream applications requires fine-grained instance-level video editing, including object insertion, object removal, and texture editing, which has emerged as a prominent yet challenging problem. Existing approaches either propose unified generative frameworks with only coarse semantic control, or design task-specific frameworks for individual editing tasks, limiting their flexibility and applicability across diverse real-world scenarios. To address these limitations, we propose AlbedoEdit, a unified generative video editing framework that jointly supports object insertion, object removal, and texture editing. Our key insight is that the intrinsic albedo map, which is invariant to lighting and contains no specularity, shadowing and inter-reflection effects, provides an effective and user-friendly mechanism for specifying fine-grained appearance edits. Built upon video foundation models, AlbedoEdit is fine-tuned to translate source RGB videos into edited RGB videos, conditioned on a user-edited first-frame albedo. Trained on a new paired synthetic dataset covering all three editing tasks, AlbedoEdit implicitly learns to harmonize edited contents and simulate complex real-world visual effects triggered by editing operations, including specular highlights, soft shadows, and mirror reflections. AlbedoEdit demonstrates superior performance over state-of-the-art video editing approaches, both qualitatively and quantitatively. Project webpage is https://vcai.mpi-inf.mpg.de/projects/AlbedoEdit/.

Related papers

• InfinityEdit: Infinite Video Editing with a Lightweight Edit-Ignition Adapter [25.43582750863899]
  We propose a lightweight edit adapter for infinite video editing.<n>It applies an edit while preserving the original model's infinite generation ability.<n>Experiments show that InfinityEdit faithfully continues the stream under each edit, and stays stable over edit sequences.
  arXiv  Detail & Related papers  (2026-08-21T09:27:49Z)
• CoEditor++: Instruction-based Visual Editing via Cognitive Reasoning [98.98349220451216]
  CoEditor++ is a training-free framework that decomposes editing into "what to edit" and "how to edit"<n>We show that CoEditor++ achieves state-of-the-art performance in both general editing and responsible editing tasks.<n>Our findings suggest the potential toward cognitive-centric instruction-based image editing.
  arXiv  Detail & Related papers  (2026-01-31T12:20:46Z)
• SpotEdit: Selective Region Editing in Diffusion Transformers [66.44912649206553]
  SpotEdit is a training-free diffusion editing framework that selectively updates only the modified regions.<n>By reducing unnecessary computation and maintaining high fidelity in unmodified areas, SpotEdit achieves efficient and precise image editing.
  arXiv  Detail & Related papers  (2025-12-26T14:59:41Z)
• O-DisCo-Edit: Object Distortion Control for Unified Realistic Video Editing [88.93410369258203]
  O-DisCo-Edit is a unified framework that incorporates a novel object distortion control (O-DisCo)<n>This signal, based on random and adaptive noise, flexibly encapsulates a wide range of editing cues within a single representation.<n>O-DisCo-Edit enables efficient, high-fidelity editing through an effective training paradigm.
  arXiv  Detail & Related papers  (2025-09-01T16:29:39Z)
• V2Edit: Versatile Video Diffusion Editor for Videos and 3D Scenes [29.80140472486948]
  V$2$Edit is a training-free framework for instruction-guided video and 3D scene editing.<n>We introduce a progressive strategy that decomposes complex editing tasks into simpler subtasks.<n>We extend V$2$Edit to 3D scene editing via a "render-edit-reconstruct" process, enabling high-quality, 3D-consistent edits.
  arXiv  Detail & Related papers  (2025-03-13T17:59:55Z)
• UniEdit: A Unified Tuning-Free Framework for Video Motion and Appearance Editing [28.140945021777878]
  We present UniEdit, a tuning-free framework that supports both video motion and appearance editing. To realize motion editing while preserving source video content, we introduce auxiliary motion-reference and reconstruction branches. The obtained features are then injected into the main editing path via temporal and spatial self-attention layers.
  arXiv  Detail & Related papers  (2024-02-20T17:52:12Z)
• Neutral Editing Framework for Diffusion-based Video Editing [24.370584544151424]
  This paper proposes Neutral Editing (NeuEdit) framework to enable complex non-rigid editing. NeuEdit introduces a concept of neutralization' that enhances a tuning-editing process of diffusion-based editing systems. Experiments on numerous videos demonstrate adaptability and effectiveness of the NeuEdit framework.
  arXiv  Detail & Related papers  (2023-12-10T16:28:32Z)
• MagicProp: Diffusion-based Video Editing via Motion-aware Appearance Propagation [74.32046206403177]
  MagicProp disentangles the video editing process into two stages: appearance editing and motion-aware appearance propagation. In the first stage, MagicProp selects a single frame from the input video and applies image-editing techniques to modify the content and/or style of the frame. In the second stage, MagicProp employs the edited frame as an appearance reference and generates the remaining frames using an autoregressive rendering approach.
  arXiv  Detail & Related papers  (2023-09-02T11:13:29Z)
• MagicEdit: High-Fidelity and Temporally Coherent Video Editing [70.55750617502696]
  We present MagicEdit, a surprisingly simple yet effective solution to the text-guided video editing task. We found that high-fidelity and temporally coherent video-to-video translation can be achieved by explicitly disentangling the learning of content, structure and motion signals during training.
  arXiv  Detail & Related papers  (2023-08-28T17:56:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.