EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing

• URL: http://arxiv.org/abs/2603.19224v1
• Date: Thu, 19 Mar 2026 17:59:22 GMT
• Title: EffectErase: Joint Video Object Removal and Insertion for High-Quality Effect Erasing
• Abstract summary: Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds.<n>Recent diffusion-based video inpainting and object removal methods can remove the objects but often struggle to erase these effects and to synthesize coherent backgrounds.<n>We introduce VOR (Video Object Removal), a large-scale dataset that provides diverse paired videos.<n>We propose EffectErase, an effect-aware video object removal method that treats video object insertion as the inverse auxiliary task within a reciprocal learning scheme.
• Score: 50.43992550991499
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Video object removal aims to eliminate dynamic target objects and their visual effects, such as deformation, shadows, and reflections, while restoring seamless backgrounds. Recent diffusion-based video inpainting and object removal methods can remove the objects but often struggle to erase these effects and to synthesize coherent backgrounds. Beyond method limitations, progress is further hampered by the lack of a comprehensive dataset that systematically captures common object effects across varied environments for training and evaluation. To address this, we introduce VOR (Video Object Removal), a large-scale dataset that provides diverse paired videos, each consisting of one video where the target object is present with its effects and a counterpart where the object and effects are absent, with corresponding object masks. VOR contains 60K high-quality video pairs from captured and synthetic sources, covers five effects types, and spans a wide range of object categories as well as complex, dynamic multi-object scenes. Building on VOR, we propose EffectErase, an effect-aware video object removal method that treats video object insertion as the inverse auxiliary task within a reciprocal learning scheme. The model includes task-aware region guidance that focuses learning on affected areas and enables flexible task switching. Then, an insertion-removal consistency objective that encourages complementary behaviors and shared localization of effect regions and structural cues. Trained on VOR, EffectErase achieves superior performance in extensive experiments, delivering high-quality video object effect erasing across diverse scenarios.

Related papers

• EffectLearner: World-Aware Object-Effect Reasoning for Real-World Video Object Removal [43.705438947753656]
  EffectLearner is a framework that learns object-effect correspondences implicitly from effect categories and fixed data generalizations.<n>We further construct EffectWorld, a dataset specifically designed for complex object-induced effects, and introduce a progressive training curriculum that combines common supervision with complex data.
  arXiv  Detail & Related papers  (2026-08-06T03:34:19Z)
• VOID: Video Object and Interaction Deletion [50.155301620235285]
  Existing video object removal methods excel at inpainting content "behind" the object and correcting appearance-level artifacts such as shadows and reflections.<n>We present VOID, a video object removal framework designed to perform physically-plausible inpainting in complex scenarios.
  arXiv  Detail & Related papers  (2026-04-02T17:36:53Z)
• From Understanding to Erasing: Towards Complete and Stable Video Object Removal [8.035439287403983]
  Video object removal aims to eliminate target objects from videos while plausibly completing missing regions and preservingtemporal consistency.<n>It remains challenging to remove object-induced side effects without compromising overall coherence.<n>This paper introduces understanding into erasing from two complementary perspectives.
  arXiv  Detail & Related papers  (2026-04-02T06:50:39Z)
• ROSE: Remove Objects with Side Effects in Videos [47.196851721000655]
  ROSE is a framework that studies the object's effects on environment, which can be categorized into five common cases: shadows, reflections, light, translucency and mirror.<n>To localize all object-correlated areas, the entire video is fed into the model for reference-based erasing.<n>Additional supervision is introduced to explicitly predict the areas affected by side effects, which can be revealed through the differential mask between the paired videos.
  arXiv  Detail & Related papers  (2025-08-26T03:18:31Z)
• ObjectClear: Complete Object Removal via Object-Effect Attention [56.2893552300215]
  We introduce a new dataset for OBject-Effect Removal, named OBER, which provides paired images with and without object effects, along with precise masks for both objects and their associated visual artifacts.<n>We propose a novel framework, ObjectClear, which incorporates an object-effect attention mechanism to guide the model toward the foreground removal regions by learning attention masks.<n>Experiments demonstrate that ObjectClear outperforms existing methods, achieving improved object-effect removal quality and background fidelity, especially in complex scenarios.
  arXiv  Detail & Related papers  (2025-05-28T17:51:17Z)
• Object-Centric Latent Action Learning [70.3173534658611]
  We propose a novel object-centric latent action learning framework that centers on objects rather than pixels.<n>We leverage self-supervised object-centric pretraining to disentangle action-related and distracting dynamics.<n>Our results show that object-centric pretraining mitigates the negative effects of distractors by 50%.
  arXiv  Detail & Related papers  (2025-02-13T11:27:05Z)
• SOS! Self-supervised Learning Over Sets Of Handled Objects In Egocentric Action Recognition [35.4163266882568]
  We introduce Self-Supervised Learning Over Sets (SOS) to pre-train a generic Objects In Contact (OIC) representation model. Our OIC significantly boosts the performance of multiple state-of-the-art video classification models.
  arXiv  Detail & Related papers  (2022-04-10T23:27:19Z)
• Learning Visual Affordance Grounding from Demonstration Videos [76.46484684007706]
  Affordance grounding aims to segment all possible interaction regions between people and objects from an image/video. We propose a Hand-aided Affordance Grounding Network (HAGNet) that leverages the aided clues provided by the position and action of the hand in demonstration videos.
  arXiv  Detail & Related papers  (2021-08-12T11:45:38Z)
• Omnimatte: Associating Objects and Their Effects in Video [100.66205249649131]
  Scene effects related to objects in video are typically overlooked by computer vision. In this work, we take a step towards solving this novel problem of automatically associating objects with their effects in video. Our model is trained only on the input video in a self-supervised manner, without any manual labels, and is generic---it produces omnimattes automatically for arbitrary objects and a variety of effects.
  arXiv  Detail & Related papers  (2021-05-14T17:57:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.