Geometry-Instructed Video Editing

• URL: http://arxiv.org/abs/2606.24225v1
• Date: Tue, 23 Jun 2026 07:11:45 GMT
• Title: Geometry-Instructed Video Editing
• Abstract summary: GIVE is a geometry-instructed video editing framework that represents edits through a unified object-state formulation.<n>We build a scalable graphics-engine pipeline that executes object-level edit programs and renders controlled before/after pairs.<n> Experimental results demonstrate that GIVE produces faithful geometric edits with temporal coherence and consistent secondary effects.
• Score: 54.86319853573801
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Object-level geometric edits, including translating, rotating, scaling, duplicating, or removing an object, are routine operations in digital content creation (DCC) workflows, yet they remain unreliable in generative video editing. The key challenge lies in specifying the target object's 3D state change unambiguously across viewpoint and time, while consistently updating geometry-dependent secondary effects such as shadows and reflections. We introduce GIVE, a geometry-instructed video editing framework that represents edits through a unified object-state formulation. Two video-aligned geometry streams describe the target object before and after editing: a depth-box encoding coarse 3D placement and extent, and an orientation-box providing an appearance-agnostic orientation cue. Together, these streams provide a compact pre/post geometric specification for object-state transitions. To provide paired supervision for learning these edits, we build a scalable graphics-engine pipeline that executes object-level edit programs and renders controlled before/after pairs, isolating the intended geometric edit while keeping secondary effects consistent with the transformation. Experimental results demonstrate that GIVE produces faithful geometric edits with temporal coherence and consistent secondary effects across operators in a unified framework, and shows promising transfer to in-the-wild videos. Project page: https://geometry-instructed-video-editing.github.io/give/

Related papers

• GeoCo-SAVi: Geometry-Consistent Slot Attention for Explicitly Editable Object Representations [31.094346113912895]
  GeoCo-SAVi promotes geometric authority and semantic alignment.<n>On 250 MOVi-C videos, it also improves reconstruction, instance grouping, and fixed-identity geometry control.
  arXiv  Detail & Related papers  (2026-09-06T14:24:27Z)
• Feedforward 3D Editing Learns from Semantic-Part Transformation [13.61340944347895]
  A central challenge of feedforward 3D editing lies in the lack of high-quality paired supervision.<n>We introduce a new perspective: scalable feedforward 3D editing should be learned from semantic-part transformations.<n>PartFlow is a feedforward 3D editing network that injects source-aware latent control into pretrained 3D generative priors.
  arXiv  Detail & Related papers  (2026-05-26T17:51:59Z)
• VGGT-Edit: Feed-forward Native 3D Scene Editing with Residual Field Prediction [59.303842406260124]
  VGGT-Edit is a feed-forward framework for text-conditioned native 3D scene editing.<n>We introduce depth-synchronized text injection to align semantic guidance with the backbone's spatial poses.<n> VGGT-Edit substantially outperforms 2D-lifting baselines, producing sharper object details, stronger multi-view consistency, and near-instant inference speed.
  arXiv  Detail & Related papers  (2026-05-14T17:59:04Z)
• CEI-3D: Collaborative Explicit-Implicit 3D Reconstruction for Realistic and Fine-Grained Object Editing [51.73433734209541]
  Existing 3D editing methods often produce unrealistic and unrefined results due to the deeply integrated nature of their reconstruction networks.<n>This paper introduces CEI-3D, an editing-oriented reconstruction pipeline designed to facilitate realistic and fine-grained editing.<n>Our approach achieves more realistic and fine-grained editing results than the state-of-the-art (SOTA) methods while requiring less editing time.
  arXiv  Detail & Related papers  (2026-03-12T11:15:11Z)
• Geometric Image Editing via Effects-Sensitive In-Context Inpainting with Diffusion Transformers [41.08668138583002]
  GeoEdit is a framework that integrates geometric transformations for precise object edits.<n>Effects-context Attention enhances the modeling of intricate lighting and shadow effects for improved realism.<n> RS-Objects is a large-scale geometric editing dataset containing over 120,000 high-quality image pairs.
  arXiv  Detail & Related papers  (2026-02-09T08:39:47Z)
• POCI-Diff: Position Objects Consistently and Interactively with 3D-Layout Guided Diffusion [46.97254555348757]
  We propose a diffusion-based approach for Text-to-Image (T2I) generation with consistent and interactive 3D layout control and editing.<n>We introduce a framework for Positioning Objects Consistently and Interactively (POCI-Diff)<n>Our method enables explicit per-object semantic control by binding individual text descriptions to specific 3D bounding boxes.
  arXiv  Detail & Related papers  (2026-01-20T15:13:43Z)
• 3DGS-Drag: Dragging Gaussians for Intuitive Point-Based 3D Editing [58.54083747494426]
  3DGS-Drag is a point-based 3D editing framework that provides efficient, intuitive drag manipulation of real 3D scenes.<n>Our approach bridges the gap between deformation-based and 2D-editing-based 3D editing methods.
  arXiv  Detail & Related papers  (2026-01-12T19:57:31Z)
• Dragging with Geometry: From Pixels to Geometry-Guided Image Editing [42.176957681367185]
  We propose a novel geometry-guided drag-based image editing method - GeoDrag.<n>Built upon a unified displacement field that jointly encodes 3D geometry and 2D spatial priors, GeoDrag enables coherent, high-fidelity, and structure-consistent editing.
  arXiv  Detail & Related papers  (2025-09-30T03:53:11Z)
• Shape-for-Motion: Precise and Consistent Video Editing with 3D Proxy [48.72918598961146]
  We present Shape-for-Motion, a novel framework that incorporates a 3D proxy for precise and consistent video editing.<n>Our framework supports various precise and physically-consistent manipulations across the video frames, including pose editing, rotation, scaling, translation, texture modification, and object composition.
  arXiv  Detail & Related papers  (2025-06-27T17:59:01Z)
• Drag Your Gaussian: Effective Drag-Based Editing with Score Distillation for 3D Gaussian Splatting [55.14822004410817]
  We introduce DYG, an effective 3D drag-based editing method for 3D Gaussian Splatting.<n>It enables precise control over the extent of editing through the input of 3D masks and pairs of control points.<n>DYG integrates the strengths of the implicit triplane representation to establish the geometric scaffold of the editing results.
  arXiv  Detail & Related papers  (2025-01-30T18:51:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.