CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
- URL: http://arxiv.org/abs/2609.01479v1
- Date: Tue, 01 Sep 2026 16:16:06 GMT
- Title: CameraEditor: Camera-Controlled Image Editing via Video-Prior Sequential Modeling
- Abstract summary: Camera parameters play a pivotal role in dictating the geometric perspective and appearance of any given image.<n>Recent image editing models excel at semantic and stylistic manipulation, but struggle with explicit camera parameter control.<n>We introduce CameraEditor, a framework that reformulates camera-controlled editing from a spatial problem into a temporal sequence prediction task.
- Score: 33.2078327357266
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Beyond semantic content, camera parameters play a pivotal role in dictating the geometric perspective and appearance of any given image. While recent image editing models excel at semantic and stylistic manipulation, they struggle with explicit camera parameter control. When handling large perspective shifts, instruction-driven models face a dilemma: they either suffer from structural tearing or generate conservative outputs that ignore geometric instructions. To address this, we introduce CameraEditor, a framework that reformulates camera-controlled editing from a spatial problem into a temporal sequence prediction task. By leveraging the temporal coherence of video diffusion models, our approach integrates an explicit geometric perception module with a dynamic reference routing mechanism. This allows us to construct geometrically rigorous visual reference pairs via dynamic panorama cropping, overcoming the ambiguity of text-based instructions. Furthermore, CameraEditor strategically inserts intermediate transition frames to decompose large perspective shifts, providing a robust temporal buffer that preserves content identity and spatial coherence. We construct a training dataset of 5,760 instances. As an independent contribution, we introduce CamEditor-Bench, a model-agnostic evaluation suite of 462 test cases. Extensive experiments demonstrate that CameraEditor achieves state-of-the-art camera control precision and source identity preservation, outperforming existing methods.
Related papers
- CameraAnything: Refilming Videos with Arbitrary Camera Control [104.67227614978822]
We introduce CameraAnything, the first unified framework for camera controlled video editing.<n>It enables joint control of both intrinsic and extrinsic camera parameters.<n>With a tailored training strategy, CameraAnything enables expressive video reshooting with arbitrary viewpoint control, focal length adjustment, resolution adaptation, and multi-shot transitions within a single generation process.
arXiv Detail & Related papers (2026-07-27T15:55:08Z) - GeoStream: Toward Precise Camera Controlled Streaming Video Generation [85.01823220801256]
Existing approaches learn camera motion implicitly, leading to inaccurate control under out-of-distribution trajectories.<n>Explicit geometric conditioning improves controllability, but existing methods are non-autoregressive.<n>We propose GeoStream, a framework that enables precise metric-scale camera control in autoregressive streaming video generation.
arXiv Detail & Related papers (2026-06-13T07:18:04Z) - DeltaCam: Differential Intrinsic Camera Modeling for Video Generation [8.590252585822439]
We introduce DeltaCam, a video diffusion framework that models camera behavior through relative changes in camera motion and intrinsics instead of absolute states.<n>We extend this framework to real-world footage through two mechanisms: finetuning the controls on real image-metadata pairs for precise shot matching, and extracting disentangled embeddings for implicit video-to-video style transfer.
arXiv Detail & Related papers (2026-05-24T21:39:54Z) - CalibAnyView: Beyond Single-View Camera Calibration in the Wild [59.66873936532375]
Camera calibration is a fundamental prerequisite for reliable geometric perception.<n>Recent learning-based methods have shown promising results for single-view calibration, but inherently neglect geometric consistency across multiple views.<n>We introduce CalibAnyView, a unified formulation that supports an arbitrary number of input views.
arXiv Detail & Related papers (2026-05-14T09:32:12Z) - UniGeo: Unifying Geometric Guidance for Camera-Controllable Image Editing via Video Models [20.550231658763085]
Camera-controllable image editing aims to synthesize novel views of a given scene under varying camera poses.<n>Existing methods rely on fragmented geometric guidance, such as only injecting point clouds at the representation level.<n>We propose UniGeo, a novel camera-controllable editing framework.
arXiv Detail & Related papers (2026-04-19T18:11:08Z) - World-Shaper: A Unified Framework for 360° Panoramic Editing [57.174341220144605]
Existing perspective-based image editing methods fail to model the spatial structure of panoramas.<n>We present World-Shaper, a unified geometry-aware framework that bridges panoramic generation and editing within a single editing-centric design.<n>Our method achieves superior geometric consistency, editing fidelity, and text controllability compared to SOTA methods.
arXiv Detail & Related papers (2026-01-30T19:38:54Z) - Generative Photographic Control for Scene-Consistent Video Cinematic Editing [75.45726688666083]
We propose CineCtrl, the first video cinematic editing framework that provides fine control over professional camera parameters.<n>We introduce a decoupled cross-attention mechanism to disentangle camera motion from photographic inputs.<n>Our model generates high-fidelity videos with precisely controlled, user-specified photographic camera effects.
arXiv Detail & Related papers (2025-11-17T03:17:23Z) - CamPVG: Camera-Controlled Panoramic Video Generation with Epipolar-Aware Diffusion [31.032317079295762]
CamPVG is the first diffusion-based framework for panoramic video generation guided by precise camera poses.<n>We achieve camera position encoding for panoramic images and cross-view feature aggregation based on spherical projection.<n>Our method generates high-quality panoramic videos consistent with camera trajectories, far surpassing existing methods in panoramic video generation.
arXiv Detail & Related papers (2025-09-24T10:34:24Z) - Vid-CamEdit: Video Camera Trajectory Editing with Generative Rendering from Estimated Geometry [41.904066758259624]
We introduce Vid-CamEdit, a novel framework for video camera trajectory editing.<n>Our approach consists of two steps: estimating temporally consistent geometry, and generative rendering guided by this geometry.
arXiv Detail & Related papers (2025-06-16T17:02:47Z) - VASE: Object-Centric Appearance and Shape Manipulation of Real Videos [108.60416277357712]
In this work, we introduce a framework that is object-centric and is designed to control both the object's appearance and, notably, to execute precise and explicit structural modifications on the object.
We build our framework on a pre-trained image-conditioned diffusion model, integrate layers to handle the temporal dimension, and propose training strategies and architectural modifications to enable shape control.
We evaluate our method on the image-driven video editing task showing similar performance to the state-of-the-art, and showcasing novel shape-editing capabilities.
arXiv Detail & Related papers (2024-01-04T18:59:24Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.