CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control

• URL: http://arxiv.org/abs/2603.14241v1
• Date: Sun, 15 Mar 2026 06:28:46 GMT
• Title: CamLit: Unified Video Diffusion with Explicit Camera and Lighting Control
• Abstract summary: CamLit is the first unified video diffusion model that jointly performs novel view synthesis (NVS) and relighting from a single input image.<n>We show that a single generative model can effectively integrate camera and lighting control, simplifying the video generation pipeline.
• Score: 34.44048565655544
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We present CamLit, the first unified video diffusion model that jointly performs novel view synthesis (NVS) and relighting from a single input image. Given one reference image, a user-defined camera trajectory, and an environment map, CamLit synthesizes a video of the scene from new viewpoints under the specified illumination. Within a single generative process, our model produces temporally coherent and spatially aligned outputs, including relit novel-view frames and corresponding albedo frames, enabling high-quality control of both camera pose and lighting. Qualitative and quantitative experiments demonstrate that CamLit achieves high-fidelity outputs on par with state-of-the-art methods in both novel view synthesis and relighting, without sacrificing visual quality in either task. We show that a single generative model can effectively integrate camera and lighting control, simplifying the video generation pipeline while maintaining competitive performance and consistent realism.

Related papers

• Relit-LiVE: Relight Video by Jointly Learning Environment Video [17.623352754423287]
  We present Relit-LiVE, a novel video relighting framework that produces physically consistent, temporally stable results without requiring prior knowledge of camera pose.<n>Our key insight is to explicitly introduce raw reference images into the rendering process, enabling the model to recover critical scene cues that are inevitably lost or corrupted in intrinsic representations.<n>Our framework naturally supports a wide range of downstream applications, including scene-level rendering, material editing, object insertion, and streaming video relighting.
  arXiv  Detail & Related papers  (2026-05-07T17:58:15Z)
• Lighting-grounded Video Generation with Renderer-based Agent Reasoning [56.50946217758078]
  LiVER is a diffusion-based framework for scene-controllable video generation.<n>We present a novel framework that conditions video synthesis on explicit 3D scene properties.<n>Our method disentangles these properties by rendering control signals from a unified 3D representation.
  arXiv  Detail & Related papers  (2026-04-09T08:29:29Z)
• OmniCamera: A Unified Framework for Multi-task Video Generation with Arbitrary Camera Control [49.41924736941193]
  Video fundamentally intertwines two crucial axes: the dynamic content of a scene and the camera motion through which it is observed.<n>Existing generation models often entangle these factors, limiting independent control.<n>We introduce OmniCamera, a unified framework designed to explicitly disentangle and command these two dimensions.
  arXiv  Detail & Related papers  (2026-04-07T16:06:02Z)
• SyncLight: Controllable and Consistent Multi-View Relighting [32.77275120597073]
  We present SyncLight, the first method to enable consistent, parametric relighting across multiple uncalibrated views of a static scene.<n> SyncLight addresses this by enabling precise control over light intensity and color across a multi-view capture of a scene, conditioned on a single reference edit.
  arXiv  Detail & Related papers  (2026-01-23T18:59:57Z)
• Light-X: Generative 4D Video Rendering with Camera and Illumination Control [52.87059646145144]
  Light-X is a video generation framework that enables controllable rendering from monocular videos with both viewpoint and illumination control.<n>To address the lack of paired multi-view and multi-illumination videos, we introduce Light-Syn, a degradation-based pipeline with inverse-mapping.
  arXiv  Detail & Related papers  (2025-12-04T18:59:57Z)
• Virtually Being: Customizing Camera-Controllable Video Diffusion Models with Multi-View Performance Captures [18.241178853941623]
  We introduce a framework that enables both multi-view character consistency and 3D camera control in video diffusion models.<n>We fine-tune state-of-the-art open-source video diffusion models on this data to provide strong multi-view identity preservation.<n>Our framework also supports core capabilities for virtual production, including multi-subject generation.
  arXiv  Detail & Related papers  (2025-10-16T00:20:57Z)
• ReLumix: Extending Image Relighting to Video via Video Diffusion Models [5.890782804843724]
  Controlling illumination during video post-production is a crucial yet elusive goal in computational photography.<n>This paper introduces ReLumix, a novel framework that decouples the relighting from temporal synthesis.<n>Although trained on synthetic data, ReLumix shows competitive generalization to real-world videos.
  arXiv  Detail & Related papers  (2025-09-28T09:35:33Z)
• UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting [85.27994475113056]
  We introduce a general-purpose approach that jointly estimates albedo and synthesizes relit outputs in a single pass.<n>Our model demonstrates strong generalization across diverse domains and surpasses previous methods in both visual fidelity and temporal consistency.
  arXiv  Detail & Related papers  (2025-06-18T17:56:45Z)
• Stable Virtual Camera: Generative View Synthesis with Diffusion Models [51.71244310522393]
  We present Stable Virtual Camera (Seva), a generalist diffusion model that creates novel views of a scene.<n>Our approach overcomes these limitations through simple model design, optimized training recipe, and flexible sampling strategy.<n>Our method can generate high-quality videos lasting up to half a minute with seamless loop closure.
  arXiv  Detail & Related papers  (2025-03-18T17:57:22Z)
• StreetCrafter: Street View Synthesis with Controllable Video Diffusion Models [76.62929629864034]
  We introduce StreetCrafter, a controllable video diffusion model that utilizes LiDAR point cloud renderings as pixel-level conditions.<n>In addition, the utilization of pixel-level LiDAR conditions allows us to make accurate pixel-level edits to target scenes.<n>Our model enables flexible control over viewpoint changes, enlarging the view for satisfying rendering regions.
  arXiv  Detail & Related papers  (2024-12-17T18:58:55Z)
• Consistent View Synthesis with Pose-Guided Diffusion Models [51.37925069307313]
  Novel view synthesis from a single image has been a cornerstone problem for many Virtual Reality applications. We propose a pose-guided diffusion model to generate a consistent long-term video of novel views from a single image.
  arXiv  Detail & Related papers  (2023-03-30T17:59:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.