AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animation

• URL: http://arxiv.org/abs/2607.18539v1
• Date: Mon, 20 Jul 2026 22:14:03 GMT
• Title: AniGS: Bridging Rendering and Diffusion Prior for 3D Scene Animation
• Abstract summary: We present AniGS, a method for scene-level animation of 3D Gaussian Splatting (3DGS) reconstructions.<n>AniGS adds subtle, distributed dynamics, e.g., vegetation motion, while preserving rigid structures.<n>Experiments on five real-world, large-scale outdoor scenes demonstrate that AniGS produces natural ambient dynamics and high-quality novel view videos.
• Score: 56.353660100768856
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Novel view rendering of large and complex reconstructed scenes is becoming increasingly photorealistic. However, most reconstructions remain static and lack the ambient motion that makes environments immersive. We present AniGS, a method for scene-level animation of 3D Gaussian Splatting (3DGS) reconstructions that adds subtle, distributed dynamics, e.g., vegetation motion, while preserving rigid structures. Unlike existing 3D animation techniques which are limited to object-centric subjects or small regions, AniGS is designed for large, cluttered, navigable scenes. AniGS represents the scene with a canonical 3DGS and models motion using a time-conditioned deformation field. To animate the entire scene, we leverage a pretrained video diffusion model and introduce an iterative dataset--model update strategy that progressively expands viewpoint coverage and repeatedly updates camera-fixed training videos using a render-and-refine scheme. To prevent artifacts from unintended motion in static areas, we further introduce a composed video-to-video refinement scheme that restricts motion to desired regions. Experiments on five real-world, large-scale outdoor scenes demonstrate that AniGS produces natural ambient dynamics and high-quality novel view videos, enabling more immersive viewing experiences of reconstructed environments.

Related papers

• World from Motion: Generative Dynamic Gaussian Reconstruction from Monocular Video [62.16750462940772]
  We present World from Motion, a method for generating freely renderable dynamic 3D Gaussian representations from monocular videos.<n>Our approach conditions a video model on dense, pixel-aligned renderings that encode appearance, geometry, and 3D scene motion.<n>At test time, we distill the model's generations back into a single consistent, high-quality dynamic 3DGS, improving both novel-view synthesis and the underlying 3D motion.
  arXiv  Detail & Related papers  (2026-07-01T17:41:00Z)
• 3D Scene-Adaptive Trajectory-Controllable Human Image Animation with Camera Movement [51.22216867938034]
  We present a 3D motion animation framework that controls both human motion trajectories within a reconstructed 3D environment for video generation.<n>We design a viewpoint-adaptive latent fusion mechanism to inject point-cloud geometric priors through scene-visibility masking into the generative process.<n>Experiments on two standard human image animation benchmark datasets demonstrate remarkable improvements of our method over the state of the arts in related video generation metics.
  arXiv  Detail & Related papers  (2026-06-29T16:22:54Z)
• Rein3D: Reinforced 3D Indoor Scene Generation with Panoramic Video Diffusion Models [38.45163624089566]
  Rein3D is a framework that reconstructs full 360-degree indoor environments.<n>We employ a radial exploration strategy to render imperfect panoramic videos.<n>These sequences are restored by a panoramic video-to-video diffusion model and further enhanced via video super-resolution to synthesize high-fidelity geometry and textures.
  arXiv  Detail & Related papers  (2026-04-12T10:55:14Z)
• CineScene: Implicit 3D as Effective Scene Representation for Cinematic Video Generation [65.03946626081036]
  We present CineScene, a framework that leverages implicit 3D-aware scene representation for cinematic video generation.<n>CineScene achieves state-of-the-art performance in scene-consistent cinematic video generation.
  arXiv  Detail & Related papers  (2026-02-06T18:59:24Z)
• AnimateScene: Camera-controllable Animation in Any Scene [34.04222775149215]
  3D scene reconstruction and 4D human animation have seen rapid progress and broad adoption in recent years.<n>One key difficulty lies in placing the human at the correct location and scale within the scene.<n>Another challenge is that the human and the background may exhibit different lighting and style, leading to unrealistic composites.<n>We present AnimateScene, which addresses the above issues in a unified framework.
  arXiv  Detail & Related papers  (2025-08-08T03:28:17Z)
• DGS-LRM: Real-Time Deformable 3D Gaussian Reconstruction From Monocular Videos [52.46386528202226]
  We introduce the Deformable Gaussian Splats Large Reconstruction Model (DGS-LRM)<n>It is the first feed-forward method predicting deformable 3D Gaussian splats from a monocular posed video of any dynamic scene.<n>It achieves performance on par with state-of-the-art monocular video 3D tracking methods.
  arXiv  Detail & Related papers  (2025-06-11T17:59:58Z)
• Gaussians-to-Life: Text-Driven Animation of 3D Gaussian Splatting Scenes [49.26872036160368]
  We propose a method for animating parts of high-quality 3D scenes in a Gaussian Splatting representation.<n>We find that, in contrast to prior work, this enables realistic animations of complex, pre-existing 3D scenes.
  arXiv  Detail & Related papers  (2024-11-28T16:01:58Z)
• SpectroMotion: Dynamic 3D Reconstruction of Specular Scenes [7.590932716513324]
  We present a novel approach that combines 3D Gaussian Splatting (3DGS) with physically-based rendering (PBR) and deformation fields to reconstruct dynamic specular scenes.<n>It is the only existing 3DGS method capable of synthesizing photorealistic real-world dynamic specular scenes.
  arXiv  Detail & Related papers  (2024-10-22T17:59:56Z)
• Modeling Ambient Scene Dynamics for Free-view Synthesis [31.233859111566613]
  We introduce a novel method for dynamic free-view synthesis of an ambient scenes from a monocular capture. Our method builds upon the recent advancements in 3D Gaussian Splatting (3DGS) that can faithfully reconstruct complex static scenes.
  arXiv  Detail & Related papers  (2024-06-13T17:59:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.