ViewSplat: View-Adaptive Dynamic Gaussian Splatting for Feed-Forward Synthesis
- URL: http://arxiv.org/abs/2603.25265v1
- Date: Thu, 26 Mar 2026 10:03:44 GMT
- Title: ViewSplat: View-Adaptive Dynamic Gaussian Splatting for Feed-Forward Synthesis
- Abstract summary: We present ViewSplat, a view-adaptive 3D Gaussian splatting network for novel view synthesis from unposed images.<n>We show that ViewSplat achieves state-of-the-art fidelity while maintaining fast inference and real-time rendering.
- Score: 10.752176613697912
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present ViewSplat, a view-adaptive 3D Gaussian splatting network for novel view synthesis from unposed images. While recent feed-forward 3D Gaussian splatting has significantly accelerated 3D scene reconstruction by bypassing per-scene optimization, a fundamental fidelity gap remains. We attribute this bottleneck to the limited capacity of single-step feed-forward networks to regress static Gaussian primitives that satisfy all viewpoints. To address this limitation, we shift the paradigm from static primitive regression to view-adaptive dynamic splatting. Instead of a rigid Gaussian representation, our pipeline learns a view-adaptable latent representation. Specifically, ViewSplat initially predicts base Gaussian primitives alongside the weights of dynamic MLPs. During rendering, these MLPs take target view coordinates as input and predict view-dependent residual updates for each Gaussian attribute (i.e., 3D position, scale, rotation, opacity, and color). This mechanism, which we term view-adaptive dynamic splatting, allows each primitive to rectify initial estimation errors, effectively capturing high-fidelity appearances. Extensive experiments demonstrate that ViewSplat achieves state-of-the-art fidelity while maintaining fast inference (17 FPS) and real-time rendering (154 FPS).
Related papers
- TruncGradGS: Improved 3D Gaussian Splatting via Truncated Gradient Updates [12.79385955347933]
3D Gaussian Splatting has become a de facto scene representation for novel view synthesis.<n>Standard optimization relies on gradient-based updates, but a common issue is the gradient vanishing phenomenon.<n>We propose a method to address gradient vanishing with a piecewise truncated gradient formulation.
arXiv Detail & Related papers (2026-09-03T08:34:27Z) - AugSplat: Radiance Field-Informed Gaussian Splatting for Sparse-View Settings [35.450442960064116]
We present AugSplat, a framework for improving Gaussian Splatting in sparse-view regimes.<n>We first train a radiance field on sparse input views and use it to synthesize additional images from nearby novel viewpoints.<n>These synthetic views are then used as auxiliary supervision during Gaussian Splatting.<n>Experiments on sparse-view mip-NeRF 360 scenes show that AugSplat improves reconstruction quality over standard Gaussian Splatting.
arXiv Detail & Related papers (2026-06-30T12:12:21Z) - EcoSplat: Efficiency-controllable Feed-forward 3D Gaussian Splatting from Multi-view Images [39.67757218876105]
EcoSplat is a feed-forward 3DGS framework that adaptively predicts the 3D representation for any given target primitive count at inference time.<n>We show that EcoSplat is robust and outperforms state-of-the-art methods under strict primitive-count constraints.
arXiv Detail & Related papers (2025-12-21T11:12:48Z) - G3Splat: Geometrically Consistent Generalizable Gaussian Splatting [30.752029360892504]
We introduce G3Splat, which enforces geometric priors to obtain geometrically consistent 3D scene representations.<n>Trained on RE10K, our approach achieves state-of-the-art performance in (i) geometrically consistent reconstruction, (ii) relative pose estimation, and (iii) novel-view synthesis.
arXiv Detail & Related papers (2025-12-19T13:11:55Z) - HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis [59.25751939710903]
We propose a novel deformable Gaussian splatting framework that addresses embodied view synthesis from long monocular RGB videos.<n>Our method leverages invertible Gaussian Splatting deformation networks to reconstruct large-scale, dynamic environments accurately.<n>Results highlight a practical and scalable solution for EVS in real-world scenarios.
arXiv Detail & Related papers (2025-06-24T03:54:40Z) - Epipolar-Free 3D Gaussian Splatting for Generalizable Novel View Synthesis [25.924727931514735]
Generalizable 3DGS can reconstruct new scenes from sparse-view observations in a feed-forward inference manner.
Existing methods rely heavily on epipolar priors, which can be unreliable in complex realworld scenes.
We propose eFreeSplat, an efficient feed-forward 3DGS-based model for generalizable novel view synthesis.
arXiv Detail & Related papers (2024-10-30T08:51:29Z) - PF3plat: Pose-Free Feed-Forward 3D Gaussian Splatting [54.7468067660037]
PF3plat sets a new state-of-the-art across all benchmarks, supported by comprehensive ablation studies validating our design choices.<n>Our framework capitalizes on fast speed, scalability, and high-quality 3D reconstruction and view synthesis capabilities of 3DGS.
arXiv Detail & Related papers (2024-10-29T15:28:15Z) - MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields [100.90743697473232]
Radiance fields represented by 3D Gaussians excel at synthesizing novel views, offering both high training efficiency and fast rendering.<n>Existing methods often incorporate depth priors from dense estimation networks but overlook the inherent multi-view consistency in input images.<n>We propose a view synthesis framework based on 3D Gaussian Splatting, enabling scene reconstruction from sparse views.
arXiv Detail & Related papers (2024-10-15T08:39:05Z) - FreeSplat: Generalizable 3D Gaussian Splatting Towards Free-View Synthesis of Indoor Scenes [50.534213038479926]
FreeSplat is capable of reconstructing geometrically consistent 3D scenes from long sequence input towards free-view synthesis.
We propose a simple but effective free-view training strategy that ensures robust view synthesis across broader view range regardless of the number of views.
arXiv Detail & Related papers (2024-05-28T08:40:14Z) - InstantSplat: Sparse-view Gaussian Splatting in Seconds [91.77050739918037]
We introduce InstantSplat, a novel approach for addressing sparse-view 3D scene reconstruction at lightning-fast speed.<n>InstantSplat employs a self-supervised framework that optimize 3D scene representation and camera poses.<n>It achieves an acceleration of over 30x in reconstruction and improves visual quality (SSIM) from 0.3755 to 0.7624 compared to traditional SfM with 3D-GS.
arXiv Detail & Related papers (2024-03-29T17:29:58Z) - Scaffold-GS: Structured 3D Gaussians for View-Adaptive Rendering [71.44349029439944]
Recent 3D Gaussian Splatting method has achieved the state-of-the-art rendering quality and speed.
We introduce Scaffold-GS, which uses anchor points to distribute local 3D Gaussians.
We show that our method effectively reduces redundant Gaussians while delivering high-quality rendering.
arXiv Detail & Related papers (2023-11-30T17:58:57Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.