SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis

• URL: http://arxiv.org/abs/2605.07287v1
• Date: Fri, 08 May 2026 05:51:34 GMT
• Title: SplatWeaver: Learning to Allocate Gaussian Primitives for Generalizable Novel View Synthesis
• Abstract summary: Generalizable novel view synthesis aims to render unseen views from uncalibrated input images without requiring per-scene optimization.<n>Recent feed-forward approaches based on 3D Gaussian Splatting have achieved promising efficiency and rendering quality.<n>SplatWeaver is able to dynamically allocate Gaussian primitives over different regions in a feed-forward manner.
• Score: 60.075770066276505
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Generalizable novel view synthesis aims to render unseen views from uncalibrated input images without requiring per-scene optimization. Recent feed-forward approaches based on 3D Gaussian Splatting have achieved promising efficiency and rendering quality. However, most of them assign a fixed number of Gaussians to each pixel or voxel, ignoring the spatially varying complexity of real-world scenes. Such uniform allocation often wastes Gaussian primitives in smooth regions while providing insufficient capacity for fine structures, complex geometry, and high-frequency details. This motivates us to predict region-dependent primitive cardinalities rather than impose a fixed primitive budget everywhere, enabling a more expressive yet compact 3D scene representation. Therefore, we propose SplatWeaver, a generalizable novel view synthesis framework that is able to dynamically allocate Gaussian primitives over different regions in a feed-forward manner. Specifically, SplatWeaver introduces cardinality Gaussian experts and a pixel-level routing scheme, wherein each expert specializes in producing a specific number of primitives from 0 to M, and the routing scheme coordinates these experts to adaptively determine how many Gaussian primitives should be allocated to each spatial location. Moreover, SplatWeaver incorporates a high-frequency prior with attendant guidance module and routing regularization to stabilize expert selection and promote complexity-aware allocation. By leveraging high-frequency structural cues, the routing process is encouraged to assign more Gaussian primitives to fine structures, complex geometry, and textured regions, while suppressing redundant primitives in smooth areas. Extensive experiments across diverse scenarios show that SplatWeaver consistently outperforms state-of-the-art methods, delivering more faithful novel-view renderings with fewer Gaussian primitives.

Related papers

• Z-Order Transformer for Feed-Forward Gaussian Splatting [14.297614617317533]
  We introduce a transformer-based architecture specifically designed for feed-forward Gaussian Splatting.<n>Our key insight is that spatial and semantic relationships among Gaussians can be effectively captured through a sparse attention mechanism.<n>We incorporate this Z-order strategy to adaptively suppress redundancy while preserving critical structural details.
  arXiv  Detail & Related papers  (2026-05-13T12:54:59Z)
• Faster 3D Gaussian Splatting Convergence via Structure-Aware Densification [52.517763621139956]
  3D Gaussian Splatting has emerged as a powerful scene representation for real-time novel-view synthesis.<n>Standard adaptive density control relies on screen-space positional gradients.<n>We present a structure-aware densification framework for 3D Gaussian Splatting.
  arXiv  Detail & Related papers  (2026-04-30T15:37:20Z)
• F4Splat: Feed-Forward Predictive Densification for Feed-Forward 3D Gaussian Splatting [28.800888081472422]
  We present F4Splat, which performs Feed-Forward predictive densification for Feed-Forward 3D Gaussian Splatting.<n>Our model predicts per-region densification scores to estimate the required Gaussian density and allows explicit control over the final Gaussian budget.<n>Experiments demonstrate that our model achieves superior novel-view synthesis performance compared to prior uncalibrated feed-forward methods.
  arXiv  Detail & Related papers  (2026-03-22T16:03:56Z)
• A Mixed-Primitive-based Gaussian Splatting Method for Surface Reconstruction [61.205927223522174]
  We propose a novel framework that enables Gaussian Splatting to incorporate multiple types of primitives during its surface reconstruction process.<n>Specifically, in our framework, we first propose a compositional splatting strategy, enabling the splatting and rendering of different types of primitives.
  arXiv  Detail & Related papers  (2025-07-15T13:52:40Z)
• SmileSplat: Generalizable Gaussian Splats for Unconstrained Sparse Images [91.28365943547703]
  A novel generalizable Gaussian Splatting method, SmileSplat, is proposed to reconstruct pixel-aligned Gaussian surfels for diverse scenarios.<n>The proposed method achieves state-of-the-art performance in various 3D vision tasks.
  arXiv  Detail & Related papers  (2024-11-27T05:52:28Z)
• PixelGaussian: Generalizable 3D Gaussian Reconstruction from Arbitrary Views [116.10577967146762]
  PixelGaussian is an efficient framework for learning generalizable 3D Gaussian reconstruction from arbitrary views. Our method achieves state-of-the-art performance with good generalization to various numbers of views.
  arXiv  Detail & Related papers  (2024-10-24T17:59:58Z)
• MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields [100.90743697473232]
  Radiance fields represented by 3D Gaussians excel at synthesizing novel views, offering both high training efficiency and fast rendering.<n>Existing methods often incorporate depth priors from dense estimation networks but overlook the inherent multi-view consistency in input images.<n>We propose a view synthesis framework based on 3D Gaussian Splatting, enabling scene reconstruction from sparse views.
  arXiv  Detail & Related papers  (2024-10-15T08:39:05Z)
• GaussianForest: Hierarchical-Hybrid 3D Gaussian Splatting for Compressed Scene Modeling [40.743135560583816]
  We introduce the Gaussian-Forest modeling framework, which hierarchically represents a scene as a forest of hybrid 3D Gaussians. Experiments demonstrate that Gaussian-Forest not only maintains comparable speed and quality but also achieves a compression rate surpassing 10 times.
  arXiv  Detail & Related papers  (2024-06-13T02:41:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.