Beyond Heuristics: Learnable Density Control for 3D Gaussian Splatting

• URL: http://arxiv.org/abs/2605.00408v1
• Date: Fri, 01 May 2026 05:04:49 GMT
• Title: Beyond Heuristics: Learnable Density Control for 3D Gaussian Splatting
• Abstract summary: We introduce bfLeGS, a framework that reformulates density control as a parameterized policy network optimized via Reinforcement Learning (RL)<n>To maintain computational tractability, we derive a closed-form solution that reduces the complexity of reward calculation from $O(N2)$ to $O(N)$.<n>Experiments on the Mip-NeRF 360, Tanks & Temples, and Deep Blending datasets demonstrate that bfLeGS significantly outperforms state-of-the-art methods.
• Score: 78.96382179408054
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While 3D Gaussian Splatting (3DGS) has demonstrated impressive real-time rendering performance, its efficacy remains constrained by a reliance on heuristic density control. Despite numerous refinements to these handcrafted rules, such methods inherently lack the flexibility to adapt to diverse scenes with complex geometries. In this paper, we propose a paradigm shift for density control from rigid heuristics to fully learnable policies. Specifically, we introduce \textbf{LeGS}, a framework that reformulates density control as a parameterized policy network optimized via Reinforcement Learning (RL). Central to our approach is the tailored effective reward function grounded in sensitivity analysis, which precisely quantifies the marginal contribution of individual Gaussians to reconstruction quality. To maintain computational tractability, we derive a closed-form solution that reduces the complexity of reward calculation from $O(N^2)$ to $O(N)$. Extensive experiments on the Mip-NeRF 360, Tanks \& Temples, and Deep Blending datasets demonstrate that \textbf{LeGS} significantly outperforms state-of-the-art methods, striking a superior balance between reconstruction quality and efficiency. The code will be released at https://github.com/AaronNZH/LeGS

Related papers

• REFINE: Super-efficient 3D Gaussian Splatting Pruning via Rendering-Free Primitive Importance [58.94345609736356]
  REFINE is a highly accelerated 3DGS pruning framework centered on a novel rendering-free primitive importance metric.<n>Experiments across multiple benchmark datasets demonstrate that REFINE maintains highly competitive rendering quality.
  arXiv  Detail & Related papers  (2026-06-08T06:16:38Z)
• Softmax-GS: Generalized Gaussians Learning When to Blend or Bound [19.234118544637592]
  3D Gaussian Splatting (3D GS) is widely adopted for novel view synthesis due to its high training and rendering efficiency.<n>We propose Softmax-GS, a unified solution that addresses the view-inconsistency and the diffuse-boundary problem.
  arXiv  Detail & Related papers  (2026-04-30T05:23:05Z)
• GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting [50.2045409672451]
  3D Gaussian Splatting (3DGS) has demonstrated breakthrough performance in novel view synthesis and real-time rendering.<n>It is constrained by the high memory cost due to a huge number of Gaussian points.<n>We propose graph-based spatial distribution optimization for compact 3DGS.
  arXiv  Detail & Related papers  (2026-04-02T10:41:51Z)
• DensifyBeforehand: LiDAR-assisted Content-aware Densification for Efficient and Quality 3D Gaussian Splatting [1.5576275034099496]
  This paper addresses the limitations of existing 3D Gaussian Splatting (3DGS) methods by combining sparse LiDAR data with monocular depth estimation from corresponding RGB images.<n>Our ROI-aware sampling scheme prioritizes semantically and geometrically important regions, yielding a dense point cloud.<n>Our method achieves comparable results to state-of-the-art techniques while significantly lowering resource consumption and training time.
  arXiv  Detail & Related papers  (2025-11-24T16:39:13Z)
• Opacity-Gradient Driven Density Control for Compact and Efficient Few-Shot 3D Gaussian Splatting [0.0]
  This paper presents a framework that revises the core 3DGS optimization to prioritize efficiency.<n>We replace the standard positional gradient with a novel densification trigger that uses the opacity gradient as a lightweight proxy for rendering error.<n>On the 3-view LLFF dataset, our model is over 40% more compact (32k vs. 57k primitives) than FSGS, and on the Mip-NeRF 360 dataset, it achieves a reduction of approximately 70%.
  arXiv  Detail & Related papers  (2025-10-11T15:33:50Z)
• D$^2$GS: Depth-and-Density Guided Gaussian Splatting for Stable and Accurate Sparse-View Reconstruction [73.61056394880733]
  3D Gaussian Splatting (3DGS) enables real-time, high-fidelity novel view synthesis (NVS) with explicit 3D representations.<n>We identify two key failure modes under sparse-view conditions: overfitting in regions with excessive Gaussian density near the camera, and underfitting in distant areas with insufficient Gaussian coverage.<n>We propose a unified framework D$2$GS, comprising two key components: a Depth-and-Density Guided Dropout strategy, and a Distance-Aware Fidelity Enhancement module.
  arXiv  Detail & Related papers  (2025-10-09T17:59:49Z)
• Steepest Descent Density Control for Compact 3D Gaussian Splatting [72.54055499344052]
  3D Gaussian Splatting (3DGS) has emerged as a powerful real-time, high-resolution novel view.<n>We propose a theoretical framework that demystifies and improves density control in 3DGS.<n>We introduce SteepGS, incorporating steepest density control, a principled strategy that minimizes loss while maintaining a compact point cloud.
  arXiv  Detail & Related papers  (2025-05-08T18:41:38Z)
• Micro-splatting: Multistage Isotropy-informed Covariance Regularization Optimization for High-Fidelity 3D Gaussian Splatting [1.5582756275568836]
  Micro-Splatting is a unified, in-training pipeline that preserves visual detail while drastically reducing model complexity.<n>On four object-centric benchmarks, Micro-Splatting reduces splat count and model size by up to 60% and shortens training by 20%.<n>Results demonstrate that Micro-Splatting delivers both compactness and high fidelity in a single, efficient, end-to-end framework.
  arXiv  Detail & Related papers  (2025-04-08T07:15:58Z)
• HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression [55.6351304553003]
  3D Gaussian Splatting (3DGS) has emerged as a promising framework for novel view synthesis. We propose a Hash-grid Assisted Context (HAC) framework for highly compact 3DGS representation. Our work is the pioneer to explore context-based compression for 3DGS representation, resulting in a remarkable size reduction of over $75times$ compared to vanilla 3DGS.
  arXiv  Detail & Related papers  (2024-03-21T16:28:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.