Revising Densification in Gaussian Splatting

• URL: http://arxiv.org/abs/2404.06109v1
• Date: Tue, 9 Apr 2024 08:20:37 GMT
• Title: Revising Densification in Gaussian Splatting
• Authors: Samuel Rota Bulò, Lorenzo Porzi, Peter Kontschieder,
• Abstract summary: We introduce a pixel-error driven formulation for density control in 3DGS, leveraging an auxiliary, per-pixel error function as the criterion for densification. Our approach leads to consistent quality improvements across a variety of benchmark scenes, without sacrificing the method's efficiency.
• Score: 23.037676471903215
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: In this paper, we address the limitations of Adaptive Density Control (ADC) in 3D Gaussian Splatting (3DGS), a scene representation method achieving high-quality, photorealistic results for novel view synthesis. ADC has been introduced for automatic 3D point primitive management, controlling densification and pruning, however, with certain limitations in the densification logic. Our main contribution is a more principled, pixel-error driven formulation for density control in 3DGS, leveraging an auxiliary, per-pixel error function as the criterion for densification. We further introduce a mechanism to control the total number of primitives generated per scene and correct a bias in the current opacity handling strategy of ADC during cloning operations. Our approach leads to consistent quality improvements across a variety of benchmark scenes, without sacrificing the method's efficiency.

Related papers

• Micro-splatting: Maximizing Isotropic Constraints for Refined Optimization in 3D Gaussian Splatting [0.3749861135832072]
  This work implements an adaptive densification strategy that dynamically refines regions with high image gradients. It results in a denser and more detailed gaussian means where needed, without sacrificing rendering efficiency.
  arXiv  Detail & Related papers  (2025-04-08T07:15:58Z)
• FreeSplat++: Generalizable 3D Gaussian Splatting for Efficient Indoor Scene Reconstruction [50.534213038479926]
  FreeSplat++ is an alternative approach to large-scale indoor whole-scene reconstruction. Our method with depth-regularized per-scene fine-tuning demonstrates substantial improvements in reconstruction accuracy and a notable reduction in training time.
  arXiv  Detail & Related papers  (2025-03-29T06:22:08Z)
• COB-GS: Clear Object Boundaries in 3DGS Segmentation Based on Boundary-Adaptive Gaussian Splitting [67.03992455145325]
  3D segmentation based on 3D Gaussian Splatting (3DGS) struggles with accurately delineating object boundaries. We introduce Clear Object Boundaries for 3DGS (COB-GS), which aims to improve segmentation accuracy. For semantic guidance, we introduce a boundary-adaptive Gaussian splitting technique. For the visual optimization, we rectify the degraded texture of the 3DGS scene.
  arXiv  Detail & Related papers  (2025-03-25T08:31:43Z)
• Frequency-Aware Density Control via Reparameterization for High-Quality Rendering of 3D Gaussian Splatting [11.892334330536974]
  3D Gaussian Splatting (3DGS) can better represent scene details in high-frequency regions. 3DGS currently lacks an explicit constraint linking the density and scale of 3D Gaussians across the domain. We develop a frequency-aware density control strategy, consisting of densification and deletion, to improve representation quality.
  arXiv  Detail & Related papers  (2025-03-10T07:30:45Z)
• Efficient Density Control for 3D Gaussian Splatting [3.6379656024631215]
  We introduce a more efficient long-axis split operation to replace the original clone and split. We also propose a simple adaptive pruning technique to reduce the number of low-opacity Gaussians. We evaluate our proposed method on various challenging real-world datasets.
  arXiv  Detail & Related papers  (2024-11-15T12:12:56Z)
• MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields [73.49548565633123]
  Radiance fields represented by 3D Gaussians excel at synthesizing novel views, offering both high training efficiency and fast rendering. Existing methods often incorporate depth priors from dense estimation networks but overlook the inherent multi-view consistency in input images. We propose a view framework based on 3D Gaussian Splatting, named MCGS, enabling scene reconstruction from sparse input views.
  arXiv  Detail & Related papers  (2024-10-15T08:39:05Z)
• GaRField++: Reinforced Gaussian Radiance Fields for Large-Scale 3D Scene Reconstruction [1.7624442706463355]
  This paper proposes a novel framework for large-scale scene reconstruction based on 3D Gaussian splatting (3DGS) For tackling the scalability issue, we split the large scene into multiple cells, and the candidate point-cloud and camera views of each cell are correlated. We show that our method consistently generates more high-fidelity rendering results than state-of-the-art methods of large-scale scene reconstruction.
  arXiv  Detail & Related papers  (2024-09-19T13:43:31Z)
• MVG-Splatting: Multi-View Guided Gaussian Splatting with Adaptive Quantile-Based Geometric Consistency Densification [8.099621725105857]
  We introduce MVG-Splatting, a solution guided by Multi-View considerations. We propose an adaptive quantile-based method that dynamically determines the level of additional densification. This approach significantly enhances the overall fidelity and accuracy of the 3D reconstruction process.
  arXiv  Detail & Related papers  (2024-07-16T15:24:01Z)
• Gaussian Splatting with Localized Points Management [52.009874685460694]
  Localized Point Management (LPM) is capable of identifying those error-contributing zones in the highest demand for both point addition and geometry calibration. LPM applies point densification in the identified zone, whilst resetting the opacity of those points residing in front of these regions so that a new opportunity is created to correct ill-conditioned points. Notably, LPM improves both vanilla 3DGS and SpaceTimeGS to achieve state-of-the-art rendering quality while retaining real-time speeds.
  arXiv  Detail & Related papers  (2024-06-06T16:55:07Z)
• LP-3DGS: Learning to Prune 3D Gaussian Splatting [71.97762528812187]
  We propose learning-to-prune 3DGS, where a trainable binary mask is applied to the importance score that can find optimal pruning ratio automatically. Experiments have shown that LP-3DGS consistently produces a good balance that is both efficient and high quality.
  arXiv  Detail & Related papers  (2024-05-29T05:58:34Z)
• End-to-End Rate-Distortion Optimized 3D Gaussian Representation [33.20840558425759]
  We formulate the compact 3D Gaussian learning as an end-to-end Rate-Distortion Optimization problem. We introduce dynamic pruning and entropy-constrained vector quantization (ECVQ) that optimize the rate and distortion at the same time. We verify our method on both real and synthetic scenes, showcasing that RDO-Gaussian greatly reduces the size of 3D Gaussian over 40x.
  arXiv  Detail & Related papers  (2024-04-09T14:37:54Z)
• GaussianPro: 3D Gaussian Splatting with Progressive Propagation [49.918797726059545]
  3DGS relies heavily on the point cloud produced by Structure-from-Motion (SfM) techniques. We propose a novel method that applies a progressive propagation strategy to guide the densification of the 3D Gaussians. Our method significantly surpasses 3DGS on the dataset, exhibiting an improvement of 1.15dB in terms of PSNR.
  arXiv  Detail & Related papers  (2024-02-22T16:00:20Z)
• Towards Model Generalization for Monocular 3D Object Detection [57.25828870799331]
  We present an effective unified camera-generalized paradigm (CGP) for Mono3D object detection. We also propose the 2D-3D geometry-consistent object scaling strategy (GCOS) to bridge the gap via an instance-level augment. Our method called DGMono3D achieves remarkable performance on all evaluated datasets and surpasses the SoTA unsupervised domain adaptation scheme.
  arXiv  Detail & Related papers  (2022-05-23T23:05:07Z)
• The KFIoU Loss for Rotated Object Detection [115.334070064346]
  In this paper, we argue that one effective alternative is to devise an approximate loss who can achieve trend-level alignment with SkewIoU loss. Specifically, we model the objects as Gaussian distribution and adopt Kalman filter to inherently mimic the mechanism of SkewIoU. The resulting new loss called KFIoU is easier to implement and works better compared with exact SkewIoU.
  arXiv  Detail & Related papers  (2022-01-29T10:54:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.