SafeguardGS: 3D Gaussian Primitive Pruning While Avoiding Catastrophic Scene Destruction

• URL: http://arxiv.org/abs/2405.17793v2
• Date: Fri, 22 Nov 2024 23:43:24 GMT
• Title: SafeguardGS: 3D Gaussian Primitive Pruning While Avoiding Catastrophic Scene Destruction
• Abstract summary: This paper is the first to categorize 3DGS pruning techniques into two types: Scene-level pruning and Pixel-level pruning. Experiments show that pixel-level pruning provides an inherent boundary of pruning, i.e., a safeguard of Gaussian pruning. We believe our research provides valuable insights for optimizing 3DGS for future works.
• Score: 45.654397516679495
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 3D Gaussian Splatting (3DGS) has made significant strides in novel view synthesis. However, its suboptimal densification process results in the excessively large number of Gaussian primitives, which impacts frame-per-second and increases memory usage, making it unsuitable for low-end devices. To address this issue, many follow-up studies have proposed various pruning techniques with score functions designed to identify and remove less important primitives. Nonetheless, a comprehensive discussion of their effectiveness and implications across all techniques is missing. In this paper, we are the first to categorize 3DGS pruning techniques into two types: Scene-level pruning and Pixel-level pruning, distinguished by their scope for ranking primitives. Our subsequent experiments reveal that, while scene-level pruning leads to disastrous quality drops under extreme decimation of Gaussian primitives, pixel-level pruning not only sustains relatively high rendering quality with minuscule performance degradation but also provides an inherent boundary of pruning, i.e., a safeguard of Gaussian pruning. Building on this observation, we further propose multiple variations of score functions based on the factors of rendering equations and discover that assessing based on color similarity with blending weight is the most effective method for discriminating insignificant primitives. In our experiments, our SafeguardGS with the optimal score function shows the highest PSNR-per-primitive performance under an extreme pruning setting, retaining only about 10% of the primitives from the original 3DGS scene (i.e., 10x compression ratio). We believe our research provides valuable insights for optimizing 3DGS for future works.

Related papers

• REFINE: Super-efficient 3D Gaussian Splatting Pruning via Rendering-Free Primitive Importance [58.94345609736356]
  REFINE is a highly accelerated 3DGS pruning framework centered on a novel rendering-free primitive importance metric.<n>Experiments across multiple benchmark datasets demonstrate that REFINE maintains highly competitive rendering quality.
  arXiv  Detail & Related papers  (2026-06-08T06:16:38Z)
• PointSplat: Efficient Geometry-Driven Pruning and Transformer Refinement for 3D Gaussian Splatting [2.5823344978857388]
  3D Gaussian Splatting has recently unlocked real-time, high-fidelity novel view synthesis by representing scenes using explicit 3D primitives.<n>Traditional methods often require millions of Gaussians to capture complex scenes, leading to significant memory and storage demands.<n>Recent approaches have addressed this issue through pruning and per-scene fine-tuning of Gaussian parameters, thereby reducing the model size while maintaining visual quality.
  arXiv  Detail & Related papers  (2026-04-10T20:56:18Z)
• Gradient-Driven Natural Selection for Compact 3D Gaussian Splatting [3.6626434111127075]
  3DGS employs a large number of Gaussian primitives to fit scenes, resulting in substantial storage and computational overhead.<n>We propose an natural selection inspired pruning framework that models survival pressure as a regularization gradient field applied to opacity.<n>Our method achieves over 0.6 dB PSNR gain under 15% budgets, establishing state-of-the-art performance for compact 3DGS.
  arXiv  Detail & Related papers  (2025-11-21T06:27:46Z)
• ConeGS: Error-Guided Densification Using Pixel Cones for Improved Reconstruction with Fewer Primitives [27.616880434926646]
  3D Gaussian Splatting achieves state-of-the-art image quality and real-time performance in novel view synthesis.<n>Issue stems from cloning-based densification, which propagates Gaussians along existing geometry.<n>We present ConeGS, an image-space-informed densification framework that is independent of existing scene geometry state.
  arXiv  Detail & Related papers  (2025-11-10T07:54:58Z)
• UGOD: Uncertainty-Guided Differentiable Opacity and Soft Dropout for Enhanced Sparse-View 3DGS [8.78995910690481]
  3D Gaussian Splatting (3DGS) has become a competitive approach for novel view synthesis (NVS)<n>We investigate how adaptive weighting of Gaussians affects rendering quality, which is characterised by learned uncertainties proposed.<n>Our method achieves 3.27% PSNR improvements on the MipNeRF 360 dataset.
  arXiv  Detail & Related papers  (2025-08-07T01:42:22Z)
• Low-Frequency First: Eliminating Floating Artifacts in 3D Gaussian Splatting [22.626200397052862]
  3D Gaussian Splatting (3DGS) is a powerful representation for 3D reconstruction.<n>3DGS often produces floating artifacts, which are erroneous structures detached from the actual geometry.<n>We propose EFA-GS, which selectively expands under-optimized Gaussians to prioritize accurate low-frequency learning.
  arXiv  Detail & Related papers  (2025-08-04T15:03:56Z)
• Gaussian Herding across Pens: An Optimal Transport Perspective on Global Gaussian Reduction for 3DGS [15.072715525951526]
  We propose a novel optimal transport perspective that casts 3DGS compaction as global Gaussian mixture reduction.<n>Specifically, we first minimize the composite transport divergence over a KD-tree partition to produce a compact geometric representation.<n>Our method is applicable to any stage of vanilla or accelerated 3DGS pipelines, providing an efficient and agnostic pathway to lightweight neural rendering.
  arXiv  Detail & Related papers  (2025-06-11T09:04:44Z)
• Steepest Descent Density Control for Compact 3D Gaussian Splatting [72.54055499344052]
  3D Gaussian Splatting (3DGS) has emerged as a powerful real-time, high-resolution novel view.<n>We propose a theoretical framework that demystifies and improves density control in 3DGS.<n>We introduce SteepGS, incorporating steepest density control, a principled strategy that minimizes loss while maintaining a compact point cloud.
  arXiv  Detail & Related papers  (2025-05-08T18:41:38Z)
• ProtoGS: Efficient and High-Quality Rendering with 3D Gaussian Prototypes [81.48624894781257]
  3D Gaussian Splatting (3DGS) has made significant strides in novel view synthesis but is limited by the substantial number of Gaussian primitives required. Recent methods address this issue by compressing the storage size of densified Gaussians, yet fail to preserve rendering quality and efficiency. We propose ProtoGS to learn Gaussian prototypes to represent Gaussian primitives, significantly reducing the total Gaussian amount without sacrificing visual quality.
  arXiv  Detail & Related papers  (2025-03-21T18:55:14Z)
• Improving Adaptive Density Control for 3D Gaussian Splatting [3.2248805768155835]
  3D Gaussian Splatting is one of the most influential works in the past year. It faces challenges to properly manage the number of Gaussian primitives that are used during scene reconstruction. We propose three new improvements to the adaptive density control mechanism.
  arXiv  Detail & Related papers  (2025-03-18T14:09:10Z)
• Mipmap-GS: Let Gaussians Deform with Scale-specific Mipmap for Anti-aliasing Rendering [81.88246351984908]
  We propose a unified optimization method to make Gaussians adaptive for arbitrary scales. Inspired by the mipmap technique, we design pseudo ground-truth for the target scale and propose a scale-consistency guidance loss to inject scale information into 3D Gaussians. Our method outperforms 3DGS in PSNR by an average of 9.25 dB for zoom-in and 10.40 dB for zoom-out.
  arXiv  Detail & Related papers  (2024-08-12T16:49:22Z)
• PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splatting [59.277480452459315]
  We propose a principled spatial sensitivity pruning score that outperforms current approaches. We also propose a multi-round prune-refine pipeline that can be applied to any pretrained 3D-GS model. Our pipeline increases the average rendering speed of 3D-GS by 2.65$times$ while retaining more salient foreground information.
  arXiv  Detail & Related papers  (2024-06-14T17:53:55Z)
• LP-3DGS: Learning to Prune 3D Gaussian Splatting [71.97762528812187]
  We propose learning-to-prune 3DGS, where a trainable binary mask is applied to the importance score that can find optimal pruning ratio automatically. Experiments have shown that LP-3DGS consistently produces a good balance that is both efficient and high quality.
  arXiv  Detail & Related papers  (2024-05-29T05:58:34Z)
• EfficientGS: Streamlining Gaussian Splatting for Large-Scale High-Resolution Scene Representation [29.334665494061113]
  'EfficientGS' is an advanced approach that optimize 3DGS for high-resolution, large-scale scenes. We analyze the densification process in 3DGS and identify areas of Gaussian over-proliferation. We propose a selective strategy, limiting Gaussian increase to key redundant primitives, thereby enhancing the representational efficiency.
  arXiv  Detail & Related papers  (2024-04-19T10:32:30Z)
• AbsGS: Recovering Fine Details for 3D Gaussian Splatting [10.458776364195796]
  3D Gaussian Splatting (3D-GS) technique couples 3D primitives with differentiable Gaussianization to achieve high-quality novel view results. However, 3D-GS frequently suffers from over-reconstruction issue in intricate scenes containing high-frequency details, leading to blurry rendered images. We present a comprehensive analysis of the cause of aforementioned artifacts, namely gradient collision. Our strategy efficiently identifies large Gaussians in over-reconstructed regions, and recovers fine details by splitting.
  arXiv  Detail & Related papers  (2024-04-16T11:44:12Z)
• CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting [68.94594215660473]
  We propose an efficient 3D scene representation, named Compressed Gaussian Splatting (CompGS) We exploit a small set of anchor primitives for prediction, allowing the majority of primitives to be encapsulated into highly compact residual forms. Experimental results show that the proposed CompGS significantly outperforms existing methods, achieving superior compactness in 3D scene representation without compromising model accuracy and rendering quality.
  arXiv  Detail & Related papers  (2024-04-15T04:50:39Z)
• GaussianPro: 3D Gaussian Splatting with Progressive Propagation [49.918797726059545]
  3DGS relies heavily on the point cloud produced by Structure-from-Motion (SfM) techniques. We propose a novel method that applies a progressive propagation strategy to guide the densification of the 3D Gaussians. Our method significantly surpasses 3DGS on the dataset, exhibiting an improvement of 1.15dB in terms of PSNR.
  arXiv  Detail & Related papers  (2024-02-22T16:00:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.