CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation

• URL: http://arxiv.org/abs/2605.20872v1
• Date: Wed, 20 May 2026 08:08:39 GMT
• Title: CAdam: Context-Adaptive Moment Estimation for 3D Gaussian Densification in Generative Distillation
• Abstract summary: We introduce Context-Adaptive Moment Estimation (CAdam) to solve the Densification Dilemma.<n>CAdam reduces Gaussian count by 85%-97% relative to standard densification while preserving overall comparable quality.<n>These results highlight signal-aware density control as a practical way to improve memory efficiency in optimization-based generative distillation.
• Score: 3.4998703934432682
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Adaptive densification is the engine of 3D Gaussian Splatting (3DGS). However, when transposed to the optimization-based Generative Distillation paradigm, this reconstruction-native mechanism reveals fundamental limitations, resulting in inefficient representations cluttered with redundant primitives. We diagnose this failure as a Densification Dilemma stemming from the stochastic nature of generative guidance: the standard magnitude-based accumulation indiscriminately aggregates transient noise alongside geometric signals, making it difficult to strike a balance between over-densification and under-fitting. To resolve this, we introduce Context-Adaptive Moment Estimation (CAdam), a novel framework that reinterprets densification as a statistically grounded signal verification problem. CAdam leverages the first moment of gradients to exploit the interference principle, where stochastic fluctuations cancel out via destructive interference while consistent geometric drifts accumulate via constructive interference, effectively disentangling the underlying signal from the generative noise floor. This is further augmented by a quantile-based context awareness and an intrinsic Signal-to-Noise Ratio (SNR) gating mechanism, which ensure robust adaptation across optimization stages and enable the soft termination of densification. Extensive experiments across diverse objectives (SDS, ISM, VFDS) and strong generative 3DGS backbones show that CAdam reduces Gaussian count by 85%-97% relative to standard densification while preserving overall comparable perceptual quality. These results highlight signal-aware density control as a practical way to improve memory efficiency in optimization-based generative distillation.

Related papers

• Interleaved Noise Injection Improves Clean, Corrupted, and OOD Performance [1.6567880228735357]
  We present a theoretical analysis of noise injection, which confirms that corruption by impulse noise approximates a Jacobian regularization.<n>We show that the effect of interleaved noise injection stems from penalizing the failure modes encouraged by the inductive bias of the models.<n>Interleaved noise injection is therefore an effective tool to improve the test performance on clean, noisy, and out-of-distribution data at essentially zero computational cost.
  arXiv  Detail & Related papers  (2026-07-16T01:25:44Z)
• Projection-Volume Fidelity Divergence: Diagnosing and Controlling Optimization Drift in Sparse-View 3D Gaussian Tomography [11.284905409634957]
  We propose LADES, a ground-truth-free optimization controller for sparse-view Gaussian tomography.<n>Experiments on sparse-view CT reconstruction show that LADES improves volumetric fidelity, suppresses structural degeneration, and substantially reduces training time.
  arXiv  Detail & Related papers  (2026-06-21T14:24:02Z)
• Denoising-GS: Gaussian Splatting with Spatial-aware Denoising [59.331050242447255]
  3D Gaussian Splatting (3DGS) has achieved remarkable success in high-fidelity Novel View Synthesis (NVS)<n>We introduce a new perspective by formulating the optimization of 3DGS as a primitive denoising process.<n>We propose Denoising-GS, a coherent denoising framework for primitives by taking both the positions and spatial structure into consideration.<n> Experiments conducted on three benchmark datasets demonstrate that Denoising-GS consistently enhances NVS fidelity while maintaining representation compactness.
  arXiv  Detail & Related papers  (2026-05-14T14:24:21Z)
• DOC-GS: Dual-Domain Observation and Calibration for Reliable Sparse-View Gaussian Splatting [80.43237927269575]
  In this paper, we revisit sparse-view 3DGS reconstruction from a new perspective.<n>We identify the core challenge as the unobservability of Gaussian primitive reliability.<n>Motivated by this observation, we propose a unified Dual-domain Observation and geometrics in rendered images framework.
  arXiv  Detail & Related papers  (2026-04-08T07:01:24Z)
• 3DGS-HPC: Distractor-free 3D Gaussian Splatting with Hybrid Patch-wise Classification [80.43401018217367]
  3D Gaussian Splatting (3DGS) has demonstrated remarkable performance in novel view synthesis and 3D scene reconstruction.<n>Its quality often degrades in real-world environments due to transient distractors, such as moving objects and varying shadows.<n>Existing methods rely on semantic cues extracted from pre-trained vision models to identify and suppress these distractors.<n>We propose 3DGS- HPC, a framework that circumvents these limitations by combining two complementary principles.
  arXiv  Detail & Related papers  (2026-03-08T11:16:30Z)
• ERGO: Excess-Risk-Guided Optimization for High-Fidelity Monocular 3D Gaussian Splatting [63.138778159026934]
  We propose an adaptive optimization framework guided by excess risk decomposition, termed ERGO.<n> ERGO dynamically estimates the view-specific excess risk and adaptively adjust loss weights during optimization.<n>Experiments on the Google Scanned Objects dataset and the OmniObject3D dataset demonstrate the superiority of ERGO over existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2026-02-10T20:44:43Z)
• AD-GS: Alternating Densification for Sparse-Input 3D Gaussian Splatting [6.696418686121452]
  3D Gaussian Splatting (3DGS) has shown impressive results in real-time novel view synthesis.<n>We find that a key contributing factor is uncontrolled densification, where adding primitives rapidly without guidance can harm geometry and cause artifacts.<n>We propose AD-GS, a novel alternating densification framework that interleaves high and low densification phases.
  arXiv  Detail & Related papers  (2025-09-13T23:05:49Z)
• Metropolis-Hastings Sampling for 3D Gaussian Reconstruction [31.840492077537018]
  We propose an adaptive sampling framework for 3D Gaussian Splatting (3DGS)<n>Our framework overcomes limitations by reformulating densification and pruning as a probabilistic sampling process.<n>Our approach achieves faster convergence while matching or modestly surpassing the view-synthesis quality of state-of-the-art models.
  arXiv  Detail & Related papers  (2025-06-15T19:12:37Z)
• Steepest Descent Density Control for Compact 3D Gaussian Splatting [72.54055499344052]
  3D Gaussian Splatting (3DGS) has emerged as a powerful real-time, high-resolution novel view.<n>We propose a theoretical framework that demystifies and improves density control in 3DGS.<n>We introduce SteepGS, incorporating steepest density control, a principled strategy that minimizes loss while maintaining a compact point cloud.
  arXiv  Detail & Related papers  (2025-05-08T18:41:38Z)
• Uncertainty-Aware Normal-Guided Gaussian Splatting for Surface Reconstruction from Sparse Image Sequences [21.120659841877508]
  3D Gaussian Splatting (3DGS) has achieved impressive rendering performance in novel view synthesis.<n>We propose Uncertainty-aware Normal-Guided Gaussian Splatting (UNG-GS) to quantify geometric uncertainty within the 3DGS pipeline.<n>UNG-GS significantly outperforms state-of-the-art methods in both sparse and dense sequences.
  arXiv  Detail & Related papers  (2025-03-14T08:18:12Z)
• Revising Densification in Gaussian Splatting [23.037676471903215]
  We introduce a pixel-error driven formulation for density control in 3DGS, leveraging an auxiliary, per-pixel error function as the criterion for densification. Our approach leads to consistent quality improvements across a variety of benchmark scenes, without sacrificing the method's efficiency.
  arXiv  Detail & Related papers  (2024-04-09T08:20:37Z)
• DiffusionAD: Norm-guided One-step Denoising Diffusion for Anomaly Detection [80.20339155618612]
  DiffusionAD is a novel anomaly detection pipeline comprising a reconstruction sub-network and a segmentation sub-network.<n>A rapid one-step denoising paradigm achieves hundreds of times acceleration while preserving comparable reconstruction quality.<n>Considering the diversity in the manifestation of anomalies, we propose a norm-guided paradigm to integrate the benefits of multiple noise scales.
  arXiv  Detail & Related papers  (2023-03-15T16:14:06Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.