HEMGS: A Hybrid Entropy Model for 3D Gaussian Splatting Data Compression

• URL: http://arxiv.org/abs/2411.18473v2
• Date: Tue, 22 Apr 2025 13:41:54 GMT
• Title: HEMGS: A Hybrid Entropy Model for 3D Gaussian Splatting Data Compression
• Authors: Lei Liu, Zhenghao Chen, Wei Jiang, Wei Wang, Dong Xu,
• Abstract summary: We introduce a novel Hybrid Entropy Model for 3D Gaussian Splatting (HEMGS) to achieve hybrid lossy-lossless compression.<n>It consists of three main components: a variable-rate predictor, a hyperprior network, and an autoregressive network.<n>HEMGS achieves about a 40% average reduction in size while maintaining rendering quality over baseline methods.
• Score: 25.820461699307042
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this work, we propose a novel compression framework for 3D Gaussian Splatting (3DGS) data. Building on anchor-based 3DGS methodologies, our approach compresses all attributes within each anchor by introducing a novel Hybrid Entropy Model for 3D Gaussian Splatting (HEMGS) to achieve hybrid lossy-lossless compression. It consists of three main components: a variable-rate predictor, a hyperprior network, and an autoregressive network. First, unlike previous methods that adopt multiple models to achieve multi-rate lossy compression, thereby increasing training overhead, our variable-rate predictor enables variable-rate compression with a single model and a hyperparameter $\lambda$ by producing a learned Quantization Step feature for versatile lossy compression. Second, to improve lossless compression, the hyperprior network captures both scene-agnostic and scene-specific features to generate a prior feature, while the autoregressive network employs an adaptive context selection algorithm with flexible receptive fields to produce a contextual feature. By integrating these two features, HEMGS can accurately estimate the distribution of the current coding element within each attribute, enabling improved entropy coding and reduced storage. We integrate HEMGS into a compression framework, and experimental results on four benchmarks indicate that HEMGS achieves about a 40% average reduction in size while maintaining rendering quality over baseline methods and achieving state-of-the-art compression results.

Related papers

• Arbitrary Ratio Feature Compression via Next Token Prediction [52.10426317889982]
  Arbitrary Ratio Feature Compression (ARFC) framework supports any compression ratio with a single model.<n>ARC is an auto-regressive model that performs compression via next-gressive prediction.<n>MoS module refines the compressed tokens by utilizing multiple compression results.<n>ERGC is integrated into the training process to preserve semantic and structural relationships during compression.
  arXiv  Detail & Related papers  (2026-02-12T02:38:57Z)
• CSGaussian: Progressive Rate-Distortion Compression and Segmentation for 3D Gaussian Splatting [57.73006852239138]
  We present the first unified framework for rate-distortion-optimized compression and segmentation of 3D Gaussian Splatting (3DGS)<n>Inspired by recent advances in rate-distortion-optimized 3DGS compression, this work integrates semantic learning into the compression pipeline to support decoder-side applications.<n>Our scheme features a lightweight implicit neural representation-based hyperprior, enabling efficient entropy coding of both color and semantic attributes.
  arXiv  Detail & Related papers  (2026-01-19T08:21:45Z)
• SCAR-GS: Spatial Context Attention for Residuals in Progressive Gaussian Splatting [0.37515646463759694]
  We introduce a novel progressive synthesis for 3D Gaussian Splatting that replaces traditional methods with a more powerful Residual Vector Quantization approach.<n>Our key contribution is an auto-regressive entropy model, guided by a multi-resolution hash grid, that accurately predicts the conditional probability of each successive transmitted index.
  arXiv  Detail & Related papers  (2026-01-07T19:34:51Z)
• Feed-Forward 3D Gaussian Splatting Compression with Long-Context Modeling [30.948753429414648]
  3DGS has emerged as a revolutionary 3D representation, but its substantial data size poses a major barrier to widespread adoption.<n>We propose a novel feed-forward 3DGS compression framework that effectively models long-range correlations.<n>Our method yields a $20times$ compression ratio for 3DGS in a feed-forward inference.
  arXiv  Detail & Related papers  (2025-11-30T12:51:43Z)
• TinySplat: Feedforward Approach for Generating Compact 3D Scene Representation [38.50388562890992]
  TinySplat is a complete feedforward approach for generating compact 3D scene representations.<n>Built upon standard feedforward 3DGS methods, TinySplat integrates a training-free compression framework.<n>Our framework requires only 25% of the encoding time and 1% of the decoding time.
  arXiv  Detail & Related papers  (2025-06-11T07:47:19Z)
• CompGS++: Compressed Gaussian Splatting for Static and Dynamic Scene Representation [60.712165339762116]
  CompGS++ is a novel framework that leverages compact Gaussian primitives to achieve accurate 3D modeling. Our design is based on the principle of eliminating redundancy both between and within primitives. Our implementation will be made publicly available on GitHub to facilitate further research.
  arXiv  Detail & Related papers  (2025-04-17T15:33:01Z)
• Enhancing 3D Gaussian Splatting Compression via Spatial Condition-based Prediction [24.061525432639943]
  We introduce the prediction technique into the anchor-based Gaussian representation to effectively reduce the bit rate. Our framework still achieves a bit rate savings of 24.42 percent.
  arXiv  Detail & Related papers  (2025-03-30T06:41:43Z)
• GoDe: Gaussians on Demand for Progressive Level of Detail and Scalable Compression [13.616981296093932]
  We propose a novel, model-agnostic technique that organizes Gaussians into several hierarchical layers. This method, combined with recent approach of compression of 3DGS, allows a single model to instantly scale across several compression ratios. We validate our approach on typical datasets and benchmarks, showcasing low distortion and substantial gains in terms of scalability and adaptability.
  arXiv  Detail & Related papers  (2025-01-23T11:05:45Z)
• A Hierarchical Compression Technique for 3D Gaussian Splatting Compression [23.785131033155924]
  3D Gaussian Splatting (GS) demonstrates excellent rendering quality and generation speed in novel view synthesis. Current 3D GS compression research primarily focuses on developing more compact scene representations. We propose a Hierarchical GS Compression (HGSC) technique to address this gap.
  arXiv  Detail & Related papers  (2024-11-11T13:34:24Z)
• Fast Feedforward 3D Gaussian Splatting Compression [55.149325473447384]
  3D Gaussian Splatting (FCGS) is an optimization-free model that can compress 3DGS representations rapidly in a single feed-forward pass. FCGS achieves a compression ratio of over 20X while maintaining fidelity, surpassing most per-scene SOTA optimization-based methods.
  arXiv  Detail & Related papers  (2024-10-10T15:13:08Z)
• ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Model [77.71796503321632]
  We introduce a context model in the anchor level for 3DGS representation, yielding an impressive size reduction of over 100 times compared to vanilla 3DGS. Our work pioneers the context model in the anchor level for 3DGS representation, yielding an impressive size reduction of over 100 times compared to vanilla 3DGS and 15 times compared to the most recent state-of-the-art work Scaffold-GS.
  arXiv  Detail & Related papers  (2024-05-31T09:23:39Z)
• CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting [68.94594215660473]
  We propose an efficient 3D scene representation, named Compressed Gaussian Splatting (CompGS) We exploit a small set of anchor primitives for prediction, allowing the majority of primitives to be encapsulated into highly compact residual forms. Experimental results show that the proposed CompGS significantly outperforms existing methods, achieving superior compactness in 3D scene representation without compromising model accuracy and rendering quality.
  arXiv  Detail & Related papers  (2024-04-15T04:50:39Z)
• HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compression [55.6351304553003]
  3D Gaussian Splatting (3DGS) has emerged as a promising framework for novel view synthesis. We propose a Hash-grid Assisted Context (HAC) framework for highly compact 3DGS representation. Our work is the pioneer to explore context-based compression for 3DGS representation, resulting in a remarkable size reduction of over $75times$ compared to vanilla 3DGS.
  arXiv  Detail & Related papers  (2024-03-21T16:28:58Z)
• GAN Slimming: All-in-One GAN Compression by A Unified Optimization Framework [94.26938614206689]
  We propose the first unified optimization framework combining multiple compression means for GAN compression, dubbed GAN Slimming. We apply GS to compress CartoonGAN, a state-of-the-art style transfer network, by up to 47 times, with minimal visual quality degradation.
  arXiv  Detail & Related papers  (2020-08-25T14:39:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.