ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion
- URL: http://arxiv.org/abs/2607.20417v2
- Date: Tue, 28 Jul 2026 04:32:19 GMT
- Title: ATSplat: Compact Feed-forward 3D Gaussian Splatting with Adaptive Token Expansion
- Abstract summary: ATSplat is a feed-forward 3DGS framework that restores the adaptive allocation capability of 3DGS optimization.<n>From 12 input images at $512 times 960$ resolution, ATSplat completes reconstruction in less than a second using a single commercial GPU.
- Score: 60.00320387969695
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: 3D Gaussian Splatting (3DGS) achieves high-quality novel-view synthesis by optimizing freely placed primitives in 3D and adaptively densifying them in under-reconstructed regions. However, this scene-adaptive capacity allocation is largely lost in existing feed-forward 3DGS methods, which commonly regress Gaussians at input pixels and lift them along camera rays. Such pixel-aligned formulations make the number and placement of primitives depend on image resolution and input viewpoints rather than scene complexity, resulting in dense and often redundant Gaussian sets. We present ATSplat, a feed-forward 3DGS framework that restores the adaptive allocation capability of 3DGS optimization through Adaptive 3D Tokens. ATSplat first lifts coarse patch-level depth and camera cues into sparse 3D anchor tokens, forming a compact scaffold of the scene. Each token is then regressed into local Gaussians with learnable 3D offsets, decoupling primitive placement from input image grids. An Adaptive Token Expansion module predicts a token-level uncertainty score, supervised by rendering error maps, and selectively expands high-uncertainty tokens through learnable expansion layers. This sparse-to-adaptive formulation enables ATSplat to concentrate primitives in challenging regions while maintaining a compact representation. Experiments on two representative datasets, RealEstate10K and DL3DV, show that ATSplat achieves state-of-the-art rendering quality while reducing the number of Gaussians by more than $5.7\times$ compared with dense feed-forward 3DGS methods. From 12 input images at $512 \times 960$ resolution, ATSplat completes reconstruction in less than a second using a single commercial GPU, and renders high-quality novel views at 1136 FPS ($512 \times 960$) with only 311K Gaussians.
Related papers
- CodecSplat: Ultra-Compact Latent Coding for Feed-Forward 3D Gaussian Splatting [53.50198425973128]
We introduce CodecSplat, an ultracompact latent coding framework for feed-forward 3D Gaussian splatting.<n>CodecSplat achieves 23.56-26.36 dB and 24.76-27.05 dB with only 20.00-10777 PSNR with 3.37-12 and 3.37-12 respectively.
arXiv Detail & Related papers (2026-05-25T08:17:35Z) - AnchorSplat: Feed-Forward 3D Gaussian Splatting with 3D Geometric Priors [23.943522711585597]
We propose AnchorSplat, a novel feed-forward 3DGS framework for scene-level reconstruction.<n> anchor-aligned Gaussian representation guided by 3D geometric priors.<n>Design substantially reduces the number of required Gaussians.
arXiv Detail & Related papers (2026-04-08T13:04:54Z) - SparseSplat: Towards Applicable Feed-Forward 3D Gaussian Splatting with Pixel-Unaligned Prediction [30.232615052359673]
SparseSplat is the first feed-forward 3DGS model that adjusts Gaussian density according to scene structure and information richness of local regions.<n>We show that SparseSplat can achieve state-of-the-art rendering quality with only 22% of the Gaussians and maintain reasonable rendering quality with only 1.5% of the Gaussians.
arXiv Detail & Related papers (2026-04-03T14:48:33Z) - GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting [50.2045409672451]
3D Gaussian Splatting (3DGS) has demonstrated breakthrough performance in novel view synthesis and real-time rendering.<n>It is constrained by the high memory cost due to a huge number of Gaussian points.<n>We propose graph-based spatial distribution optimization for compact 3DGS.
arXiv Detail & Related papers (2026-04-02T10:41:51Z) - FlexGS: Train Once, Deploy Everywhere with Many-in-One Flexible 3D Gaussian Splatting [57.97160965244424]
3D Gaussian splatting (3DGS) has enabled various applications in 3D scene representation and novel view synthesis.<n>Previous approaches have focused on pruning less important Gaussians, effectively compressing 3DGS.<n>We present an elastic inference method for 3DGS, achieving substantial rendering performance without additional fine-tuning.
arXiv Detail & Related papers (2025-06-04T17:17:57Z) - CAT-3DGS: A Context-Adaptive Triplane Approach to Rate-Distortion-Optimized 3DGS Compression [10.869104603083676]
3D Gaussian Splatting (3DGS) has recently emerged as a promising 3D representation.<n>The needs to compress and transmit the 3DGS representation to the remote side are overlooked.<n>This new application calls for rate-distortion-optimized 3DGS compression.
arXiv Detail & Related papers (2025-03-01T05:42:52Z) - EfficientGS: Streamlining Gaussian Splatting for Large-Scale High-Resolution Scene Representation [29.334665494061113]
'EfficientGS' is an advanced approach that optimize 3DGS for high-resolution, large-scale scenes.
We analyze the densification process in 3DGS and identify areas of Gaussian over-proliferation.
We propose a selective strategy, limiting Gaussian increase to key redundant primitives, thereby enhancing the representational efficiency.
arXiv Detail & Related papers (2024-04-19T10:32:30Z) - CompGS: Efficient 3D Scene Representation via Compressed Gaussian Splatting [68.94594215660473]
We propose an efficient 3D scene representation, named Compressed Gaussian Splatting (CompGS)
We exploit a small set of anchor primitives for prediction, allowing the majority of primitives to be encapsulated into highly compact residual forms.
Experimental results show that the proposed CompGS significantly outperforms existing methods, achieving superior compactness in 3D scene representation without compromising model accuracy and rendering quality.
arXiv Detail & Related papers (2024-04-15T04:50:39Z) - LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPS [55.85673901231235]
We introduce LightGaussian, a method for transforming 3D Gaussians into a more compact format.
Inspired by Network Pruning, LightGaussian identifies Gaussians with minimal global significance on scene reconstruction.
LightGaussian achieves an average 15x compression rate while boosting FPS from 144 to 237 within the 3D-GS framework.
arXiv Detail & Related papers (2023-11-28T21:39:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.