ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes

• URL: http://arxiv.org/abs/2609.01740v1
• Date: Tue, 01 Sep 2026 18:07:49 GMT
• Title: ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes
• Abstract summary: ZipTok3D is a 3D tokenizer designed for high-fidelity reconstruction from extremely short token sequences.<n>With the same token dimension, ZipTok3D achieves reconstruction quality comparable to the 32-token COD-VAE baseline.
• Score: 38.735159381505014
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Compact token sequences are essential for efficient 3D generation. However, existing 3D tokenizers typically organize latent representations either over spatial regions or as fixed-size sets of global tokens, both suffering sharp reconstruction degradation when compressed to extremely low token budgets. In this paper, we present ZipTok3D, a 3D tokenizer designed for high-fidelity reconstruction from extremely short token sequences. Its key idea is to organize object geometry into progressively informative global-token prefixes and unfold these compact representations through iterative decoding. Specifically, nested dropout randomly truncates the latent sequence after encoding during training and requires each retained prefix to reconstruct the complete object, thereby prioritizing essential geometric information in the leading tokens. The decoder then repeatedly applies a parameter-shared Transformer block to recover fine-grained geometry from each prefix without a separate generative sampling stage. With the same token dimension, ZipTok3D achieves reconstruction quality comparable to the 32-token COD-VAE baseline using only one token on ShapeNet and four on TRELLIS, yielding $32\times$ and $8\times$ shorter token sequences, respectively.

Related papers

• 3DZip: Spatial-Aware Feature Diversity-Guided Token Compression for 3D Question Answering [8.79576142391319]
  Recent 3D vision-language models construct geometry aware tokens by projecting 2D visual features into world coordinates.<n>This design generates thousands of tokens per scene, resulting in substantial computational and memory overhead.<n>We propose 3DZip, a three-stage token compression framework that first applies coarse voxelization to remove point-level redundancy, then selects anchor tokens based on feature-space diversity, and finally merges remaining tokens under spatial constraints to preserve geometric coherence.
  arXiv  Detail & Related papers  (2026-08-02T12:11:51Z)
• DynaTok: Token-Based 4D Reconstruction from Partial Point Clouds [86.5916611076068]
  DynaTok is a point-based framework for correspondence-free 4D reconstruction from partial point sequences without images.<n>A flow-matching decoder then reconstructs complete, temporally consistent 4D point-temporal observations.
  arXiv  Detail & Related papers  (2026-06-10T15:13:14Z)
• Spark3R: Asymmetric Token Reduction Makes Fast Feed-Forward 3D Reconstruction [47.55355615080919]
  Feed-forward 3D reconstruction models based on Vision Transformers can estimate scene geometry and camera poses from a small set of input images.<n>Scaling them to video inputs with hundreds or thousands of frames remains challenging due to the quadratic cost of global attention layers.<n>We propose Spark3R, a training-free acceleration framework that decouples the compression of query tokens and key-value tokens.<n>As a plug-and-play framework requiring no retraining, Spark3R integrates directly into multiple pretrained feed-forward 3D reconstruction models.
  arXiv  Detail & Related papers  (2026-05-07T13:45:37Z)
• LoST: Level of Semantics Tokenization for 3D Shapes [50.847769883816085]
  State-of-the-art methods rely on geometric level-of-detail (LoD) hierarchies, originally designed for rendering and compression.<n>We propose Level-of-Semantics Tokenization (LoST), which orders salience, such that early prefixes decode complete, plausible shapes.<n>LoST achieves SOTA reconstruction, surpassing previous LoD-based 3D shape tokenizers by large margins on both geometric and semantic reconstruction metrics.
  arXiv  Detail & Related papers  (2026-03-18T17:56:06Z)
• SceneTok: A Compressed, Diffusable Token Space for 3D Scenes [18.094424146923892]
  We present SceneTok, a novel tokenizer for encoding view sets of scenes into a compressed and diffusable set of unstructured tokens.<n>We show that the compression is 1-3 orders of magnitude stronger than for other representations while still reaching state-of-the-art reconstruction quality.
  arXiv  Detail & Related papers  (2026-02-21T16:08:17Z)
• How Many Tokens Do 3D Point Cloud Transformer Architectures Really Need? [56.09721366421187]
  We present the finding that tokens are remarkably redundant, leading to substantial inefficiency.<n>We introduce gitmerge3D, a globally informed graph token merging method that can reduce the token count by up to 90-95%.<n>This work is the first to assess redundancy in large-scale 3D transformer models, providing insights into the development of more efficient 3D foundation architectures.
  arXiv  Detail & Related papers  (2025-11-07T17:38:01Z)
• Self-Supervised and Generalizable Tokenization for CLIP-Based 3D Understanding [87.68271178167373]
  We present a universal 3D tokenizer designed for scale-invariant representation learning with a frozen CLIP backbone.<n>S4Token is a tokenization pipeline that produces semantically-informed tokens regardless of scene scale.
  arXiv  Detail & Related papers  (2025-05-24T18:26:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.