Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction

• URL: http://arxiv.org/abs/2607.01928v1
• Date: Thu, 02 Jul 2026 09:23:23 GMT
• Title: Sparse-Aware Vector Quantization for Bandwidth-Efficient Collaborative 3D Semantic Occupancy Prediction
• Abstract summary: Collaborative perception extends single-agent perception by enabling multiple vehicles to exchange complementary perceptual information.<n>Existing methods typically compress 3D features into 2D, causing severe spatial information loss.<n>We propose a bandwidth-efficient collaborative Vector Quantization Semantic Occupancy Prediction framework.<n>Our approach achieves state-of-the-art performance while reducing communication volume by up to 82x.
• Score: 5.902824856447626
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Collaborative perception extends single-agent perception by enabling multiple vehicles to exchange complementary perceptual information. However, it introduces an inherent trade-off between perception gain and communication overhead, which is particularly severe for 3D semantic occupancy prediction that relies on fine-grained spatial structures. Existing methods typically compress 3D features into 2D, causing severe spatial information loss, or transmit dense 3D representations, hindering real-world deployment. To overcome these limitations, we propose a bandwidth-efficient collaborative Vector Quantization Semantic Occupancy Prediction (VQSOP) framework. VQSOP employs a Sparse-Aware Vector Quantization (SAVQ) mechanism that exploits 3D scene sparsity to compactly encode informative regions, drastically reducing communication overhead while preserving complete geometric context. Furthermore, to enhance structural consistency and feature continuity, we design a Dual-Branch Adaptive Spatial Refinement (ASR) module that dynamically fuses local high-frequency details with broad contextual semantics. Extensive experiments demonstrate that our approach achieves state-of-the-art performance while reducing communication volume by up to 82x.

Related papers

• FDR-Occ: Factorized Dense Routing for Full-Spectrum 3D Occupancy Prediction [63.738631229597274]
  Vision-based 3D occupancy prediction fundamentally relies on the 2D-to-3D view transformation.<n>Current paradigms predominantly utilize explicit physical projection, which artificially restricts the routing matrix to strict, sparse camera rays.<n>We propose Factorized Dense Routing (FDR) to break this bottleneck.<n>Our framework achieves state-the-art performance on the Occ3D-nuScenes and Occ3D-Waymo benchmarks.
  arXiv  Detail & Related papers  (2026-07-04T11:12:42Z)
• SpaceEra++: A Unified Framework Towards 3D Spatial Reasoning in Video [88.79625979053873]
  We propose a novel framework, SpaceEra, for pre-trained vision-language models (VLMs)<n>We extend the original framework into a comprehensive system, termed SpaceEra++, which spans data construction, model design, training optimization, and prompting inference.<n>In addition, to enhance spatial reasoning, we develop SpaceAlign, which enforces pairwise object constraints by jointly exploiting absolute coordinates and relative spatial relations.
  arXiv  Detail & Related papers  (2026-07-02T06:56:29Z)
• UnsOcc: 3D Semantic Occupancy Prediction in Unstructured Scene via Rendering Fusion [2.4196046716427393]
  UnsOcc is a multi-modal 3D semantic occupancy prediction framework that improves robustness in unstructured environments.<n>At its core, we introduce a rendering-based fusion module, RenderFusion, which enhances cross-modal feature alignment.<n>Our method significantly outperforms existing state-of-the-art approaches.
  arXiv  Detail & Related papers  (2026-06-02T12:50:14Z)
• SUG-Occ: An Explicit Semantics and Uncertainty Guided Sparse Learning Framework for Real-Time 3D Occupancy Prediction [5.730573889498275]
  We propose SUG-Occ, an explicit Semantics and Uncertainty Guided Sparse Learning Enabled 3D Occupancy Prediction Framework.<n>We first utilize semantic and uncertainty priors to suppress projections from free space during view transformation.<n>We then employ an explicit unsigned distance encoding to enhance geometric consistency, producing a structurally consistent sparse 3D representation.
  arXiv  Detail & Related papers  (2026-01-16T16:07:38Z)
• MCOP: Multi-UAV Collaborative Occupancy Prediction [40.58729551462363]
  Current Bird's Eye View (BEV)-based approaches exhibit two main limitations.<n>We propose a novel multi-UAV collaborative occupancy prediction framework.<n>Our method achieves state-of-the-art accuracy, significantly outperforming existing collaborative methods.
  arXiv  Detail & Related papers  (2025-10-14T16:17:42Z)
• Semantic Causality-Aware Vision-Based 3D Occupancy Prediction [63.752869043357585]
  Vision-based 3D semantic occupancy prediction is a critical task in 3D vision.<n>Existing methods, however, often rely on modular pipelines.<n>We propose a novel causal loss that enables holistic, end-to-end supervision of the modular 2D-to-3D transformation pipeline.
  arXiv  Detail & Related papers  (2025-09-10T08:29:22Z)
• Vision-Only Gaussian Splatting for Collaborative Semantic Occupancy Prediction [12.80732853899807]
  Collaborative perception enables connected vehicles to share information.<n>Existing vision-only methods for 3D semantic occupancy prediction commonly rely on dense 3D voxels.<n>We propose the first approach leveraging sparse 3D semantic Gaussian splatting for collaborative 3D semantic occupancy prediction.
  arXiv  Detail & Related papers  (2025-08-12T19:50:34Z)
• Ultra3D: Efficient and High-Fidelity 3D Generation with Part Attention [54.15345846343084]
  We propose Ultra3D, an efficient 3D generation framework that significantly accelerates sparse voxel modeling without compromising quality.<n>Part Attention is a geometry-aware localized attention mechanism that restricts attention computation within semantically consistent part regions.<n>Experiments demonstrate that Ultra3D supports high-resolution 3D generation at 1024 resolution and achieves state-of-the-art performance in both visual fidelity and user preference.
  arXiv  Detail & Related papers  (2025-07-23T17:57:16Z)
• CompGS++: Compressed Gaussian Splatting for Static and Dynamic Scene Representation [60.712165339762116]
  CompGS++ is a novel framework that leverages compact Gaussian primitives to achieve accurate 3D modeling.<n>Our design is based on the principle of eliminating redundancy both between and within primitives.<n>Our implementation will be made publicly available on GitHub to facilitate further research.
  arXiv  Detail & Related papers  (2025-04-17T15:33:01Z)
• Which2comm: An Efficient Collaborative Perception Framework for 3D Object Detection [5.195291754828701]
  Collaborative perception allows real-time inter-agent information exchange.<n>limited communication bandwidth in practical scenarios restricts the inter-agent data transmission volume.<n>We propose Which2comm, a novel multi-agent 3D object detection framework leveraging object-level sparse features.
  arXiv  Detail & Related papers  (2025-03-21T14:24:07Z)
• ALOcc: Adaptive Lifting-Based 3D Semantic Occupancy and Cost Volume-Based Flow Predictions [91.55655961014027]
  3D semantic occupancy and flow prediction are fundamental to understanding scene scene.<n>This paper proposes a vision-based framework with three targeted improvements.<n>Our purely convolutional architecture establishes new SOTA performance on multiple benchmarks for both semantic occupancy and joint semantic-flow prediction.
  arXiv  Detail & Related papers  (2024-11-12T11:32:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.