GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors

• URL: http://arxiv.org/abs/2607.13481v1
• Date: Wed, 15 Jul 2026 06:21:25 GMT
• Title: GPOcc++: Unified Sparse Gaussian Occupancy Prediction with Visual Geometry Priors
• Abstract summary: We introduce GPOcc, which transforms visual geometry priors into occupancy-aware sparse Gaussian representations.<n>Building on GPOcc, GPOcc++ models multi-view observations and temporal sequences within a unified framework.<n>Experiments on both indoor and outdoor benchmarks demonstrate consistently strong performance across both multi-view and temporal settings.
• Score: 70.03915250336668
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Accurate 3D scene understanding is fundamental to embodied intelligence and autonomous driving, where 3D occupancy provides a unified representation of objects, structures, and free space. However, recovering such a complete volumetric representation from visual observations remains challenging, particularly in occluded and unobserved regions. Visual geometry priors offer strong and generalizable geometric cues for addressing this challenge, but their outputs are inherently surface-centric, whereas occupancy prediction requires reasoning about volumetric interiors and free space. To bridge this gap, we introduce GPOcc, which transforms visual geometry priors into occupancy-aware sparse Gaussian representations for efficient and expressive volumetric scene modeling. Building on GPOcc, GPOcc++ models multi-view observations and temporal sequences within a unified framework, allowing spatial and temporal evidence to be handled through the same representation. We further extend GPOcc++ from indoor scenes to outdoor occupancy prediction. Extensive experiments on both indoor and outdoor benchmarks demonstrate consistently strong performance across both multi-view and temporal settings, together with favorable efficiency and generalization. Code will be released at https://github.com/JuIvyy/GPOcc.

Related papers

• VGOcc: Learning Visual-Geometric Gaussians for Vision-Centric 3D Driving Occupancy Prediction [13.991187977226302]
  Vision-only occupancy prediction requires recovering a semantic 3D occupancy field from calibrated surround-view images.<n>We propose VGOcc, which learns visual and geometric cues from foundation models for Gaussian modeling.<n> Experiments on nuScenes demonstrate that VGOcc achieves state-of-the-art performance in vision-only 3D occupancy prediction.
  arXiv  Detail & Related papers  (2026-07-20T15:46:30Z)
• G$^2$TAM: Geometry Grounded Track Anything Model [49.05553245076823]
  We propose a unified framework for promptable instance tracking in 3D using only unordered RGB images or videos.<n>G$2$TAM employs spatially aligned geometric representations as implicit memory, ensuring stable instance identity and localization across frames and views.<n>At its core is a cross-modal spatial encoder that integrates visual and textual prompts into a shared geometric space, enabling end-to-end spatial reconstruction and instance-consistent mask prediction.
  arXiv  Detail & Related papers  (2026-07-04T09:32:13Z)
• Z-FLoc: Zero-Shot Floorplan Localization via Geometric Primitives [72.63181031215858]
  We propose a zero-shot floorplan localization method that generalizes to novel environments without any retraining.<n>Our key insight is that dominant geometric primitives are ubiquitous in human-made environments.<n> Experiments on both simulated and real-world datasets show that our approach outperforms state-of-the-art learning-based methods on unseen environments.
  arXiv  Detail & Related papers  (2026-06-03T12:14:24Z)
• GA-VLN: Geometry-Aware BEV Representation for Efficient Vision-Language Navigation [75.85672467847631]
  We introduce the Geometry-Aware BEV (GA-BEV) - a compact, 3D-grounded feature representation.<n>We construct BEV spatial maps from RGB-D inputs by projecting visual features into 3D space.<n>We incorporate features from a pretrained 3D foundation model into the BEV space, injecting structural priors learned from large-scale 3D reconstruction tasks.
  arXiv  Detail & Related papers  (2026-05-21T06:20:17Z)
• OccAny: Generalized Unconstrained Urban 3D Occupancy [11.937212229169512]
  We present OccAny, the first unconstrained urban 3D occupancy model capable of operating on out-of-domain uncalibrated scenes.<n>OccAny is versatile to predict occupancy from sequential, monocular, or surround-view images.
  arXiv  Detail & Related papers  (2026-03-24T17:59:58Z)
• Generation Models Know Space: Unleashing Implicit 3D Priors for Scene Understanding [50.098085774845195]
  We propose a paradigm shift by leveraging the implicit spatial prior within large-scale generation models.<n>We introduce GeneEGA-3D (Video Extracted Generative Awareness), a plug-and-play framework that repurposes a pre-trained video diffusion model as a Latent World Simulator.
  arXiv  Detail & Related papers  (2026-03-19T17:59:58Z)
• Generalizing Visual Geometry Priors to Sparse Gaussian Occupancy Prediction [10.394184895110007]
  We present GPOcc, a framework that leverages visual geometry priors for monocular occupancy prediction.<n>Experiments on Occ-ScanNet and EmbodiedOcc-ScanNet demonstrate significant gains.
  arXiv  Detail & Related papers  (2026-02-25T04:16:54Z)
• COSMOS: Coherent Supergaussian Modeling with Spatial Priors for Sparse-View 3D Splatting [2.549594916296063]
  3D Gaussian Splatting (3DGS) has recently emerged as a promising approach for 3D reconstruction.<n>We propose Coherent supergaussian Modeling with Spatial Priors (COSMOS) to address this issue.<n>Our experiments on Blender and DTU show that COSMOS surpasses state-of-the-art methods in sparse-view settings without any external depth supervision.
  arXiv  Detail & Related papers  (2025-12-17T04:55:15Z)
• ST-GS: Vision-Based 3D Semantic Occupancy Prediction with Spatial-Temporal Gaussian Splatting [21.87807066521776]
  3D occupancy prediction is critical for comprehensive scene understanding in vision-centric autonomous driving.<n>Recent advances have explored utilizing 3D semantic Gaussians to model occupancy while reducing computational overhead.<n>We propose a novel Spatial-Temporal Gaussian Splatting (ST-GS) framework to enhance both spatial and temporal modeling.
  arXiv  Detail & Related papers  (2025-09-20T06:36:30Z)
• QuadricFormer: Scene as Superquadrics for 3D Semantic Occupancy Prediction [49.75084732129701]
  3D occupancy prediction is crucial for robust autonomous driving systems.<n>Most existing methods employ dense voxel-based scene representations.<n>We present QuadricFormer, a superquadric-based model for efficient 3D occupancy prediction.
  arXiv  Detail & Related papers  (2025-06-12T17:59:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.