Geospatial-Prior Guidance for 3D Semantic Scene Completion
- URL: http://arxiv.org/abs/2608.03618v1
- Date: Tue, 04 Aug 2026 13:08:14 GMT
- Title: Geospatial-Prior Guidance for 3D Semantic Scene Completion
- Abstract summary: GeoScene is a framework that jointly uses satellite imagery and structured OpenStreetMap cues as soft priors for 3D semantic scene completion.<n>GeoScene learns complementary voxel-wise reliability weights for onboard observations and geospatial guidance, and uses them to control feature refinement in observed and unobserved regions.
- Score: 38.43604650752214
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Inferring complete 3D geometry and semantics from onboard images remains challenging because occlusions and restricted fields of view leave large scene regions underconstrained. Although satellite imagery provides wide-area context, appearance cues alone offer limited structural guidance and may be unreliable because of spatial or temporal discrepancies. We present GeoScene, a geospatially guided framework that jointly uses satellite imagery and structured OpenStreetMap cues as soft priors for 3D semantic scene completion. GeoScene learns complementary voxel-wise reliability weights for onboard observations and geospatial guidance, and uses them to control feature refinement in observed and unobserved regions. This design preserves local visual evidence while exploiting large-scale road and building structure beyond onboard visibility. Experiments on SemanticKITTI and SSCBench-KITTI-360 demonstrate that GeoScene consistently improves both geometric and semantic completion under the geospatial-prior-assisted setting, with the most pronounced benefits for large-scale static and geospatially structured classes.
Related papers
- SphereSOD: Geometry-Structure Coupled Learning for 360 Salient Object Detection [75.77856258186854]
360 salient object detection aims to accurately segment salient regions across a full field of view.<n>Existing methods mainly focus on compensating projection distortion while overlooking the interaction between panoramic geometry and salient object structure.<n>We propose SphereSOD, an ERP-native framework that couples panoramic geometry with evolving salient structures.
arXiv Detail & Related papers (2026-09-07T14:47:54Z) - GeoAnchor: Collaborative Reasoning via Latent Decomposition for 3D Spatial Understanding [45.67186918674009]
GeoAnchor is an interleaved text-latent reasoning framework for 3D spatial relationships.<n>It decomposes 3D spatial information into three complementary components: position latents for object grounding, direction latents for relational orientation, and geometry latents for scene structure.<n>Experiments on diverse and complex 3D reasoning tasks demonstrate that GeoAnchor outperforms the state of the art, validating its effectiveness and generalization capabilities.
arXiv Detail & Related papers (2026-07-15T05:27:37Z) - TerraDiT-$Ω$: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive [19.699267665705715]
We introduce TerraDiT-$$, a unified spatial control framework that generates satellite imagery directly from any native primitive.<n>Generative models have achieved remarkable progress, yet applying them to satellite imagery remains challenging.
arXiv Detail & Related papers (2026-06-30T01:56:41Z) - From Extrinsic to Intrinsic: Geodesic-Guided Representation Learning for 3D Geometric Data [56.41479248637621]
We introduce a novel 3D representation learning paradigm, namely textbfPRISM, for textbfPre-training.<n>PRISM learns embeddings by textbfRecovering the textbfIntrinsic textbfSurface geodesic textbfMetric.<n> Experiments demonstrate that our approach shows satisfactory accuracy, robustness, and high efficiency in geodesic distance prediction.
arXiv Detail & Related papers (2026-06-01T13:54:26Z) - Geo$^\textbf{2}$: Geometry-Guided Cross-view Geo-Localization and Image Synthesis [12.868037364314953]
Cross-view geo-spatial learning consists of two important tasks: Cross-View Geo-Localization (CVGL) and Cross-View Image Synthesis (CVIS)
arXiv Detail & Related papers (2026-03-26T18:36:09Z) - Learning to Wander: Improving the Global Image Geolocation Ability of LMMs via Actionable Reasoning [72.13218601075958]
We introduce textbfWanderBench, the first open access global geolocation benchmark for actionable geolocation reasoning in embodied scenarios.<n>We propose textbfGeoAoT (Action of Thought), a underlineGeolocation framework with underlineAction of underlineThough, which couples reasoning with embodied actions.<n>Experiments on 19 large multimodal models show that GeoAoT achieves superior fine-grained localization and stronger generalization in dynamic environments.
arXiv Detail & Related papers (2026-03-11T06:24:10Z) - Wrivinder: Towards Spatial Intelligence for Geo-locating Ground Images onto Satellite Imagery [28.971555127858334]
We introduce Wrivinder, a framework that aggregates multiple ground photographs to align it with overhead satellite imagery.<n>We also release MC-Sat, a curated dataset linking multi-view ground imagery with geo-registered satellite tiles across diverse outdoor environments.<n>In zero-shot experiments, Wrivinder achieves sub-30,m geolocation accuracy across both dense and large-area scenes.
arXiv Detail & Related papers (2026-02-16T17:06:54Z) - GeoSurDepth: Spatial Geometry-Consistent Self-Supervised Depth Estimation for Surround-View Cameras [3.072321170197384]
GeoSurDepth is a framework that leverages geometry consistency as the primary cue for surround-view depth estimation.<n>Our framework highlights the importance of exploiting geometry coherence and consistency for robust self-supervised multi-view depth estimation.
arXiv Detail & Related papers (2026-01-09T15:13:28Z) - GeoDistill: Geometry-Guided Self-Distillation for Weakly Supervised Cross-View Localization [70.65458151146767]
Cross-view localization is crucial for large-scale outdoor applications like autonomous navigation and augmented reality.<n>Existing methods often rely on fully supervised learning, which requires costly ground-truth pose annotations.<n>We propose GeoDistill, a framework that uses teacher-student learning with Field-of-View (FoV)-based masking.
arXiv Detail & Related papers (2025-07-15T03:00:15Z) - Camera-based 3D Semantic Scene Completion with Sparse Guidance Network [18.415854443539786]
We propose a camera-based semantic scene completion framework called SGN.
SGN propagates semantics from semantic-aware seed voxels to the whole scene based on spatial geometry cues.
Our experimental results demonstrate the superiority of our SGN over existing state-of-the-art methods.
arXiv Detail & Related papers (2023-12-10T04:17:27Z) - Accurate 3-DoF Camera Geo-Localization via Ground-to-Satellite Image
Matching [102.39635336450262]
We address the problem of ground-to-satellite image geo-localization by matching a query image captured at the ground level against a large-scale database with geotagged satellite images.
Our new method is able to achieve the fine-grained location of a query image, up to pixel size precision of the satellite image.
arXiv Detail & Related papers (2022-03-26T20:10:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.