GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors

• URL: http://arxiv.org/abs/2604.11401v1
• Date: Mon, 13 Apr 2026 12:42:28 GMT
• Title: GS4City: Hierarchical Semantic Gaussian Splatting via City-Model Priors
• Abstract summary: We present GS4City, a hierarchical semantic Gaussian Splatting method that incorporates city-model priors for urban scene understanding.<n>GS4City derives reliable image-aligned masks from Level of Detail 3 CityGML models via two-pass raycasting.<n>It then fuses these geometry-grounded masks with foundation-model predictions to establish scene-consistent instance correspondences.
• Score: 21.77168114492861
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent semantic 3D Gaussian Splatting (3DGS) methods primarily rely on 2D foundation models, often yielding ambiguous boundaries and limited support for structured urban semantics. While city models such as CityGML encode hierarchically organized semantics together with building geometry, these labels cannot be directly mapped to Gaussian primitives. We present GS4City, a hierarchical semantic Gaussian Splatting method that incorporates city-model priors for urban scene understanding. GS4City derives reliable image-aligned masks from Level of Detail (LoD) 3 CityGML models via two-pass raycasting, explicitly using parent-child relations to validate and recover fine-grained facade elements. It then fuses these geometry-grounded masks with foundation-model predictions to establish scene-consistent instance correspondences, and learns a compact identity encoding for each Gaussian under joint 2D identity supervision and 3D spatial regularization. Experiments on the TUM2TWIN and Gold Coast datasets show that GS4City effectively incorporates structured building semantics into Gaussian scene representations, outperforming existing 2D-driven semantic 3DGS baselines, including LangSplat and Gaga, by up to 15.8 IoU points in coarse building segmentation and 14.2 mIoU points in fine-grained semantic segmentation. By bridging structured city models and photorealistic Gaussian scene representations, GS4City enables semantically queryable and structure-aware urban reconstruction. Code is available at https://github.com/Jinyzzz/GS4City.

Related papers

• InfiniSplat: Implicit Gaussian Decoding for Large-Baseline Monocular View Synthesis [49.87457834078904]
  InfiniSplat is a feed-forward single-image 3DGS framework that moves from a pixel-aligned representation toward a surface-aligned representation.<n>InfiniSplat achieves state-of-the-art performance compared with single-image feed-forward baselines.
  arXiv  Detail & Related papers  (2026-08-03T16:17:39Z)
• SemCityLoc: Aerial 6DoF Localization Using Semantic 3D City Models [51.121529170856064]
  We propose SemCityLoc, a semantic-geometric alignment system that reframes aerial pose estimation.<n>Instead of matching sparse contours or dense texture, our method aligns semantic surfaces and monocular depth with lightweight semantic 3D building models.<n>Experiments demonstrate substantial improvements over existing map-based approaches.
  arXiv  Detail & Related papers  (2026-06-25T18:13:39Z)
• DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding [6.961193964556352]
  We present DGSG-Mind, a hybrid instance-aware 3D Gaussian dynamic scene graph system with an embodied reasoning agent.<n>We show that DGSG-Mind achieves the best zero-shot 3DVG performance among methods operating on self-reconstructed maps.<n>We also deploy DGSG-Mind on real-world robots to demonstrate its target-oriented reasoning and dynamic update capabilities.
  arXiv  Detail & Related papers  (2026-05-28T13:04:17Z)
• Joint Semantic and Rendering Enhancements in 3D Gaussian Modeling with Anisotropic Local Encoding [86.55824709875598]
  We propose a joint enhancement framework for 3D semantic Gaussian modeling that synergizes both semantic and rendering branches.<n>Unlike conventional point cloud shape encoding, we introduce an anisotropic 3D Gaussian Chebyshev descriptor to capture fine-grained 3D shape details.<n>We employ a cross-scene knowledge transfer module to continuously update learned shape patterns, enabling faster convergence and robust representations.
  arXiv  Detail & Related papers  (2026-01-05T18:33:50Z)
• CymbaDiff: Structured Spatial Diffusion for Sketch-based 3D Semantic Urban Scene Generation [55.74642848285121]
  We introduce SketchSem3D, the first large-scale benchmark for generating 3D outdoor semantic scenes from freehand sketches and satellite images.<n>We also propose Cylinder Mamba Diffusion (CymbaDiff) that significantly enhances spatial coherence in scene generation.<n>CymbaDiff achieves superior semantic consistency, spatial realism, and cross-dataset generalization.
  arXiv  Detail & Related papers  (2025-10-15T07:47:00Z)
• Visibility-Aware Densification for 3D Gaussian Splatting in Dynamic Urban Scenes [7.253732091582086]
  VAD-GS is a 3DGS framework tailored for geometry recovery in challenging urban scenes.<n>Our method identifies unreliable geometry structures via voxel-based visibility reasoning.<n>It selects informative supporting views through diversity-aware view selection, and recovers missing structures via patch matching-based stereo reconstruction.
  arXiv  Detail & Related papers  (2025-10-10T13:22:12Z)
• Controllable Generation of Large-Scale 3D Urban Layouts with Semantic and Structural Guidance [7.298148118365382]
  We present a controllable framework for large-scale 3D vector urban layout generation.<n>By fusing geometric and semantic attributes, edge weights, and embedding building height in the graph, our method extends 2D layouts to realistic 3D structures.
  arXiv  Detail & Related papers  (2025-09-28T11:08:17Z)
• GS4Buildings: Prior-Guided Gaussian Splatting for 3D Building Reconstruction [6.410170080806193]
  We propose GS4Buildings, a novel prior-guided Gaussian Splatting method for robust and scalable building surface reconstruction.<n>We generate prior depth and normal maps from the planar building geometry and incorporate them into the optimization process.<n> Experiments on urban datasets demonstrate that GS4Buildings improves reconstruction completeness by 20.5% and geometric accuracy by 32.8%.
  arXiv  Detail & Related papers  (2025-08-10T14:13:31Z)
• SeqAffordSplat: Scene-level Sequential Affordance Reasoning on 3D Gaussian Splatting [85.87902260102652]
  We introduce the novel task of Sequential 3D Gaussian Affordance Reasoning.<n>We then propose SeqSplatNet, an end-to-end framework that directly maps an instruction to a sequence of 3D affordance masks.<n>Our method sets a new state-of-the-art on our challenging benchmark, effectively advancing affordance reasoning from single-step interactions to complex, sequential tasks at the scene level.
  arXiv  Detail & Related papers  (2025-07-31T17:56:55Z)
• Interpretable Single-View 3D Gaussian Splatting using Unsupervised Hierarchical Disentangled Representation Learning [46.85417907244265]
  We propose an interpretable single-view 3DGS framework, termed 3DisGS, to discover both coarse- and fine-grained 3D semantics.<n>Our model achieves 3D disentanglement while preserving high-quality and rapid reconstruction.
  arXiv  Detail & Related papers  (2025-04-05T14:42:13Z)
• OVGaussian: Generalizable 3D Gaussian Segmentation with Open Vocabularies [112.80292725951921]
  textbfOVGaussian is a generalizable textbfOpen-textbfVocabulary 3D semantic segmentation framework based on the 3D textbfGaussian representation.<n>We first construct a large-scale 3D scene dataset based on 3DGS, dubbed textbfSegGaussian, which provides detailed semantic and instance annotations for both Gaussian points and multi-view images.<n>To promote semantic generalization across scenes, we introduce Generalizable Semantic Rasterization (GSR), which leverages a
  arXiv  Detail & Related papers  (2024-12-31T07:55:35Z)
• UrbanGS: Semantic-Guided Gaussian Splatting for Urban Scene Reconstruction [86.4386398262018]
  UrbanGS uses 2D semantic maps and an existing dynamic Gaussian approach to distinguish static objects from the scene.<n>For potentially dynamic objects, we aggregate temporal information using learnable time embeddings.<n>Our approach outperforms state-of-the-art methods in reconstruction quality and efficiency.
  arXiv  Detail & Related papers  (2024-12-04T16:59:49Z)
• COHO: Context-Sensitive City-Scale Hierarchical Urban Layout Generation [1.5745692520785073]
  We introduce a novel graph-based masked autoencoder (GMAE) for city-scale urban layout generation. The method encodes attributed buildings, city blocks, communities and cities into a unified graph structure. Our approach achieves good realism, semantic consistency, and correctness across the heterogeneous urban styles in 330 US cities.
  arXiv  Detail & Related papers  (2024-07-16T00:49:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.