Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization

• URL: http://arxiv.org/abs/2605.07351v1
• Date: Fri, 08 May 2026 07:01:30 GMT
• Title: Disambiguating 2D-3D Correspondences in Gaussian Splatting-based Feature Fields for Visual Localization
• Abstract summary: This paper highlights that photometrically optimized Feature Fields (GSFFs) are inherently ill-suited for 2D-3D matching.<n>To address these issues, we propose SplitGS-Loc, a specialized localization framework that disambiates 2D-3D correspondences by exploiting Gaussian attributes.
• Score: 36.99946317601775
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: While Gaussian Splatting-based Feature Fields (GSFFs) have shown promise for visual localization, this paper highlights that photometrically optimized GSFFs are inherently ill-suited for 2D-3D matching. The volumetric extent of each Gaussian induces many-to-one pixel-to-point mappings that destabilize PnP-based pose estimation, while photometric optimization gives rise to superfluous Gaussians devoid of multi-view consistency. To address these issues, we propose SplitGS-Loc, a localization-specialized GSFFs construction framework that disambiguates 2D-3D correspondences by exploiting Gaussian attributes. Our key design, Mixture-of-Gaussians-based splitting, decomposes each Gaussian into smaller Gaussians, replacing ambiguous many-to-one with precise one-to-one correspondences. In parallel, we exploit composition weights from GS rasterization to select Gaussians that significantly and consistently contribute across multiple views and aggregate discriminative features through strong pixel-Gaussian associations, enforcing multi-view consistency. The resulting compact yet discriminative feature fields enable stable PnP convergence, achieving state-of-the-art performance on localization benchmarks. Extensive experiments validate that SplitGS-Loc extends the utility of photometric GSFFs to accurate and efficient localization by exploiting Gaussian attributes, without per-scene training or iterative pose refinement.

Related papers

• Gaussian-JEPA: Joint-Embedding Predictive Learning for 3D Gaussian Splats [91.55220894541151]
  3D Gaussian Splatting (3DGS) represents 3D content with anisotropic primitives that jointly encode geometry and appearance.<n>We introduce Gaussian-JEPA, which predicts representations of held-out Gaussian token blocks from visible context.
  arXiv  Detail & Related papers  (2026-08-16T09:43:50Z)
• Local-GS: Accelerating 3D Gaussian Splatting via Tile-Local Warp Coherence [31.001161060131622]
  3D Gaussian Splatting (3DGS) has significantly advanced real-time novel view computation by representing scenes as dense collections of anisotropic 3D Gaussian primitives.<n>We present Local-GS, a warp-coherent rendering paradigm that organizes Gaussian primitives with respect to SIMT (Single Instruction, Multiple Threads) execution boundaries rather than scene geometry.<n>As a plug-and-play optimization, it provides additional performance gains to all tested baselines, culminating in a $7.76times$ speedup on Deep Blending scenes.
  arXiv  Detail & Related papers  (2026-06-15T11:08:10Z)
• NG-GS: NeRF-Guided 3D Gaussian Splatting Segmentation [65.34304674634713]
  We introduce NG-GS, a framework for high-quality object segmentation in 3DGS that explicitly addresses boundary discretization.<n>We show that our method achieves photorealistic state-of-the-art performance, with significant gains in boundary mIoU.
  arXiv  Detail & Related papers  (2026-04-16T07:14:07Z)
• GS^2: Graph-based Spatial Distribution Optimization for Compact 3D Gaussian Splatting [50.2045409672451]
  3D Gaussian Splatting (3DGS) has demonstrated breakthrough performance in novel view synthesis and real-time rendering.<n>It is constrained by the high memory cost due to a huge number of Gaussian points.<n>We propose graph-based spatial distribution optimization for compact 3DGS.
  arXiv  Detail & Related papers  (2026-04-02T10:41:51Z)
• Gau-Occ: Geometry-Completed Gaussians for Multi-Modal 3D Occupancy Prediction [40.5891357994769]
  Gau-Occ is a multi-modal framework that bypasses dense volumetric processing.<n>It integrates multi-view image semantics via geometry-aligned 2D sampling and cross-modal alignment.
  arXiv  Detail & Related papers  (2026-03-24T06:44:46Z)
• F4Splat: Feed-Forward Predictive Densification for Feed-Forward 3D Gaussian Splatting [28.800888081472422]
  We present F4Splat, which performs Feed-Forward predictive densification for Feed-Forward 3D Gaussian Splatting.<n>Our model predicts per-region densification scores to estimate the required Gaussian density and allows explicit control over the final Gaussian budget.<n>Experiments demonstrate that our model achieves superior novel-view synthesis performance compared to prior uncalibrated feed-forward methods.
  arXiv  Detail & Related papers  (2026-03-22T16:03:56Z)
• 2D Gaussian Splatting with Semantic Alignment for Image Inpainting [46.266955851252504]
  We propose the first image inpainting framework based on 2D Gaussian Splatting.<n>For global semantic consistency, we incorporate features from a pretrained DINO model.<n>Our method achieves competitive performance in both quantitative metrics and perceptual quality.
  arXiv  Detail & Related papers  (2025-09-02T05:12:52Z)
• PixelGaussian: Generalizable 3D Gaussian Reconstruction from Arbitrary Views [116.10577967146762]
  PixelGaussian is an efficient framework for learning generalizable 3D Gaussian reconstruction from arbitrary views. Our method achieves state-of-the-art performance with good generalization to various numbers of views.
  arXiv  Detail & Related papers  (2024-10-24T17:59:58Z)
• MCGS: Multiview Consistency Enhancement for Sparse-View 3D Gaussian Radiance Fields [100.90743697473232]
  Radiance fields represented by 3D Gaussians excel at synthesizing novel views, offering both high training efficiency and fast rendering.<n>Existing methods often incorporate depth priors from dense estimation networks but overlook the inherent multi-view consistency in input images.<n>We propose a view synthesis framework based on 3D Gaussian Splatting, enabling scene reconstruction from sparse views.
  arXiv  Detail & Related papers  (2024-10-15T08:39:05Z)
• GES: Generalized Exponential Splatting for Efficient Radiance Field Rendering [112.16239342037714]
  GES (Generalized Exponential Splatting) is a novel representation that employs Generalized Exponential Function (GEF) to model 3D scenes. With the aid of a frequency-modulated loss, GES achieves competitive performance in novel-view synthesis benchmarks.
  arXiv  Detail & Related papers  (2024-02-15T17:32:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.