$L^3$:Scene-agnostic Visual Localization in the Wild

• URL: http://arxiv.org/abs/2603.07937v1
• Date: Mon, 09 Mar 2026 04:04:24 GMT
• Title: $L^3$:Scene-agnostic Visual Localization in the Wild
• Abstract summary: In this paper, we propose a novel map-free visual localization framework $L3$.<n> Specifically, by performing direct online 3D reconstruction on RGB images, followed by two-stage metric scale recovery and pose refinement based on 2D-3D correspondences, $L3$ achieves high accuracy without the need to pre-build or store any offline scene representations.
• Score: 8.93640624067105
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Standard visual localization methods typically require offline pre-processing of scenes to obtain 3D structural information for better performance. This inevitably introduces additional computational and time costs, as well as the overhead of storing scene representations. Can we visually localize in a wild scene without any off-line preprocessing step? In this paper, we leverage the online inference capabilities of feed-forward 3D reconstruction networks to propose a novel map-free visual localization framework $L^3$. Specifically, by performing direct online 3D reconstruction on RGB images, followed by two-stage metric scale recovery and pose refinement based on 2D-3D correspondences, $L^3$ achieves high accuracy without the need to pre-build or store any offline scene representations. Extensive experiments demonstrate $L^3$ not only that the performance is comparable to state-of-the-art solutions on various benchmarks, but also that it exhibits significantly superior robustness in sparse scenes (fewer reference images per scene).

Related papers

• Memory Over Maps: 3D Object Localization Without Reconstruction [44.29345996003297]
  Target localization is a prerequisite for embodied tasks such as navigation and manipulation.<n>Recent advances in vision-language models suggest that rich semantic reasoning can be performed directly on 2D observations.<n>We propose a map-free pipeline that stores only posed RGB-Ds as a lightweight visual memory without constructing any global 3D representation of the scene.
  arXiv  Detail & Related papers  (2026-03-20T21:57:51Z)
• EmbodiedSplat: Online Feed-Forward Semantic 3DGS for Open-Vocabulary 3D Scene Understanding [66.80528512321106]
  EmbodiedSplat is an online feed-forward 3DGS for open-vocabulary scene understanding.<n>Our objectives are 1) Reconstructs the semantic-embedded 3DGS of the entire scene from over 300 streaming images in an online manner, and 2) Highly generalizable to novel scenes with feed-forward design.
  arXiv  Detail & Related papers  (2026-03-04T16:40:41Z)
• TSP3D: Text-guided Sparse Voxel Pruning for Efficient 3D Visual Grounding [74.033589504806]
  We propose an efficient multi-level convolution architecture for 3D visual grounding.<n>Our method achieves top inference speed and surpasses previous fastest method by 100% FPS.
  arXiv  Detail & Related papers  (2025-02-14T18:59:59Z)
• SplatLoc: 3D Gaussian Splatting-based Visual Localization for Augmented Reality [50.179377002092416]
  We propose an efficient visual localization method capable of high-quality rendering with fewer parameters. Our method achieves superior or comparable rendering and localization performance to state-of-the-art implicit-based visual localization approaches.
  arXiv  Detail & Related papers  (2024-09-21T08:46:16Z)
• Fully Geometric Panoramic Localization [16.200889977514862]
  We introduce a lightweight and accurate localization method that only utilizes the geometry of 2D-3D lines. Given a pre-captured 3D map, our approach localizes a panorama image, taking advantage of the holistic 360 view. Our fully geometric approach does not involve extensive parameter tuning or neural network training, making it a practical algorithm that can be readily deployed in the real world.
  arXiv  Detail & Related papers  (2024-03-29T01:07:20Z)
• Memory-based Adapters for Online 3D Scene Perception [71.71645534899905]
  Conventional 3D scene perception methods are offline, i.e., take an already reconstructed 3D scene geometry as input. We propose an adapter-based plug-and-play module for the backbone of 3D scene perception model. Our adapters can be easily inserted into mainstream offline architectures of different tasks and significantly boost their performance on online tasks.
  arXiv  Detail & Related papers  (2024-03-11T17:57:41Z)
• ALSTER: A Local Spatio-Temporal Expert for Online 3D Semantic Reconstruction [62.599588577671796]
  We propose an online 3D semantic segmentation method that incrementally reconstructs a 3D semantic map from a stream of RGB-D frames. Unlike offline methods, ours is directly applicable to scenarios with real-time constraints, such as robotics or mixed reality.
  arXiv  Detail & Related papers  (2023-11-29T20:30:18Z)
• Visual Localization using Imperfect 3D Models from the Internet [54.731309449883284]
  This paper studies how imperfections in 3D models affect localization accuracy. We show that 3D models from the Internet show promise as an easy-to-obtain scene representation.
  arXiv  Detail & Related papers  (2023-04-12T16:15:05Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.