Empowering Feed-Forward Reconstruction Models with Metric Scale via Satellite Images

• URL: http://arxiv.org/abs/2606.08205v1
• Date: Sat, 06 Jun 2026 14:44:04 GMT
• Title: Empowering Feed-Forward Reconstruction Models with Metric Scale via Satellite Images
• Abstract summary: We propose a satellite-guided framework for resolving scale ambiguity in feed-forward 3D reconstruction.<n>By enforcing consistency between the reconstructed scene and the satellite reference, the model infers absolute scale, refines scene geometry, and estimates camera pose in a metric coordinate frame.
• Score: 17.10424609165589
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Feed-forward 3D reconstruction models have recently shown strong generalization across diverse scenes, yet most of them recover geometry only up to an unknown global scale. This scale ambiguity limits their use in applications that require metric understanding of the environment. Existing metric reconstruction methods commonly rely on large-scale metric annotations or accurate camera calibration, both of which are costly or unreliable in many real-world settings. We propose a satellite-guided framework for resolving scale ambiguity in feed-forward 3D reconstruction. The key idea is to use readily available satellite imagery as a global metric reference. Given a coarse camera pose, our method retrieves a local satellite patch and integrates it with a feed-forward reconstruction backbone through bidirectional cross-view interaction. By enforcing consistency between the reconstructed scene and the satellite reference, the model infers absolute scale, refines scene geometry, and estimates camera pose in a metric coordinate frame. Experiments on KITTI, nuScenes, and Oxford RobotCar show consistent improvements in metric depth estimation, multi-view point-cloud reconstruction, and cross-view camera localization, while preserving strong generalization across datasets and geographic regions.

Related papers

• OmniPoint: Universal Monocular Metric Pointcloud from Any Camera [79.24417597712802]
  We present OmniPoint, a unified framework designed to generalize metric reconstruction across diverse imaging sensors.<n>To overcome projection rigidity, OmniPoint abandons conventional planar depth regression.<n>It instead adopts a decoupled ray and distance representation alongside a decoupled training objective.
  arXiv  Detail & Related papers  (2026-09-08T19:45:58Z)
• Ground-to-Satellite Localization in Unconstrained Image Collections for 3D Scene Reconstruction [9.370818606626663]
  Ground image localization with respect to satellite imagery is a key enabler for metrically-accurate, geo-localized 3D scene reconstruction.<n>Existing cross-view localization methods have strict requirements such as panoramic imagery or known initial locations.<n>We propose a robust hierarchical cross-view localization framework that leverages geometric constraints from Structure-from-Motion (SfM) models.
  arXiv  Detail & Related papers  (2026-08-29T11:52:21Z)
• Honey, I Shrunk the Arc de Triomphe! [28.188906774039364]
  Metric scale monocular geometry estimation has seen significant progress through large-scale data aggregation.<n>Current foundation models suffer from a persistent ''scale-collapse'' phenomenon: distant landmarks and vast landscapes are metrically underestimated.<n>We curate a new metrically-grounded, in-the-wild dataset that we call MetricScenes.<n>Fine-tuning MoGe-2 on our dataset significantly mitigates scale-collapse and achieves superior metric accuracy in unconstrained, open-domain scenes.
  arXiv  Detail & Related papers  (2026-06-01T15:28:13Z)
• Unifying UAV Cross-View Geo-Localization via 3D Geometric Perception [51.687842983240564]
  Cross-view geo-localization for Unmanned Aerial Vehicles (UAVs) remains challenging due to the severe geometric discrepancy between oblique UAV imagery and satellite maps.<n>We propose a geometry-aware UAV geo-localization framework that explicitly models the 3D scene geometry to unify coarse place recognition and fine-grained pose estimation.<n>Our method significantly outperforms state-of-the-art baselines, achieving robust meter-level localization accuracy and improved generalization in complex urban environments.
  arXiv  Detail & Related papers  (2026-04-02T08:08:41Z)
• Scene Grounding In the Wild [27.597534811067348]
  Reconstructing accurate 3D models of large-scale real-world scenes from unstructured, in-the-wild imagery remains a core challenge in computer vision.<n>We propose a framework that grounds each partial reconstruction to a complete reference model of the scene.<n>We demonstrate that our approach consistently improves global alignment when with various classical and learning-based pipelines.
  arXiv  Detail & Related papers  (2026-03-27T16:41:20Z)
• HGGT: Robust and Flexible 3D Hand Mesh Reconstruction from Uncalibrated Images [81.42866295265443]
  High-fidelity 3D hand geometry is a critical task in computer vision.<n> scalable applications demand both accuracy and deployment flexibility.<n>We propose a feed-forward architecture that infers 3D hand meshes and camera poses from uncalibrated views.
  arXiv  Detail & Related papers  (2026-03-25T06:54:34Z)
• TALO: Pushing 3D Vision Foundation Models Towards Globally Consistent Online Reconstruction [57.46712611558817]
  3D vision foundation models have shown strong generalization in reconstructing key 3D attributes from uncalibrated images through a single feed-forward pass.<n>Recent strategies align consecutive predictions by solving global transformation, yet our analysis reveals their fundamental limitations in assumption validity, local alignment scope, and robustness under noisy geometry.<n>We propose a higher-DOF and long-term alignment framework based on Thin Plate Spline, leveraging globally propagated control points to correct spatially varying inconsistencies.
  arXiv  Detail & Related papers  (2025-12-02T02:22:20Z)
• GRS-SLAM3R: Real-Time Dense SLAM with Gated Recurrent State [29.91962530945268]
  We introduce GRS-SLAM3R, an end-to-end SLAM framework for dense scene reconstruction.<n>Our method supports sequentialized input and incrementally estimates metric-scale point clouds in the global coordinate.<n>Experiments on various datasets show that our framework achieves superior reconstruction accuracy while maintaining real-time performance.
  arXiv  Detail & Related papers  (2025-09-28T08:33:34Z)
• MapAnything: Universal Feed-Forward Metric 3D Reconstruction [63.79151976126576]
  MapAnything ingests one or more images along with optional geometric inputs such as camera intrinsics, poses, depth, or partial reconstructions.<n>It then directly regresses the metric 3D scene geometry and cameras.<n>MapAnything addresses a broad range of 3D vision tasks in a single feed-forward pass.
  arXiv  Detail & Related papers  (2025-09-16T18:00:14Z)
• Lazy Visual Localization via Motion Averaging [89.8709956317671]
  We show that it is possible to achieve high localization accuracy without reconstructing the scene from the database. Experiments show that our visual localization proposal, LazyLoc, achieves comparable performance against state-of-the-art structure-based methods.
  arXiv  Detail & Related papers  (2023-07-19T13:40:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.