Adapting a Foundation Model for Lunar Surface Height Estimation
- URL: http://arxiv.org/abs/2609.02448v1
- Date: Wed, 02 Sep 2026 11:11:38 GMT
- Title: Adapting a Foundation Model for Lunar Surface Height Estimation
- Abstract summary: Digital elevation models (DEMs) can provide accurate height information, making it invaluable for analyzing the lunar surface.<n>Traditional approaches to generate DEMs from imagery, such as shape from shading (SfS) and stereophotogrammetry (SPG) have been proven highly valuable for this task.<n>We present a methodology that builds on the well-known zero-shot relative depth estimation model Depth Anything V2 (DAV2)<n>Our results demonstrate a significant improvement compared to the zero-shot model, effectively transforming DAV2 into a reliable relative depth estimator of the lunar surface.
- Score: 2.930026359321754
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Digital elevation models (DEMs) can provide accurate height information, making it invaluable for analyzing the lunar surface. As the European Space Agency (ESA) prepares for future lunar missions that aim to land on the Moon, a precise method for height estimation will be essential for hazardous terrain that could endanger the landing approach. Traditional approaches to generate DEMs from imagery, such as shape from shading (SfS) and stereophotogrammetry (SPG) have been proven highly valuable for this task. However, due to advancements in machine learning, especially computer vision, the focus has shifted towards monocular depth estimation via deep learning. The lunar surface is covered by rocks and craters, and classic hazard detection methods rely solely on 2D image data. Our goal is to address this issue by developing a relative lunar surface height estimator that can provide additional information for hazard localization. In this letter, we present a methodology that builds on the well-known zero-shot relative depth estimation model Depth Anything V2 (DAV2). Other works have been using it as a state-of-the-art comparison for their proposed lunar DEM estimation method, but without adaptations to the target domain. Thus, it may underperform. Therefore, we propose a fine-tuning strategy with publicly available SPG-derived DEM data of the lunar surface. Our results demonstrate a significant improvement in performance compared to the zero-shot model, effectively transforming DAV2 into a reliable relative depth estimator of the lunar surface.
Related papers
- AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World [75.54693105865003]
We introduce AerialMetric, a benchmark dataset to evaluate and facilitate the adaptation of monocular metric depth estimation under UAV aerial viewpoints.<n>AerialMetric provides 52K real-world and 16K synthetic image-depth pairs with reliable metric ground truth.
arXiv Detail & Related papers (2026-06-29T02:48:47Z) - LunarDepthNet: Generation of Digital Elevation Models using Deep Learning and Monocular Satellite Images [0.40228234427513104]
This study proposes a novel deep learning method that estimates and generates a surface elevation map directly from monocular images of the surface.<n>The dataset used comprises of the Chandrayaan-2 Terrain Mapping Camera (TMC) images with their corresponding Digital Terrain Models (DTMs)
arXiv Detail & Related papers (2026-04-22T06:16:13Z) - Vision-Language Model for Accurate Crater Detection [2.6038033465934083]
The European Space Agency (ESA) has a profound interest in reliable crater detection, since craters pose a risk to safe lunar landings.<n>It is non-trivial due to the vast amount of craters of various sizes and shapes, as well as challenging conditions such as varying illumination and rugged terrain.<n>We propose a deep-learning crater detection algorithm based on the OWLv2 model, that has proven highly effective in various computer vision tasks.
arXiv Detail & Related papers (2026-01-12T18:08:17Z) - StarryGazer: Leveraging Monocular Depth Estimation Models for Domain-Agnostic Single Depth Image Completion [56.28564075246147]
StarryGazer is a framework that predicts dense depth images from a single sparse depth image and an RGB image.<n>We employ a pre-trained MDE model to produce relative depth images.<n>A refinement network is trained with the synthetic pairs, incorporating the relative depth maps and RGB images to improve the model's accuracy and robustness.
arXiv Detail & Related papers (2025-12-15T09:56:09Z) - A Stochastic Approach to Terrain Maps for Safe Lunar Landing [8.1140131376627]
Traditional vision-based hazard detection methods are not reliable on the lunar surface.<n>The potential existence of valuable resources at the lunar South Pole has made landing in that region a high priority for many space agencies and commercial companies.<n> relying on a LiDAR for hazard detection during descent is risky, as this technology is fairly untested in the lunar environment.<n>There exists a rich log of lunar surface data from the Lunar Reconnaissance Orbiter (LRO), which could be used to create prior maps of the surface before descent.
arXiv Detail & Related papers (2025-12-12T21:56:08Z) - Loc$^2$: Interpretable Cross-View Localization via Depth-Lifted Local Feature Matching [80.57282092735991]
We propose an accurate and interpretable fine-grained cross-view localization method.<n>It estimates the 3 Degrees of Freedom (DoF) pose of a ground-level image by matching its local features with a reference aerial image.<n> Experiments show state-of-the-art accuracy in challenging scenarios such as cross-area testing and unknown orientation.
arXiv Detail & Related papers (2025-09-11T18:52:16Z) - LunarLoc: Segment-Based Global Localization on the Moon [52.418394025548295]
Global localization is necessary for autonomous operations on the lunar surface where traditional Earth-based navigation infrastructure, such as GPS, is unavailable.<n>We propose LunarLoc, an approach to global localization that leverages instance segmentation for zero-shot extraction of boulder landmarks from onboard stereo imagery.<n>LunarLoc achieves sub-cm level accuracy in multi-session global localization experiments, significantly outperforming the state of the art in lunar global localization.
arXiv Detail & Related papers (2025-06-20T12:06:47Z) - Enhancing Monocular Height Estimation via Sparse LiDAR-Guided Correction [25.268217296287688]
We investigate a state-of-the-art MHE model trained purely on synthetic data.<n>We find that the model relies heavily on shadow cues, a factor that can lead to overestimation or underestimation of heights.<n>We propose a novel correction pipeline that integrates sparse, imperfect global LiDAR measurements.
arXiv Detail & Related papers (2025-05-11T08:54:09Z) - TanDepth: Leveraging Global DEMs for Metric Monocular Depth Estimation in UAVs [5.6168844664788855]
This work presents TanDepth, a practical scale recovery method for obtaining metric depth results from relative estimations at inference-time.<n>Our method leverages sparse measurements from Global Digital Elevation Models (GDEM) by projecting them to the camera view.<n>An adaptation to the Cloth Filter Simulation is presented, which allows selecting ground points from the estimated depth map to then correlate with the projected reference points.
arXiv Detail & Related papers (2024-09-08T15:54:43Z) - ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation [62.600382533322325]
We propose a novel monocular depth estimation method called ScaleDepth.
Our method decomposes metric depth into scene scale and relative depth, and predicts them through a semantic-aware scale prediction module.
Our method achieves metric depth estimation for both indoor and outdoor scenes in a unified framework.
arXiv Detail & Related papers (2024-07-11T05:11:56Z) - Monocular Visual-Inertial Depth Estimation [66.71452943981558]
We present a visual-inertial depth estimation pipeline that integrates monocular depth estimation and visual-inertial odometry.
Our approach performs global scale and shift alignment against sparse metric depth, followed by learning-based dense alignment.
We evaluate on the TartanAir and VOID datasets, observing up to 30% reduction in RMSE with dense scale alignment.
arXiv Detail & Related papers (2023-03-21T18:47:34Z) - Mind The Edge: Refining Depth Edges in Sparsely-Supervised Monocular Depth Estimation [42.19770683222846]
Monocular Depth Estimation (MDE) is a fundamental problem in computer vision with numerous applications.
In this paper we propose to learn to detect the location of depth edges from densely-supervised synthetic data.
We demonstrate significant gains in the accuracy of the depth edges with comparable per-pixel depth accuracy on several challenging datasets.
arXiv Detail & Related papers (2022-12-10T14:49:24Z) - Improving Monocular Visual Odometry Using Learned Depth [84.05081552443693]
We propose a framework to exploit monocular depth estimation for improving visual odometry (VO)
The core of our framework is a monocular depth estimation module with a strong generalization capability for diverse scenes.
Compared with current learning-based VO methods, our method demonstrates a stronger generalization ability to diverse scenes.
arXiv Detail & Related papers (2022-04-04T06:26:46Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.