A technique to jointly estimate depth and depth uncertainty for unmanned aerial vehicles

• URL: http://arxiv.org/abs/2305.19780v1
• Date: Wed, 31 May 2023 12:13:45 GMT
• Title: A technique to jointly estimate depth and depth uncertainty for unmanned aerial vehicles
• Authors: Micha\"el Fonder and Marc Van Droogenbroeck
• Abstract summary: M4Depth is a state-of-the-art depth estimation method designed for unmanned aerial vehicle (UAV) applications. We show how M4Depth can be enhanced to perform joint depth and uncertainty estimation.
• Score: 11.725077632618879
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: When used by autonomous vehicles for trajectory planning or obstacle avoidance, depth estimation methods need to be reliable. Therefore, estimating the quality of the depth outputs is critical. In this paper, we show how M4Depth, a state-of-the-art depth estimation method designed for unmanned aerial vehicle (UAV) applications, can be enhanced to perform joint depth and uncertainty estimation. For that, we present a solution to convert the uncertainty estimates related to parallax generated by M4Depth into uncertainty estimates related to depth, and show that it outperforms the standard probabilistic approach. Our experiments on various public datasets demonstrate that our method performs consistently, even in zero-shot transfer. Besides, our method offers a compelling value when compared to existing multi-view depth estimation methods as it performs similarly on a multi-view depth estimation benchmark despite being 2.5 times faster and causal, as opposed to other methods. The code of our method is publicly available at https://github.com/michael-fonder/M4DepthU .

Related papers

• IA-MVS: Instance-Focused Adaptive Depth Sampling for Multi-View Stereo [4.8042164035190424]
  Multi-view stereo (MVS) models based on progressive depth hypothesis narrowing have made remarkable advancements.<n>Existing methods haven't fully utilized the potential that the depth coverage of individual instances is smaller than that of the entire scene.<n>In this paper, we propose Instance-Adaptive MVS (IA-MVS)<n>It enhances the precision of depth estimation by narrowing the depth hypothesis range and conducting refinement on each instance.
  arXiv  Detail & Related papers  (2025-05-19T05:11:39Z)
• Revisiting Gradient-based Uncertainty for Monocular Depth Estimation [10.502852645001882]
  We introduce gradient-based uncertainty estimation for monocular depth estimation models. We demonstrate that our approach is effective in determining the uncertainty without re-training. In particular, for models trained with monocular sequences and therefore most prone to uncertainty, our method outperforms related approaches.
  arXiv  Detail & Related papers  (2025-02-09T17:21:41Z)
• ScaleDepth: Decomposing Metric Depth Estimation into Scale Prediction and Relative Depth Estimation [62.600382533322325]
  We propose a novel monocular depth estimation method called ScaleDepth. Our method decomposes metric depth into scene scale and relative depth, and predicts them through a semantic-aware scale prediction module. Our method achieves metric depth estimation for both indoor and outdoor scenes in a unified framework.
  arXiv  Detail & Related papers  (2024-07-11T05:11:56Z)
• Single Image Depth Prediction Made Better: A Multivariate Gaussian Take [163.14849753700682]
  We introduce an approach that performs continuous modeling of per-pixel depth. Our method's accuracy (named MG) is among the top on the KITTI depth-prediction benchmark leaderboard.
  arXiv  Detail & Related papers  (2023-03-31T16:01:03Z)
• Diversity Matters: Fully Exploiting Depth Clues for Reliable Monocular 3D Object Detection [37.37316176663782]
  We propose a depth solving system that fully explores the visual clues from the subtasks in monocular 3D images. Our method surpasses the current best method by more than 20% relatively on the Moderate level of test split in the KITTI 3D object detection benchmark.
  arXiv  Detail & Related papers  (2022-05-19T08:12:55Z)
• Robust Depth Completion with Uncertainty-Driven Loss Functions [60.9237639890582]
  We introduce uncertainty-driven loss functions to improve the robustness of depth completion and handle the uncertainty in depth completion. Our method has been tested on KITTI Depth Completion Benchmark and achieved the state-of-the-art robustness performance in terms of MAE, IMAE, and IRMSE metrics.
  arXiv  Detail & Related papers  (2021-12-15T05:22:34Z)
• On the Sins of Image Synthesis Loss for Self-supervised Depth Estimation [60.780823530087446]
  We show that improvements in image synthesis do not necessitate improvement in depth estimation. We attribute this diverging phenomenon to aleatoric uncertainties, which originate from data. This observed divergence has not been previously reported or studied in depth.
  arXiv  Detail & Related papers  (2021-09-13T17:57:24Z)
• Bayesian Deep Basis Fitting for Depth Completion with Uncertainty [13.2830249140166]
  We extend Deep Basis Fitting (DBF) for depth completion within a Bayesian evidence framework. By adopting a Bayesian treatment, our approach is able to 1) predict high-quality uncertainty estimates and 2) enable depth completion with few or no sparse measurements.
  arXiv  Detail & Related papers  (2021-03-29T00:40:02Z)
• Variational Monocular Depth Estimation for Reliability Prediction [12.951621755732544]
  Self-supervised learning for monocular depth estimation is widely investigated as an alternative to supervised learning approach. Previous works have successfully improved the accuracy of depth estimation by modifying the model structure. In this paper, we theoretically formulate a variational model for the monocular depth estimation to predict the reliability of the estimated depth image.
  arXiv  Detail & Related papers  (2020-11-24T06:23:51Z)
• A New Distributional Ranking Loss With Uncertainty: Illustrated in Relative Depth Estimation [0.0]
  We propose a new approach for the problem of relative depth estimation from a single image. Instead of directly regressing over depth scores, we formulate the problem as estimation of a probability distribution over depth. To train our model, we propose a new ranking loss, Distributional Loss, which tries to increase the probability of farther pixel's depth being greater than the closer pixel's depth.
  arXiv  Detail & Related papers  (2020-10-14T13:47:18Z)
• Adaptive confidence thresholding for monocular depth estimation [83.06265443599521]
  We propose a new approach to leverage pseudo ground truth depth maps of stereo images generated from self-supervised stereo matching methods. The confidence map of the pseudo ground truth depth map is estimated to mitigate performance degeneration by inaccurate pseudo depth maps. Experimental results demonstrate superior performance to state-of-the-art monocular depth estimation methods.
  arXiv  Detail & Related papers  (2020-09-27T13:26:16Z)
• On the uncertainty of self-supervised monocular depth estimation [52.13311094743952]
  Self-supervised paradigms for monocular depth estimation are very appealing since they do not require ground truth annotations at all. We explore for the first time how to estimate the uncertainty for this task and how this affects depth accuracy. We propose a novel peculiar technique specifically designed for self-supervised approaches.
  arXiv  Detail & Related papers  (2020-05-13T09:00:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.