Shape Completion with Prediction of Uncertain Regions
- URL: http://arxiv.org/abs/2308.00377v1
- Date: Tue, 1 Aug 2023 08:40:40 GMT
- Title: Shape Completion with Prediction of Uncertain Regions
- Authors: Matthias Humt, Dominik Winkelbauer, Ulrich Hillenbrand
- Abstract summary: In particular, there can be an irreducible uncertainty in extended regions about the presence of entire object parts when given ambiguous object views.
We propose two novel methods for predicting such uncertain regions as straightforward extensions of any method for predicting local spatial occupancy.
We train on this dataset and test each method in shape completion and prediction of uncertain regions for known and novel object instances.
- Score: 4.689234879218989
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Shape completion, i.e., predicting the complete geometry of an object from a
partial observation, is highly relevant for several downstream tasks, most
notably robotic manipulation. When basing planning or prediction of real grasps
on object shape reconstruction, an indication of severe geometric uncertainty
is indispensable. In particular, there can be an irreducible uncertainty in
extended regions about the presence of entire object parts when given ambiguous
object views. To treat this important case, we propose two novel methods for
predicting such uncertain regions as straightforward extensions of any method
for predicting local spatial occupancy, one through postprocessing occupancy
scores, the other through direct prediction of an uncertainty indicator. We
compare these methods together with two known approaches to probabilistic shape
completion. Moreover, we generate a dataset, derived from ShapeNet, of
realistically rendered depth images of object views with ground-truth
annotations for the uncertain regions. We train on this dataset and test each
method in shape completion and prediction of uncertain regions for known and
novel object instances and on synthetic and real data. While direct uncertainty
prediction is by far the most accurate in the segmentation of uncertain
regions, both novel methods outperform the two baselines in shape completion
and uncertain region prediction, and avoiding the predicted uncertain regions
increases the quality of grasps for all tested methods. Web:
https://github.com/DLR-RM/shape-completion
Related papers
- Distribution-Free Conformal Joint Prediction Regions for Neural Marked Temporal Point Processes [4.324839843326325]
We develop more reliable methods for uncertainty in neural TPP models via the framework of conformal prediction.
A primary objective is to generate a distribution-free joint prediction region for an event's arrival time and mark, with a finite-sample marginal coverage guarantee.
arXiv Detail & Related papers (2024-01-09T15:28:29Z) - Topology-Aware Uncertainty for Image Segmentation [19.248891926246383]
We focus on uncertainty estimation for such tasks, so that highly uncertain, and thus error-prone structures can be identified for human annotators to verify.
We propose a joint prediction model that estimates the uncertainty of a structure while taking the neighboring structures into consideration.
We also propose a novel Probabilistic DMT to model the inherent uncertainty within each structure.
arXiv Detail & Related papers (2023-06-09T05:01:55Z) - Pixel-wise Gradient Uncertainty for Convolutional Neural Networks
applied to Out-of-Distribution Segmentation [0.43512163406552007]
We present a method for obtaining uncertainty scores from pixel-wise loss gradients which can be computed efficiently during inference.
Our experiments show the ability of our method to identify wrong pixel classifications and to estimate prediction quality at negligible computational overhead.
arXiv Detail & Related papers (2023-03-13T08:37:59Z) - Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose
Estimation [70.32536356351706]
We introduce MRP-Net that constitutes a common deep network backbone with two output heads subscribing to two diverse configurations.
We derive suitable measures to quantify prediction uncertainty at both pose and joint level.
We present a comprehensive evaluation of the proposed approach and demonstrate state-of-the-art performance on benchmark datasets.
arXiv Detail & Related papers (2022-03-29T07:14:58Z) - NUQ: Nonparametric Uncertainty Quantification for Deterministic Neural
Networks [151.03112356092575]
We show the principled way to measure the uncertainty of predictions for a classifier based on Nadaraya-Watson's nonparametric estimate of the conditional label distribution.
We demonstrate the strong performance of the method in uncertainty estimation tasks on a variety of real-world image datasets.
arXiv Detail & Related papers (2022-02-07T12:30:45Z) - Dense Uncertainty Estimation [62.23555922631451]
In this paper, we investigate neural networks and uncertainty estimation techniques to achieve both accurate deterministic prediction and reliable uncertainty estimation.
We work on two types of uncertainty estimations solutions, namely ensemble based methods and generative model based methods, and explain their pros and cons while using them in fully/semi/weakly-supervised framework.
arXiv Detail & Related papers (2021-10-13T01:23:48Z) - CertainNet: Sampling-free Uncertainty Estimation for Object Detection [65.28989536741658]
Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings.
In this work, we propose a novel sampling-free uncertainty estimation method for object detection.
We call it CertainNet, and it is the first to provide separate uncertainties for each output signal: objectness, class, location and size.
arXiv Detail & Related papers (2021-10-04T17:59:31Z) - Estimating and Exploiting the Aleatoric Uncertainty in Surface Normal
Estimation [25.003116148843525]
Surface normal estimation from a single image is an important task in 3D scene understanding.
In this paper, we address two limitations shared by the existing methods: the inability to estimate the aleatoric uncertainty and lack of detail in the prediction.
We present a novel decoder framework where pixel-wise perceptrons are trained on a subset of pixels sampled based on the estimated uncertainty.
arXiv Detail & Related papers (2021-09-20T23:30:04Z) - Confidence Adaptive Anytime Pixel-Level Recognition [86.75784498879354]
Anytime inference requires a model to make a progression of predictions which might be halted at any time.
We propose the first unified and end-to-end model approach for anytime pixel-level recognition.
arXiv Detail & Related papers (2021-04-01T20:01:57Z) - Probabilistic Deep Learning for Instance Segmentation [9.62543698736491]
We propose a generic method to obtain model-inherent uncertainty estimates within proposal-free instance segmentation models.
We evaluate our method on the BBBC010 C. elegans dataset, where it yields competitive performance.
arXiv Detail & Related papers (2020-08-24T19:51:48Z) - Refined Plane Segmentation for Cuboid-Shaped Objects by Leveraging Edge
Detection [63.942632088208505]
We propose a post-processing algorithm to align the segmented plane masks with edges detected in the image.
This allows us to increase the accuracy of state-of-the-art approaches, while limiting ourselves to cuboid-shaped objects.
arXiv Detail & Related papers (2020-03-28T18:51:43Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.