A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometry

• URL: http://arxiv.org/abs/2605.05095v1
• Date: Wed, 06 May 2026 16:32:55 GMT
• Title: A Bayesian Approach for Task-Specific Next-Best-View Selection with Uncertain Geometry
• Abstract summary: We develop a framework for task-specific active next-best-view selection in 3D reconstruction from point clouds.<n>Our framework achieves superior task performance with fewer views compared to commonly used baselines and prior general uncertainty-reduction techniques.
• Score: 50.782490644267334
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop a framework for task-specific active next-best-view selection in 3D reconstruction from point clouds, by casting the problem in the language of Bayesian decision theory. Our framework works by (a) placing a prior distribution over the space of implicit surfaces, (b) using recently-developed stochastic surface reconstruction methods to calculate the resulting posterior distribution, then (c) using the posterior distribution to carefully reason about which view to scan next. This enables us to perform camera selection in a manner that is directly optimized for the intended use of the reconstructed data - meaning, we reduce uncertainty only in those regions that make a difference in the task at hand, as opposed to prior approaches that reduce it uniformly across space. We evaluate our method across three distinct downstream tasks: semantic classification, segmentation, and PDE-guided physics simulation. Experimental results demonstrate that our framework achieves superior task performance with fewer views compared to commonly used baselines and prior general uncertainty-reduction techniques.

Related papers

• UNOPose: Unseen Object Pose Estimation with an Unposed RGB-D Reference Image [86.7128543480229]
  Unseen object pose estimation methods often rely on CAD models or multiple reference views.<n>To simplify reference acquisition, we aim to estimate the unseen object's pose through a single unposed RGB-D reference image.<n>We present a novel approach and benchmark, termed UNOPose, for unseen one-reference-based object pose estimation.
  arXiv  Detail & Related papers  (2024-11-25T05:36:00Z)
• OPUS: Occupancy Prediction Using a Sparse Set [64.60854562502523]
  We present a framework to simultaneously predict occupied locations and classes using a set of learnable queries. OPUS incorporates a suite of non-trivial strategies to enhance model performance. Our lightest model achieves superior RayIoU on the Occ3D-nuScenes dataset at near 2x FPS, while our heaviest model surpasses previous best results by 6.1 RayIoU.
  arXiv  Detail & Related papers  (2024-09-14T07:44:22Z)
• Occlusion Handling in 3D Human Pose Estimation with Perturbed Positional Encoding [15.834419910916933]
  We propose a novel positional encoding technique, PerturbPE, that extracts consistent and regular components from the eigenbasis. Our results support our theoretical findings, e.g. our experimental analysis observed a performance enhancement of up to $12%$ on the Human3.6M dataset. Our novel approach significantly enhances performance in scenarios where two edges are missing, setting a new benchmark for state-of-the-art.
  arXiv  Detail & Related papers  (2024-05-27T17:48:54Z)
• RBP-Pose: Residual Bounding Box Projection for Category-Level Pose Estimation [103.74918834553247]
  Category-level object pose estimation aims to predict the 6D pose as well as the 3D metric size of arbitrary objects from a known set of categories. Recent methods harness shape prior adaptation to map the observed point cloud into the canonical space and apply Umeyama algorithm to recover the pose and size. We propose a novel geometry-guided Residual Object Bounding Box Projection network RBP-Pose that jointly predicts object pose and residual vectors.
  arXiv  Detail & Related papers  (2022-07-30T14:45:20Z)
• Optimization of Directional Landmark Deployment for Visual Observer on SE(3) [11.064269835254791]
  An optimization method is proposed for deployment of given number of directional landmarks within a given region in the 3-D task space. The technique is built on the geometric models of both landmarks and the monocular camera. Both simulation and experimental results are presented to validate the effectiveness of the proposed landmark deployment optimization method.
  arXiv  Detail & Related papers  (2022-03-28T04:06:14Z)
• A Probabilistic Framework for Dynamic Object Recognition in 3D Environment With A Novel Continuous Ground Estimation Method [0.0]
  A probabilistic framework is developed and proposed for Dynamic Object Recognition in 3D Environments. A novel Gaussian Process Regression (GPR) based method is developed to detect ground points in different urban scenarios.
  arXiv  Detail & Related papers  (2022-01-27T16:07:10Z)
• Dynamic Iterative Refinement for Efficient 3D Hand Pose Estimation [87.54604263202941]
  We propose a tiny deep neural network of which partial layers are iteratively exploited for refining its previous estimations. We employ learned gating criteria to decide whether to exit from the weight-sharing loop, allowing per-sample adaptation in our model. Our method consistently outperforms state-of-the-art 2D/3D hand pose estimation approaches in terms of both accuracy and efficiency for widely used benchmarks.
  arXiv  Detail & Related papers  (2021-11-11T23:31:34Z)
• Posterior Meta-Replay for Continual Learning [4.319932092720977]
  Continual Learning (CL) algorithms have recently received a lot of attention as they attempt to overcome the need to train with an i.i.d. sample from some unknown target data distribution. We study principled ways to tackle the CL problem by adopting a Bayesian perspective and focus on continually learning a task-specific posterior distribution.
  arXiv  Detail & Related papers  (2021-03-01T17:08:35Z)
• Next-best-view Regression using a 3D Convolutional Neural Network [0.9449650062296823]
  We propose a data-driven approach to address the next-best-view problem. The proposed approach trains a 3D convolutional neural network with previous reconstructions in order to regress the btxtposition of the next-best-view. We have validated the proposed approach making use of two groups of experiments.
  arXiv  Detail & Related papers  (2021-01-23T01:50:26Z)
• Robust 6D Object Pose Estimation by Learning RGB-D Features [59.580366107770764]
  We propose a novel discrete-continuous formulation for rotation regression to resolve this local-optimum problem. We uniformly sample rotation anchors in SO(3), and predict a constrained deviation from each anchor to the target, as well as uncertainty scores for selecting the best prediction. Experiments on two benchmarks: LINEMOD and YCB-Video, show that the proposed method outperforms state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-02-29T06:24:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.