Active Learning for Bayesian 3D Hand Pose Estimation
- URL: http://arxiv.org/abs/2010.00694v2
- Date: Sun, 21 Feb 2021 04:56:35 GMT
- Title: Active Learning for Bayesian 3D Hand Pose Estimation
- Authors: Razvan Caramalau, Binod Bhattarai, Tae-Kyun Kim
- Abstract summary: We propose a Bayesian approximation to a deep learning architecture for 3D hand pose estimation.
Through this framework, we explore and analyse the two types of uncertainties that are influenced either by data or by the learning capability.
- Score: 53.99104862192055
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We propose a Bayesian approximation to a deep learning architecture for 3D
hand pose estimation. Through this framework, we explore and analyse the two
types of uncertainties that are influenced either by data or by the learning
capability. Furthermore, we draw comparisons against the standard estimator
over three popular benchmarks. The first contribution lies in outperforming the
baseline while in the second part we address the active learning application.
We also show that with a newly proposed acquisition function, our Bayesian 3D
hand pose estimator obtains lowest errors with the least amount of data. The
underlying code is publicly available at
https://github.com/razvancaramalau/al_bhpe.
Related papers
- Bayesian Self-Training for Semi-Supervised 3D Segmentation [59.544558398992386]
3D segmentation is a core problem in computer vision.
densely labeling 3D point clouds to employ fully-supervised training remains too labor intensive and expensive.
Semi-supervised training provides a more practical alternative, where only a small set of labeled data is given, accompanied by a larger unlabeled set.
arXiv Detail & Related papers (2024-09-12T14:54:31Z) - RadOcc: Learning Cross-Modality Occupancy Knowledge through Rendering
Assisted Distillation [50.35403070279804]
3D occupancy prediction is an emerging task that aims to estimate the occupancy states and semantics of 3D scenes using multi-view images.
We propose RadOcc, a Rendering assisted distillation paradigm for 3D Occupancy prediction.
arXiv Detail & Related papers (2023-12-19T03:39:56Z) - CheckerPose: Progressive Dense Keypoint Localization for Object Pose
Estimation with Graph Neural Network [66.24726878647543]
Estimating the 6-DoF pose of a rigid object from a single RGB image is a crucial yet challenging task.
Recent studies have shown the great potential of dense correspondence-based solutions.
We propose a novel pose estimation algorithm named CheckerPose, which improves on three main aspects.
arXiv Detail & Related papers (2023-03-29T17:30:53Z) - SpyroPose: SE(3) Pyramids for Object Pose Distribution Estimation [4.8342038441006805]
We propose a novel method for pose distribution estimation on SE(3).
We use a hierarchical grid, a pyramid, which enables efficient importance sampling during training and sparse evaluation of the pyramid at inference.
Our method outperforms state-of-the-art methods on SO(3), and to the best of our knowledge, we provide the first quantitative results on pose distribution estimation on SE(3).
arXiv Detail & Related papers (2023-03-09T14:58:01Z) - VL4Pose: Active Learning Through Out-Of-Distribution Detection For Pose
Estimation [79.50280069412847]
We introduce VL4Pose, a first principles approach for active learning through out-of-distribution detection.
Our solution involves modelling the pose through a simple parametric Bayesian network trained via maximum likelihood estimation.
We perform qualitative and quantitative experiments on three datasets: MPII, LSP and ICVL, spanning human and hand pose estimation.
arXiv Detail & Related papers (2022-10-12T09:03:55Z) - SurfEmb: Dense and Continuous Correspondence Distributions for Object
Pose Estimation with Learnt Surface Embeddings [2.534402217750793]
We present an approach to learn dense, continuous 2D-3D correspondence distributions over the surface of objects from data.
We also present a new method for 6D pose estimation of rigid objects using the learnt distributions to sample, score and refine pose hypotheses.
arXiv Detail & Related papers (2021-11-26T13:39:38Z) - Semi-supervised 3D Hand-Object Pose Estimation via Pose Dictionary
Learning [27.78922896432688]
Current hand-object pose estimation methods require detailed 3D labels, which are expensive and labor-intensive.
We propose a semi-supervised 3D hand-object pose estimation method with two key techniques: pose dictionary learning and an object-oriented coordinate system.
Our method reduces estimation error by 19.5% / 24.9% for hands/objects compared to straightforward use of labeled data.
arXiv Detail & Related papers (2021-07-16T02:50:17Z) - Deep Optimized Priors for 3D Shape Modeling and Reconstruction [38.79018852887249]
We introduce a new learning framework for 3D modeling and reconstruction.
We show that the proposed strategy effectively breaks the barriers constrained by the pre-trained priors.
arXiv Detail & Related papers (2020-12-14T03:56:31Z) - Bridging the Reality Gap for Pose Estimation Networks using Sensor-Based
Domain Randomization [1.4290119665435117]
Methods trained on synthetic data use 2D images, as domain randomization in 2D is more developed.
Our method integrates the 3D data into the network to increase the accuracy of the pose estimation.
Experiments on three large pose estimation benchmarks show that the presented method outperforms previous methods trained on synthetic data.
arXiv Detail & Related papers (2020-11-17T09:12:11Z) - Fast Uncertainty Quantification for Deep Object Pose Estimation [91.09217713805337]
Deep learning-based object pose estimators are often unreliable and overconfident.
In this work, we propose a simple, efficient, and plug-and-play UQ method for 6-DoF object pose estimation.
arXiv Detail & Related papers (2020-11-16T06:51:55Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.