ZePHyR: Zero-shot Pose Hypothesis Rating
- URL: http://arxiv.org/abs/2104.13526v2
- Date: Fri, 30 Apr 2021 04:11:27 GMT
- Title: ZePHyR: Zero-shot Pose Hypothesis Rating
- Authors: Brian Okorn, Qiao Gu, Martial Hebert, David Held
- Abstract summary: We introduce a novel method for zero-shot object pose estimation in clutter.
Our approach uses a hypothesis generation and scoring framework, with a focus on learning a scoring function that generalizes to objects not used for training.
We demonstrate how our system can be used by quickly scanning and building a model of a novel object, which can immediately be used by our method for pose estimation.
- Score: 36.52070583343388
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Pose estimation is a basic module in many robot manipulation pipelines.
Estimating the pose of objects in the environment can be useful for grasping,
motion planning, or manipulation. However, current state-of-the-art methods for
pose estimation either rely on large annotated training sets or simulated data.
Further, the long training times for these methods prohibit quick interaction
with novel objects. To address these issues, we introduce a novel method for
zero-shot object pose estimation in clutter. Our approach uses a hypothesis
generation and scoring framework, with a focus on learning a scoring function
that generalizes to objects not used for training. We achieve zero-shot
generalization by rating hypotheses as a function of unordered point
differences. We evaluate our method on challenging datasets with both textured
and untextured objects in cluttered scenes and demonstrate that our method
significantly outperforms previous methods on this task. We also demonstrate
how our system can be used by quickly scanning and building a model of a novel
object, which can immediately be used by our method for pose estimation. Our
work allows users to estimate the pose of novel objects without requiring any
retraining. Additional information can be found on our website
https://bokorn.github.io/zephyr/
Related papers
- Generalizable Pose Estimation Using Implicit Scene Representations [4.124185654280966]
6-DoF pose estimation is an essential component of robotic manipulation pipelines.
We address the generalization capability of pose estimation using models that contain enough information to render it in different poses.
Our final evaluation shows a significant improvement in inference performance and speed compared to existing approaches.
arXiv Detail & Related papers (2023-05-26T20:42:52Z) - ShapeShift: Superquadric-based Object Pose Estimation for Robotic
Grasping [85.38689479346276]
Current techniques heavily rely on a reference 3D object, limiting their generalizability and making it expensive to expand to new object categories.
This paper proposes ShapeShift, a superquadric-based framework for object pose estimation that predicts the object's pose relative to a primitive shape which is fitted to the object.
arXiv Detail & Related papers (2023-04-10T20:55:41Z) - PoseMatcher: One-shot 6D Object Pose Estimation by Deep Feature Matching [51.142988196855484]
We propose PoseMatcher, an accurate model free one-shot object pose estimator.
We create a new training pipeline for object to image matching based on a three-view system.
To enable PoseMatcher to attend to distinct input modalities, an image and a pointcloud, we introduce IO-Layer.
arXiv Detail & Related papers (2023-04-03T21:14:59Z) - KeyMatchNet: Zero-Shot Pose Estimation in 3D Point Clouds by Generalized
Keypoint Matching [5.710971447109951]
KeyMatchNet is a novel network for zero-shot pose estimation in 3D point clouds.
The method generalizes to new objects by using not only the scene point cloud as input but also the object point cloud.
arXiv Detail & Related papers (2023-03-28T16:11:31Z) - NOPE: Novel Object Pose Estimation from a Single Image [67.11073133072527]
We propose an approach that takes a single image of a new object as input and predicts the relative pose of this object in new images without prior knowledge of the object's 3D model.
We achieve this by training a model to directly predict discriminative embeddings for viewpoints surrounding the object.
This prediction is done using a simple U-Net architecture with attention and conditioned on the desired pose, which yields extremely fast inference.
arXiv Detail & Related papers (2023-03-23T18:55:43Z) - LocPoseNet: Robust Location Prior for Unseen Object Pose Estimation [69.70498875887611]
LocPoseNet is able to robustly learn location prior for unseen objects.
Our method outperforms existing works by a large margin on LINEMOD and GenMOP.
arXiv Detail & Related papers (2022-11-29T15:21:34Z) - Unseen Object 6D Pose Estimation: A Benchmark and Baselines [62.8809734237213]
We propose a new task that enables and facilitates algorithms to estimate the 6D pose estimation of novel objects during testing.
We collect a dataset with both real and synthetic images and up to 48 unseen objects in the test set.
By training an end-to-end 3D correspondences network, our method finds corresponding points between an unseen object and a partial view RGBD image accurately and efficiently.
arXiv Detail & Related papers (2022-06-23T16:29:53Z) - Zero-Shot Category-Level Object Pose Estimation [24.822189326540105]
We tackle the problem of estimating the pose of novel object categories in a zero-shot manner.
This extends much of the existing literature by removing the need for pose-labelled datasets or category-specific CAD models.
Our method provides a six-fold improvement in average rotation accuracy at 30 degrees.
arXiv Detail & Related papers (2022-04-07T17:58:39Z) - OSSID: Online Self-Supervised Instance Detection by (and for) Pose
Estimation [17.78557307620686]
Real-time object pose estimation is necessary for many robot manipulation algorithms.
We propose the OSSID framework, leveraging a slow zero-shot pose estimator to self-supervise the training of a fast detection algorithm.
We show that this self-supervised training exceeds the performance of existing zero-shot detection methods.
arXiv Detail & Related papers (2022-01-18T20:55:56Z) - Few-shot Weakly-Supervised Object Detection via Directional Statistics [55.97230224399744]
We propose a probabilistic multiple instance learning approach for few-shot Common Object Localization (COL) and few-shot Weakly Supervised Object Detection (WSOD)
Our model simultaneously learns the distribution of the novel objects and localizes them via expectation-maximization steps.
Our experiments show that the proposed method, despite being simple, outperforms strong baselines in few-shot COL and WSOD, as well as large-scale WSOD tasks.
arXiv Detail & Related papers (2021-03-25T22:34:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.