Category-Level and Open-Set Object Pose Estimation for Robotics

• URL: http://arxiv.org/abs/2504.19572v1
• Date: Mon, 28 Apr 2025 08:31:33 GMT
• Title: Category-Level and Open-Set Object Pose Estimation for Robotics
• Authors: Peter Hönig, Matthias Hirschmanner, Markus Vincze,
• Abstract summary: This paper compares datasets, accuracy metrics, and algorithms for solving 6D pose estimation on the category-level.<n>We analyze how to bridge category-level and open-set object pose estimation to reach generalization and provide actionable recommendations.
• Score: 7.9471205712560264
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Object pose estimation enables a variety of tasks in computer vision and robotics, including scene understanding and robotic grasping. The complexity of a pose estimation task depends on the unknown variables related to the target object. While instance-level methods already excel for opaque and Lambertian objects, category-level and open-set methods, where texture, shape, and size are partially or entirely unknown, still struggle with these basic material properties. Since texture is unknown in these scenarios, it cannot be used for disambiguating object symmetries, another core challenge of 6D object pose estimation. The complexity of estimating 6D poses with such a manifold of unknowns led to various datasets, accuracy metrics, and algorithmic solutions. This paper compares datasets, accuracy metrics, and algorithms for solving 6D pose estimation on the category-level. Based on this comparison, we analyze how to bridge category-level and open-set object pose estimation to reach generalization and provide actionable recommendations.

Related papers

• FreeZe: Training-free zero-shot 6D pose estimation with geometric and vision foundation models [5.754251195342313]
  We show how to tackle the same task but without training on specific data.<n>We propose FreeZe, a novel solution that harnesses the capabilities of pre-trained geometric and vision foundation models.<n>FreeZe consistently outperforms all state-of-the-art approaches, including competitors extensively trained on synthetic 6D pose estimation data.
  arXiv  Detail & Related papers  (2023-12-01T22:00:14Z)
• ZS6D: Zero-shot 6D Object Pose Estimation using Vision Transformers [9.899633398596672]
  We introduce ZS6D, for zero-shot novel object 6D pose estimation. Visual descriptors, extracted using pre-trained Vision Transformers (ViT), are used for matching rendered templates. Experiments are performed on LMO, YCBV, and TLESS datasets.
  arXiv  Detail & Related papers  (2023-09-21T11:53:01Z)
• You Only Look at One: Category-Level Object Representations for Pose Estimation From a Single Example [26.866356430469757]
  We present a method for achieving category-level pose estimation by inspection of just a single object from a desired category. We demonstrate that our method runs in real-time, enabling a robot manipulator equipped with an RGBD sensor to perform online 6D pose estimation for novel objects.
  arXiv  Detail & Related papers  (2023-05-22T01:32:24Z)
• ShapeShift: Superquadric-based Object Pose Estimation for Robotic Grasping [85.38689479346276]
  Current techniques heavily rely on a reference 3D object, limiting their generalizability and making it expensive to expand to new object categories. This paper proposes ShapeShift, a superquadric-based framework for object pose estimation that predicts the object's pose relative to a primitive shape which is fitted to the object.
  arXiv  Detail & Related papers  (2023-04-10T20:55:41Z)
• MegaPose: 6D Pose Estimation of Novel Objects via Render & Compare [84.80956484848505]
  MegaPose is a method to estimate the 6D pose of novel objects, that is, objects unseen during training. We present a 6D pose refiner based on a render&compare strategy which can be applied to novel objects. Second, we introduce a novel approach for coarse pose estimation which leverages a network trained to classify whether the pose error between a synthetic rendering and an observed image of the same object can be corrected by the refiner.
  arXiv  Detail & Related papers  (2022-12-13T19:30:03Z)
• Context-aware 6D Pose Estimation of Known Objects using RGB-D data [3.48122098223937]
  6D object pose estimation has been a research topic in the field of computer vision and robotics. We present an architecture that, unlike prior work, is context-aware. Our experiments show an enhancement in the accuracy of about 3.2% over the LineMOD dataset.
  arXiv  Detail & Related papers  (2022-12-11T18:01:01Z)
• LocPoseNet: Robust Location Prior for Unseen Object Pose Estimation [69.70498875887611]
  LocPoseNet is able to robustly learn location prior for unseen objects. Our method outperforms existing works by a large margin on LINEMOD and GenMOP.
  arXiv  Detail & Related papers  (2022-11-29T15:21:34Z)
• Unseen Object 6D Pose Estimation: A Benchmark and Baselines [62.8809734237213]
  We propose a new task that enables and facilitates algorithms to estimate the 6D pose estimation of novel objects during testing. We collect a dataset with both real and synthetic images and up to 48 unseen objects in the test set. By training an end-to-end 3D correspondences network, our method finds corresponding points between an unseen object and a partial view RGBD image accurately and efficiently.
  arXiv  Detail & Related papers  (2022-06-23T16:29:53Z)
• Category-Agnostic 6D Pose Estimation with Conditional Neural Processes [19.387280883044482]
  We present a novel meta-learning approach for 6D pose estimation on unknown objects. Our algorithm learns object representation in a category-agnostic way, which endows it with strong generalization capabilities across object categories.
  arXiv  Detail & Related papers  (2022-06-14T20:46:09Z)
• Coupled Iterative Refinement for 6D Multi-Object Pose Estimation [64.7198752089041]
  Given a set of known 3D objects and an RGB or RGB-D input image, we detect and estimate the 6D pose of each object. Our approach iteratively refines both pose and correspondence in a tightly coupled manner, allowing us to dynamically remove outliers to improve accuracy.
  arXiv  Detail & Related papers  (2022-04-26T18:00:08Z)
• CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learning [74.53664270194643]
  Modern monocular 6D pose estimation methods can only cope with a handful of object instances. We propose a novel method for class-level monocular 6D pose estimation, coupled with metric shape retrieval. We experimentally demonstrate that we can retrieve precise 6D poses and metric shapes from a single RGB image.
  arXiv  Detail & Related papers  (2020-03-12T15:28:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.