Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding

• URL: http://arxiv.org/abs/2212.01920v1
• Date: Sun, 4 Dec 2022 20:45:46 GMT
• Title: Review on 6D Object Pose Estimation with the focus on Indoor Scene Understanding
• Authors: Negar Nejatishahidin and Pooya Fayyazsanavi
• Abstract summary: 6D object pose estimation problem has been extensively studied in the field of Computer Vision and Robotics. As a part of our discussion, we will focus on how 6D object pose estimation can be used for understanding 3D scenes.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: 6D object pose estimation problem has been extensively studied in the field of Computer Vision and Robotics. It has wide range of applications such as robot manipulation, augmented reality, and 3D scene understanding. With the advent of Deep Learning, many breakthroughs have been made; however, approaches continue to struggle when they encounter unseen instances, new categories, or real-world challenges such as cluttered backgrounds and occlusions. In this study, we will explore the available methods based on input modality, problem formulation, and whether it is a category-level or instance-level approach. As a part of our discussion, we will focus on how 6D object pose estimation can be used for understanding 3D scenes.

Related papers

• Markerless Multi-view 3D Human Pose Estimation: a survey [0.49157446832511503]
  3D human pose estimation aims to reconstruct the human skeleton of all the individuals in a scene by detecting several body joints. No method is yet capable of solving all the challenges associated with the reconstruction of the 3D pose. Further research is still required to develop an approach capable of quickly inferring a highly accurate 3D pose with bearable computation cost.
  arXiv  Detail & Related papers  (2024-07-04T10:44:35Z)
• 3D Neural Embedding Likelihood: Probabilistic Inverse Graphics for Robust 6D Pose Estimation [50.15926681475939]
  Inverse graphics aims to infer the 3D scene structure from 2D images. We introduce probabilistic modeling to quantify uncertainty and achieve robustness in 6D pose estimation tasks. 3DNEL effectively combines learned neural embeddings from RGB with depth information to improve robustness in sim-to-real 6D object pose estimation from RGB-D images.
  arXiv  Detail & Related papers  (2023-02-07T20:48:35Z)
• State of the Art in Dense Monocular Non-Rigid 3D Reconstruction [100.9586977875698]
  3D reconstruction of deformable (or non-rigid) scenes from a set of monocular 2D image observations is a long-standing and actively researched area of computer vision and graphics. This survey focuses on state-of-the-art methods for dense non-rigid 3D reconstruction of various deformable objects and composite scenes from monocular videos or sets of monocular views.
  arXiv  Detail & Related papers  (2022-10-27T17:59:53Z)
• Self-Supervised Geometric Correspondence for Category-Level 6D Object Pose Estimation in the Wild [47.80637472803838]
  We introduce a self-supervised learning approach trained directly on large-scale real-world object videos for category-level 6D pose estimation in the wild. Our framework reconstructs the canonical 3D shape of an object category and learns dense correspondences between input images and the canonical shape via surface embedding. Surprisingly, our method, without any human annotations or simulators, can achieve on-par or even better performance than previous supervised or semi-supervised methods on in-the-wild images.
  arXiv  Detail & Related papers  (2022-10-13T17:19:22Z)
• Weakly Supervised Learning of Keypoints for 6D Object Pose Estimation [73.40404343241782]
  We propose a weakly supervised 6D object pose estimation approach based on 2D keypoint detection. Our approach achieves comparable performance with state-of-the-art fully supervised approaches.
  arXiv  Detail & Related papers  (2022-03-07T16:23:47Z)
• 3D Registration for Self-Occluded Objects in Context [66.41922513553367]
  We introduce the first deep learning framework capable of effectively handling this scenario. Our method consists of an instance segmentation module followed by a pose estimation one. It allows us to perform 3D registration in a one-shot manner, without requiring an expensive iterative procedure.
  arXiv  Detail & Related papers  (2020-11-23T08:05:28Z)
• SHREC 2020 track: 6D Object Pose Estimation [26.4781238445338]
  6D pose estimation is crucial for augmented reality, virtual reality, robotic manipulation and visual navigation. Different pose estimation methods have different strengths and weaknesses, depending on feature representations and scene contents. Existing 3D datasets that are used for data-driven methods to estimate 6D poses have limited view angles and low resolution.
  arXiv  Detail & Related papers  (2020-10-19T09:45:42Z)
• CPS++: Improving Class-level 6D Pose and Shape Estimation From Monocular Images With Self-Supervised Learning [74.53664270194643]
  Modern monocular 6D pose estimation methods can only cope with a handful of object instances. We propose a novel method for class-level monocular 6D pose estimation, coupled with metric shape retrieval. We experimentally demonstrate that we can retrieve precise 6D poses and metric shapes from a single RGB image.
  arXiv  Detail & Related papers  (2020-03-12T15:28:13Z)
• A Review on Object Pose Recovery: from 3D Bounding Box Detectors to Full 6D Pose Estimators [40.049600223903546]
  We present the first comprehensive and most recent review of the methods on object pose recovery. The methods mathematically model the problem as a classification, regression, classification & regression, template matching, and point-pair feature matching task.
  arXiv  Detail & Related papers  (2020-01-28T22:05:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.