Object-Augmented RGB-D SLAM for Wide-Disparity Relocalisation

• URL: http://arxiv.org/abs/2108.02522v1
• Date: Thu, 5 Aug 2021 11:02:25 GMT
• Title: Object-Augmented RGB-D SLAM for Wide-Disparity Relocalisation
• Authors: Yuhang Ming, Xingrui Yang, Andrew Calway
• Abstract summary: We propose a novel object-augmented RGB-D SLAM system that is capable of constructing a consistent object map and performing relocalisation based on centroids of objects in the map.
• Score: 3.888848425698769
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: We propose a novel object-augmented RGB-D SLAM system that is capable of constructing a consistent object map and performing relocalisation based on centroids of objects in the map. The approach aims to overcome the view dependence of appearance-based relocalisation methods using point features or images. During the map construction, we use a pre-trained neural network to detect objects and estimate 6D poses from RGB-D data. An incremental probabilistic model is used to aggregate estimates over time to create the object map. Then in relocalisation, we use the same network to extract objects-of-interest in the `lost' frames. Pairwise geometric matching finds correspondences between map and frame objects, and probabilistic absolute orientation followed by application of iterative closest point to dense depth maps and object centroids gives relocalisation. Results of experiments in desktop environments demonstrate very high success rates even for frames with widely different viewpoints from those used to construct the map, significantly outperforming two appearance-based methods.

Related papers

• GOReloc: Graph-based Object-Level Relocalization for Visual SLAM [17.608119427712236]
  This article introduces a novel method for object-level relocalization of robotic systems. It determines the pose of a camera sensor by robustly associating the object detections in the current frame with 3D objects in a lightweight object-level map.
  arXiv  Detail & Related papers  (2024-08-15T03:54:33Z)
• VOOM: Robust Visual Object Odometry and Mapping using Hierarchical Landmarks [19.789761641342043]
  We propose a Visual Object Odometry and Mapping framework VOOM. We use high-level objects and low-level points as the hierarchical landmarks in a coarse-to-fine manner. VOOM outperforms both object-oriented SLAM and feature points SLAM systems in terms of localization.
  arXiv  Detail & Related papers  (2024-02-21T08:22:46Z)
• RGB-based Category-level Object Pose Estimation via Decoupled Metric Scale Recovery [72.13154206106259]
  We propose a novel pipeline that decouples the 6D pose and size estimation to mitigate the influence of imperfect scales on rigid transformations. Specifically, we leverage a pre-trained monocular estimator to extract local geometric information. A separate branch is designed to directly recover the metric scale of the object based on category-level statistics.
  arXiv  Detail & Related papers  (2023-09-19T02:20:26Z)
• Learning-based Relational Object Matching Across Views [63.63338392484501]
  We propose a learning-based approach which combines local keypoints with novel object-level features for matching object detections between RGB images. We train our object-level matching features based on appearance and inter-frame and cross-frame spatial relations between objects in an associative graph neural network.
  arXiv  Detail & Related papers  (2023-05-03T19:36:51Z)
• Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis [66.49788145564004]
  We present an unsupervised deep neural architecture called Flattening-Net to represent irregular 3D point clouds of arbitrary geometry and topology. Our methods perform favorably against the current state-of-the-art competitors.
  arXiv  Detail & Related papers  (2022-12-17T15:05:25Z)
• Learning to Complete Object Shapes for Object-level Mapping in Dynamic Scenes [30.500198859451434]
  We propose a novel object-level mapping system that can simultaneously segment, track, and reconstruct objects in dynamic scenes. It can further predict and complete their full geometries by conditioning on reconstructions from depth inputs and a category-level shape prior. We evaluate its effectiveness by quantitatively and qualitatively testing it in both synthetic and real-world sequences.
  arXiv  Detail & Related papers  (2022-08-09T22:56:33Z)
• Robust Change Detection Based on Neural Descriptor Fields [53.111397800478294]
  We develop an object-level online change detection approach that is robust to partially overlapping observations and noisy localization results. By associating objects via shape code similarity and comparing local object-neighbor spatial layout, our proposed approach demonstrates robustness to low observation overlap and localization noises.
  arXiv  Detail & Related papers  (2022-08-01T17:45:36Z)
• FD-SLAM: 3-D Reconstruction Using Features and Dense Matching [18.577229381683434]
  We propose an RGB-D SLAM system that uses dense frame-to-model odometry to build accurate sub-maps. We incorporate a learning-based loop closure component based on 3-D features which further stabilises map building. The approach can also scale to large scenes where other systems often fail.
  arXiv  Detail & Related papers  (2022-03-25T18:58:46Z)
• ZebraPose: Coarse to Fine Surface Encoding for 6DoF Object Pose Estimation [76.31125154523056]
  We present a discrete descriptor, which can represent the object surface densely. We also propose a coarse to fine training strategy, which enables fine-grained correspondence prediction.
  arXiv  Detail & Related papers  (2022-03-17T16:16:24Z)
• Fusing Local Similarities for Retrieval-based 3D Orientation Estimation of Unseen Objects [70.49392581592089]
  We tackle the task of estimating the 3D orientation of previously-unseen objects from monocular images. We follow a retrieval-based strategy and prevent the network from learning object-specific features. Our experiments on the LineMOD, LineMOD-Occluded, and T-LESS datasets show that our method yields a significantly better generalization to unseen objects than previous works.
  arXiv  Detail & Related papers  (2022-03-16T08:53:00Z)
• Combining Local and Global Pose Estimation for Precise Tracking of Similar Objects [2.861848675707602]
  We present a multi-object 6D detection and tracking pipeline for potentially similar and non-textured objects. A new network architecture, trained solely with synthetic images, allows simultaneous pose estimation of multiple objects. We show how the system can be used in a real AR assistance application within the field of construction.
  arXiv  Detail & Related papers  (2022-01-31T14:36:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.