SGM-SLAM: Scene Graph Matching for Data-Efficient Distributed SLAM

• URL: http://arxiv.org/abs/2606.16881v1
• Date: Mon, 15 Jun 2026 15:53:59 GMT
• Title: SGM-SLAM: Scene Graph Matching for Data-Efficient Distributed SLAM
• Abstract summary: Our framework uses scene graph matching to identify inter-robot measurement constraints.<n>Unlike prior approaches that rely on feature-level matching, our framework is the first to perform scene graph matching using only object labels and centroids.<n>We demonstrate the effectiveness and efficiency of our approach using both simulation and real-world datasets collected by legged robots.
• Score: 6.282206745727115
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We introduce a data-efficient distributed Simultaneous Localization and Mapping (SLAM) framework designed for a team of robots equipped with LiDAR, cameras, and inertial sensors. Our framework uses scene graph matching to identify inter-robot measurement constraints. Unlike prior approaches that rely on feature-level matching, our framework is the first to perform scene graph matching using only object labels and centroids. Our approach constructs a scene graph by using fused RGB-LiDAR point clouds to generate both a semantically segmented point cloud layer, and a layer of discrete bounded objects, to accompany estimated robot trajectories. Scene graph matching is performed collaboratively through exchanging and matching object data with neighboring robots. To maximize communication efficiency, we utilize a multi-step data exchange and optimization process. We demonstrate the effectiveness and efficiency of our approach using both simulation and real-world datasets collected by legged robots in indoor and outdoor environments.

Related papers

• PROSE: Training-Free Egocentric Scene Registration with Vision-Language Models [48.66414784633783]
  PROSE (Prompted Scene rEgistration) lifts each RGB sequence into an object-level 3D scene graph.<n> PROSE adds no learned parameters and requires no depth sensor, training, or annotated graph.<n>On the egocentric Aria Digital Twin and Aria Everyday Activities benchmarks, it outperforms both geometric and learned scene-graph baselines in registration accuracy.
  arXiv  Detail & Related papers  (2026-06-15T11:11:14Z)
• Learning-Based Hierarchical Scene Graph Matching for Robot Localization Leveraging Prior Maps [0.17398560678845076]
  Scene graphs encode the structure of an environment as a hierarchy of semantic entities and their relationships.<n> Matching these two complementary representations enables drift correction in SLAM by grounding robot observations against a known structural prior.<n>Here we present a learned, end-to-end differentiable pipeline that augments both graphs with semantically motivated edge types encoding intra- and inter-level relationships.
  arXiv  Detail & Related papers  (2026-04-30T13:05:57Z)
• Matching Distance and Geometric Distribution Aided Learning Multiview Point Cloud Registration [15.594026254653276]
  Multiview point cloud registration plays a crucial role in robotics, automation, and computer vision fields.<n>Previous methods for pose graph construction often pruned fully connected graphs or constructed sparse graph using global feature aggregated from local descriptors.<n>We design a network model that extracts information from the matching distance between point cloud pairs.<n>For motion synchronization, we propose another neural network model to calculate the absolute pose in a data-driven manner.
  arXiv  Detail & Related papers  (2025-05-06T16:54:07Z)
• Semantic Segmentation and Scene Reconstruction of RGB-D Image Frames: An End-to-End Modular Pipeline for Robotic Applications [0.7951977175758216]
  Traditional RGB-D processing pipelines focus primarily on geometric reconstruction.<n>We introduce a novel end-to-end modular pipeline that integrates semantic segmentation, human tracking, point-cloud fusion, and scene reconstruction.<n>We validate our approach on benchmark datasets and real-world Kinect RGB-D data, demonstrating improved efficiency, accuracy, and usability.
  arXiv  Detail & Related papers  (2024-10-23T16:01:31Z)
• Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detection [116.21529970404653]
  We introduce SG2HOI+, a unified one-step model based on the Transformer architecture. Our approach employs two interactive hierarchical Transformers to seamlessly unify the tasks of SGG and HOI detection. Our approach achieves competitive performance when compared to state-of-the-art HOI methods.
  arXiv  Detail & Related papers  (2023-11-03T07:25:57Z)
• Local-Global Information Interaction Debiasing for Dynamic Scene Graph Generation [51.92419880088668]
  We propose a novel DynSGG model based on multi-task learning, DynSGG-MTL, which introduces the local interaction information and global human-action interaction information. Long-temporal human actions supervise the model to generate multiple scene graphs that conform to the global constraints and avoid the model being unable to learn the tail predicates.
  arXiv  Detail & Related papers  (2023-08-10T01:24:25Z)
• Location-Free Scene Graph Generation [45.366540803729386]
  Scene Graph Generation (SGG) is a visual understanding task, aiming to describe a scene as a graph of entities and their relationships with each other.<n>Existing works rely on location labels in form of bounding boxes or segmentation masks, increasing annotation costs and limiting dataset expansion.<n>We break this dependency and introduce location-free scene graph generation (LF-SGG)<n>This new task aims at predicting instances of entities, as well as their relationships, without the explicit calculation of their spatial localization.
  arXiv  Detail & Related papers  (2023-03-20T08:57:45Z)
• S-Graphs+: Real-time Localization and Mapping leveraging Hierarchical Representations [9.13466172688693]
  S-Graphs+ is a novel four-layered factor graph that includes: (1) a pose layer with robot pose estimates, (2) a walls layer representing wall surfaces, (3) a rooms layer encompassing sets of wall planes, and (4) a floors layer gathering the rooms within a given floor level. The above graph is optimized in real-time to obtain a robust and accurate estimate of the robots pose and its map, simultaneously constructing and leveraging high-level information of the environment.
  arXiv  Detail & Related papers  (2022-12-22T15:06:21Z)
• Representing Videos as Discriminative Sub-graphs for Action Recognition [165.54738402505194]
  We introduce a new design of sub-graphs to represent and encode theriminative patterns of each action in the videos. We present MUlti-scale Sub-Earn Ling (MUSLE) framework that novelly builds space-time graphs and clusters into compact sub-graphs on each scale.
  arXiv  Detail & Related papers  (2022-01-11T16:15:25Z)
• HighlightMe: Detecting Highlights from Human-Centric Videos [52.84233165201391]
  We present a domain- and user-preference-agnostic approach to detect highlightable excerpts from human-centric videos. We use an autoencoder network equipped with spatial-temporal graph convolutions to detect human activities and interactions. We observe a 4-12% improvement in the mean average precision of matching the human-annotated highlights over state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-10-05T01:18:15Z)
• A Graph-based Interactive Reasoning for Human-Object Interaction Detection [71.50535113279551]
  We present a novel graph-based interactive reasoning model called Interactive Graph (abbr. in-Graph) to infer HOIs. We construct a new framework to assemble in-Graph models for detecting HOIs, namely in-GraphNet. Our framework is end-to-end trainable and free from costly annotations like human pose.
  arXiv  Detail & Related papers  (2020-07-14T09:29:03Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.