Concept-Guided Exploration: Building Persistent, Actionable Scene Graphs

• URL: http://arxiv.org/abs/2608.23650v1
• Date: Mon, 24 Aug 2026 10:08:48 GMT
• Title: Concept-Guided Exploration: Building Persistent, Actionable Scene Graphs
• Abstract summary: The perception of 3D space by mobile robots is rapidly moving from flat metric grid representations to hybrid metric-semantic graphs built from human-interpretable concepts.<n>Our robot employs two spatial concepts (room and door), implemented as autonomous processes within a cognitive distributed architecture.
• Score: 37.37531372066396
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The perception of 3D space by mobile robots is rapidly moving from flat metric grid representations to hybrid metric-semantic graphs built from human-interpretable concepts. While most approaches first build metric maps and then add semantic layers, we explore an alternative, concept-first architecture in which spatial understanding emerges from asynchronous concept agents that directly instantiate and manage semantic entities. Our robot employs two spatial concepts (room and door), implemented as autonomous processes within a cognitive distributed architecture. These concept agents cooperatively build a shared scene graph representation of indoor layouts through active exploration and incremental validation. The key architectural principle is hierarchical constraint propagation: Room instantiation provides geometric and semantic priors to guide and support door detection within wall boundaries. The resulting structure is maintained by a complementary functional principle based on prediction-matching loops. This approach is designed to yield an actionable, human-interpretable spatial representation without relying on any pre-existing global metric map, supporting scalable operation and persistent, task-relevant understanding in structured indoor environments.

Related papers

• Prior-SG: Task and Prior Driven Region Segmentation for Scene Graphs in Arbitrarily-Structured Environments [20.027960785504586]
  We propose Prior-SG, a task- and prior-driven framework that casts scene graph generation as a probabilistic alignment problem.<n>We validate this approach across diverse simulated residential datasets and large, open-plan real-world environments.
  arXiv  Detail & Related papers  (2026-08-06T15:36:12Z)
• From Pixels to Concepts: Growing Rich 3D Semantic Scene Graph Forests utilizing Foundation Models [4.137761255401348]
  Hierarchical 3D scene graphs integrate geometric, semantic, and relational data within a unified spatial framework.<n>Current 3D scene graph approaches often restrict themselves to rigid structures of pre-determined relationship classes.<n>This paper explores the potential of foundation models to build forests of 3D scene graphs with open semantic relationships.
  arXiv  Detail & Related papers  (2026-06-22T13:26:17Z)
• SpatialClaw: Rethinking Action Interface for Agentic Spatial Reasoning [99.49739831030388]
  We study how the design of this interface shapes the agent's capacity for open-ended spatial reasoning.<n>We propose SpatialClaw, a training-free framework for spatial reasoning that adopts code as the action interface.
  arXiv  Detail & Related papers  (2026-06-11T17:59:36Z)
• Learning-Based Hierarchical Scene Graph Matching for Robot Localization Leveraging Prior Maps [0.17398560678845076]
  Scene graphs encode the structure of an environment as a hierarchy of semantic entities and their relationships.<n> Matching these two complementary representations enables drift correction in SLAM by grounding robot observations against a known structural prior.<n>Here we present a learned, end-to-end differentiable pipeline that augments both graphs with semantically motivated edge types encoding intra- and inter-level relationships.
  arXiv  Detail & Related papers  (2026-04-30T13:05:57Z)
• AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis [50.793806818677716]
  AffordGrasp produces physically stable and semantically faithful human grasps with high precision.<n>AffordGrasp integrates an affordance-aware latent representation of hand poses with a dual-conditioning diffusion process.<n>We evaluate AffordGrasp across four instruction-augmented benchmarks derived from HO-3D, OakInk, GRAB, and AffordPose.
  arXiv  Detail & Related papers  (2026-03-09T06:56:35Z)
• A Scene Graph Backed Approach to Open Set Semantic Mapping [1.8266902367595235]
  Open Set Semantic Mapping and 3D Scene Graphs (3DSSGs) are established paradigms in robotic perception.<n>We propose a mapping architecture where the 3DSSG serves as the foundational backend, acting as the primary knowledge representation.<n>This ensures that the map remains topologically consistent and computationally efficient, even during extended operations in large-scale settings.
  arXiv  Detail & Related papers  (2026-02-03T17:41:51Z)
• ArtiSG: Functional 3D Scene Graph Construction via Human-demonstrated Articulated Objects Manipulation [51.54082859171464]
  ArtiSG is a framework that constructs functional 3D scene graphs by encoding human demonstrations into structured robotic memory.<n>We show that ArtiSG significantly outperforms baselines in functional element recall and articulation estimation precision.
  arXiv  Detail & Related papers  (2025-12-31T13:10:40Z)
• Open-Vocabulary Octree-Graph for 3D Scene Understanding [54.11828083068082]
  Octree-Graph is a novel scene representation for open-vocabulary 3D scene understanding. An adaptive-octree structure is developed that stores semantics and depicts the occupancy of an object adjustably according to its shape.
  arXiv  Detail & Related papers  (2024-11-25T10:14:10Z)
• A Modular Robotic System for Autonomous Exploration and Semantic Updating in Large-Scale Indoor Environments [2.8252013503798907]
  We present a modular robotic system for autonomous exploration and semantic updating of large-scale unknown environments.<n>Our approach enables a mobile robot to build, revisit, and update a hybrid semantic map that integrates a 2D occupancy grid for geometry with a topological graph for object semantics.
  arXiv  Detail & Related papers  (2024-09-23T19:25:03Z)
• Hierarchical Path-planning from Speech Instructions with Spatial Concept-based Topometric Semantic Mapping [7.332652485849632]
  This study aims to realize a hierarchical spatial representation using a topometric semantic map and path planning with speech instructions, including waypoints. We conducted experiments in home environments using the Toyota Human Support Robot on the SIGVerse simulator and in a lab-office environment with the real robot, Albert. Navigation experiments using speech instructions with a waypoint demonstrated a performance improvement of SpCoTMHP over the baseline hierarchical path planning method with path costs.
  arXiv  Detail & Related papers  (2022-03-21T09:15:25Z)
• Spatial Pyramid Based Graph Reasoning for Semantic Segmentation [67.47159595239798]
  We apply graph convolution into the semantic segmentation task and propose an improved Laplacian. The graph reasoning is directly performed in the original feature space organized as a spatial pyramid. We achieve comparable performance with advantages in computational and memory overhead.
  arXiv  Detail & Related papers  (2020-03-23T12:28:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.