PSG-Nav: Probabilistic Scene Graph Navigation via Multiverse Decision Making

• URL: http://arxiv.org/abs/2606.01313v1
• Date: Sun, 31 May 2026 16:00:19 GMT
• Title: PSG-Nav: Probabilistic Scene Graph Navigation via Multiverse Decision Making
• Abstract summary: Open-vocabulary navigation requires embodied agents to manage perception uncertainty stemming from semantic ambiguity and model errors.<n>We propose Probabilistic Scene Graph Navigation (PSG-Nav), which constructs a 3D Probabilistic Scene Graph that uses full semantic categorical distributions to account for perception uncertainty.<n>We also introduce the Evidential Experience Calibrator, which enables online lifelong adaptation by cross-validating detections against memories of past successes and failures.
• Score: 21.851142332572845
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Open-vocabulary navigation requires embodied agents to manage significant perception uncertainty stemming from semantic ambiguity and model errors. However, most existing works settle for local optimal deterministic approaches, depriving complex navigation decision-making over multiple composite possibilities that are critical for globally better solutions. In this paper, we propose Probabilistic Scene Graph Navigation (PSG-Nav), which constructs a 3D Probabilistic Scene Graph that uses full semantic categorical distributions to account for perception uncertainty. To efficiently use the local distributions to compose and reason about the optimal navigation landmarks, we propose Multiverse Decision to sample multiple most likely world settings from the joint distribution, and evaluate navigation landmarks based on the compatibility between landmarks and multiverses. To mitigate false positives due to epistemic uncertainty in open-vocabulary navigation, we introduce the Evidential Experience Calibrator, which enables online lifelong adaptation by cross-validating detections against memories of past successes and failures. Extensive experiments on widely-used benchmarks MP3D, HM3D, and HSSD demonstrate that PSG-Nav establishes new state-of-the-art results, achieving Success Rates of 66.1%, 44.8%, and 67.9%, respectively. Code is available at: https://psg-nav.github.io/

Related papers

• Map the Possibilities: Spatial Belief Fields for Language-Goal Aerial Navigation [49.03955946482723]
  We introduce SBFNav, a closed-loop navigation framework centered on a language- conditioned Spatial Belief Field.<n>Unlike ego-centric maps that primarily record what has been observed, SBF rep- resents a task-conditioned distribution over plausible target locations.<n>SBFNav selects the goal that best aligns with the instruction and observations as a met- ric waypoint for control.
  arXiv  Detail & Related papers  (2026-09-05T03:11:01Z)
• CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation [15.24487734405541]
  Vision-and-Language Navigation (VLN) requires agents to reason over accumulated observations while continuously exploring unseen regions.<n>We propose Cognitive Graph-Field Memory (CGFM), a persistent multimodal scene representation.<n>Building upon CGFM, we introduce CGFM-Nav, a foundation-model-based framework for lifelong multimodal navigation.
  arXiv  Detail & Related papers  (2026-08-29T07:54:38Z)
• Uncertainty-Aware World Model for Aerial Image-Goal Navigation [49.01078106635952]
  Uncertainty-Aware Navigation World Model (UA-NWM) is an efficient latent world model for aerial image-goal navigation.<n>It decomposes the prediction--goal discrepancy into uncertainty-explainable and unexplainable components.<n>It consistently outperforms existing navigation world models while maintaining low inference latency.
  arXiv  Detail & Related papers  (2026-08-06T04:43:53Z)
• Rethinking Embodied Navigation via Relational Inductive Bias [53.72276435022479]
  We propose DB-Nav, a framework that reshapes the search space via dual relational biases.<n>It factorizes target-centric relations into an Activation Bias and an Inhibition Bias.<n>It significantly outperforms existing methods in success rate (SR) and Success weighted by Path Length (SPL)
  arXiv  Detail & Related papers  (2026-06-09T02:57:34Z)
• WAM-Nav: Asymmetric Latent World-Action Modeling for Unified Visual Navigation [31.539730066120374]
  Visual navigation requires generating smooth and collision-free trajectories under complex geometric and physical constraints.<n>We propose WAM-Nav, a Latent World-Action Model for embodied visual navigation that jointly learns action generation and latent visual foresight.
  arXiv  Detail & Related papers  (2026-06-03T14:05:19Z)
• Stop Wandering: Efficient Vision-Language Navigation via Metacognitive Reasoning [12.880792990007244]
  Training-free Vision-Language Navigation (VLN) agents can follow instructions and explore 3D environments.<n>Existing approaches rely on greedy frontier selection and passive spatial memory.<n>We propose MetaNav, a metacognitive navigation agent integrating spatial memory, history-aware planning, and reflective correction.
  arXiv  Detail & Related papers  (2026-04-02T17:58:08Z)
• Beyond Matching to Tiles: Bridging Unaligned Aerial and Satellite Views for Vision-Only UAV Navigation [51.286599397552756]
  We present Bearing-UAV, a vision-driven cross-view navigation method that jointly predicts UAV absolute location and heading from neighboring features.<n>We also present Bearing-UAV-90k, a benchmark for evaluating cross-view localization and navigation.
  arXiv  Detail & Related papers  (2026-03-23T16:17:39Z)
• ReasonNavi: Human-Inspired Global Map Reasoning for Zero-Shot Embodied Navigation [53.95797153529148]
  Embodied agents often struggle with efficient navigation because they rely primarily on partial egocentric observations.<n>We introduce ReasonNavi, a human-inspired framework that operationalizes this reason-then-act paradigm by coupling Multimodal Large Language Models (MLLMs) with deterministic planners.
  arXiv  Detail & Related papers  (2026-01-26T19:09:20Z)
• MSGNav: Unleashing the Power of Multi-modal 3D Scene Graph for Zero-Shot Embodied Navigation [42.4892002514681]
  Real-world deployment requires open vocabulary generalization and low training overhead.<n>Existing zero-shot methods that build explicit 3D scene graphs compress rich visual observations into text-only relations.<n>We introduce the Multi-modal 3D Scene Graph (M3DSG), which preserves visual cues by replacing textual relation.
  arXiv  Detail & Related papers  (2025-11-13T14:51:21Z)
• GaussNav: Gaussian Splatting for Visual Navigation [92.13664084464514]
  Instance ImageGoal Navigation (IIN) requires an agent to locate a specific object depicted in a goal image within an unexplored environment.<n>We propose a new framework for IIN, Gaussian Splatting for Visual Navigation (GaussNav), which constructs a novel map representation based on 3D Gaussian Splatting (3DGS)<n>Our GaussNav framework demonstrates a significant performance improvement, with Success weighted by Path Length (SPL) increasing from 0.347 to 0.578 on the challenging Habitat-Matterport 3D (HM3D) dataset.
  arXiv  Detail & Related papers  (2024-03-18T09:56:48Z)
• Hierarchical Spatial Proximity Reasoning for Vision-and-Language Navigation [1.2473780585666772]
  Most Vision-and-Language Navigation (VLN) algorithms are prone to making inaccurate decisions due to their lack of visual common sense and limited reasoning capabilities. We propose a Hierarchical Spatial Proximity Reasoning (HSPR) method to help the agent build a knowledge base of hierarchical spatial proximity. We validate our approach with experiments on publicly available datasets including REVERIE, SOON, R2R, and R4R.
  arXiv  Detail & Related papers  (2024-03-18T07:51:22Z)
• PDC-Net+: Enhanced Probabilistic Dense Correspondence Network [161.76275845530964]
  Enhanced Probabilistic Dense Correspondence Network, PDC-Net+, capable of estimating accurate dense correspondences. We develop an architecture and an enhanced training strategy tailored for robust and generalizable uncertainty prediction. Our approach obtains state-of-the-art results on multiple challenging geometric matching and optical flow datasets.
  arXiv  Detail & Related papers  (2021-09-28T17:56:41Z)
• Multimodal Trajectory Prediction via Topological Invariance for Navigation at Uncontrolled Intersections [45.508973373913946]
  We focus on decentralized navigation among multiple non-communicating rational agents at street intersections without traffic signs or signals. Our key insight is that the geometric structure of the intersection and the incentive of agents to move efficiently and avoid collisions (rationality) reduces the space of likely behaviors. We design Multiple Topologies Prediction (MTP), a data-driven trajectory-prediction mechanism that reconstructs trajectory representations of high-likelihood modes in multiagent intersection scenes.
  arXiv  Detail & Related papers  (2020-11-08T02:56:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.