CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation

• URL: http://arxiv.org/abs/2608.29114v1
• Date: Sat, 29 Aug 2026 07:54:38 GMT
• Title: CGFM-Nav: Cognitive Graph-Field Memory for Semantic-Guided Lifelong Multimodal Embodied Navigation
• Abstract summary: Vision-and-Language Navigation (VLN) requires agents to reason over accumulated observations while continuously exploring unseen regions.<n>We propose Cognitive Graph-Field Memory (CGFM), a persistent multimodal scene representation.<n>Building upon CGFM, we introduce CGFM-Nav, a foundation-model-based framework for lifelong multimodal navigation.
• Score: 15.24487734405541
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Vision-and-Language Navigation (VLN) requires agents to reason over accumulated observations while continuously exploring unseen regions. However, existing environment representations often struggle to jointly support explicit semantic memory and continuous exploration guidance. To address this challenge, we propose Cognitive Graph-Field Memory (CGFM), a persistent multimodal scene representation that couples explicit relational memory with continuous spatial intuition. CGFM organizes objects, spatial relations, and visual observations into a multimodal scene graph, enabling target retrieval and long-horizon reasoning across navigation tasks. When no reliable target match is identified, graph-based evidence is projected into a goal-conditioned semantic-frontier field to guide exploration toward semantically promising frontiers and regions. Building upon CGFM, we introduce CGFM-Nav, a foundation-model-based framework for lifelong multimodal navigation that integrates task-relevant subgraph selection, VLM reasoning, and verification feedback into a closed decision loop. Preliminary experiments on GOAT-Bench show that, under the same Qwen3-VL-8B backbone, CGFM-Nav improves the overall success rate from 53.2% to 63.0% and SPL from 30.0% to 39.6%, demonstrating the effectiveness of combining explicit semantic memory with semantic-guided exploration.

Related papers

• Scaffolding Foundation Models into Physical-World Agents Pushes the Frontier of Long-Horizon Navigation [52.90741218586653]
  Long-horizon physical-world agents must reason over distant goals while grounding decisions in reliable closed-loop behavior.<n>We introduce NavMCP, an agentic scaffolding framework that couples a VLM reasoning agent with an NFM executor for long-horizon exploration.<n>NavMCP achieves state-of-the-art results on Embodied Question Answering and a Unitree Go2.
  arXiv  Detail & Related papers  (2026-08-31T07:50:16Z)
• STEGNav: Spatio-Temporal Event Graph Reasoning for Multimodal Lifelong Object Navigation [17.685326212060716]
  We propose a training-free framework that extends conventional scene graphs into event graphs along complementary spatial and temporal axes.<n>STEGNav achieves 66.3% SR and 39.7 SPL on GOAT-Bench, as well as SR scores of 64.0% and 69.4% on HM3D1 and HM3Dv2, respectively.
  arXiv  Detail & Related papers  (2026-08-28T12:42:16Z)
• From Semantic Grounding to Decision Optimization: A Unified Framework for Long-Horizon UAV Vision-Language Navigation [40.51712647240084]
  UAV vision-language navigation (UAV-VLN) focuses on enabling an aerial agent to follow natural-language instructions in open 3D environments.<n>Current approaches suffer from three coupled issues: weak grounding of instruction-relevant landmarks in visual observations, insufficient exploitation of long-horizon history, and unstable decisions under local traps or repeated exploration.<n>We propose a unified semantic-to-decision framework to address these issues.
  arXiv  Detail & Related papers  (2026-08-10T12:59:50Z)
• VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation [55.45263611374435]
  We introduce Cross-Episode Object-Goal Navigation, in which an agent repeatedly operates in the same scene, retains only self-acquired experience, and keeps its model parameters fixed.<n>To support experience reuse, we present method, a training-free VLM navigation framework with a persistent hierarchical Visual-Topological Memory (VTM)<n>method achieves the best performance across all three benchmarks, demonstrating the effectiveness and robustness of structured visual-topological experience reuse across datasets.
  arXiv  Detail & Related papers  (2026-07-16T03:11:37Z)
• Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory [69.51256305550844]
  We propose PSC-AVDN, a training-free framework that tightly couples a three-stage Parsing-Search-Confirmation reasoning pipeline with a Structured Spatial Memory.<n> PSC-AVDN establishes new state-of-the-art performance in the training-free setting, matching or surpassing several finetuned methods.
  arXiv  Detail & Related papers  (2026-07-13T13:14:20Z)
• IGV-RRT: Prior-Real-Time Observation Fusion for Active Object Search in Changing Environments [10.748685496551067]
  We propose a probabilistic planning framework that combines uncertainty-aware scene priors with online target relevance estimates.<n>The framework contains a dual-layer semantic mapping module and a real-time planner.<n>The proposed method effectively mitigates the impact of object rearrangement, achieving higher search efficiency and success rates.
  arXiv  Detail & Related papers  (2026-03-23T12:14:26Z)
• Move to Understand a 3D Scene: Bridging Visual Grounding and Exploration for Efficient and Versatile Embodied Navigation [54.04601077224252]
  Embodied scene understanding requires not only comprehending visual-spatial information but also determining where to explore next in the 3D physical world.<n>underlinetextbf3D vision-language learning enables embodied agents to effectively explore and understand their environment.<n>model's versatility enables navigation using diverse input modalities, including categories, language descriptions, and reference images.
  arXiv  Detail & Related papers  (2025-07-05T14:15:52Z)
• Object Navigation with Structure-Semantic Reasoning-Based Multi-level Map and Multimodal Decision-Making LLM [18.406869393228813]
  We propose an active object navigation framework with Environmental Attributes Map (EAM) and MLLM Hierarchical Reasoning module (MHR)<n>EAM is constructed by reasoning observed environments with SBERT and predicting unobserved ones with Diffusion.<n>MHR is inspired by EAM to perform frontier exploration decision-making, avoiding the circuitous trajectories in long-range scenarios to improve path efficiency.
  arXiv  Detail & Related papers  (2025-06-06T09:08:40Z)
• DORAEMON: Decentralized Ontology-aware Reliable Agent with Enhanced Memory Oriented Navigation [55.888688171010365]
  DORAEMON is a cognitive-inspired framework consisting of Ventral and Dorsal Streams that mimics human navigation capabilities.<n>We evaluate DORAEMON on the HM3D, MP3D and GOAT datasets, where it achieves state-of-the-art performance on both success rate (SR) and success weighted by path length (SPL) metrics.
  arXiv  Detail & Related papers  (2025-05-28T04:46:13Z)
• Hierarchical Spatial Proximity Reasoning for Vision-and-Language Navigation [1.2473780585666772]
  Most Vision-and-Language Navigation (VLN) algorithms are prone to making inaccurate decisions due to their lack of visual common sense and limited reasoning capabilities. We propose a Hierarchical Spatial Proximity Reasoning (HSPR) method to help the agent build a knowledge base of hierarchical spatial proximity. We validate our approach with experiments on publicly available datasets including REVERIE, SOON, R2R, and R4R.
  arXiv  Detail & Related papers  (2024-03-18T07:51:22Z)
• Structured Scene Memory for Vision-Language Navigation [155.63025602722712]
  We propose a crucial architecture for vision-language navigation (VLN) It is compartmentalized enough to accurately memorize the percepts during navigation. It also serves as a structured scene representation, which captures and disentangles visual and geometric cues in the environment.
  arXiv  Detail & Related papers  (2021-03-05T03:41:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.