NavPatch: Evidence-Guided Object-Level Costmap Correction with Vision-Language Models

• URL: http://arxiv.org/abs/2609.14543v1
• Date: Sun, 13 Sep 2026 14:30:55 GMT
• Title: NavPatch: Evidence-Guided Object-Level Costmap Correction with Vision-Language Models
• Abstract summary: We present NavPatch, an object level correction layer that assigns ADD, REMOVE, or EXTEND to navigation relevant object categories.<n>Open vocabulary grounding localizes object instances, and LiDAR and RGB-D observations provide 3D support.
• Score: 6.1440916891645285
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Mobile robots typically rely on geometric maps for obstacle avoidance and path planning, but the resulting obstacle representation does not always match how an object should affect navigation. A low lying cable may be missed, a flexible curtain may create spurious blockage, and a traffic cone may require an exclusion region larger than its observed footprint. We present NavPatch, an object level correction layer that assigns ADD, REMOVE, or EXTEND to navigation relevant object categories through periodic scene understanding with a vision-language model. Open vocabulary grounding localizes object instances, and LiDAR and RGB-D observations provide 3D support. Observation quality filtering and cross frame maintenance determine when each correction patch is committed, replaced, or revoked. In 50 real robot trials across five layouts, NavPatch achieves an overall success rate of 86.0%. An ablation study of four configurations with 200 runs in total shows that NavPatch improves the success rate from 70.0% to 86.0% and reduces the false commit rate from 68.4% to 40.7% compared with updates based only on the current observation.

Related papers

• LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation [52.91080323083409]
  Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments.<n>Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads.
  arXiv  Detail & Related papers  (2026-08-31T15:08:53Z)
• SSTG-Nav: Metric-Grounded Spatial-Semantic Topological Graphs for Reusable Object Navigation [2.272547247667044]
  SSTG-Nav is a reusable metric-semantic memory that turns a one-time survey into actionable object goals.<n>On 1,000 HM3D-v2 episodes across 36 scenes, our goal-independent topology achieves a 99.4% geometric success ceiling.
  arXiv  Detail & Related papers  (2026-08-01T08:40:04Z)
• Learning to Navigate Efficiently with Only 0.58M Trainable Parameters [12.68304107799412]
  We propose a navigation model in which operations with known closed-form structure are computed analytically and serve as interfaces between three small learned modules.<n>The system trains only 0.58M out of a total of 22.7M parameters, on 44k frames in under one GPU-hour, yet approaches the performance of state-of-the-art models on navigation tasks.
  arXiv  Detail & Related papers  (2026-07-13T02:49:55Z)
• Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localization [0.0]
  We address robot localization in GPS-denied indoor environments by reframing it as a semantic reasoning task.<n>Motivated by how humans localize using object-level cues and labeled maps, we ask whether a vision-language model, given a front camera image, can infer the robot pose.<n>We fine-tune Qwen2.5-VL-7B with LoRA and attach a lightweight regression head that predicts continuous pose coordinates.
  arXiv  Detail & Related papers  (2026-07-01T15:37:29Z)
• Efficient Visual Pointing for Embodied AI:Agent-Driven Data Synthesis, Cross-Block Attention, and Iterative Correction [55.11480729304395]
  We describe our PointArena 2026 solution, which achieves 77.2% overall accuracy and ranks second on the benchmark.<n>The ap proach targets three failure modes. First, agent-driven syn thesis builds large semantic and anchor-relative candidate pools.<n>Second, a determinis tic steerable-data pipeline creates a verified 10,000-sample main set, plus reserve samples, using masks, templates, and path verification.
  arXiv  Detail & Related papers  (2026-06-29T06:39:03Z)
• LocalNav: Distilling Frontier VLMs and Embodied RL for On-Device Object Goal Navigation [53.88286427894783]
  Vision Language Models (VLMs) have emerged in the robotic domain as a powerful tool that enables environmental perception with language context.<n>Yet, their computational footprint typically confines them to cloud execution, hindering low-latency inference with local deployment on resource-constrained robots.<n>We present a distillation strategy that transfers complex spatial-semantic reasoning from large frontier models into a lightweight, 4B- parameter local VLM for edge execution on embedded GPU devices.
  arXiv  Detail & Related papers  (2026-06-26T09:11:59Z)
• Uni-LaViRA: Language-Vision-Robot Actions Translation for Unified Embodied Navigation [60.07205156194741]
  Embodied navigation requires an agent to map language and visual observations to a stream of spatial actions that drive a real robot through environments it has never seen.<n>We present Uni-LaViRA, a unified agentic architecture that extends the same insight to four task families and to four heterogeneous real robots.
  arXiv  Detail & Related papers  (2026-05-26T18:52:04Z)
• What Limits Vision-and-Language Navigation ? [18.423144111320592]
  StereoNav is a robust Vision-Language-Action framework designed to enhance real-world navigation consistency.<n>Experiments on R2R-CE and RxR-CE demonstrate that StereoNav achieves state-of-the-art egocentric RGB performance.
  arXiv  Detail & Related papers  (2026-05-13T10:41:24Z)
• DRIVE-Nav: Directional Reasoning, Inspection, and Verification for Efficient Open-Vocabulary Navigation [3.249609824556708]
  DRIVE-Nav is a structured framework that organizes exploration around persistent directions.<n>It reduces redundant revisits and improves path efficiency.<n>Experiments on HM3D-OVON, HM3Dv2, and MP3D demonstrate strong overall performance and consistent efficiency gains.
  arXiv  Detail & Related papers  (2026-03-30T17:12:17Z)
• When Engineering Outruns Intelligence: Rethinking Instruction-Guided Navigation [10.827213515727996]
  Recent ObjectNav systems credit large language models (LLMs) for sizable zero-shot gains.<n>We revisit this question by re-evaluating an instruction-guided pipeline, InstructNav, under a detector-controlled setting.
  arXiv  Detail & Related papers  (2025-07-26T17:37:15Z)
• NOVA: Navigation via Object-Centric Visual Autonomy for High-Speed Target Tracking in Unstructured GPS-Denied Environments [56.35569661650558]
  We introduce NOVA, a fully onboard, object-centric framework that enables robust target tracking and collision-aware navigation.<n>Rather than constructing a global map, NOVA formulates perception, estimation, and control entirely in the target's reference frame.<n>We validate NOVA across challenging real-world scenarios, including urban mazes, forest trails, and repeated transitions through buildings with intermittent GPS loss.
  arXiv  Detail & Related papers  (2025-06-23T14:28:30Z)
• The Surprising Effectiveness of Visual Odometry Techniques for Embodied PointGoal Navigation [100.08270721713149]
  PointGoal navigation has been introduced in simulated Embodied AI environments. Recent advances solve this PointGoal navigation task with near-perfect accuracy (99.6% success) We show that integrating visual odometry techniques into navigation policies improves the state-of-the-art on the popular Habitat PointNav benchmark by a large margin.
  arXiv  Detail & Related papers  (2021-08-26T02:12:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.