FloVerse: Floor Plan-Guided Multi-Modal Navigation

• URL: http://arxiv.org/abs/2606.14267v1
• Date: Fri, 12 Jun 2026 08:49:53 GMT
• Title: FloVerse: Floor Plan-Guided Multi-Modal Navigation
• Abstract summary: FloVerse is a task for floor plan-guided embodied navigation.<n>ThreeDiff implicitly captures spatial information from floor plans.<n>Experiments demonstrate that floor-plan priors improve navigation performance across all goal modalities.
• Score: 27.822662490531325
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Floor plans encapsulate compact spatial priors, enabling agents to navigate unseen scenes more efficiently. While prior work has explored floor plan-guided navigation, it has focused mainly on PointNav and a limited set of environments. To bridge this gap, we introduce FloVerse, a new task for floor plan-guided embodied navigation that unifies PointNav, ObjectNav, and ImageNav. To support FloVerse, we assemble FloVerse-1.6K, a large-scale dataset of 1.6K scenes from HM3D and Gibson 4+, paired with corresponding floor plans, comprising 240K expert trajectories and 12M RGBD frames. We further propose ThreeDiff, a two-stage imitation learning policy comprising a planner, a diffusion-based multimodal goal-reasoning module trained via masked-modality modeling, and a refiner, a depth-based trajectory-refinement module for safe execution. Extensive experiments demonstrate that (1) floor-plan priors improve navigation performance across all goal modalities, and (2) ThreeDiff implicitly captures spatial information from floor plans. These results underscore the effectiveness of spatial priors and validate our proposed unified approach for floor plan-guided embodied navigation.

Related papers

• Embodied-Navigator: Point, Think, Memorize, and Align for Efficient Navigation [68.02899606570223]
  We propose TAMP-Nav, a unified framework for efficient embodied navigation.<n>First, we introduce a Pixel-to-3D Action Formulation (Point) that reformulates navigation into 2D visual coordinates.<n>Second, we propose an integrated Selective Reasoning and Anchor-Trajectory Memory mechanism (Think and Memorize)
  arXiv  Detail & Related papers  (2026-08-18T08:37:08Z)
• From Sketch Prior to Trajectories: A Mission-Oriented Coordinated Navigation Framework for Indoor UAV Swarm [21.73274394878446]
  This paper proposes a mission-oriented coordinated navigation framework that exploits sketch-map priors for multi-UAV indoor operations.<n>A layered 2D--3D coordinated navigation framework is further developed, where 2D guided path planning generates mission-oriented guide paths.<n> Simulation and real-world experiments validate the effectiveness of the proposed framework in structured multi-room indoor environments.
  arXiv  Detail & Related papers  (2026-07-13T10:47:14Z)
• TravExplorer: Cross-Floor Embodied Exploration via Traversability-Aware 3-D Planning [17.54520943622758]
  This article presents TravExplorer, a cross-floor embodied exploration framework.<n>It couples zero-shot semantic guidance with traversability-aware 3-D planning.<n>Fifty real-world trials on a Unitree Go2 further validate open-vocabulary target search across single-floor and cross-floor indoor environments.
  arXiv  Detail & Related papers  (2026-05-19T15:11:29Z)
• FloorPlan-VLN: A New Paradigm for Floor Plan Guided Vision-Language Navigation [17.1490555684021]
  Existing-Language Navigation (VLN) task requires agents to follow instructions, ignoring some potentially useful global spatial priors.<n>We introduce bfFloorPlan-VLN, a new paradigm that leverages structured floor plans as global spatial priors to enable navigation with only concise instructions.
  arXiv  Detail & Related papers  (2026-03-18T07:22:48Z)
• Floorplan2Guide: LLM-Guided Floorplan Parsing for BLV Indoor Navigation [4.3114959617830015]
  We propose a novel navigation approach that transforms floor plans into navigable knowledge graphs and generate human-readable navigation instructions.<n> Floorplan2Guide integrates a large language model (LLM) to extract spatial information from architectural layouts.<n>Results indicate that few-shot learning improves navigation accuracy in comparison to zero-shot learning on simulated and real-world evaluations.
  arXiv  Detail & Related papers  (2025-12-13T04:49:26Z)
• FOM-Nav: Frontier-Object Maps for Object Goal Navigation [65.76906445210112]
  FOM-Nav is a framework that enhances exploration efficiency through Frontier-Object Maps and vision-language models.<n>To train FOM-Nav, we automatically construct large-scale navigation datasets from real-world scanned environments.<n> FOM-Nav achieves state-of-the-art performance on the MP3D and HM3D benchmarks, particularly in navigation efficiency metric SPL.
  arXiv  Detail & Related papers  (2025-11-30T18:16:09Z)
• DAgger Diffusion Navigation: DAgger Boosted Diffusion Policy for Vision-Language Navigation [73.80968452950854]
  Vision-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural language instructions through free-form 3D spaces.<n>Existing VLN-CE approaches typically use a two-stage waypoint planning framework.<n>We propose DAgger Diffusion Navigation (DifNav) as an end-to-end optimized VLN-CE policy.
  arXiv  Detail & Related papers  (2025-08-13T02:51:43Z)
• FloNa: Floor Plan Guided Embodied Visual Navigation [17.872748053116137]
  Humans naturally rely on floor plans to navigate in unfamiliar environments.<n>Existing visual navigation settings overlook this valuable prior knowledge.<n>We introduce Floor Plan Visual Navigation (FloNa), the first attempt to incorporate floor plan into embodied visual navigation.
  arXiv  Detail & Related papers  (2024-12-24T10:42:25Z)
• Affordances-Oriented Planning using Foundation Models for Continuous Vision-Language Navigation [64.84996994779443]
  We propose a novel Affordances-Oriented Planner for continuous vision-language navigation (VLN) task. Our AO-Planner integrates various foundation models to achieve affordances-oriented low-level motion planning and high-level decision-making. Experiments on the challenging R2R-CE and RxR-CE datasets show that AO-Planner achieves state-of-the-art zero-shot performance.
  arXiv  Detail & Related papers  (2024-07-08T12:52:46Z)
• Long-HOT: A Modular Hierarchical Approach for Long-Horizon Object Transport [83.06265788137443]
  We address key challenges in long-horizon embodied exploration and navigation by proposing a new object transport task and a novel modular framework for temporally extended navigation. Our first contribution is the design of a novel Long-HOT environment focused on deep exploration and long-horizon planning. We propose a modular hierarchical transport policy (HTP) that builds a topological graph of the scene to perform exploration with the help of weighted frontiers.
  arXiv  Detail & Related papers  (2022-10-28T05:30:49Z)
• Target-Driven Structured Transformer Planner for Vision-Language Navigation [55.81329263674141]
  We propose a Target-Driven Structured Transformer Planner (TD-STP) for long-horizon goal-guided and room layout-aware navigation. Specifically, we devise an Imaginary Scene Tokenization mechanism for explicit estimation of the long-term target. In addition, we design a Structured Transformer Planner which elegantly incorporates the explored room layout into a neural attention architecture for structured and global planning.
  arXiv  Detail & Related papers  (2022-07-19T06:46:21Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.