FloNa: Floor Plan Guided Embodied Visual Navigation

• URL: http://arxiv.org/abs/2412.18335v2
• Date: Fri, 07 Mar 2025 03:11:27 GMT
• Title: FloNa: Floor Plan Guided Embodied Visual Navigation
• Abstract summary: Humans naturally rely on floor plans to navigate in unfamiliar environments.<n>Existing visual navigation settings overlook this valuable prior knowledge.<n>We introduce Floor Plan Visual Navigation (FloNa), the first attempt to incorporate floor plan into embodied visual navigation.
• Score: 17.872748053116137
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Humans naturally rely on floor plans to navigate in unfamiliar environments, as they are readily available, reliable, and provide rich geometrical guidance. However, existing visual navigation settings overlook this valuable prior knowledge, leading to limited efficiency and accuracy. To eliminate this gap, we introduce a novel navigation task: Floor Plan Visual Navigation (FloNa), the first attempt to incorporate floor plan into embodied visual navigation. While the floor plan offers significant advantages, two key challenges emerge: (1) handling the spatial inconsistency between the floor plan and the actual scene layout for collision-free navigation, and (2) aligning observed images with the floor plan sketch despite their distinct modalities. To address these challenges, we propose FloDiff, a novel diffusion policy framework incorporating a localization module to facilitate alignment between the current observation and the floor plan. We further collect $20k$ navigation episodes across $117$ scenes in the iGibson simulator to support the training and evaluation. Extensive experiments demonstrate the effectiveness and efficiency of our framework in unfamiliar scenes using floor plan knowledge. Project website: https://gauleejx.github.io/flona/.

Related papers

• FloVerse: Floor Plan-Guided Multi-Modal Navigation [27.822662490531325]
  FloVerse is a task for floor plan-guided embodied navigation.<n>ThreeDiff implicitly captures spatial information from floor plans.<n>Experiments demonstrate that floor-plan priors improve navigation performance across all goal modalities.
  arXiv  Detail & Related papers  (2026-06-12T08:49:53Z)
• SceneAligner: 3D-Grounded Floorplan Localization in the Wild [24.114337264203428]
  We present an approach for performing floorplan localization in the wild by grounding the task in a reconstructed 3D representation of the scene.<n>Our method reconstructs a gravity-aligned 3D scene and projects it into a 2D density map that serves as a floorplan proxy.<n>To bridge the appearance gap between density maps and architectural floorplans, we adapt a 2D foundation model to learn cross-modal correspondences.
  arXiv  Detail & Related papers  (2026-05-21T14:53:05Z)
• TravExplorer: Cross-Floor Embodied Exploration via Traversability-Aware 3-D Planning [17.54520943622758]
  This article presents TravExplorer, a cross-floor embodied exploration framework.<n>It couples zero-shot semantic guidance with traversability-aware 3-D planning.<n>Fifty real-world trials on a Unitree Go2 further validate open-vocabulary target search across single-floor and cross-floor indoor environments.
  arXiv  Detail & Related papers  (2026-05-19T15:11:29Z)
• FloorPlan-VLN: A New Paradigm for Floor Plan Guided Vision-Language Navigation [17.1490555684021]
  Existing-Language Navigation (VLN) task requires agents to follow instructions, ignoring some potentially useful global spatial priors.<n>We introduce bfFloorPlan-VLN, a new paradigm that leverages structured floor plans as global spatial priors to enable navigation with only concise instructions.
  arXiv  Detail & Related papers  (2026-03-18T07:22:48Z)
• History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigation [64.51891404034164]
  Aerial Vision-and-Language Navigation (AVLN) requires Unmanned Aerial Vehicle (UAV) agents to localize targets in large-scale urban environments.<n>Existing UAV agents typically adopt mono-granularity frameworks that struggle to balance these two aspects.<n>This work proposes a History-Enhanced Two-Stage Transformer (HETT) framework, which integrates the two aspects through a coarse-to-fine navigation pipeline.
  arXiv  Detail & Related papers  (2025-12-16T09:16:07Z)
• Floorplan2Guide: LLM-Guided Floorplan Parsing for BLV Indoor Navigation [4.3114959617830015]
  We propose a novel navigation approach that transforms floor plans into navigable knowledge graphs and generate human-readable navigation instructions.<n> Floorplan2Guide integrates a large language model (LLM) to extract spatial information from architectural layouts.<n>Results indicate that few-shot learning improves navigation accuracy in comparison to zero-shot learning on simulated and real-world evaluations.
  arXiv  Detail & Related papers  (2025-12-13T04:49:26Z)
• DUViN: Diffusion-Based Underwater Visual Navigation via Knowledge-Transferred Depth Features [47.88998580611257]
  We propose a Diffusion-based Underwater Visual Navigation policy via knowledge-transferred depth features, named DUViN.<n>DuViN guides the vehicle to avoid obstacles and maintain a safe and perception awareness altitude relative to the terrain without relying on pre-built maps.<n> Experiments in both simulated and real-world underwater environments demonstrate the effectiveness and generalization of our approach.
  arXiv  Detail & Related papers  (2025-09-03T03:43:12Z)
• Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Construction [102.70482302750897]
  Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction. Previous methods struggle to perform well due to the longer navigation path, more complicated 3D scenes, and the neglect of the interplay between vertical and horizontal actions. We propose a novel grid-based view selection framework that formulates aerial VLN action prediction as a grid-based view selection task.
  arXiv  Detail & Related papers  (2025-03-14T05:20:43Z)
• TOP-Nav: Legged Navigation Integrating Terrain, Obstacle and Proprioception Estimation [5.484041860401147]
  TOP-Nav is a novel legged navigation framework that integrates a comprehensive path planner with Terrain awareness, Obstacle avoidance and close-loop Proprioception. We show that TOP-Nav achieves open-world navigation that the robot can handle terrains or disturbances beyond the distribution of prior knowledge.
  arXiv  Detail & Related papers  (2024-04-23T17:42:45Z)
• Aligning Knowledge Graph with Visual Perception for Object-goal Navigation [16.32780793344835]
  We propose the Aligning Knowledge Graph with Visual Perception (AKGVP) method for object-goal navigation. Our approach introduces continuous modeling of the hierarchical scene architecture and leverages visual-language pre-training to align natural language description with visual perception. The integration of a continuous knowledge graph architecture and multimodal feature alignment empowers the navigator with a remarkable zero-shot navigation capability.
  arXiv  Detail & Related papers  (2024-02-29T06:31:18Z)
• How To Not Train Your Dragon: Training-free Embodied Object Goal Navigation with Semantic Frontiers [94.46825166907831]
  We present a training-free solution to tackle the object goal navigation problem in Embodied AI. Our method builds a structured scene representation based on the classic visual simultaneous localization and mapping (V-SLAM) framework. Our method propagates semantics on the scene graphs based on language priors and scene statistics to introduce semantic knowledge to the geometric frontiers.
  arXiv  Detail & Related papers  (2023-05-26T13:38:33Z)
• Predicting Topological Maps for Visual Navigation in Unexplored Environments [28.30219170556201]
  We propose a robotic learning system for autonomous exploration and navigation in unexplored environments. The core of our method is a process for building, predicting, and using probabilistic layout graphs for assisting goal-based visual navigation. We test our framework in Matterport3D and show more success and efficient navigation in unseen environments.
  arXiv  Detail & Related papers  (2022-11-23T00:53:11Z)
• Target-Driven Structured Transformer Planner for Vision-Language Navigation [55.81329263674141]
  We propose a Target-Driven Structured Transformer Planner (TD-STP) for long-horizon goal-guided and room layout-aware navigation. Specifically, we devise an Imaginary Scene Tokenization mechanism for explicit estimation of the long-term target. In addition, we design a Structured Transformer Planner which elegantly incorporates the explored room layout into a neural attention architecture for structured and global planning.
  arXiv  Detail & Related papers  (2022-07-19T06:46:21Z)
• ViKiNG: Vision-Based Kilometer-Scale Navigation with Geographic Hints [94.60414567852536]
  Long-range navigation requires both planning and reasoning about local traversability. We propose a learning-based approach that integrates learning and planning. ViKiNG can leverage its image-based learned controller and goal-directed to navigate to goals up to 3 kilometers away.
  arXiv  Detail & Related papers  (2022-02-23T02:14:23Z)
• Lifelong Topological Visual Navigation [16.41858724205884]
  We propose a learning-based visual navigation method with graph update strategies that improve lifelong navigation performance over time. We take inspiration from sampling-based planning algorithms to build image-based topological graphs, resulting in sparser graphs yet with higher navigation performance compared to baseline methods. Unlike controllers that learn from fixed training environments, we show that our model can be finetuned using a relatively small dataset from the real-world environment where the robot is deployed.
  arXiv  Detail & Related papers  (2021-10-16T06:16:14Z)
• Augmented reality navigation system for visual prosthesis [67.09251544230744]
  We propose an augmented reality navigation system for visual prosthesis that incorporates a software of reactive navigation and path planning. It consists on four steps: locating the subject on a map, planning the subject trajectory, showing it to the subject and re-planning without obstacles. Results show how our augmented navigation system help navigation performance by reducing the time and distance to reach the goals, even significantly reducing the number of obstacles collisions.
  arXiv  Detail & Related papers  (2021-09-30T09:41:40Z)
• Structured Scene Memory for Vision-Language Navigation [155.63025602722712]
  We propose a crucial architecture for vision-language navigation (VLN) It is compartmentalized enough to accurately memorize the percepts during navigation. It also serves as a structured scene representation, which captures and disentangles visual and geometric cues in the environment.
  arXiv  Detail & Related papers  (2021-03-05T03:41:00Z)
• Plan2Vec: Unsupervised Representation Learning by Latent Plans [106.37274654231659]
  We introduce plan2vec, an unsupervised representation learning approach that is inspired by reinforcement learning. Plan2vec constructs a weighted graph on an image dataset using near-neighbor distances, and then extrapolates this local metric to a global embedding by distilling path-integral over planned path. We demonstrate the effectiveness of plan2vec on one simulated and two challenging real-world image datasets.
  arXiv  Detail & Related papers  (2020-05-07T17:52:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.