FreqNav: Stage-Wise Frequency Routing for Object-Oriented Aerial Vision-Language Navigation
- URL: http://arxiv.org/abs/2608.00970v1
- Date: Sun, 02 Aug 2026 03:49:54 GMT
- Title: FreqNav: Stage-Wise Frequency Routing for Object-Oriented Aerial Vision-Language Navigation
- Abstract summary: We propose a lightweight adaptive perception framework for long-horizon aerial navigation.<n>FreqNav dynamically reallocates visual tokens across frequency components according to the current navigation stage.<n>Experiments show that FreqNav outperforms strong baselines while achieving approximately 3x faster inference.
- Score: 20.62861089679206
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Object-oriented aerial vision-and-language navigation (VLN) requires searching for a described target and landing on it precisely, under long-horizon and closed-loop control. Guided by a target-descriptive instruction during navigation, perceptual priorities dynamically evolve: early-stage exploration prioritizes low-frequency spatial layout, and then shifts to high-frequency target details. Existing VLN methods model the varying perceptual requirements across navigation stages with identical visual tokens, leading to interference from irrelevant objects and background clutter. To this end, we therefore formulate long-horizon aerial navigation as a frequencypreference shift from spatial structure to local detail and propose FreqNav, a lightweight frequency-routing adaptive perception framework. Under a fixed computational budget, FreqNav dynamically reallocates visual tokens across frequency components according to the current navigation stage. A Frequency Token Router selects stage-relevant visual representations from dual-view observations, while a Phase-dependent Grounding Module anchors visual evidence through explicit supervision. A Diffusion Transformer then predicts smooth trajectories for continuous control. Experiments show that FreqNav outperforms strong baselines while achieving approximately 3x faster inference. Real-world deployment further demonstrates its effectiveness, efficiency, and practical potential for long-horizon aerial autonomy.
Related papers
- LightNav-0: Eliciting VLM Spatial Intelligence for Generalist Embodied Navigation [52.91080323083409]
Embodied navigation requires agents to translate heterogeneous goals and visual observations into actions across tasks, environments, and robot embodiments.<n>Here we present LightNav-0, a compact generalist embodied navigation model that elicits the spatial intelligence of a pretrained VLM and aligns it with navigation, without task-specific prediction heads.
arXiv Detail & Related papers (2026-08-31T15:08:53Z) - VoLN: Vision-Only Long-Horizon Navigation---Paradigm, Benchmark, and Method [14.658802504108833]
Vision-and-Language Navigation (VLN) enables embodied agents to follow natural-language instructions.<n>We propose Vision-Only Long-Horizon Navigation (VoLN), which shifts route-relevant information from externally supplied instructions and global guidance to locally observable in-scene cues.<n>We instantiate VoLN for aerial navigation through VoLN-UAV, a 7,210-episode benchmark that combines long-horizon goal-directed flight, continuous 3D motion, large viewpoint changes, and context-dependent beacon selection.
arXiv Detail & Related papers (2026-07-23T15:02:01Z) - FSD-VLN: Fast-Slow Dual-System Modeling for Aerial Long-Horizon Vision-Language Navigation [33.92221208368759]
Vision-Language Navigation (VLN) is an autonomous navigation in unknown environments by mapping language instructions to real-time visual inputs.<n>Existing methods suffer from structural misalignment between global multimodal understanding and sequential action generation.<n>We propose FSD-VLN, a fast-slow dual-system architecture disentangling semantic reasoning and low-altitude flight command generation.
arXiv Detail & Related papers (2026-07-09T11:17:04Z) - Beyond Matching to Tiles: Bridging Unaligned Aerial and Satellite Views for Vision-Only UAV Navigation [51.286599397552756]
We present Bearing-UAV, a vision-driven cross-view navigation method that jointly predicts UAV absolute location and heading from neighboring features.<n>We also present Bearing-UAV-90k, a benchmark for evaluating cross-view localization and navigation.
arXiv Detail & Related papers (2026-03-23T16:17:39Z) - History-Conditioned Spatio-Temporal Visual Token Pruning for Efficient Vision-Language Navigation [18.716145266309802]
Vision-Language Navigation (LNV) enables robots to follow natural-language instructions in visually grounded environments, serving as a key capability for embodied robotic systems.<n>Recent Vision-Language-Action-Models have demonstrated strong navigation performance, but their computational latency that limits real-time deployment.<n>We propose a training-free vision-language framework tailored to VLN-based VLN.
arXiv Detail & Related papers (2026-03-06T17:03:16Z) - LongFly: Long-Horizon UAV Vision-and-Language Navigation with Spatiotemporal Context Integration [49.676794850174325]
LongFly is a history-awaretemporal modeling framework for long-horizon UAV VLN.<n>It transforms fragmented and redundant historical data into structured, compact, and expressive representations.<n>It outperforms state-of-the-art UAV VLN baselines by 7.89% in success rate and 6.33% in success weighted by path length.
arXiv Detail & Related papers (2025-12-26T12:09:40Z) - History-Enhanced Two-Stage Transformer for Aerial Vision-and-Language Navigation [64.51891404034164]
Aerial Vision-and-Language Navigation (AVLN) requires Unmanned Aerial Vehicle (UAV) agents to localize targets in large-scale urban environments.<n>Existing UAV agents typically adopt mono-granularity frameworks that struggle to balance these two aspects.<n>This work proposes a History-Enhanced Two-Stage Transformer (HETT) framework, which integrates the two aspects through a coarse-to-fine navigation pipeline.
arXiv Detail & Related papers (2025-12-16T09:16:07Z) - HUNT: High-Speed UAV Navigation and Tracking in Unstructured Environments via Instantaneous Relative Frames [50.83645076723809]
HUNT (High-speed UAV Navigation and Tracking) is a real-time framework that unifies, acquisition, and tracking within a single relative formulation.<n>Trials in dense forests, container compounds, and search-and-rescue operations with vehicles and mannequins demonstrate robust autonomy where global methods fail.
arXiv Detail & Related papers (2025-09-23T18:07:10Z) - Aerial Vision-and-Language Navigation with Grid-based View Selection and Map Construction [102.70482302750897]
Aerial Vision-and-Language Navigation (Aerial VLN) aims to obtain an unmanned aerial vehicle agent to navigate aerial 3D environments following human instruction.<n>Previous methods struggle to perform well due to the longer navigation path, more complicated 3D scenes, and the neglect of the interplay between vertical and horizontal actions.<n>We propose a novel grid-based view selection framework that formulates aerial VLN action prediction as a grid-based view selection task.
arXiv Detail & Related papers (2025-03-14T05:20:43Z) - Reinforced Structured State-Evolution for Vision-Language Navigation [42.46176089721314]
Vision-and-language Navigation (VLN) task requires an embodied agent to navigate to a remote location following a natural language instruction.
Previous methods usually adopt a sequence model (e.g., Transformer and LSTM) as the navigator.
We propose a novel Structured state-Evolution (SEvol) model to effectively maintain the environment layout clues for VLN.
arXiv Detail & Related papers (2022-04-20T07:51:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.