FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation
- URL: http://arxiv.org/abs/2606.22424v2
- Date: Tue, 23 Jun 2026 03:11:10 GMT
- Title: FlowDec: Temporal Conditional Flow Decorruptor for Robust Continuous Vision-Language Navigation
- Abstract summary: Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural-language instructions in unseen scenes.<n>We introduce Temporal Flow Decorruptor (FlowDec), a novel image restoration framework tailored for LM-based VLN-CE.<n>FlowDec outperforms state-of-the-art decorruption methods in both navigation accuracy and generation latency.
- Score: 8.00310534826872
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to follow natural-language instructions in unseen scenes. While Large Models (LMs) have advanced VLN-CE, their performance remains severely degraded by real-world visual corruptions, a critical yet underexplored domain constraint. We introduce Temporal Conditional Flow Decorruptor (FlowDec), a novel image restoration framework tailored for LM-based VLN-CE. FlowDec integrates a hybrid temporal conditioning strategy to align the generative flow path with historical context and employs action-centroid guided filtering to dynamically assess and integrate outputs. Extensive experiments demonstrate that FlowDec outperforms state-of-the-art decorruption methods in both navigation accuracy and generation latency. Our approach establishes a robust, efficient paradigm for resilient embodied navigation in unpredictable real-world conditions.
Related papers
- SC$^{2}$-WM: A Self-Correcting World Model with Closed-Loop Feedback for Vision-and-Language Navigation in Continuous Environments [54.76467884696539]
We propose SC$2$-WM, a self-correcting world model framework that introduces internal feedback for closed-loop decision making in VLN-CE.<n>Our method derives feedback from world-model foresight to perform state-level plan refinement before action execution.<n>Experiments on standard VLN-CE benchmarks demonstrate improved navigation and generalization.
arXiv Detail & Related papers (2026-08-01T03:17:48Z) - LC-Flow: Learning Local Continuous Optical Flow and Confidence from events [5.146238489510258]
Event cameras capture brightness changes asynchronously with microsecond resolution, yet existing optical flow methods fail to exploit this temporal continuity.<n>We propose textbfLC-Flow, the first temporally continuous, learning-based optical flow estimator that operates purely from local events.
arXiv Detail & Related papers (2026-05-23T14:42:24Z) - OFlow: Injecting Object-Aware Temporal Flow Matching for Robust Robotic Manipulation [55.56490813640669]
VLA models typically act only on the current frame, while future prediction and object-aware reasoning are often learned in separate latent spaces.<n>We propose OFlow, a framework that addresses both limitations by unifying temporal foresight and object-aware reasoning in a shared semantic latent space.<n>Our method forecasts future latents with temporal flow matching, factorizes them into object-aware representations that emphasize physically relevant cues.
arXiv Detail & Related papers (2026-04-20T06:38:01Z) - FlowIt: Global Matching for Optical Flow with Confidence-Guided Refinement [44.07406912385784]
FlowIt is a novel architecture for optical flow estimation.<n>It is designed to robustly handle large pixel displacements.<n>It achieves state-of-the-art results on the competitive Sintel and KITTI benchmarks.
arXiv Detail & Related papers (2026-03-30T17:58:12Z) - NavMorph: A Self-Evolving World Model for Vision-and-Language Navigation in Continuous Environments [67.18144414660681]
Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to execute sequential navigation actions in complex environments guided by natural language instructions.<n>Inspired by human cognition, we present NavMorph, a self-evolving world model framework that enhances environmental understanding and decision-making in VLN-CE tasks.
arXiv Detail & Related papers (2025-06-30T02:20:00Z) - VLN-R1: Vision-Language Navigation via Reinforcement Fine-Tuning [77.34267241692706]
Vision-Language Navigation (VLN) is a core challenge in embodied AI, requiring agents to navigate real-world environments using natural language instructions.<n>We propose VLN-R1, an end-to-end framework that leverages Large Vision-Language Models (LVLM) to directly translate egocentric video streams into continuous navigation actions.
arXiv Detail & Related papers (2025-06-20T17:59:59Z) - GC-ConsFlow: Leveraging Optical Flow Residuals and Global Context for Robust Deepfake Detection [23.05634856249282]
Deepfake technology has enabled the generation of highly realistic manipulated videos, posing severe social and ethical challenges.<n>Existing Deepfake detection methods primarily focused on either spatial or temporal inconsistencies, neglecting the interplay between the two.<n>We propose the global context flow (GC-ConsFlow), a novel dual-stream framework that effectively integrates spatial and temporal features for robust Deepfake detection.
arXiv Detail & Related papers (2025-01-23T07:43:56Z) - AccFlow: Backward Accumulation for Long-Range Optical Flow [70.4251045372285]
This paper proposes a novel recurrent framework called AccFlow for long-range optical flow estimation.
We demonstrate the superiority of backward accumulation over conventional forward accumulation.
Experiments validate the effectiveness of AccFlow in handling long-range optical flow estimation.
arXiv Detail & Related papers (2023-08-25T01:51:26Z) - Self-Supervised Learning of Non-Rigid Residual Flow and Ego-Motion [63.18340058854517]
We present an alternative method for end-to-end scene flow learning by joint estimation of non-rigid residual flow and ego-motion flow for dynamic 3D scenes.
We extend the supervised framework with self-supervisory signals based on the temporal consistency property of a point cloud sequence.
arXiv Detail & Related papers (2020-09-22T11:39:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.