Autonomous FPV Flight with Translational Optical Flow and Uncertainty Mask

• URL: http://arxiv.org/abs/2606.09088v1
• Date: Mon, 08 Jun 2026 06:35:32 GMT
• Title: Autonomous FPV Flight with Translational Optical Flow and Uncertainty Mask
• Abstract summary: We show how to disentangle obstacle-induced optical flow from the ego-motion background flow and suffer from low signal-to-noise ratios.<n>The proposed system achieves robust flight at speeds of up to 13.91 m/s in simulation and 11.79 m/s in real-world tests, with a 93.3% success rate over 30 real-world trials.
• Score: 21.625723699038897
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Autonomous FPV quadrotor flight in complex environments using a monocular RGB camera as the sole exteroceptive sensor remains a fundamental challenge. Recent research has shown that using optical flow as the input of a neural network can achieve end-to-end autonomous flight in cluttered scenes. However, extracting the most relevant information from the flow estimation is the key bottleneck limiting agility and robustness. Existing methods struggle to disentangle obstacle-induced optical flow from the ego-motion background flow and suffer from low signal-to-noise ratios near the focus of expansion (FoE). To address these issues, we decompose the optical flow into translational and rotational components and utilize only the translational flow, which captures scene geometry and depth cues. In addition, we introduce an uncertainty mask derived from inconsistencies between forward and backward flow estimates. This mask highlights obstacle structures, including those within the FoE region. Both cues are fed to a control policy trained in a differentiable simulation framework, which enables efficient first-order optimization across perception and control. We validate our approach through extensive experiments in both simulated and real-world forest environments. The proposed system achieves robust flight at speeds of up to 13.91 m/s in simulation and 11.79 m/s in real-world tests, with a 93.3\% success rate over 30 real-world trials, nearly doubling the previously reported 6 m/s real-world speed of the monocular-RGB optical-flow UAV obstacle avoidance system.

Related papers

• FlowPainter: Inpainting Optical Flow via Confidence-Guided Completion [52.3830227666301]
  FlowPainter is a diffusion-based optical flow framework that reformulates dense-flow generation as confidence-guided soft inpainting.<n>Our approach offers a practical way to integrate reliable discriminative priors with diffusion-based refinement for optical flow estimation.
  arXiv  Detail & Related papers  (2026-07-11T05:59:22Z)
• RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow [51.43025173196566]
  Monocular scene flow estimation aims to recover dense 3D motion from image sequences.<n>We propose RAFT-MSF++, a self-supervised multi-frame framework that fuses temporal features to jointly estimate depth and scene flow.<n>Experiments show that RAFT-MSF++ achieves 24.14% SF-all on the KITTI Scene Flow benchmark, with a 30.99% improvement over the baseline and better robustness in occluded regions.
  arXiv  Detail & Related papers  (2026-04-21T11:32:49Z)
• Safe Path Planning and Observation Quality Enhancement Strategy for Unmanned Aerial Vehicles in Water Quality Monitoring Tasks [7.258114996625529]
  spectral remote sensing technology is widely used in water quality monitoring.<n>In dynamic environments, varying illumination conditions, such as shadows and specular reflection, can cause severe spectral distortion.<n>This paper proposes an active path planning method for dynamic light and shadow disturbance avoidance.
  arXiv  Detail & Related papers  (2025-12-24T14:26:20Z)
• PMA-Diffusion: A Physics-guided Mask-Aware Diffusion Framework for TSE from Sparse Observations [0.6918455480131249]
  PMA-Diffusion is a physics-guided mask-aware diffusion framework.<n>It reconstructs unobserved highway speed fields from sparse, incomplete observations.<n>It is tested on the I-24 MOTION dataset with varying visibility ratios.
  arXiv  Detail & Related papers  (2025-12-05T22:05:01Z)
• Multi-Modal Neural Radiance Field for Monocular Dense SLAM with a Light-Weight ToF Sensor [58.305341034419136]
  We present the first dense SLAM system with a monocular camera and a light-weight ToF sensor. We propose a multi-modal implicit scene representation that supports rendering both the signals from the RGB camera and light-weight ToF sensor. Experiments demonstrate that our system well exploits the signals of light-weight ToF sensors and achieves competitive results.
  arXiv  Detail & Related papers  (2023-08-28T07:56:13Z)
• Towards Anytime Optical Flow Estimation with Event Cameras [37.892840680923584]
  Event cameras respond to changes in log-brightness at the millisecond level, making them ideal for optical flow estimation.<n>Existing datasets from event cameras provide only low frame rate ground truth for optical flow.<n>We propose EVA-Flow, an EVent-based Anytime Flow estimation network to produce high-frame-rate event optical flow.
  arXiv  Detail & Related papers  (2023-07-11T06:15:12Z)
• Weakly-Supervised Optical Flow Estimation for Time-of-Flight [11.496094830445054]
  We propose a training algorithm, which allows to supervise Optical Flow networks directly on the reconstructed depth. We demonstrate that this approach enables the training of OF networks to align raw iToF measurements and compensate motion artifacts in the iToF depth images.
  arXiv  Detail & Related papers  (2022-10-11T09:47:23Z)
• Dense Optical Flow from Event Cameras [55.79329250951028]
  We propose to incorporate feature correlation and sequential processing into dense optical flow estimation from event cameras. Our proposed approach computes dense optical flow and reduces the end-point error by 23% on MVSEC.
  arXiv  Detail & Related papers  (2021-08-24T07:39:08Z)
• Unsupervised Motion Representation Enhanced Network for Action Recognition [4.42249337449125]
  Motion representation between consecutive frames has proven to have great promotion to video understanding. TV-L1 method, an effective optical flow solver, is time-consuming and expensive in storage for caching the extracted optical flow. We propose UF-TSN, a novel end-to-end action recognition approach enhanced with an embedded lightweight unsupervised optical flow estimator.
  arXiv  Detail & Related papers  (2021-03-05T04:14:32Z)
• Optical Flow Estimation from a Single Motion-blurred Image [66.2061278123057]
  Motion blur in an image may have practical interests in fundamental computer vision problems. We propose a novel framework to estimate optical flow from a single motion-blurred image in an end-to-end manner.
  arXiv  Detail & Related papers  (2021-03-04T12:45:18Z)
• FAITH: Fast iterative half-plane focus of expansion estimation using event-based optic flow [3.326320568999945]
  This study proposes the FAst ITerative Half-plane (FAITH) method to determine the course of a micro air vehicle (MAV) Results show that the computational efficiency of our solution outperforms state-of-the-art methods while keeping a high level of accuracy.
  arXiv  Detail & Related papers  (2021-02-25T12:49:02Z)
• FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolation [97.99012124785177]
  FLAVR is a flexible and efficient architecture that uses 3D space-time convolutions to enable end-to-end learning and inference for video framesupervised. We demonstrate that FLAVR can serve as a useful self- pretext task for action recognition, optical flow estimation, and motion magnification.
  arXiv  Detail & Related papers  (2020-12-15T18:59:30Z)
• End-to-end Learning for Inter-Vehicle Distance and Relative Velocity Estimation in ADAS with a Monocular Camera [81.66569124029313]
  We propose a camera-based inter-vehicle distance and relative velocity estimation method based on end-to-end training of a deep neural network. The key novelty of our method is the integration of multiple visual clues provided by any two time-consecutive monocular frames. We also propose a vehicle-centric sampling mechanism to alleviate the effect of perspective distortion in the motion field.
  arXiv  Detail & Related papers  (2020-06-07T08:18:31Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.