Distilling deep optical flow stereo methods to retrieve dense three-dimensional wind fields

• URL: http://arxiv.org/abs/2609.03100v1
• Date: Wed, 02 Sep 2026 19:22:45 GMT
• Title: Distilling deep optical flow stereo methods to retrieve dense three-dimensional wind fields
• Abstract summary: Geostationary atmospheric motion vectors (AMVs) provide the dense horizontal wind vectors (u,v) and heights ingested into data assimilation systems.<n>Traditional AMVs track features using window-based cross-correlation and estimate heights via infrared brightness temperatures paired with numerical weather prediction (NWP) background states.<n>We replace window-based tracking in stereo matching with deep optical flow for efficient, improved retrieval.
• Score: 1.9773952530645156
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Geostationary atmospheric motion vectors (AMVs) provide the dense horizontal wind vectors (u,v) and heights ingested into data assimilation systems. Traditional AMVs track features using window-based cross-correlation and estimate heights via infrared brightness temperatures paired with numerical weather prediction (NWP) background states, creating a circular dependency that yields inaccurate heights, high computational cost, and sparse retrievals. Stereo winds from GEO-GEO and GEO-LEO geometrically resolve heights from parallax shifts across different poses, eliminating NWP dependence and improving accuracy, but they remain computationally heavy with limited coverage. In this work, we replace window-based tracking in stereo matching with deep optical flow for efficient, improved retrieval. Fine-tuning balances a self-supervised geometric residual loss with supervised radiosonde reconstruction. To eliminate multi-satellite overlap requirements, we distill the stereo teacher into a single-satellite student model. Chi-square and height uncertainties from the teacher are emulated by the student for quality assurance. The student generates winds across full-disk GEO imagery globally. Validation compares stereo and student models against radiosondes, operational AMVs, ERA5 reanalysis, and EarthCARE cloud profiles. Results through triple collocation show that stereo winds improve performance beyond operational AMVs for water vapor bands (6.2, 6.9, and 7.3 μm), wit degradation in the long-wave infrared (11.2 μm) band.

Related papers

• Does Robust VIO Need More Learning? Geometry-Verified Visual Measurements under Distribution Shift [18.007082445726756]
  We propose a minimal-learning stereo VIO framework in which SEA-RAFT is used only to propose dense stereo correspondences and predict their uncertainty.<n>Dense flow is sampled at sparse feature locations, filtered using predicted uncertainty and stereo epipolar consistency, and incorporated into a sliding-window stereo-inertial estimator.<n>Experiments on EuRoC, VIODE, and 4Seasons demonstrate accurate and stable estimation under motion blur, dynamic scenes, illumination changes, and large indoor-to-outdoor distribution shifts.
  arXiv  Detail & Related papers  (2026-07-20T13:57:44Z)
• Cross-Modal Hierarchical Fusion for from Multi-Sensor Ground Observation [2.538209532048867]
  AtmoFuseNet is a framework that fuses multi-view sky camera imagery with millimeter-wave cloud radar and ceilometer observations to produce 4D estimates of cloud state and wind.<n>On collocated observations from a semi-arid site, AtmoFuseNet reaches 0.026 g m-3 liquid water content MAE and 1.18 ms-1 wind speed MAE.
  arXiv  Detail & Related papers  (2026-05-31T14:17:43Z)
• Unifying UAV Cross-View Geo-Localization via 3D Geometric Perception [51.687842983240564]
  Cross-view geo-localization for Unmanned Aerial Vehicles (UAVs) remains challenging due to the severe geometric discrepancy between oblique UAV imagery and satellite maps.<n>We propose a geometry-aware UAV geo-localization framework that explicitly models the 3D scene geometry to unify coarse place recognition and fine-grained pose estimation.<n>Our method significantly outperforms state-of-the-art baselines, achieving robust meter-level localization accuracy and improved generalization in complex urban environments.
  arXiv  Detail & Related papers  (2026-04-02T08:08:41Z)
• NimbusGS: Unified 3D Scene Reconstruction under Hybrid Weather [83.14198482357388]
  We present NimbusGS, a unified framework for reconstructing high-quality 3D scenes from degraded multi-view inputs.<n>Unlike existing methods that target specific weather types, NimbusGS addresses the broader challenge of generalization.
  arXiv  Detail & Related papers  (2026-03-28T10:46:29Z)
• VGGT-World: Transforming VGGT into an Autoregressive Geometry World Model [59.789011777899965]
  VGGT-World is a geometry world model that side-steps video generation entirely and instead forecasts the temporal evolution of frozen geometry-foundation-model features.<n>We show that VGGT-World significantly outperforms the strongest baselines in depth forecasting while running 3.6-5 times faster with only 0.43B trainable parameters.
  arXiv  Detail & Related papers  (2026-03-13T04:56:43Z)
• A Radiometric Correction based Optical Modeling Approach to Removing Reflection Noise in TLS Point Clouds of Urban Scenes [3.7967365472200894]
  TLS-acquired point clouds often contain virtual points from reflective surfaces, causing disruptions. This study presents a reflection noise elimination algorithm for TLS point clouds.
  arXiv  Detail & Related papers  (2024-07-03T06:17:41Z)
• A 3D super-resolution of wind fields via physics-informed pixel-wise self-attention generative adversarial network [0.01649298969786889]
  complexity of computation in resolving high-resolution wind fields left simulations impractical to test different time lengths and model configurations. This study presents a preliminary development of a physics-informed super-resolution (SR) generative adversarial network (GAN) GAN super-resolves the three-dimensional (3D) low-resolution wind fields by upscaling x9 times.
  arXiv  Detail & Related papers  (2023-12-20T17:28:21Z)
• Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
  State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs. Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative. The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
  arXiv  Detail & Related papers  (2023-09-24T19:57:22Z)
• Vision Transformers, a new approach for high-resolution and large-scale mapping of canopy heights [50.52704854147297]
  We present a new vision transformer (ViT) model optimized with a classification (discrete) and a continuous loss function. This model achieves better accuracy than previously used convolutional based approaches (ConvNets) optimized with only a continuous loss function.
  arXiv  Detail & Related papers  (2023-04-22T22:39:03Z)
• 3D wind field profiles from hyperspectral sounders: revisiting optic-flow from a meteorological perspective [0.0]
  We present an efficient optic flow algorithm for the extraction of vertically resolved 3D atmospheric motion vector (AMV) data measures by Forecast sounders. We show that the proposed recursion is superior to state-of-the-art optical flow algorithms in the real atmospheric sounding inter-II observations.
  arXiv  Detail & Related papers  (2023-03-09T10:14:25Z)
• On Robust Cross-View Consistency in Self-Supervised Monocular Depth Estimation [56.97699793236174]
  We study two kinds of robust cross-view consistency in this paper. We exploit the temporal coherence in both depth feature space and 3D voxel space for self-supervised monocular depth estimation. Experimental results on several outdoor benchmarks show that our method outperforms current state-of-the-art techniques.
  arXiv  Detail & Related papers  (2022-09-19T03:46:13Z)
• Lidar Light Scattering Augmentation (LISA): Physics-based Simulation of Adverse Weather Conditions for 3D Object Detection [60.89616629421904]
  Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. They are sensitive to adverse weather conditions such as rain, snow and fog due to reduced signal-to-noise ratio (SNR) and signal-to-background ratio (SBR)
  arXiv  Detail & Related papers  (2021-07-14T21:10:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.