Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Data

• URL: http://arxiv.org/abs/2410.12938v3
• Date: Mon, 05 May 2025 20:43:49 GMT
• Title: Local Off-Grid Weather Forecasting with Multi-Modal Earth Observation Data
• Authors: Qidong Yang, Jonathan Giezendanner, Daniel Salles Civitarese, Johannes Jakubik, Eric Schmitt, Anirban Chandra, Jeremy Vila, Detlef Hohl, Chris Hill, Campbell Watson, Sherrie Wang,
• Abstract summary: Wildfire management and renewable energy generation require precise, localized weather forecasts near the Earth's surface.<n>Forecasts produced by machine learning models or numerical weather prediction systems are typically generated on large-scale regular grids.<n>We propose a multi-grained transformer model trained end-to-end to downscale gridded forecasts to off-grid locations of interest.
• Score: 3.890177521606208
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Urgent applications like wildfire management and renewable energy generation require precise, localized weather forecasts near the Earth's surface. However, forecasts produced by machine learning models or numerical weather prediction systems are typically generated on large-scale regular grids, where direct downscaling fails to capture fine-grained, near-surface weather patterns. In this work, we propose a multi-modal transformer model trained end-to-end to downscale gridded forecasts to off-grid locations of interest. Our model directly combines local historical weather observations (e.g., wind, temperature, dewpoint) with gridded forecasts to produce locally accurate predictions at various lead times. Multiple data modalities are collected and concatenated at station-level locations, treated as a token at each station. Using self-attention, the token corresponding to the target location aggregates information from its neighboring tokens. Experiments using weather stations across the Northeastern United States show that our model outperforms a range of data-driven and non-data-driven off-grid forecasting methods. They also reveal that direct input of station data provides a phase shift in local weather forecasting accuracy, reducing the prediction error by up to 80% compared to pure gridded data based models. This approach demonstrates how to bridge the gap between large-scale weather models and locally accurate forecasts to support high-stakes, location-sensitive decision-making.

Related papers

• OneForecast: A Universal Framework for Global and Regional Weather Forecasting [44.203835175341]
  This paper proposes a global-regional nested weather forecasting framework based on graph neural networks (GNNs) By combining a dynamic system perspective with multi-grid theory, we construct a multi-scale graph structure and densify the target region to capture local high-frequency features. For high-resolution regional forecasts, we propose a neural nested grid method to mitigate boundary information loss.
  arXiv  Detail & Related papers  (2025-02-01T06:49:16Z)
• Generating Fine-Grained Causality in Climate Time Series Data for Forecasting and Anomaly Detection [67.40407388422514]
  We design a conceptual fine-grained causal model named TBN Granger Causality. Second, we propose an end-to-end deep generative model called TacSas, which discovers TBN Granger Causality in a generative manner. We test TacSas on climate benchmark ERA5 for climate forecasting and the extreme weather benchmark of NOAA for extreme weather alerts.
  arXiv  Detail & Related papers  (2024-08-08T06:47:21Z)
• Generative Data Assimilation of Sparse Weather Station Observations at Kilometer Scales [5.427841765899196]
  We demonstrate the viability of score-based data assimilation in the context of realistically complex km-scale weather.<n>By incorporating observations from 40 weather stations, 10% lower RMSEs on left-out stations are attained.<n>It is a ripe time to explore extensions that combine increasingly ambitious regional state generators with an increasing set of in situ, ground-based, and satellite remote sensing data streams.
  arXiv  Detail & Related papers  (2024-06-19T10:28:11Z)
• Aardvark weather: end-to-end data-driven weather forecasting [30.219727555662267]
  Aardvark Weather is an end-to-end data-driven weather prediction system. It ingests raw observations and outputs global gridded forecasts and local station forecasts. It can be optimised end-to-end to maximise performance over quantities of interest.
  arXiv  Detail & Related papers  (2024-03-30T16:41:24Z)
• Observation-Guided Meteorological Field Downscaling at Station Scale: A Benchmark and a New Method [66.80344502790231]
  We extend meteorological downscaling to arbitrary scattered station scales and establish a new benchmark and dataset. Inspired by data assimilation techniques, we integrate observational data into the downscaling process, providing multi-scale observational priors. Our proposed method outperforms other specially designed baseline models on multiple surface variables.
  arXiv  Detail & Related papers  (2024-01-22T14:02:56Z)
• Scaling transformer neural networks for skillful and reliable medium-range weather forecasting [23.249955524044392]
  We introduce Stormer, a state-of-the-art performance on weather forecasting with minimal changes to the standard transformer backbone. At the core of Stormer is a randomized forecasting objective that trains the model to forecast the weather dynamics over varying time intervals. On WeatherBench 2, Stormer performs competitively at short to medium-range forecasts and outperforms current methods beyond 7 days.
  arXiv  Detail & Related papers  (2023-12-06T19:46:06Z)
• Precipitation nowcasting with generative diffusion models [0.0]
  We study the efficacy of diffusion models in handling the task of precipitation nowcasting. Our work is conducted in comparison to the performance of well-established U-Net models.
  arXiv  Detail & Related papers  (2023-08-13T09:51:16Z)
• Deep Learning for Day Forecasts from Sparse Observations [60.041805328514876]
  Deep neural networks offer an alternative paradigm for modeling weather conditions. MetNet-3 learns from both dense and sparse data sensors and makes predictions up to 24 hours ahead for precipitation, wind, temperature and dew point. MetNet-3 has a high temporal and spatial resolution, respectively, up to 2 minutes and 1 km as well as a low operational latency.
  arXiv  Detail & Related papers  (2023-06-06T07:07:54Z)
• ClimaX: A foundation model for weather and climate [51.208269971019504]
  ClimaX is a deep learning model for weather and climate science. It can be pre-trained with a self-supervised learning objective on climate datasets. It can be fine-tuned to address a breadth of climate and weather tasks.
  arXiv  Detail & Related papers  (2023-01-24T23:19:01Z)
• GraphCast: Learning skillful medium-range global weather forecasting [107.40054095223779]
  We introduce a machine learning-based method called "GraphCast", which can be trained directly from reanalysis data. It predicts hundreds of weather variables, over 10 days at 0.25 degree resolution globally, in under one minute. We show that GraphCast significantly outperforms the most accurate operational deterministic systems on 90% of 1380 verification targets.
  arXiv  Detail & Related papers  (2022-12-24T18:15:39Z)
• Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast [91.9372563527801]
  We present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For the first time, an AI-based method outperforms state-of-the-art numerical weather prediction (NWP) methods in terms of accuracy. Pangu-Weather supports a wide range of downstream forecast scenarios, including extreme weather forecast and large-member ensemble forecast in real-time.
  arXiv  Detail & Related papers  (2022-11-03T17:19:43Z)
• DL-Corrector-Remapper: A grid-free bias-correction deep learning methodology for data-driven high-resolution global weather forecasting [11.334341754942917]
  We develop a methodology to correct, remap, and fine-tune gridded uniform forecasts of FourCastNet (FCN) This is akin to bias correction and post-processing of numerical weather prediction (NWP) We call this network the Deep-Learning-Corrector-Remapper (DLCR)
  arXiv  Detail & Related papers  (2022-10-21T23:04:44Z)
• Multi-time Predictions of Wildfire Grid Map using Remote Sensing Local Data [0.0]
  This paper proposes a distributed learning framework that shares local data collected in ten locations in the western USA throughout local agents. The proposed model has distinct features that address the characteristic need in prediction evaluations, including dynamic online estimation and time-series modeling.
  arXiv  Detail & Related papers  (2022-09-15T22:34:06Z)
• Forecasting large-scale circulation regimes using deformable convolutional neural networks and global spatiotemporal climate data [86.1450118623908]
  We investigate a supervised machine learning approach based on deformable convolutional neural networks (deCNNs) We forecast the North Atlantic-European weather regimes during extended boreal winter for 1 to 15 days into the future. Due to its wider field of view, we also observe deCNN achieving considerably better performance than regular convolutional neural networks at lead times beyond 5-6 days.
  arXiv  Detail & Related papers  (2022-02-10T11:37:00Z)
• HiSTGNN: Hierarchical Spatio-temporal Graph Neural Networks for Weather Forecasting [13.317147032467306]
  We propose a novel Graph Hierarchical Spatio-Temporal Neural Network (HiSTGNN) to model cross-regional-temporal correlations among meteorological variables in multiple stations. Experimental results on three real-world meteorological datasets demonstrate the superior performance of HiSTGNN beyond 7 baselines. It reduces the errors by 4.2% to 11.6% especially compared to state-of-the-art weather forecasting method.
  arXiv  Detail & Related papers  (2022-01-22T17:30:46Z)
• Deep Learning Based Cloud Cover Parameterization for ICON [55.49957005291674]
  We train NN based cloud cover parameterizations with coarse-grained data based on realistic regional and global ICON simulations. Globally trained NNs can reproduce sub-grid scale cloud cover of the regional simulation. We identify an overemphasis on specific humidity and cloud ice as the reason why our column-based NN cannot perfectly generalize from the global to the regional coarse-grained data.
  arXiv  Detail & Related papers  (2021-12-21T16:10:45Z)
• A generative adversarial network approach to (ensemble) weather prediction [91.3755431537592]
  We use a conditional deep convolutional generative adversarial network to predict the geopotential height of the 500 hPa pressure level, the two-meter temperature and the total precipitation for the next 24 hours over Europe. The proposed models are trained on 4 years of ERA5 reanalysis data from 2015-2018 with the goal to predict the associated meteorological fields in 2019.
  arXiv  Detail & Related papers  (2020-06-13T20:53:17Z)
• Improving data-driven global weather prediction using deep convolutional neural networks on a cubed sphere [7.918783985810551]
  We present a significantly-improved data-driven global weather forecasting framework using a deep convolutional neural network (CNN) New developments in this framework include an offline volume-conservative mapping to a cubed-sphere grid. Our model is able to learn to forecast complex surface temperature patterns from few input atmospheric state variables.
  arXiv  Detail & Related papers  (2020-03-15T19:57:34Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.