Quantile Regression, Variational Autoencoders, and Diffusion Models for Uncertainty Quantification: A Spatial Analysis of Sub-seasonal Wind Speed Prediction

• URL: http://arxiv.org/abs/2510.16958v1
• Date: Sun, 19 Oct 2025 18:26:46 GMT
• Title: Quantile Regression, Variational Autoencoders, and Diffusion Models for Uncertainty Quantification: A Spatial Analysis of Sub-seasonal Wind Speed Prediction
• Authors: Ganglin Tian, Anastase Alexandre Charantonis, Camille Le Coz, Alexis Tantet, Riwal Plougonven,
• Abstract summary: This study aims to improve the representation of uncertainties when regressing surface wind speeds from large-scale atmospheric predictors for sub-seasonal forecasting.<n>Probabilistic deep learning models offer promising solutions for capturing complex spatial dependencies.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This study aims to improve the spatial representation of uncertainties when regressing surface wind speeds from large-scale atmospheric predictors for sub-seasonal forecasting. Sub-seasonal forecasting often relies on large-scale atmospheric predictors such as 500 hPa geopotential height (Z500), which exhibit higher predictability than surface variables and can be downscaled to obtain more localised information. Previous work by Tian et al. (2024) demonstrated that stochastic perturbations based on model residuals can improve ensemble dispersion representation in statistical downscaling frameworks, but this method fails to represent spatial correlations and physical consistency adequately. More sophisticated approaches are needed to capture the complex relationships between large-scale predictors and local-scale predictands while maintaining physical consistency. Probabilistic deep learning models offer promising solutions for capturing complex spatial dependencies. This study evaluates three probabilistic methods with distinct uncertainty quantification mechanisms: Quantile Regression Neural Network that directly models distribution quantiles, Variational Autoencoders that leverage latent space sampling, and Diffusion Models that utilise iterative denoising. These models are trained on ERA5 reanalysis data and applied to ECMWF sub-seasonal hindcasts to regress probabilistic wind speed ensembles. Our results show that probabilistic downscaling approaches provide more realistic spatial uncertainty representations compared to simpler stochastic methods, with each probabilistic model offering different strengths in terms of ensemble dispersion, deterministic skill, and physical consistency. These findings establish probabilistic downscaling as an effective enhancement to operational sub-seasonal wind forecasts for renewable energy planning and risk assessment.

Related papers

• Universal Diffusion-Based Probabilistic Downscaling [3.47037488116399]
  We introduce a universal diffusion-based downscaling framework that lifts deterministic low-resolution weather forecasts into high-resolution predictions.<n>A single conditional diffusion model is trained on paired coarse-resolution inputs and high-resolution regional reanalysis targets.<n>We evaluate probabilistic forecasts against independent in situ station observations over lead times up to 90 h.
  arXiv  Detail & Related papers  (2026-02-12T12:42:46Z)
• Demystifying Data-Driven Probabilistic Medium-Range Weather Forecasting [63.8116386935854]
  We demonstrate that state-of-the-art probabilistic skill requires neither intricate architectural constraints nor specialized trainings.<n>We introduce a scalable framework for learning multi-scale atmospheric dynamics by combining a directly downsampled latent space with a history-conditioned local projector.<n>We find that our framework design is robust to the choice of probabilistic estimators, seamlessly supporting interpolants, diffusion models, and CRPS-based ensemble training.
  arXiv  Detail & Related papers  (2026-01-26T03:52:16Z)
• Bridging the Gap Between Bayesian Deep Learning and Ensemble Weather Forecasts [100.26854618129039]
  Weather forecasting is fundamentally challenged by the chaotic nature of the atmosphere.<n>Recent advances in Bayesian Deep Learning (BDL) offer a promising but often disconnected alternative.<n>We bridge these paradigms through a unified hybrid BDL framework for ensemble weather forecasting.
  arXiv  Detail & Related papers  (2025-11-18T07:49:52Z)
• Km-scale dynamical downscaling through conformalized latent diffusion models [45.94979929172337]
  Dynamical downscaling is crucial for deriving high-resolution meteorological fields from coarse-scale simulations.<n>Generative Diffusion models (DMs) have recently emerged as powerful data-driven tools for this task.<n>However, DMs lack finite-sample guarantees against overconfident predictions, resulting in miscalibrated grid-point-level uncertainty estimates.<n>We tackle this issue by augmenting the downscaling pipeline with a conformal prediction framework.
  arXiv  Detail & Related papers  (2025-10-15T08:41:36Z)
• DEF: Diffusion-augmented Ensemble Forecasting [5.433548785820674]
  We present DEF (textbfulEnsemble textbfulForecasting), a novel approach for generating initial condition perturbations.<n>We demonstrate that a simple conditional diffusion model can generate meaningful structured perturbations.<n>We show that the model accumulates less error over long-term forecasts while producing meaningful forecast distributions.
  arXiv  Detail & Related papers  (2025-06-08T23:43:41Z)
• Diffusion models for probabilistic precipitation generation from atmospheric variables [1.6099193327384094]
  In Earth system models (ESMs), precipitation is not resolved explicitly, but represented by parameterizations.<n>We present a novel approach, based on generative machine learning, which integrates a conditional diffusion model with a UNet architecture.<n>Unlike traditional parameterizations, our framework efficiently produces ensemble predictions, capturing uncertainties in precipitation, and does not require fine-tuning by hand.
  arXiv  Detail & Related papers  (2025-04-01T00:21:31Z)
• Data-driven Mesoscale Weather Forecasting Combining Swin-Unet and Diffusion Models [0.0]
  This study proposes an architecture that combines a diffusion model with Swin-Unet as a deterministic model.<n>The proposed architecture trains the two models independently, allowing the diffusion model to remain unchanged when the deterministic model is updated.
  arXiv  Detail & Related papers  (2025-03-25T05:07:31Z)
• Collaborative Deterministic-Probabilistic Forecasting for Diverse Spatiotemporal Systems [16.028948493876126]
  CoST achieves 25% over state-of-the-art baselines, while significantly reducing computational cost.<n>Trials across climate, energy communication, and urban systems show gains of 25% over state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-02-16T06:35:26Z)
• On conditional diffusion models for PDE simulations [53.01911265639582]
  We study score-based diffusion models for forecasting and assimilation of sparse observations. We propose an autoregressive sampling approach that significantly improves performance in forecasting. We also propose a new training strategy for conditional score-based models that achieves stable performance over a range of history lengths.
  arXiv  Detail & Related papers  (2024-10-21T18:31:04Z)
• Efficient modeling of sub-kilometer surface wind with Gaussian processes and neural networks [0.0]
  Wind represents a particularly challenging variable to model due to its high spatial and temporal variability. This paper presents a novel approach that integrates Gaussian processes and neural networks to model surface wind gusts at sub-kilometer resolution.
  arXiv  Detail & Related papers  (2024-05-21T09:07:47Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2023-10-17T20:30:16Z)
• When in Doubt: Neural Non-Parametric Uncertainty Quantification for Epidemic Forecasting [70.54920804222031]
  Most existing forecasting models disregard uncertainty quantification, resulting in mis-calibrated predictions. Recent works in deep neural models for uncertainty-aware time-series forecasting also have several limitations. We model the forecasting task as a probabilistic generative process and propose a functional neural process model called EPIFNP.
  arXiv  Detail & Related papers  (2021-06-07T18:31:47Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.