Forecasting threshold exceedance of atmospheric variables at a specific location
- URL: http://arxiv.org/abs/2605.31079v1
- Date: Fri, 29 May 2026 09:46:03 GMT
- Title: Forecasting threshold exceedance of atmospheric variables at a specific location
- Abstract summary: We show that the full distribution probabilistic method consistently outperforms the direct method for rare, extreme events.<n>This advantage arises because the full distribution approach effectively learns the parameters of the conditional distribution from moderate and mild intensity events.<n>We find that the specific parametric shape of the chosen distribution plays a secondary role compared to accurately capturing predictable shifts in its bulk properties.
- Score: 0.15039745292757667
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This study compares two methodological approaches for predicting, at a given site, threshold exceedances of atmospheric variables such as temperature and wind speed: (i) direct probabilistic methods, which treat exceedance as a binary classification problem, and (ii) full distribution probabilistic methods, which model the complete conditional probability law of the target variable. Using theoretical analysis and numerical simulations on a toy model, alongside real-world data from the MeteoNet dataset (2016--2018) for southeastern France, we demonstrate that the full distribution approach consistently outperforms the direct method for rare, extreme events. This advantage arises because the full distribution approach effectively learns the parameters of the conditional distribution from moderate and mild intensity events, thereby achieving better calibration and discrimination in the tails. We find that the specific parametric shape of the chosen distribution plays a secondary role compared to accurately capturing predictable shifts in its bulk properties (i.e., mean and variance). This empirical indistinguishability is also informative about the physical mechanics driving atmospheric extremes, suggesting that extreme exceedances are primarily driven by significant conditional displacements of the entire distribution rather than by unpredictable, fat-tailed anomalies within a static climatology. Our results are validated for both strong surface wind speeds and intense hourly rainfall, with performance evaluated using proper scoring rules (Brier score, logarithmic score) and deterministic skill scores (Peirce Skill Score, CSI, HSS). These findings highlight the critical importance of modeling the full probability distribution for rare-event forecasting and provide practical guidance for improving extreme weather prediction in operational meteorology.
Related papers
- Target Concept Tuning Improves Extreme Weather Forecasting [51.43578341469291]
Deep learning models for meteorological forecasting often fail in rare but high-impact events such as typhoons.<n>Existing fine-tuning methods face a trade-off between overlooking these extreme events and overfitting them at the expense of overall performance.<n>We propose TaCT, an interpretable concept-gated fine-tuning framework that solves the aforementioned issue by selective model improvement.
arXiv Detail & Related papers (2026-03-17T15:34:05Z) - FuXiWeather2: Learning accurate atmospheric state estimation for operational global weather forecasting [15.10103712842682]
We present FuXiWeather2, a unified end-to-end neural framework for assimilation and forecasting.<n>FuXiWeather2 generates high-resolution ($0.25circ$) global analysis fields and 10-day forecasts within minutes.<n>These high-quality analysis fields drive deterministic forecasts that exceed the skill of the HRES system in 91% of evaluated metrics.
arXiv Detail & Related papers (2026-03-16T14:36:47Z) - Trustworthy predictive distributions for rare events via diagnostic transport maps [3.2309187092212936]
Even when forecast systems provide a full predictive distribution, the result is rarely calibrated with respect to all x and y.<n>In this paper, we take an initial predictive distribution as given and treat it as a useful but potentially misspecified base model.<n>We then introduce diagnostic transport maps, co-dependent probability-to-probability maps that quantify how the base model's probabilities should be adjusted to better match the true conditional distribution of calibration data.
arXiv Detail & Related papers (2026-03-11T18:55:34Z) - Universal Diffusion-Based Probabilistic Downscaling [3.47037488116399]
We introduce a universal diffusion-based downscaling framework that lifts deterministic low-resolution weather forecasts into high-resolution predictions.<n>A single conditional diffusion model is trained on paired coarse-resolution inputs and high-resolution regional reanalysis targets.<n>We evaluate probabilistic forecasts against independent in situ station observations over lead times up to 90 h.
arXiv Detail & Related papers (2026-02-12T12:42:46Z) - Investigating the Robustness of Extreme Precipitation Super-Resolution Across Climates [0.0482931985924527]
coarse spatial resolution of gridded climate models limits their use in projecting socially relevant variables like extreme precipitation.<n>We propose super-resolving the parameters of the target variable's probability distribution using analytically tractable mappings.<n>Our framework is broadly applicable to variables governed by parametric distributions and offers a model-agnostic diagnostic for understanding when and why empirical downscaling generalizes to climate change and extremes.
arXiv Detail & Related papers (2025-07-12T07:04:07Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2023-10-17T20:30:16Z) - Residual Corrective Diffusion Modeling for Km-scale Atmospheric Downscaling [58.456404022536425]
State of the art for physical hazard prediction from weather and climate requires expensive km-scale numerical simulations driven by coarser resolution global inputs.
Here, a generative diffusion architecture is explored for downscaling such global inputs to km-scale, as a cost-effective machine learning alternative.
The model is trained to predict 2km data from a regional weather model over Taiwan, conditioned on a 25km global reanalysis.
arXiv Detail & Related papers (2023-09-24T19:57:22Z) - Statistical post-processing of visibility ensemble forecasts [0.0]
We investigate the predictive performance of locally, semi-locally and regionally trained proportional odds logistic regression (POLR) and multilayer perceptron (MLP) neural network classifiers.
We show that while climatological forecasts outperform the raw ensemble by a wide margin, post-processing results in further substantial improvement in forecast skill.
arXiv Detail & Related papers (2023-05-24T16:41:36Z) - Confidence and Dispersity Speak: Characterising Prediction Matrix for
Unsupervised Accuracy Estimation [51.809741427975105]
This work aims to assess how well a model performs under distribution shifts without using labels.
We use the nuclear norm that has been shown to be effective in characterizing both properties.
We show that the nuclear norm is more accurate and robust in accuracy than existing methods.
arXiv Detail & Related papers (2023-02-02T13:30:48Z) - Distributional Gradient Boosting Machines [77.34726150561087]
Our framework is based on XGBoost and LightGBM.
We show that our framework achieves state-of-the-art forecast accuracy.
arXiv Detail & Related papers (2022-04-02T06:32:19Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.