Improving seasonal forecast using probabilistic deep learning
- URL: http://arxiv.org/abs/2010.14610v1
- Date: Tue, 27 Oct 2020 21:02:26 GMT
- Title: Improving seasonal forecast using probabilistic deep learning
- Authors: Baoxiang Pan, Gemma J. Anderson, AndrE Goncalves, Donald D. Lucas,
CEline J.W. Bonfils, Jiwoo Lee
- Abstract summary: We develop a probabilistic deep neural network model to enhance seasonal forecast capability and forecast diagnosis.
By leveraging complex physical relationships encoded in climate simulations, our model demonstrates favorable deterministic and probabilistic skill.
We give a more definitive answer to how the El Nino/Southern Oscillation, the dominant mode of seasonal variability, modulates global seasonal predictability.
- Score: 1.1988695717766686
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The path toward realizing the potential of seasonal forecasting and its
socioeconomic benefits depends heavily on improving general circulation model
based dynamical forecasting systems. To improve dynamical seasonal forecast, it
is crucial to set up forecast benchmarks, and clarify forecast limitations
posed by model initialization errors, formulation deficiencies, and internal
climate variability. With huge cost in generating large forecast ensembles, and
limited observations for forecast verification, the seasonal forecast
benchmarking and diagnosing task proves challenging. In this study, we develop
a probabilistic deep neural network model, drawing on a wealth of existing
climate simulations to enhance seasonal forecast capability and forecast
diagnosis. By leveraging complex physical relationships encoded in climate
simulations, our probabilistic forecast model demonstrates favorable
deterministic and probabilistic skill compared to state-of-the-art dynamical
forecast systems in quasi-global seasonal forecast of precipitation and
near-surface temperature. We apply this probabilistic forecast methodology to
quantify the impacts of initialization errors and model formulation
deficiencies in a dynamical seasonal forecasting system. We introduce the
saliency analysis approach to efficiently identify the key predictors that
influence seasonal variability. Furthermore, by explicitly modeling uncertainty
using variational Bayes, we give a more definitive answer to how the El
Nino/Southern Oscillation, the dominant mode of seasonal variability, modulates
global seasonal predictability.
Related papers
- Using Deep Learning to Identify Initial Error Sensitivity for Interpretable ENSO Forecasts [0.0]
We introduce an interpretable-by-design method, optimized model-analog, that integrates deep learning with model-analog forecasting.
We evaluate our approach using the Community Earth System Model Version 2 Large Ensemble to forecast the El Nino-Southern Oscillation (ENSO) on a seasonal-to-annual time scale.
Results show a 10% improvement in forecasting equatorial Pacific sea surface temperature anomalies at 9-12 months leads.
arXiv Detail & Related papers (2024-04-23T18:10:18Z) - Uncertainty quantification for data-driven weather models [0.0]
We study and compare uncertainty quantification methods to generate probabilistic weather forecasts from a state-of-the-art deterministic data-driven weather model, Pangu-Weather.
Specifically, we compare approaches for quantifying forecast uncertainty based on generating ensemble forecasts via perturbations to the initial conditions.
In a case study on medium-range forecasts of selected weather variables over Europe, the probabilistic forecasts obtained by using the Pangu-Weather model in concert with uncertainty quantification methods show promising results.
arXiv Detail & Related papers (2024-03-20T10:07:51Z) - Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
We introduce a novel method that applies diffusion models (DM) for weather forecasting.
Our method can achieve both direct and iterative forecasting with the same modeling framework.
The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
arXiv Detail & Related papers (2024-02-06T21:28:42Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - Performative Time-Series Forecasting [71.18553214204978]
We formalize performative time-series forecasting (PeTS) from a machine-learning perspective.
We propose a novel approach, Feature Performative-Shifting (FPS), which leverages the concept of delayed response to anticipate distribution shifts.
We conduct comprehensive experiments using multiple time-series models on COVID-19 and traffic forecasting tasks.
arXiv Detail & Related papers (2023-10-09T18:34:29Z) - SEEDS: Emulation of Weather Forecast Ensembles with Diffusion Models [13.331224394143117]
Uncertainty quantification is crucial to decision-making.
dominant approach to representing uncertainty in weather forecasting is to generate an ensemble of forecasts.
We propose to amortize the computational cost by emulating these forecasts with deep generative diffusion models learned from historical data.
arXiv Detail & Related papers (2023-06-24T22:00:06Z) - Surrogate Ensemble Forecasting for Dynamic Climate Impact Models [0.0]
This study considers a climate driven disease model, the Liverpool Malaria Model (LMM), which predicts the malaria transmission coefficient R0.
The input and output data is used to train surrogate models in the form of a Random Forest Quantile Regression (RFQR) model and a Bayesian Long Short-Term Memory (BLSTM) neural network.
arXiv Detail & Related papers (2022-04-12T13:30:01Z) - A Bayesian Deep Learning Approach to Near-Term Climate Prediction [12.870804083819603]
We pursue a complementary machine-learning-based approach to climate prediction.
In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill.
arXiv Detail & Related papers (2022-02-23T00:28:36Z) - When in Doubt: Neural Non-Parametric Uncertainty Quantification for
Epidemic Forecasting [70.54920804222031]
Most existing forecasting models disregard uncertainty quantification, resulting in mis-calibrated predictions.
Recent works in deep neural models for uncertainty-aware time-series forecasting also have several limitations.
We model the forecasting task as a probabilistic generative process and propose a functional neural process model called EPIFNP.
arXiv Detail & Related papers (2021-06-07T18:31:47Z) - Learning Interpretable Deep State Space Model for Probabilistic Time
Series Forecasting [98.57851612518758]
Probabilistic time series forecasting involves estimating the distribution of future based on its history.
We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks.
We show in experiments that our model produces accurate and sharp probabilistic forecasts.
arXiv Detail & Related papers (2021-01-31T06:49:33Z) - A generative adversarial network approach to (ensemble) weather
prediction [91.3755431537592]
We use a conditional deep convolutional generative adversarial network to predict the geopotential height of the 500 hPa pressure level, the two-meter temperature and the total precipitation for the next 24 hours over Europe.
The proposed models are trained on 4 years of ERA5 reanalysis data from 2015-2018 with the goal to predict the associated meteorological fields in 2019.
arXiv Detail & Related papers (2020-06-13T20:53:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.