A Bayesian Deep Learning Approach to Near-Term Climate Prediction
- URL: http://arxiv.org/abs/2202.11244v1
- Date: Wed, 23 Feb 2022 00:28:36 GMT
- Title: A Bayesian Deep Learning Approach to Near-Term Climate Prediction
- Authors: Xihaier Luo and Balasubramanya T. Nadiga and Yihui Ren and Ji Hwan
Park and Wei Xu and Shinjae Yoo
- Abstract summary: We pursue a complementary machine-learning-based approach to climate prediction.
In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill.
- Score: 12.870804083819603
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Since model bias and associated initialization shock are serious shortcomings
that reduce prediction skills in state-of-the-art decadal climate prediction
efforts, we pursue a complementary machine-learning-based approach to climate
prediction. The example problem setting we consider consists of predicting
natural variability of the North Atlantic sea surface temperature on the
interannual timescale in the pre-industrial control simulation of the Community
Earth System Model (CESM2). While previous works have considered the use of
recurrent networks such as convolutional LSTMs and reservoir computing networks
in this and other similar problem settings, we currently focus on the use of
feedforward convolutional networks. In particular, we find that a feedforward
convolutional network with a Densenet architecture is able to outperform a
convolutional LSTM in terms of predictive skill. Next, we go on to consider a
probabilistic formulation of the same network based on Stein variational
gradient descent and find that in addition to providing useful measures of
predictive uncertainty, the probabilistic (Bayesian) version improves on its
deterministic counterpart in terms of predictive skill. Finally, we
characterize the reliability of the ensemble of ML models obtained in the
probabilistic setting by using analysis tools developed in the context of
ensemble numerical weather prediction.
Related papers
- Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models.
Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML)
We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
arXiv Detail & Related papers (2024-07-18T15:44:23Z) - ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast.
We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples.
Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
arXiv Detail & Related papers (2024-02-02T10:34:13Z) - From Reactive to Proactive Volatility Modeling with Hemisphere Neural Networks [0.0]
We reinvigorate maximum likelihood estimation (MLE) for macroeconomic density forecasting through a novel neural network architecture with dedicated mean and variance hemispheres.
Our Hemisphere Neural Network (HNN) provides proactive volatility forecasts based on leading indicators when it can, and reactive volatility based on the magnitude of previous prediction errors when it must.
arXiv Detail & Related papers (2023-11-27T21:37:50Z) - Long-term drought prediction using deep neural networks based on geospatial weather data [75.38539438000072]
High-quality drought forecasting up to a year in advance is critical for agriculture planning and insurance.
We tackle drought data by introducing an end-to-end approach that adopts a systematic end-to-end approach.
Key findings are the exceptional performance of a Transformer model, EarthFormer, in making accurate short-term (up to six months) forecasts.
arXiv Detail & Related papers (2023-09-12T13:28:06Z) - Probabilistic Forecasting with Coherent Aggregation [42.215158938066054]
We augment an MQForecaster neural network architecture with a novel deep Gaussian factor forecasting model that achieves coherence by construction.
In a comparison to state-of-the-art coherent forecasting methods, DeepCoFactor achieves significant improvements in scaled CRPS forecast accuracy, with average gains of 15%.
arXiv Detail & Related papers (2023-07-19T07:31:37Z) - Uncertainty estimation of pedestrian future trajectory using Bayesian
approximation [137.00426219455116]
Under dynamic traffic scenarios, planning based on deterministic predictions is not trustworthy.
The authors propose to quantify uncertainty during forecasting using approximation which deterministic approaches fail to capture.
The effect of dropout weights and long-term prediction on future state uncertainty has been studied.
arXiv Detail & Related papers (2022-05-04T04:23:38Z) - Probabilistic AutoRegressive Neural Networks for Accurate Long-range
Forecasting [6.295157260756792]
We introduce the Probabilistic AutoRegressive Neural Networks (PARNN)
PARNN is capable of handling complex time series data exhibiting non-stationarity, nonlinearity, non-seasonality, long-range dependence, and chaotic patterns.
We evaluate the performance of PARNN against standard statistical, machine learning, and deep learning models, including Transformers, NBeats, and DeepAR.
arXiv Detail & Related papers (2022-04-01T17:57:36Z) - Learning Interpretable Deep State Space Model for Probabilistic Time
Series Forecasting [98.57851612518758]
Probabilistic time series forecasting involves estimating the distribution of future based on its history.
We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks.
We show in experiments that our model produces accurate and sharp probabilistic forecasts.
arXiv Detail & Related papers (2021-01-31T06:49:33Z) - Probabilistic electric load forecasting through Bayesian Mixture Density
Networks [70.50488907591463]
Probabilistic load forecasting (PLF) is a key component in the extended tool-chain required for efficient management of smart energy grids.
We propose a novel PLF approach, framed on Bayesian Mixture Density Networks.
To achieve reliable and computationally scalable estimators of the posterior distributions, both Mean Field variational inference and deep ensembles are integrated.
arXiv Detail & Related papers (2020-12-23T16:21:34Z) - Improving seasonal forecast using probabilistic deep learning [1.1988695717766686]
We develop a probabilistic deep neural network model to enhance seasonal forecast capability and forecast diagnosis.
By leveraging complex physical relationships encoded in climate simulations, our model demonstrates favorable deterministic and probabilistic skill.
We give a more definitive answer to how the El Nino/Southern Oscillation, the dominant mode of seasonal variability, modulates global seasonal predictability.
arXiv Detail & Related papers (2020-10-27T21:02:26Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.