Fast parameter estimation of Generalized Extreme Value distribution
using Neural Networks
- URL: http://arxiv.org/abs/2305.04341v1
- Date: Sun, 7 May 2023 17:40:52 GMT
- Title: Fast parameter estimation of Generalized Extreme Value distribution
using Neural Networks
- Authors: Sweta Rai, Alexis Hoffman, Soumendra Lahiri, Douglas W. Nychka,
Stephan R. Sain, Soutir Bandyopadhyay
- Abstract summary: Generalized extreme-value distribution is a popular choice for modeling extreme events such as floods, droughts, heatwaves, wildfires, etc.
We propose a computationally efficient, likelihood-free estimation method utilizing a neural network.
We show that the proposed neural network-based method provides Generalized Extreme Value (GEV) distribution parameter estimates with comparable accuracy to the conventional maximum likelihood method.
- Score: 9.987055028382876
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The heavy-tailed behavior of the generalized extreme-value distribution makes
it a popular choice for modeling extreme events such as floods, droughts,
heatwaves, wildfires, etc. However, estimating the distribution's parameters
using conventional maximum likelihood methods can be computationally intensive,
even for moderate-sized datasets. To overcome this limitation, we propose a
computationally efficient, likelihood-free estimation method utilizing a neural
network. Through an extensive simulation study, we demonstrate that the
proposed neural network-based method provides Generalized Extreme Value (GEV)
distribution parameter estimates with comparable accuracy to the conventional
maximum likelihood method but with a significant computational speedup. To
account for estimation uncertainty, we utilize parametric bootstrapping, which
is inherent in the trained network. Finally, we apply this method to 1000-year
annual maximum temperature data from the Community Climate System Model version
3 (CCSM3) across North America for three atmospheric concentrations: 289 ppm
$\mathrm{CO}_2$ (pre-industrial), 700 ppm $\mathrm{CO}_2$ (future conditions),
and 1400 ppm $\mathrm{CO}_2$, and compare the results with those obtained using
the maximum likelihood approach.
Related papers
- Amortized Bayesian Local Interpolation NetworK: Fast covariance parameter estimation for Gaussian Processes [0.04660328753262073]
We propose an Amortized Bayesian Local Interpolation NetworK for fast covariance parameter estimation.
The fast prediction time of these networks allows us to bypass the matrix inversion step, creating large computational speedups.
We show significant increases in computational efficiency over comparable scalable GP methodology.
arXiv Detail & Related papers (2024-11-10T01:26:16Z) - Extreme heatwave sampling and prediction with analog Markov chain and
comparisons with deep learning [0.0]
We present a data-driven emulator, weather generator (SWG), suitable for estimating probabilities of heatwaves in France and Scandinavia.
We train the emulator on an intermediate complexity climate model run and show that it is capable of predicting conditional probabilities (forecasting) of heatwaves out of sample.
The probabilistic prediction achieved with SWG is compared with the one achieved with Convolutional Neural Network (CNN)
arXiv Detail & Related papers (2023-07-18T08:25:14Z) - Stochastic Marginal Likelihood Gradients using Neural Tangent Kernels [78.6096486885658]
We introduce lower bounds to the linearized Laplace approximation of the marginal likelihood.
These bounds are amenable togradient-based optimization and allow to trade off estimation accuracy against computational complexity.
arXiv Detail & Related papers (2023-06-06T19:02:57Z) - Efficient CDF Approximations for Normalizing Flows [64.60846767084877]
We build upon the diffeomorphic properties of normalizing flows to estimate the cumulative distribution function (CDF) over a closed region.
Our experiments on popular flow architectures and UCI datasets show a marked improvement in sample efficiency as compared to traditional estimators.
arXiv Detail & Related papers (2022-02-23T06:11:49Z) - Learning to Estimate Without Bias [57.82628598276623]
Gauss theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models.
In this paper, we take a first step towards extending this result to non linear settings via deep learning with bias constraints.
A second motivation to BCE is in applications where multiple estimates of the same unknown are averaged for improved performance.
arXiv Detail & Related papers (2021-10-24T10:23:51Z) - Physics-constrained deep neural network method for estimating parameters
in a redox flow battery [68.8204255655161]
We present a physics-constrained deep neural network (PCDNN) method for parameter estimation in the zero-dimensional (0D) model of the vanadium flow battery (VRFB)
We show that the PCDNN method can estimate model parameters for a range of operating conditions and improve the 0D model prediction of voltage.
We also demonstrate that the PCDNN approach has an improved generalization ability for estimating parameter values for operating conditions not used in the training.
arXiv Detail & Related papers (2021-06-21T23:42:58Z) - Dynamical prediction of two meteorological factors using the deep neural
network and the long short term memory $(1)$ [0.0]
This study manipulates the extant neural network methods to foster the predictive accuracy.
Simulated studies are performed by applying the artificial neural network (ANN), deep neural network (DNN), extreme learning machine (ELM), long short-term memory (LSTM)
Data are extracted from low frequency time-series of ten metropolitan cities of South Korea from March 2014 to February 2020.
arXiv Detail & Related papers (2021-01-16T16:24:24Z) - Amortized Conditional Normalized Maximum Likelihood: Reliable Out of
Distribution Uncertainty Estimation [99.92568326314667]
We propose the amortized conditional normalized maximum likelihood (ACNML) method as a scalable general-purpose approach for uncertainty estimation.
Our algorithm builds on the conditional normalized maximum likelihood (CNML) coding scheme, which has minimax optimal properties according to the minimum description length principle.
We demonstrate that ACNML compares favorably to a number of prior techniques for uncertainty estimation in terms of calibration on out-of-distribution inputs.
arXiv Detail & Related papers (2020-11-05T08:04:34Z) - Mean-Field Approximation to Gaussian-Softmax Integral with Application
to Uncertainty Estimation [23.38076756988258]
We propose a new single-model based approach to quantify uncertainty in deep neural networks.
We use a mean-field approximation formula to compute an analytically intractable integral.
Empirically, the proposed approach performs competitively when compared to state-of-the-art methods.
arXiv Detail & Related papers (2020-06-13T07:32:38Z) - Estimating Basis Functions in Massive Fields under the Spatial Mixed
Effects Model [8.528384027684194]
For massive datasets, fixed rank kriging using the Expectation-Maximization (EM) algorithm for estimation has been proposed as an alternative to the usual but computationally prohibitive kriging method.
We develop an alternative method that utilizes the Spatial Mixed Effects (SME) model, but allows for additional flexibility by estimating the range of the spatial dependence between the observations and the knots via an Alternating Expectation Conditional Maximization (AECM) algorithm.
Experiments show that our methodology improves estimation without sacrificing prediction accuracy while also minimizing the additional computational burden of extra parameter estimation.
arXiv Detail & Related papers (2020-03-12T19:36:40Z) - Generative Modeling with Denoising Auto-Encoders and Langevin Sampling [88.83704353627554]
We show that both DAE and DSM provide estimates of the score of the smoothed population density.
We then apply our results to the homotopy method of arXiv:1907.05600 and provide theoretical justification for its empirical success.
arXiv Detail & Related papers (2020-01-31T23:50:03Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.