Adaptive Neural Network Ensemble Using Frequency Distribution
- URL: http://arxiv.org/abs/2210.10360v1
- Date: Wed, 19 Oct 2022 08:05:35 GMT
- Title: Adaptive Neural Network Ensemble Using Frequency Distribution
- Authors: Ungki Lee, Namwoo Kang
- Abstract summary: Neural network (NN) ensembles can reduce large prediction variance of NN and improve prediction accuracy.
For highly nonlinear problems with insufficient data set, the prediction accuracy of NN models becomes unstable.
This study proposes a frequency distribution-based ensemble that identifies core prediction values, which are expected to be concentrated near the true prediction value.
- Score: 3.42658286826597
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Neural network (NN) ensembles can reduce large prediction variance of NN and
improve prediction accuracy. For highly nonlinear problems with insufficient
data set, the prediction accuracy of NN models becomes unstable, resulting in a
decrease in the accuracy of ensembles. Therefore, this study proposes a
frequency distribution-based ensemble that identifies core prediction values,
which are expected to be concentrated near the true prediction value. The
frequency distribution-based ensemble classifies core prediction values
supported by multiple prediction values by conducting statistical analysis with
a frequency distribution, which is based on various prediction values obtained
from a given prediction point. The frequency distribution-based ensemble can
improve predictive performance by excluding prediction values with low accuracy
and coping with the uncertainty of the most frequent value. An adaptive
sampling strategy that sequentially adds samples based on the core prediction
variance calculated as the variance of the core prediction values is proposed
to improve the predictive performance of the frequency distribution-based
ensemble efficiently. Results of various case studies show that the prediction
accuracy of the frequency distribution-based ensemble is higher than that of
Kriging and other existing ensemble methods. In addition, the proposed adaptive
sampling strategy effectively improves the predictive performance of the
frequency distribution-based ensemble compared with the previously developed
space-filling and prediction variance-based strategies.
Related papers
- Efficient pooling of predictions via kernel embeddings [0.24578723416255752]
Probabilistic predictions are probability distributions over the set of possible outcomes.
They are typically combined by linearly pooling the individual predictive distributions.
Weights assigned to each prediction can be estimated based on their past performance.
This can be achieved by finding the weights that optimise a proper scoring rule over some training data.
arXiv Detail & Related papers (2024-11-25T10:04:37Z) - Conformalized Interval Arithmetic with Symmetric Calibration [9.559062601251464]
We develop conformal prediction intervals for single target to the prediction interval for sum of multiple targets.
We show that our method outperforms existing conformalized approaches as well as non-conformal approaches.
arXiv Detail & Related papers (2024-08-20T15:27:18Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2023-10-17T20:30:16Z) - Structured Radial Basis Function Network: Modelling Diversity for
Multiple Hypotheses Prediction [51.82628081279621]
Multi-modal regression is important in forecasting nonstationary processes or with a complex mixture of distributions.
A Structured Radial Basis Function Network is presented as an ensemble of multiple hypotheses predictors for regression problems.
It is proved that this structured model can efficiently interpolate this tessellation and approximate the multiple hypotheses target distribution.
arXiv Detail & Related papers (2023-09-02T01:27:53Z) - Distribution-Free Finite-Sample Guarantees and Split Conformal
Prediction [0.0]
split conformal prediction represents a promising avenue to obtain finite-sample guarantees under minimal distribution-free assumptions.
We highlight the connection between split conformal prediction and classical tolerance predictors developed in the 1940s.
arXiv Detail & Related papers (2022-10-26T14:12:24Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2022-06-16T06:13:53Z) - Aggregating distribution forecasts from deep ensembles [0.0]
We propose a general quantile aggregation framework for deep ensembles.
We show that combining forecast distributions from deep ensembles can substantially improve the predictive performance.
arXiv Detail & Related papers (2022-04-05T15:42:51Z) - CovarianceNet: Conditional Generative Model for Correct Covariance
Prediction in Human Motion Prediction [71.31516599226606]
We present a new method to correctly predict the uncertainty associated with the predicted distribution of future trajectories.
Our approach, CovariaceNet, is based on a Conditional Generative Model with Gaussian latent variables.
arXiv Detail & Related papers (2021-09-07T09:38:24Z) - Conformal Prediction Intervals for Neural Networks Using Cross
Validation [0.0]
Neural networks are among the most powerful nonlinear models used to address supervised learning problems.
We propose the $k$-fold prediction interval method to construct prediction intervals for neural networks based on $k$-fold cross validation.
arXiv Detail & Related papers (2020-06-30T16:23:28Z) - Unlabelled Data Improves Bayesian Uncertainty Calibration under
Covariate Shift [100.52588638477862]
We develop an approximate Bayesian inference scheme based on posterior regularisation.
We demonstrate the utility of our method in the context of transferring prognostic models of prostate cancer across globally diverse populations.
arXiv Detail & Related papers (2020-06-26T13:50:19Z) - Balance-Subsampled Stable Prediction [55.13512328954456]
We propose a novel balance-subsampled stable prediction (BSSP) algorithm based on the theory of fractional factorial design.
A design-theoretic analysis shows that the proposed method can reduce the confounding effects among predictors induced by the distribution shift.
Numerical experiments on both synthetic and real-world data sets demonstrate that our BSSP algorithm significantly outperforms the baseline methods for stable prediction across unknown test data.
arXiv Detail & Related papers (2020-06-08T07:01:38Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.