Algorithmic Information Forecastability
- URL: http://arxiv.org/abs/2304.10752v2
- Date: Fri, 1 Dec 2023 16:54:49 GMT
- Title: Algorithmic Information Forecastability
- Authors: Glauco Amigo, Daniel Andr\'es D\'iaz-Pach\'on, Robert J. Marks,
Charles Baylis
- Abstract summary: degree of forecastability is a function of only the data.
oracle forecastability for predictions that are always exact, precise forecastability for errors up to a bound, and probabilistic forecastability for any other predictions.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The outcome of all time series cannot be forecast, e.g. the flipping of a
fair coin. Others, like the repeated {01} sequence {010101...} can be forecast
exactly. Algorithmic information theory can provide a measure of
forecastability that lies between these extremes. The degree of forecastability
is a function of only the data. For prediction (or classification) of labeled
data, we propose three categories for forecastability: oracle forecastability
for predictions that are always exact, precise forecastability for errors up to
a bound, and probabilistic forecastability for any other predictions. Examples
are given in each case.
Related papers
- When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2023-10-17T20:30:16Z) - Creating Probabilistic Forecasts from Arbitrary Deterministic Forecasts
using Conditional Invertible Neural Networks [0.19573380763700712]
We use a conditional Invertible Neural Network (cINN) to learn the underlying distribution of the data and then combine the uncertainty from this distribution with an arbitrary deterministic forecast.
Our approach enables the simple creation of probabilistic forecasts without complicated statistical loss functions or further assumptions.
arXiv Detail & Related papers (2023-02-03T15:11:39Z) - Prediction-Powered Inference [68.97619568620709]
Prediction-powered inference is a framework for performing valid statistical inference when an experimental dataset is supplemented with predictions from a machine-learning system.
The framework yields simple algorithms for computing provably valid confidence intervals for quantities such as means, quantiles, and linear and logistic regression coefficients.
Prediction-powered inference could enable researchers to draw valid and more data-efficient conclusions using machine learning.
arXiv Detail & Related papers (2023-01-23T18:59:28Z) - Predictive Inference with Feature Conformal Prediction [80.77443423828315]
We propose feature conformal prediction, which extends the scope of conformal prediction to semantic feature spaces.
From a theoretical perspective, we demonstrate that feature conformal prediction provably outperforms regular conformal prediction under mild assumptions.
Our approach could be combined with not only vanilla conformal prediction, but also other adaptive conformal prediction methods.
arXiv Detail & Related papers (2022-10-01T02:57:37Z) - Exceedance Probability Forecasting via Regression for Significant Wave Height Prediction [0.0]
We focus on the prediction of extreme values of significant wave height that can cause coastal disasters.
We propose a novel approach based on point forecasting.
We carried out experiments using data from a smart buoy placed on the coast of Halifax, Canada.
arXiv Detail & Related papers (2022-06-20T14:55:17Z) - When Rigidity Hurts: Soft Consistency Regularization for Probabilistic
Hierarchical Time Series Forecasting [69.30930115236228]
Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting.
Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions.
We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
arXiv Detail & Related papers (2022-06-16T06:13:53Z) - Computing the ensemble spread from deterministic weather predictions
using conditional generative adversarial networks [0.0]
We propose to use deep-learning algorithms to learn the statistical properties of an ensemble prediction system.
Once trained, the costly ensemble prediction system will not be needed anymore to obtain future ensemble forecasts.
arXiv Detail & Related papers (2022-05-18T19:10:38Z) - Uncertainty estimation of pedestrian future trajectory using Bayesian
approximation [137.00426219455116]
Under dynamic traffic scenarios, planning based on deterministic predictions is not trustworthy.
The authors propose to quantify uncertainty during forecasting using approximation which deterministic approaches fail to capture.
The effect of dropout weights and long-term prediction on future state uncertainty has been studied.
arXiv Detail & Related papers (2022-05-04T04:23:38Z) - Learning to Predict Trustworthiness with Steep Slope Loss [69.40817968905495]
We study the problem of predicting trustworthiness on real-world large-scale datasets.
We observe that the trustworthiness predictors trained with prior-art loss functions are prone to view both correct predictions and incorrect predictions to be trustworthy.
We propose a novel steep slope loss to separate the features w.r.t. correct predictions from the ones w.r.t. incorrect predictions by two slide-like curves that oppose each other.
arXiv Detail & Related papers (2021-09-30T19:19:09Z) - Probability Paths and the Structure of Predictions over Time [14.208729304407536]
In settings ranging from weather forecasts to political prognostications, probability estimates of future binary outcomes often evolve over time.
We introduce a Bayesian framework for modeling the structure of dynamic predictions over time.
By elucidating the dynamic structure of predictions over time, we hope to help individuals make more informed choices.
arXiv Detail & Related papers (2021-06-11T17:18:05Z) - Measuring Forecasting Skill from Text [15.795144936579627]
We explore connections between the language people use to describe their predictions and their forecasting skill.
We present a number of linguistic metrics which are computed over text associated with people's predictions about the future.
We demonstrate that it is possible to accurately predict forecasting skill using a model that is based solely on language.
arXiv Detail & Related papers (2020-06-12T19:04:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.