Adaptive Conformal Predictions for Time Series

• URL: http://arxiv.org/abs/2202.07282v1
• Date: Tue, 15 Feb 2022 09:57:01 GMT
• Title: Adaptive Conformal Predictions for Time Series
• Authors: Margaux Zaffran (EDF R&D, CRISAM, CMAP, PARIETAL), Aymeric Dieuleveut (CMAP), Olivier F\'eron (EDF R&D, FiME Lab), Yannig Goude (EDF R&D), Julie Josse (CRISAM, IDESP)
• Abstract summary: We argue that Adaptive Conformal Inference (ACI) is a good procedure for time series with general dependency. We propose a parameter-free method, AgACI, that adaptively builds upon ACI based on online expert aggregation. We conduct a real case study: electricity price forecasting.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Uncertainty quantification of predictive models is crucial in decision-making problems. Conformal prediction is a general and theoretically sound answer. However, it requires exchangeable data, excluding time series. While recent works tackled this issue, we argue that Adaptive Conformal Inference (ACI, Gibbs and Cand{\`e}s, 2021), developed for distribution-shift time series, is a good procedure for time series with general dependency. We theoretically analyse the impact of the learning rate on its efficiency in the exchangeable and auto-regressive case. We propose a parameter-free method, AgACI, that adaptively builds upon ACI based on online expert aggregation. We lead extensive fair simulations against competing methods that advocate for ACI's use in time series. We conduct a real case study: electricity price forecasting. The proposed aggregation algorithm provides efficient prediction intervals for day-ahead forecasting. All the code and data to reproduce the experiments is made available.

Related papers

• Adaptive time series forecasting with markovian variance switching [1.2891210250935148]
  We propose a new way of estimating variances based on online learning theory. We adapt expert aggregation methods to learn the variances over time. We show that this method is robust to misspecification and outperforms traditional expert aggregation.
  arXiv  Detail & Related papers  (2024-02-22T16:40:55Z)
• Conformal PID Control for Time Series Prediction [10.992151305603265]
  We study the problem of uncertainty quantification for time series prediction. We present algorithms that prospectively model conformal scores in an online setting. We also run experiments on predicting electricity demand, market returns, and temperature.
  arXiv  Detail & Related papers  (2023-07-31T17:59:16Z)
• Improving Adaptive Conformal Prediction Using Self-Supervised Learning [72.2614468437919]
  We train an auxiliary model with a self-supervised pretext task on top of an existing predictive model and use the self-supervised error as an additional feature to estimate nonconformity scores. We empirically demonstrate the benefit of the additional information using both synthetic and real data on the efficiency (width), deficit, and excess of conformal prediction intervals.
  arXiv  Detail & Related papers  (2023-02-23T18:57:14Z)
• Generative Time Series Forecasting with Diffusion, Denoise, and Disentanglement [51.55157852647306]
  Time series forecasting has been a widely explored task of great importance in many applications. It is common that real-world time series data are recorded in a short time period, which results in a big gap between the deep model and the limited and noisy time series. We propose to address the time series forecasting problem with generative modeling and propose a bidirectional variational auto-encoder equipped with diffusion, denoise, and disentanglement.
  arXiv  Detail & Related papers  (2023-01-08T12:20:46Z)
• Conformal prediction set for time-series [16.38369532102931]
  Uncertainty quantification is essential to studying complex machine learning methods. We develop Ensemble Regularized Adaptive Prediction Set (ERAPS) to construct prediction sets for time-series. We show valid marginal and conditional coverage by ERAPS, which also tends to yield smaller prediction sets than competing methods.
  arXiv  Detail & Related papers  (2022-06-15T23:48:53Z)
• Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecasting [4.716034416800441]
  This paper presents a novel probabilistic forecasting method called ensemble conformalized quantile regression (EnCQR) EnCQR constructs distribution-free and approximately marginally valid prediction intervals (PIs), is suitable for nonstationary and heteroscedastic time series data, and can be applied on top of any forecasting model. The results demonstrate that EnCQR outperforms models based only on quantile regression or conformal prediction, and it provides sharper, more informative, and valid PIs.
  arXiv  Detail & Related papers  (2022-02-17T16:54:20Z)
• TACTiS: Transformer-Attentional Copulas for Time Series [76.71406465526454]
  estimation of time-varying quantities is a fundamental component of decision making in fields such as healthcare and finance. We propose a versatile method that estimates joint distributions using an attention-based decoder. We show that our model produces state-of-the-art predictions on several real-world datasets.
  arXiv  Detail & Related papers  (2022-02-07T21:37:29Z)
• Learning Interpretable Deep State Space Model for Probabilistic Time Series Forecasting [98.57851612518758]
  Probabilistic time series forecasting involves estimating the distribution of future based on its history. We propose a deep state space model for probabilistic time series forecasting whereby the non-linear emission model and transition model are parameterized by networks. We show in experiments that our model produces accurate and sharp probabilistic forecasts.
  arXiv  Detail & Related papers  (2021-01-31T06:49:33Z)
• Evaluating Prediction-Time Batch Normalization for Robustness under Covariate Shift [81.74795324629712]
  We call prediction-time batch normalization, which significantly improves model accuracy and calibration under covariate shift. We show that prediction-time batch normalization provides complementary benefits to existing state-of-the-art approaches for improving robustness. The method has mixed results when used alongside pre-training, and does not seem to perform as well under more natural types of dataset shift.
  arXiv  Detail & Related papers  (2020-06-19T05:08:43Z)
• Drift-Adjusted And Arbitrated Ensemble Framework For Time Series Forecasting [0.491574468325115]
  Time series forecasting is a challenging problem due to complex and evolving nature of time series data. No one method is universally effective for all kinds of time series data. We propose a re-weighting based method to adjust the assigned weights to various forecasters in order to account for such distribution-drift.
  arXiv  Detail & Related papers  (2020-03-16T10:21:37Z)
• Ambiguity in Sequential Data: Predicting Uncertain Futures with Recurrent Models [110.82452096672182]
  We propose an extension of the Multiple Hypothesis Prediction (MHP) model to handle ambiguous predictions with sequential data. We also introduce a novel metric for ambiguous problems, which is better suited to account for uncertainties.
  arXiv  Detail & Related papers  (2020-03-10T09:15:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.