Conformal Prediction with Temporal Quantile Adjustments

• URL: http://arxiv.org/abs/2205.09940v2
• Date: Mon, 23 May 2022 07:29:51 GMT
• Title: Conformal Prediction with Temporal Quantile Adjustments
• Authors: Zhen Lin, Shubhendu Trivedi, Jimeng Sun
• Abstract summary: We develop a method to construct efficient and valid prediction intervals (PIs) for regression on cross-sectional time series data. We validate TQA's performance through extensive experimentation.
• Score: 40.282423098764404
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: We develop Temporal Quantile Adjustment (TQA), a general method to construct efficient and valid prediction intervals (PIs) for regression on cross-sectional time series data. Such data is common in many domains, including econometrics and healthcare. A canonical example in healthcare is predicting patient outcomes using physiological time-series data, where a population of patients composes a cross-section. Reliable PI estimators in this setting must address two distinct notions of coverage: cross-sectional coverage across a cross-sectional slice, and longitudinal coverage along the temporal dimension for each time series. Recent works have explored adapting Conformal Prediction (CP) to obtain PIs in the time series context. However, none handles both notions of coverage simultaneously. CP methods typically query a pre-specified quantile from the distribution of nonconformity scores on a calibration set. TQA adjusts the quantile to query in CP at each time $t$, accounting for both cross-sectional and longitudinal coverage in a theoretically-grounded manner. The post-hoc nature of TQA facilitates its use as a general wrapper around any time series regression model. We validate TQA's performance through extensive experimentation: TQA generally obtains efficient PIs and improves longitudinal coverage while preserving cross-sectional coverage.

Related papers

• Timer-XL: Long-Context Transformers for Unified Time Series Forecasting [67.83502953961505]
  We present Timer-XL, a generative Transformer for unified time series forecasting. Timer-XL achieves state-of-the-art performance across challenging forecasting benchmarks through a unified approach.
  arXiv  Detail & Related papers  (2024-10-07T07:27:39Z)
• PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
  We propose a. Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
  arXiv  Detail & Related papers  (2024-06-04T13:51:08Z)
• Conformal Predictions for Longitudinal Data [0.0]
  We introduce Longitudinal Predictive Conformal Inference (L PCI), a distribution-free conformal prediction algorithm for longitudinal data. Our experiments demonstrate that LPCI outperforms existing benchmarks in terms of longitudinal coverage rates. The robust performance of LPCI in generating reliable prediction intervals for longitudinal data underscores its potential for broad applications.
  arXiv  Detail & Related papers  (2023-10-04T14:51:07Z)
• Deep Spectral Q-learning with Application to Mobile Health [11.736014576781903]
  We propose a deep spectral Q-learning algorithm to handle mixed frequency data. In theory, we prove that the mean return under the estimated optimal policy converges to that under the optimal one and establish its rate of convergence.
  arXiv  Detail & Related papers  (2023-01-03T01:55:17Z)
• QuTE: decentralized multiple testing on sensor networks with false discovery rate control [130.7122910646076]
  This paper designs methods for decentralized multiple hypothesis testing on graphs equipped with provable guarantees on the false discovery rate (FDR) We consider the setting where distinct agents reside on the nodes of an undirected graph, and each agent possesses p-values corresponding to one or more hypotheses local to its node. Each agent must individually decide whether to reject one or more of its local hypotheses by only communicating with its neighbors, with the joint aim that the global FDR over the entire graph must be controlled at a predefined level.
  arXiv  Detail & Related papers  (2022-10-09T19:48:39Z)
• Conformal Prediction Intervals with Temporal Dependence [40.282423098764404]
  Cross-sectional prediction is common in many domains such as healthcare. We focus on the task of constructing valid prediction intervals (PIs) in time-series regression with a cross-section.
  arXiv  Detail & Related papers  (2022-05-25T17:45:04Z)
• Ensemble Conformalized Quantile Regression for Probabilistic Time Series Forecasting [4.716034416800441]
  This paper presents a novel probabilistic forecasting method called ensemble conformalized quantile regression (EnCQR) EnCQR constructs distribution-free and approximately marginally valid prediction intervals (PIs), is suitable for nonstationary and heteroscedastic time series data, and can be applied on top of any forecasting model. The results demonstrate that EnCQR outperforms models based only on quantile regression or conformal prediction, and it provides sharper, more informative, and valid PIs.
  arXiv  Detail & Related papers  (2022-02-17T16:54:20Z)
• Tolerance and Prediction Intervals for Non-normal Models [0.0]
  A prediction interval covers a future observation from a random process in repeated sampling. A tolerance interval covers a population percentile in repeated sampling and is often based on a pivotal quantity.
  arXiv  Detail & Related papers  (2020-11-23T17:48:09Z)
• DeepRite: Deep Recurrent Inverse TreatmEnt Weighting for Adjusting Time-varying Confounding in Modern Longitudinal Observational Data [68.29870617697532]
  We propose Deep Recurrent Inverse TreatmEnt weighting (DeepRite) for time-varying confounding in longitudinal data. DeepRite is shown to recover the ground truth from synthetic data, and estimate unbiased treatment effects from real data.
  arXiv  Detail & Related papers  (2020-10-28T15:05:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.