Conformal Predictions for Longitudinal Data

• URL: http://arxiv.org/abs/2310.02863v1
• Date: Wed, 4 Oct 2023 14:51:07 GMT
• Title: Conformal Predictions for Longitudinal Data
• Authors: Devesh Batra, Salvatore Mercuri, Raad Khraishi
• Abstract summary: We introduce Longitudinal Predictive Conformal Inference (L PCI), a distribution-free conformal prediction algorithm for longitudinal data. Our experiments demonstrate that LPCI outperforms existing benchmarks in terms of longitudinal coverage rates. The robust performance of LPCI in generating reliable prediction intervals for longitudinal data underscores its potential for broad applications.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We introduce Longitudinal Predictive Conformal Inference (LPCI), a novel distribution-free conformal prediction algorithm for longitudinal data. Current conformal prediction approaches for time series data predominantly focus on the univariate setting, and thus lack cross-sectional coverage when applied individually to each time series in a longitudinal dataset. The current state-of-the-art for longitudinal data relies on creating infinitely-wide prediction intervals to guarantee both cross-sectional and asymptotic longitudinal coverage. The proposed LPCI method addresses this by ensuring that both longitudinal and cross-sectional coverages are guaranteed without resorting to infinitely wide intervals. In our approach, we model the residual data as a quantile fixed-effects regression problem, constructing prediction intervals with a trained quantile regressor. Our extensive experiments demonstrate that LPCI achieves valid cross-sectional coverage and outperforms existing benchmarks in terms of longitudinal coverage rates. Theoretically, we establish LPCI's asymptotic coverage guarantees for both dimensions, with finite-width intervals. The robust performance of LPCI in generating reliable prediction intervals for longitudinal data underscores its potential for broad applications, including in medicine, finance, and supply chain management.

Related papers

• Timer-XL: Long-Context Transformers for Unified Time Series Forecasting [67.83502953961505]
  We present Timer-XL, a generative Transformer for unified time series forecasting. Timer-XL achieves state-of-the-art performance across challenging forecasting benchmarks through a unified approach.
  arXiv  Detail & Related papers  (2024-10-07T07:27:39Z)
• Risk and cross validation in ridge regression with correlated samples [72.59731158970894]
  We provide training examples for the in- and out-of-sample risks of ridge regression when the data points have arbitrary correlations. We further extend our analysis to the case where the test point has non-trivial correlations with the training set, setting often encountered in time series forecasting. We validate our theory across a variety of high dimensional data.
  arXiv  Detail & Related papers  (2024-08-08T17:27:29Z)
• Conformal Thresholded Intervals for Efficient Regression [9.559062601251464]
  Conformal Thresholded Intervals (CTI) is a novel conformal regression method that aims to produce the smallest possible prediction set with guaranteed coverage. CTI constructs prediction sets by thresholding the estimated conditional interquantile intervals based on their length.
  arXiv  Detail & Related papers  (2024-07-19T17:47:08Z)
• Adapting to Length Shift: FlexiLength Network for Trajectory Prediction [53.637837706712794]
  Trajectory prediction plays an important role in various applications, including autonomous driving, robotics, and scene understanding. Existing approaches mainly focus on developing compact neural networks to increase prediction precision on public datasets, typically employing a standardized input duration. We introduce a general and effective framework, the FlexiLength Network (FLN), to enhance the robustness of existing trajectory prediction against varying observation periods.
  arXiv  Detail & Related papers  (2024-03-31T17:18:57Z)
• Temporal Performance Prediction for Deep Convolutional Long Short-Term Memory Networks [0.0]
  We present a temporal postprocessing method which estimates the prediction performance of convolutional long short-term memory networks. To this end, we create temporal cell state-based input metrics per segment and investigate different models for the estimation of the predictive quality.
  arXiv  Detail & Related papers  (2023-11-13T17:11:35Z)
• When Rigidity Hurts: Soft Consistency Regularization for Probabilistic Hierarchical Time Series Forecasting [69.30930115236228]
  Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting. Most methods focus on point predictions and do not provide well-calibrated probabilistic forecasts distributions. We propose PROFHiT, a fully probabilistic hierarchical forecasting model that jointly models forecast distribution of entire hierarchy.
  arXiv  Detail & Related papers  (2023-10-17T20:30:16Z)
• Conformal Prediction Intervals with Temporal Dependence [40.282423098764404]
  Cross-sectional prediction is common in many domains such as healthcare. We focus on the task of constructing valid prediction intervals (PIs) in time-series regression with a cross-section.
  arXiv  Detail & Related papers  (2022-05-25T17:45:04Z)
• Conformal Prediction with Temporal Quantile Adjustments [40.282423098764404]
  We develop a method to construct efficient and valid prediction intervals (PIs) for regression on cross-sectional time series data. We validate TQA's performance through extensive experimentation.
  arXiv  Detail & Related papers  (2022-05-20T03:31:03Z)
• Predicting Multi-Antenna Frequency-Selective Channels via Meta-Learned Linear Filters based on Long-Short Term Channel Decomposition [39.38412820403623]
  We develop predictors for single-antenna frequency-flat channels based on transfer/meta-learned quadratic regularization. We introduce transfer and meta-learning algorithms for LSTD-based prediction models.
  arXiv  Detail & Related papers  (2022-03-23T20:38:48Z)
• DeepRite: Deep Recurrent Inverse TreatmEnt Weighting for Adjusting Time-varying Confounding in Modern Longitudinal Observational Data [68.29870617697532]
  We propose Deep Recurrent Inverse TreatmEnt weighting (DeepRite) for time-varying confounding in longitudinal data. DeepRite is shown to recover the ground truth from synthetic data, and estimate unbiased treatment effects from real data.
  arXiv  Detail & Related papers  (2020-10-28T15:05:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.