Exchangeability, Conformal Prediction, and Rank Tests
- URL: http://arxiv.org/abs/2005.06095v3
- Date: Fri, 4 Jun 2021 01:35:40 GMT
- Title: Exchangeability, Conformal Prediction, and Rank Tests
- Authors: Arun Kumar Kuchibhotla
- Abstract summary: We review the concept of exchangeability and discuss the implications for conformal prediction and rank tests.
We provide a low-level introduction to these topics, and discuss the similarities between conformal prediction and rank tests.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Conformal prediction has been a very popular method of distribution-free
predictive inference in recent years in machine learning and statistics. Its
popularity stems from the fact that it works as a wrapper around any prediction
algorithm such as neural networks or random forests. Exchangeability is at the
core of the validity of conformal prediction. The concept of exchangeability is
also at the core of rank tests widely known in nonparametric statistics. In
this paper, we review the concept of exchangeability and discuss the
implications for conformal prediction and rank tests. We provide a low-level
introduction to these topics, and discuss the similarities between conformal
prediction and rank tests.
Related papers
- Randomness, exchangeability, and conformal prediction [0.0]
It introduces new kinds of confidence predictors, including randomness predictors and exchangeability predictors.
The main result implies that both are close to conformal predictors and quantifies the difference between randomness prediction and conformal prediction.
arXiv Detail & Related papers (2025-01-20T19:14:26Z) - Conformal Prediction Sets with Improved Conditional Coverage using Trust Scores [52.92618442300405]
It is impossible to achieve exact, distribution-free conditional coverage in finite samples.
We propose an alternative conformal prediction algorithm that targets coverage where it matters most.
arXiv Detail & Related papers (2025-01-17T12:01:56Z) - Enhancing Conformal Prediction Using E-Test Statistics [0.0]
Conformal Prediction (CP) serves as a robust framework that quantifies uncertainty in predictions made by Machine Learning (ML) models.
This paper ventures down an alternative path, harnessing the power of e-test statistics to augment the efficacy of conformal predictions by introducing a BB-predictor.
arXiv Detail & Related papers (2024-03-28T01:14:25Z) - Conformal Prediction for Federated Uncertainty Quantification Under
Label Shift [57.54977668978613]
Federated Learning (FL) is a machine learning framework where many clients collaboratively train models.
We develop a new conformal prediction method based on quantile regression and take into account privacy constraints.
arXiv Detail & Related papers (2023-06-08T11:54:58Z) - Federated Conformal Predictors for Distributed Uncertainty
Quantification [83.50609351513886]
Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning.
In this paper, we extend conformal prediction to the federated learning setting.
We propose a weaker notion of partial exchangeability, better suited to the FL setting, and use it to develop the Federated Conformal Prediction framework.
arXiv Detail & Related papers (2023-05-27T19:57:27Z) - Prediction-Powered Inference [68.97619568620709]
Prediction-powered inference is a framework for performing valid statistical inference when an experimental dataset is supplemented with predictions from a machine-learning system.
The framework yields simple algorithms for computing provably valid confidence intervals for quantities such as means, quantiles, and linear and logistic regression coefficients.
Prediction-powered inference could enable researchers to draw valid and more data-efficient conclusions using machine learning.
arXiv Detail & Related papers (2023-01-23T18:59:28Z) - Distribution-Free Finite-Sample Guarantees and Split Conformal
Prediction [0.0]
split conformal prediction represents a promising avenue to obtain finite-sample guarantees under minimal distribution-free assumptions.
We highlight the connection between split conformal prediction and classical tolerance predictors developed in the 1940s.
arXiv Detail & Related papers (2022-10-26T14:12:24Z) - Predictive Inference with Feature Conformal Prediction [80.77443423828315]
We propose feature conformal prediction, which extends the scope of conformal prediction to semantic feature spaces.
From a theoretical perspective, we demonstrate that feature conformal prediction provably outperforms regular conformal prediction under mild assumptions.
Our approach could be combined with not only vanilla conformal prediction, but also other adaptive conformal prediction methods.
arXiv Detail & Related papers (2022-10-01T02:57:37Z) - CovarianceNet: Conditional Generative Model for Correct Covariance
Prediction in Human Motion Prediction [71.31516599226606]
We present a new method to correctly predict the uncertainty associated with the predicted distribution of future trajectories.
Our approach, CovariaceNet, is based on a Conditional Generative Model with Gaussian latent variables.
arXiv Detail & Related papers (2021-09-07T09:38:24Z) - Conformal e-prediction [0.0]
Conformal e-prediction is conceptually simpler and had been developed in the 1990s as precursor of conformal prediction.
This paper re-examines relations between conformal prediction and conformal e-prediction systematically from a modern perspective.
arXiv Detail & Related papers (2020-01-16T18:41:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.