Conformal Prediction: a Unified Review of Theory and New Challenges
- URL: http://arxiv.org/abs/2005.07972v2
- Date: Fri, 29 Jul 2022 14:06:18 GMT
- Title: Conformal Prediction: a Unified Review of Theory and New Challenges
- Authors: Matteo Fontana, Gianluca Zeni, Simone Vantini
- Abstract summary: In this work we provide a review of basic ideas and novel developments about Conformal Prediction.
The in-depth discussion provided in the paper covers the theoretical underpinnings of Conformal Prediction.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: In this work we provide a review of basic ideas and novel developments about
Conformal Prediction -- an innovative distribution-free, non-parametric
forecasting method, based on minimal assumptions -- that is able to yield in a
very straightforward way predictions sets that are valid in a statistical sense
also in in the finite sample case. The in-depth discussion provided in the
paper covers the theoretical underpinnings of Conformal Prediction, and then
proceeds to list the more advanced developments and adaptations of the original
idea.
Related papers
- Conformal Prediction for Hierarchical Data [5.580128181112309]
We propose a first step towards combining Conformal Prediction and Forecast Reconciliation.
We show that the validity granted by SCP remains while improving the efficiency of the prediction sets.
arXiv Detail & Related papers (2024-11-20T17:26:26Z) - Source-Free Unsupervised Domain Adaptation with Hypothesis Consolidation
of Prediction Rationale [53.152460508207184]
Source-Free Unsupervised Domain Adaptation (SFUDA) is a challenging task where a model needs to be adapted to a new domain without access to target domain labels or source domain data.
This paper proposes a novel approach that considers multiple prediction hypotheses for each sample and investigates the rationale behind each hypothesis.
To achieve the optimal performance, we propose a three-step adaptation process: model pre-adaptation, hypothesis consolidation, and semi-supervised learning.
arXiv Detail & Related papers (2024-02-02T05:53:22Z) - Conformal Prediction for Federated Uncertainty Quantification Under
Label Shift [57.54977668978613]
Federated Learning (FL) is a machine learning framework where many clients collaboratively train models.
We develop a new conformal prediction method based on quantile regression and take into account privacy constraints.
arXiv Detail & Related papers (2023-06-08T11:54:58Z) - Predictive Inference with Feature Conformal Prediction [80.77443423828315]
We propose feature conformal prediction, which extends the scope of conformal prediction to semantic feature spaces.
From a theoretical perspective, we demonstrate that feature conformal prediction provably outperforms regular conformal prediction under mild assumptions.
Our approach could be combined with not only vanilla conformal prediction, but also other adaptive conformal prediction methods.
arXiv Detail & Related papers (2022-10-01T02:57:37Z) - Excess risk analysis for epistemic uncertainty with application to
variational inference [110.4676591819618]
We present a novel EU analysis in the frequentist setting, where data is generated from an unknown distribution.
We show a relation between the generalization ability and the widely used EU measurements, such as the variance and entropy of the predictive distribution.
We propose new variational inference that directly controls the prediction and EU evaluation performances based on the PAC-Bayesian theory.
arXiv Detail & Related papers (2022-06-02T12:12:24Z) - Forecasting: theory and practice [65.71277206849244]
This article provides a non-systematic review of the theory and the practice of forecasting.
We provide an overview of a wide range of theoretical, state-of-the-art models, methods, principles, and approaches.
We then demonstrate how such theoretical concepts are applied in a variety of real-life contexts.
arXiv Detail & Related papers (2020-12-04T16:56:44Z) - Video Prediction via Example Guidance [156.08546987158616]
In video prediction tasks, one major challenge is to capture the multi-modal nature of future contents and dynamics.
In this work, we propose a simple yet effective framework that can efficiently predict plausible future states.
arXiv Detail & Related papers (2020-07-03T14:57:24Z) - Exchangeability, Conformal Prediction, and Rank Tests [0.0]
We review the concept of exchangeability and discuss the implications for conformal prediction and rank tests.
We provide a low-level introduction to these topics, and discuss the similarities between conformal prediction and rank tests.
arXiv Detail & Related papers (2020-05-13T00:39:45Z) - Conformal e-prediction [0.0]
Conformal e-prediction is conceptually simpler and had been developed in the 1990s as precursor of conformal prediction.
This paper re-examines relations between conformal prediction and conformal e-prediction systematically from a modern perspective.
arXiv Detail & Related papers (2020-01-16T18:41:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.