Efficient Federated Conformal Prediction with Group-Conditional Guarantees
- URL: http://arxiv.org/abs/2603.14198v2
- Date: Tue, 17 Mar 2026 12:10:46 GMT
- Title: Efficient Federated Conformal Prediction with Group-Conditional Guarantees
- Abstract summary: Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees.<n>We propose group-conditional federated conformal prediction (GC-FCP), a novel protocol that provides group-conditional coverage guarantees.<n>Experiments on synthetic and real-world datasets validate the performance of GC-FCP compared to centralized calibration baselines.
- Score: 28.340633583577112
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Deploying trustworthy AI systems requires principled uncertainty quantification. Conformal prediction (CP) is a widely used framework for constructing prediction sets with distribution-free coverage guarantees. In many practical settings, including healthcare, finance, and mobile sensing, the calibration data required for CP are distributed across multiple clients, each with its own local data distribution. In this federated setting, data can often be partitioned into, potentially overlapping, groups, which may reflect client-specific strata or cross-cutting attributes such as demographic or semantic categories. We propose group-conditional federated conformal prediction (GC-FCP), a novel protocol that provides group-conditional coverage guarantees. GC-FCP constructs mergeable, group-stratified coresets from local calibration scores, enabling clients to communicate compact weighted summaries that support efficient aggregation and calibration at the server. Experiments on synthetic and real-world datasets validate the performance of GC-FCP compared to centralized calibration baselines.
Related papers
- Multi-Agent Conformal Prediction with Personalized Statistical Validity [33.73739436774371]
Conformal prediction faces challenges under limited local calibration data, privacy constraints, and data heterogeneity.<n>We propose personalized federated conformal prediction (PFWCP), a framework that combines local density ratio weighting with weighted quantile aggregation to correct for heterogeneity while preserving privacy.<n>PFWCP yields valid marginal and calibration-conditional coverage guarantees for each participating agent and supports protocols with one-shot communication.
arXiv Detail & Related papers (2026-05-30T13:01:56Z) - Cluster Frequency Conformal Prediction for Local Coverage [7.5841677529906795]
Conformal prediction provides distribution-free coverage guarantees, but in many-class classification it may still under-cover specific classes or subpopulations.<n>We propose Cluster Frequency Conformal Prediction (CFCP), a plug-in framework that adapts conformal prediction to local structure in a learned representation space.
arXiv Detail & Related papers (2026-05-24T05:27:35Z) - Replacing Parameters with Preferences: Federated Alignment of Heterogeneous Vision-Language Models [63.70401095689976]
We argue that replacing parameters with preferences represents a more scalable and privacy-preserving future.<n>We propose MoR, a federated alignment framework based on GRPO with Mixture-of-Rewards for heterogeneous VLMs.<n>MoR consistently outperforms federated alignment baselines in generalization, robustness, and cross-client adaptability.
arXiv Detail & Related papers (2026-01-31T03:11:51Z) - Towards Federated Clustering: A Client-wise Private Graph Aggregation Framework [57.04850867402913]
Federated clustering addresses the challenge of extracting patterns from decentralized, unlabeled data.<n>We propose Structural Privacy-Preserving Federated Graph Clustering (SPP-FGC), a novel algorithm that innovatively leverages local structural graphs as the primary medium for privacy-preserving knowledge sharing.<n>Our framework achieves state-of-the-art performance, improving clustering accuracy by up to 10% (NMI) over federated baselines while maintaining provable privacy guarantees.
arXiv Detail & Related papers (2025-11-14T03:05:22Z) - Federated Conditional Conformal Prediction via Generative Models [12.463514743585515]
Conformal Prediction (CP) provides distribution-free uncertainty quantification.<n>Fed Conditional Conformal Prediction (Fed-CCP) aims for conditional coverage that adapts to local data heterogeneity.<n> Experiments on real datasets demonstrate that Fed-CCP achieves more adaptive prediction sets.
arXiv Detail & Related papers (2025-10-15T08:38:38Z) - Distributed Conformal Prediction via Message Passing [33.306901198295016]
Conformal Prediction (CP) offers a robust post-hoc calibration framework.<n>We propose two message-passing-based approaches for achieving reliable inference via CP.
arXiv Detail & Related papers (2025-01-24T14:47:42Z) - Conformal Prediction Sets with Improved Conditional Coverage using Trust Scores [52.92618442300405]
It is impossible to achieve exact, distribution-free conditional coverage in finite samples.<n>We propose an alternative conformal prediction algorithm that targets coverage where it matters most.
arXiv Detail & Related papers (2025-01-17T12:01:56Z) - Posterior Conformal Prediction [11.576645675675096]
Conformal prediction is a popular technique for constructing prediction intervals with distribution-free coverage guarantees.
This article introduces a new method, posterior conformal prediction (PCP), which generates prediction intervals with both marginal and approximate conditional validity.
We evaluate the performance of PCP on diverse datasets from socio-economic, scientific and healthcare applications.
arXiv Detail & Related papers (2024-09-29T14:09:07Z) - Certifiably Byzantine-Robust Federated Conformal Prediction [49.23374238798428]
We introduce a novel framework Rob-FCP, which executes robust federated conformal prediction effectively countering malicious clients.
We empirically demonstrate the robustness of Rob-FCP against diverse proportions of malicious clients under a variety of Byzantine attacks.
arXiv Detail & Related papers (2024-06-04T04:43:30Z) - Federated Conformal Predictors for Distributed Uncertainty
Quantification [83.50609351513886]
Conformal prediction is emerging as a popular paradigm for providing rigorous uncertainty quantification in machine learning.
In this paper, we extend conformal prediction to the federated learning setting.
We propose a weaker notion of partial exchangeability, better suited to the FL setting, and use it to develop the Federated Conformal Prediction framework.
arXiv Detail & Related papers (2023-05-27T19:57:27Z) - Fed-CBS: A Heterogeneity-Aware Client Sampling Mechanism for Federated
Learning via Class-Imbalance Reduction [76.26710990597498]
We show that the class-imbalance of the grouped data from randomly selected clients can lead to significant performance degradation.
Based on our key observation, we design an efficient client sampling mechanism, i.e., Federated Class-balanced Sampling (Fed-CBS)
In particular, we propose a measure of class-imbalance and then employ homomorphic encryption to derive this measure in a privacy-preserving way.
arXiv Detail & Related papers (2022-09-30T05:42:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.