Credal Concept Bottleneck Models for Epistemic-Aleatoric Uncertainty Decomposition

• URL: http://arxiv.org/abs/2604.24170v1
• Date: Mon, 27 Apr 2026 08:27:50 GMT
• Title: Credal Concept Bottleneck Models for Epistemic-Aleatoric Uncertainty Decomposition
• Abstract summary: Concept Bottleneck Models (CBMs) predict through human-interpretable concepts.<n>CBMs typically output point concept probabilities that conflate epistemic uncertainty and aleatoric uncertainty.<n>We introduce CREDENCE, a framework that decomposes concept uncertainty by construction.
• Score: 22.644661427062726
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Concept Bottleneck Models (CBMs) predict through human-interpretable concepts, but they typically output point concept probabilities that conflate epistemic uncertainty (reducible model underspecification) with aleatoric uncertainty (irreducible input ambiguity). This makes concept-level uncertainty hard to interpret and, more importantly, hard to act upon. We introduce CREDENCE (Credal Ensemble Concept Estimation), a CBM framework that decomposes concept uncertainty by construction. CREDENCE represents each concept as a credal prediction (a probability interval), derives epistemic uncertainty from disagreement across diverse concept heads, and estimates aleatoric uncertainty via a dedicated ambiguity output trained to match annotator disagreement when available. The resulting signals support prescriptive decisions: automate low-uncertainty cases, prioritize data collection for high-epistemic cases, route high-aleatoric cases to human review, and abstain when both are high. Across several tasks, we show that epistemic uncertainty is positively associated with prediction errors, whereas aleatoric uncertainty closely tracks annotator disagreement, providing guidance beyond error correlation. Our implementation is available at the following link: https://github.com/Tankiit/Credal_Sets/tree/ensemble-credal-cbm

Related papers

• ReCBM: Uncertainty-Gated Relational Reasoning for Concept Bottleneck Models [16.64288013782432]
  Concept Bottleneck Models (CBMs) provide an interpretable framework by grounding predictions in human-understandable concepts.<n>Recent variants have improved CBMs through richer concept representations, uncertainty estimation, and dependency modeling.<n>We propose ReCBM, an uncertainty-gated relational reasoning framework for CBMs.
  arXiv  Detail & Related papers  (2026-08-07T19:59:47Z)
• On the Faithfulness of Post-Hoc Concept Bottleneck Models [7.774981803358894]
  We study Post-Hoc Concept Bottleneck Models (post-hoc CBMs)<n>CBMs project latent features onto interpretable concept spaces using auxiliary datasets or vision-language models.<n>For example, random concept projections can achieve competitive accuracy despite being semantically meaningless.
  arXiv  Detail & Related papers  (2026-06-29T16:02:29Z)
• Aligning LLM Uncertainty with Human Disagreement in Subjectivity Analysis [57.78407973423517]
  We advocate uncertainty-aware subjectivity analysis, where models are expected to make predictions while expressing uncertainty that reflects human disagreement.<n>To operationalize this perspective, we propose a two-phase Disagreement Perception and Uncertainty Alignment framework.<n> Experiments on three subjectivity analysis tasks show that DPUA preserves task performance while better aligning model uncertainty with human disagreement.
  arXiv  Detail & Related papers  (2026-05-11T11:52:58Z)
• Possibilistic Predictive Uncertainty for Deep Learning [75.00607359322863]
  We introduce Dirichlet-approximated possibilistic posterior predictions (DAPPr)<n>DAPPr is a principled framework leveraging possibility theory.<n>This projection-and-approximation strategy yields a simple training objective with closed-form solutions.
  arXiv  Detail & Related papers  (2026-05-01T12:14:01Z)
• CUPID: A Plug-in Framework for Joint Aleatoric and Epistemic Uncertainty Estimation with a Single Model [1.6855257501750571]
  CUPID (Comprehensive Uncertainty Plug-in estImation moDel) is a general-purpose module that jointly estimates aleatoric and epistemic uncertainty without modifying or retraining the base model.<n>We evaluate CUPID across a range of tasks, including classification, regression, and out-of-distribution detection.<n>The results show that CUPID consistently delivers competitive performance while offering layer-wise insights into the origins of uncertainty.
  arXiv  Detail & Related papers  (2026-03-11T13:18:10Z)
• Credal Concept Bottleneck Models: Structural Separation of Epistemic and Aleatoric Uncertainty [38.040646841317965]
  We propose a credal-set formulation in which uncertainty is represented as a set of predictive distributions.<n>We instantiate this idea in a Variational Credal Concept Bottleneck Model with two disjoint uncertainty heads trained by disjoint objectives.
  arXiv  Detail & Related papers  (2026-02-11T10:54:57Z)
• Credal Ensemble Distillation for Uncertainty Quantification [12.36665123584814]
  We propose credal ensemble distillation (CED), a framework that compresses a deep ensemble into a single model, CREDIT, for classification tasks.<n>CED achieves superior or comparable uncertainty estimation compared to several existing baselines, while substantially reducing inference overhead compared to deep ensembles.
  arXiv  Detail & Related papers  (2025-11-14T14:53:42Z)
• Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching [61.73532883992135]
  We propose a new uncertainty-aware stereo matching framework.<n>We adopt Bayes risk as the measurement of uncertainty and use it to separately estimate data and model uncertainty.
  arXiv  Detail & Related papers  (2024-12-24T23:28:20Z)
• Identifying Drivers of Predictive Aleatoric Uncertainty [2.5311562666866494]
  We propose a straightforward approach to explain predictive aleatoric uncertainties.<n>We estimate uncertainty in regression as predictive variance by adapting a neural network with a Gaussian output distribution.<n>This approach can explain uncertainty influences more reliably than complex published approaches.
  arXiv  Detail & Related papers  (2023-12-12T13:28:53Z)
• Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval [139.21955930418815]
  Cross-modal Retrieval methods build similarity relations between vision and language modalities by jointly learning a common representation space. However, the predictions are often unreliable due to the Aleatoric uncertainty, which is induced by low-quality data, e.g., corrupt images, fast-paced videos, and non-detailed texts. We propose a novel Prototype-based Aleatoric Uncertainty Quantification (PAU) framework to provide trustworthy predictions by quantifying the uncertainty arisen from the inherent data ambiguity.
  arXiv  Detail & Related papers  (2023-09-29T09:41:19Z)
• Quantification of Predictive Uncertainty via Inference-Time Sampling [57.749601811982096]
  We propose a post-hoc sampling strategy for estimating predictive uncertainty accounting for data ambiguity. The method can generate different plausible outputs for a given input and does not assume parametric forms of predictive distributions.
  arXiv  Detail & Related papers  (2023-08-03T12:43:21Z)
• Probabilistic Concept Bottleneck Models [26.789507935869107]
  Interpretable models are designed to make decisions in a human-interpretable manner. In this study, we address the ambiguity issue that can harm reliability. We propose Probabilistic Concept Bottleneck Models (ProbCBM)
  arXiv  Detail & Related papers  (2023-06-02T14:38:58Z)
• Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Model [68.34559610536614]
  We argue that the aleatoric uncertainty is an inherent attribute of the data and can only be correctly estimated with an unbiased oracle model. We propose a new sampling and selection strategy at train time to approximate the oracle model for aleatoric uncertainty estimation. Our results show that our solution achieves both accurate deterministic results and reliable uncertainty estimation.
  arXiv  Detail & Related papers  (2021-11-22T08:54:10Z)
• Dense Uncertainty Estimation [62.23555922631451]
  In this paper, we investigate neural networks and uncertainty estimation techniques to achieve both accurate deterministic prediction and reliable uncertainty estimation. We work on two types of uncertainty estimations solutions, namely ensemble based methods and generative model based methods, and explain their pros and cons while using them in fully/semi/weakly-supervised framework.
  arXiv  Detail & Related papers  (2021-10-13T01:23:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.