Evidential uncertainty sampling for active learning

• URL: http://arxiv.org/abs/2309.12494v2
• Date: Sat, 25 May 2024 08:52:21 GMT
• Title: Evidential uncertainty sampling for active learning
• Authors: Arthur Hoarau, Vincent Lemaire, Arnaud Martin, Jean-Christophe Dubois, Yolande Le Gall,
• Abstract summary: Recent studies in active learning have focused on the decomposition of model uncertainty into reducible and irreducible uncertainties. In this paper, the aim is to simplify the computational process while eliminating the dependence on observations.
• Score: 4.271684331748043
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Recent studies in active learning, particularly in uncertainty sampling, have focused on the decomposition of model uncertainty into reducible and irreducible uncertainties. In this paper, the aim is to simplify the computational process while eliminating the dependence on observations. Crucially, the inherent uncertainty in the labels is considered, the uncertainty of the oracles. Two strategies are proposed, sampling by Klir uncertainty, which tackles the exploration-exploitation dilemma, and sampling by evidential epistemic uncertainty, which extends the concept of reducible uncertainty within the evidential framework, both using the theory of belief functions. Experimental results in active learning demonstrate that our proposed method can outperform uncertainty sampling.

Related papers

• Probabilistic Contrastive Learning with Explicit Concentration on the Hypersphere [3.572499139455308]
  This paper introduces a new perspective on incorporating uncertainty into contrastive learning by embedding representations within a spherical space. We leverage the concentration parameter, kappa, as a direct, interpretable measure to quantify uncertainty explicitly.
  arXiv  Detail & Related papers  (2024-05-26T07:08:13Z)
• Is Epistemic Uncertainty Faithfully Represented by Evidential Deep Learning Methods? [26.344949402398917]
  This paper presents novel theoretical insights of evidential deep learning. It highlights the difficulties in optimizing second-order loss functions. It provides novel insights into issues of identifiability and convergence in second-order loss minimization.
  arXiv  Detail & Related papers  (2024-02-14T10:07:05Z)
• A unified uncertainty-aware exploration: Combining epistemic and aleatory uncertainty [21.139502047972684]
  We propose an algorithm that quantifies the combined effect of aleatory and epistemic uncertainty for risk-sensitive exploration. Our method builds on a novel extension of distributional RL that estimates a parameterized return distribution. Experimental results on tasks with exploration and risk challenges show that our method outperforms alternative approaches.
  arXiv  Detail & Related papers  (2024-01-05T17:39:00Z)
• One step closer to unbiased aleatoric uncertainty estimation [71.55174353766289]
  We propose a new estimation method by actively de-noising the observed data. By conducting a broad range of experiments, we demonstrate that our proposed approach provides a much closer approximation to the actual data uncertainty than the standard method.
  arXiv  Detail & Related papers  (2023-12-16T14:59:11Z)
• Model-Based Uncertainty in Value Functions [89.31922008981735]
  We focus on characterizing the variance over values induced by a distribution over MDPs. Previous work upper bounds the posterior variance over values by solving a so-called uncertainty Bellman equation. We propose a new uncertainty Bellman equation whose solution converges to the true posterior variance over values.
  arXiv  Detail & Related papers  (2023-02-24T09:18:27Z)
• Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Model [68.34559610536614]
  We argue that the aleatoric uncertainty is an inherent attribute of the data and can only be correctly estimated with an unbiased oracle model. We propose a new sampling and selection strategy at train time to approximate the oracle model for aleatoric uncertainty estimation. Our results show that our solution achieves both accurate deterministic results and reliable uncertainty estimation.
  arXiv  Detail & Related papers  (2021-11-22T08:54:10Z)
• Logit-based Uncertainty Measure in Classification [18.224344440110862]
  We introduce a new, reliable, and agnostic uncertainty measure for classification tasks called logit uncertainty. We show that this new uncertainty measure yields a superior performance compared to existing uncertainty measures on different tasks.
  arXiv  Detail & Related papers  (2021-07-06T19:07:16Z)
• DEUP: Direct Epistemic Uncertainty Prediction [56.087230230128185]
  Epistemic uncertainty is part of out-of-sample prediction error due to the lack of knowledge of the learner. We propose a principled approach for directly estimating epistemic uncertainty by learning to predict generalization error and subtracting an estimate of aleatoric uncertainty.
  arXiv  Detail & Related papers  (2021-02-16T23:50:35Z)
• STUaNet: Understanding uncertainty in spatiotemporal collective human mobility [11.436035608461966]
  We propose an uncertainty learning mechanism to simultaneously estimate internal data quality and external uncertainty regarding various contextual interactions. We show that our proposed model is superior in terms of both forecasting and uncertainty quantification.
  arXiv  Detail & Related papers  (2021-02-09T01:43:27Z)
• The Hidden Uncertainty in a Neural Networks Activations [105.4223982696279]
  The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution correlates with a model's epistemic uncertainty, thus indicating its ability to generalise to novel inputs.
  arXiv  Detail & Related papers  (2020-12-05T17:30:35Z)
• Temporal Difference Uncertainties as a Signal for Exploration [76.6341354269013]
  An effective approach to exploration in reinforcement learning is to rely on an agent's uncertainty over the optimal policy. In this paper, we highlight that value estimates are easily biased and temporally inconsistent. We propose a novel method for estimating uncertainty over the value function that relies on inducing a distribution over temporal difference errors.
  arXiv  Detail & Related papers  (2020-10-05T18:11:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.