Uncertainty in Natural Language Processing: Sources, Quantification, and Applications

• URL: http://arxiv.org/abs/2306.04459v1
• Date: Mon, 5 Jun 2023 06:46:53 GMT
• Title: Uncertainty in Natural Language Processing: Sources, Quantification, and Applications
• Authors: Mengting Hu, Zhen Zhang, Shiwan Zhao, Minlie Huang and Bingzhe Wu
• Abstract summary: We provide a comprehensive review of uncertainty-relevant works in the NLP field. We first categorize the sources of uncertainty in natural language into three types, including input, system, and output. We discuss the challenges of uncertainty estimation in NLP and discuss potential future directions.
• Score: 56.130945359053776
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: As a main field of artificial intelligence, natural language processing (NLP) has achieved remarkable success via deep neural networks. Plenty of NLP tasks have been addressed in a unified manner, with various tasks being associated with each other through sharing the same paradigm. However, neural networks are black boxes and rely on probability computation. Making mistakes is inevitable. Therefore, estimating the reliability and trustworthiness (in other words, uncertainty) of neural networks becomes a key research direction, which plays a crucial role in reducing models' risks and making better decisions. Therefore, in this survey, we provide a comprehensive review of uncertainty-relevant works in the NLP field. Considering the data and paradigms characteristics, we first categorize the sources of uncertainty in natural language into three types, including input, system, and output. Then, we systemically review uncertainty quantification approaches and the main applications. Finally, we discuss the challenges of uncertainty estimation in NLP and discuss potential future directions, taking into account recent trends in the field. Though there have been a few surveys about uncertainty estimation, our work is the first to review uncertainty from the NLP perspective.

Related papers

• Uncertainty Calibration with Energy Based Instance-wise Scaling in the Wild Dataset [23.155946032377052]
  We introduce a novel instance-wise calibration method based on an energy model. Our method incorporates energy scores instead of softmax confidence scores, allowing for adaptive consideration of uncertainty. In experiments, we show that the proposed method consistently maintains robust performance across the spectrum.
  arXiv  Detail & Related papers  (2024-07-17T06:14:55Z)
• Decomposing Uncertainty for Large Language Models through Input Clarification Ensembling [69.83976050879318]
  In large language models (LLMs), identifying sources of uncertainty is an important step toward improving reliability, trustworthiness, and interpretability. In this paper, we introduce an uncertainty decomposition framework for LLMs, called input clarification ensembling. Our approach generates a set of clarifications for the input, feeds them into an LLM, and ensembles the corresponding predictions.
  arXiv  Detail & Related papers  (2023-11-15T05:58:35Z)
• Toward Reliable Human Pose Forecasting with Uncertainty [51.628234388046195]
  We develop an open-source library for human pose forecasting, including multiple models, supporting several datasets. We devise two types of uncertainty in the problem to increase performance and convey better trust.
  arXiv  Detail & Related papers  (2023-04-13T17:56:08Z)
• Uncertainty of Feed Forward Neural Networks Recognizing Quantum Contextuality [2.5665227681407243]
  A powerful technique for estimating both the accuracy and the uncertainty is provided by Bayesian neural networks (BNNs) We show how BNNs can highlight their ability of reliable uncertainty estimation even after training with biased data sets.
  arXiv  Detail & Related papers  (2022-12-27T17:33:46Z)
• The Unreasonable Effectiveness of Deep Evidential Regression [72.30888739450343]
  A new approach with uncertainty-aware regression-based neural networks (NNs) shows promise over traditional deterministic methods and typical Bayesian NNs. We detail the theoretical shortcomings and analyze the performance on synthetic and real-world data sets, showing that Deep Evidential Regression is a quantification rather than an exact uncertainty.
  arXiv  Detail & Related papers  (2022-05-20T10:10:32Z)
• Global Convolutional Neural Processes [52.85558458799716]
  We build a member GloBal Convolutional Neural Process(GBCoNP) that achieves the SOTA log-likelihood in latent NPFs. It designs a global uncertainty representation p(z) which is an aggregation on a discretized input space. The learnt prior is analyzed on a variety of scenarios, including 1D, 2D, and a newly proposed spatial-temporal COVID dataset.
  arXiv  Detail & Related papers  (2021-09-02T03:32:50Z)
• A Survey of Uncertainty in Deep Neural Networks [39.68313590688467]
  It is intended to give anyone interested in uncertainty estimation in neural networks a broad overview and introduction. A comprehensive introduction to the most crucial sources of uncertainty is given and their separation into reducible model uncertainty and not reducible data uncertainty is presented. For a practical application, we discuss different measures of uncertainty, approaches for the calibration of neural networks and give an overview of existing baselines and implementations.
  arXiv  Detail & Related papers  (2021-07-07T16:39:28Z)
• Interval Deep Learning for Uncertainty Quantification in Safety Applications [0.0]
  Current deep neural networks (DNNs) do not have an implicit mechanism to quantify and propagate significant input data uncertainty. We present a DNN optimized with gradient-based methods capable to quantify input and parameter uncertainty by means of interval analysis. We show that the Deep Interval Neural Network (DINN) can produce accurate bounded estimates from uncertain input data.
  arXiv  Detail & Related papers  (2021-05-13T17:21:33Z)
• Multivariate Deep Evidential Regression [77.34726150561087]
  A new approach with uncertainty-aware neural networks shows promise over traditional deterministic methods. We discuss three issues with a proposed solution to extract aleatoric and epistemic uncertainties from regression-based neural networks.
  arXiv  Detail & Related papers  (2021-04-13T12:20:18Z)
• Multidimensional Uncertainty-Aware Evidential Neural Networks [21.716045815385268]
  We propose a novel uncertainty-aware evidential NN called WGAN-ENN (WENN) for solving an out-of-versa (OOD) detection problem. We took a hybrid approach that combines Wasserstein Generative Adrial Network (WGAN) with ENNs to jointly train a model with prior knowledge of a certain class. We demonstrated that the estimation of uncertainty by WENN can significantly help distinguish OOD samples from boundary samples.
  arXiv  Detail & Related papers  (2020-12-26T04:28:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.