Quantifying uncertainty in climate projections with conformal ensembles

• URL: http://arxiv.org/abs/2408.06642v2
• Date: Thu, 15 Aug 2024 22:11:25 GMT
• Title: Quantifying uncertainty in climate projections with conformal ensembles
• Authors: Trevor Harris, Ryan Sriver,
• Abstract summary: Conformal ensembling is a new approach to uncertainty quantification in climate projections based on conformal inference to reduce projection uncertainty. It can be applied to any climatic variable using any ensemble analysis method. Experiments show that it is effective when conditioning future projections on historical reanalysis data.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large climate model ensembles are the primary tool for robustly projecting future climate states and quantifying projection uncertainty. Despite significant advancements in climate modeling over the past few decades, overall projection certainty has not commensurately decreased with steadily improving model skill. We introduce conformal ensembling, a new approach to uncertainty quantification in climate projections based on conformal inference to reduce projection uncertainty. Unlike traditional methods, conformal ensembling seamlessly integrates climate model ensembles and observational data across a range of scales to generate statistically rigorous, easy-to-interpret uncertainty estimates. It can be applied to any climatic variable using any ensemble analysis method and outperforms existing inter-model variability methods in uncertainty quantification across all time horizons and most spatial locations under SSP2-4.5. Conformal ensembling is also computationally efficient, requires minimal assumptions, and is highly robust to the conformity measure. Experiments show that it is effective when conditioning future projections on historical reanalysis data compared with standard ensemble averaging approaches, yielding more physically consistent projections.

Related papers

• SConU: Selective Conformal Uncertainty in Large Language Models [59.25881667640868]
  We propose a novel approach termed Selective Conformal Uncertainty (SConU)<n>We develop two conformal p-values that are instrumental in determining whether a given sample deviates from the uncertainty distribution of the calibration set at a specific manageable risk level.<n>Our approach not only facilitates rigorous management of miscoverage rates across both single-domain and interdisciplinary contexts, but also enhances the efficiency of predictions.
  arXiv  Detail & Related papers  (2025-04-19T03:01:45Z)
• Diffusion models for probabilistic precipitation generation from atmospheric variables [1.6099193327384094]
  In Earth system models (ESMs), precipitation is not resolved explicitly, but represented by parameterizations. We present a novel approach, based on generative machine learning, which integrates a conditional diffusion model with a UNet architecture. Unlike traditional parameterizations, our framework efficiently produces ensemble predictions, capturing uncertainties in precipitation, and does not require fine-tuning by hand.
  arXiv  Detail & Related papers  (2025-04-01T00:21:31Z)
• Generative assimilation and prediction for weather and climate [9.319028023682494]
  We introduce Generative Assimilation and Prediction (GAP) GAP is a unified framework for assimilation and prediction of both weather and climate. It excels in a broad range of weather-climate related tasks, including data assimilation, seamless prediction, and climate simulation.
  arXiv  Detail & Related papers  (2025-03-04T22:36:29Z)
• Noise-Adaptive Conformal Classification with Marginal Coverage [53.74125453366155]
  We introduce an adaptive conformal inference method capable of efficiently handling deviations from exchangeability caused by random label noise.<n>We validate our method through extensive numerical experiments demonstrating its effectiveness on synthetic and real data sets.
  arXiv  Detail & Related papers  (2025-01-29T23:55:23Z)
• Probabilistic Modeling of Disparity Uncertainty for Robust and Efficient Stereo Matching [61.73532883992135]
  We propose a new uncertainty-aware stereo matching framework.<n>We adopt Bayes risk as the measurement of uncertainty and use it to separately estimate data and model uncertainty.
  arXiv  Detail & Related papers  (2024-12-24T23:28:20Z)
• Uncertainties of Satellite-based Essential Climate Variables from Deep Learning [10.804264810132658]
  This survey explores the types of uncertainties associated with essential climate variables (ECVs) estimated from deep learning and the techniques to quantify them.<n>The focus is on highlighting the importance of quantifying inherent uncertainties in ECV estimates, considering the dynamic and multifaceted nature of climate data.
  arXiv  Detail & Related papers  (2024-12-23T12:05:22Z)
• A Deconfounding Approach to Climate Model Bias Correction [26.68810227550602]
  Global Climate Models (GCMs) are crucial for predicting future climate changes by simulating the Earth systems. GCMs exhibit systematic biases due to model uncertainties, parameterization simplifications, and inadequate representation of complex climate phenomena. This paper proposes a novel bias correction approach to utilize both GCM and observational data to learn a factor model that captures multi-cause latent confounders.
  arXiv  Detail & Related papers  (2024-08-22T01:53:35Z)
• Climate Variable Downscaling with Conditional Normalizing Flows [21.2670980628433]
  We apply conditional normalizing flows to the task of climate variable downscaling. We show that the method allows us to assess the predictive uncertainty in terms of standard deviation from the fitted conditional distribution mean.
  arXiv  Detail & Related papers  (2024-05-31T09:20:33Z)
• Weather Prediction with Diffusion Guided by Realistic Forecast Processes [49.07556359513563]
  We introduce a novel method that applies diffusion models (DM) for weather forecasting. Our method can achieve both direct and iterative forecasting with the same modeling framework. The flexibility and controllability of our model empowers a more trustworthy DL system for the general weather community.
  arXiv  Detail & Related papers  (2024-02-06T21:28:42Z)
• ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast [57.6987191099507]
  We introduce Exloss, a novel loss function that performs asymmetric optimization and highlights extreme values to obtain accurate extreme weather forecast. We also introduce ExBooster, which captures the uncertainty in prediction outcomes by employing multiple random samples. Our solution can achieve state-of-the-art performance in extreme weather prediction, while maintaining the overall forecast accuracy comparable to the top medium-range forecast models.
  arXiv  Detail & Related papers  (2024-02-02T10:34:13Z)
• Uncertainty quantification in automated valuation models with spatially weighted conformal prediction [1.0687104237121408]
  Conformal prediction (CP) is a framework for constructing confidence sets around predictions of machine learning models with minimal assumptions.<n>Due to the spatial dependencies observed in house prices, direct application of CP leads to confidence sets that are not calibrated everywhere.<n>We show that calibrating the confidence sets on a spatially weighted version of the non-conformity scores makes the coverage more consistently calibrated across geographical regions.
  arXiv  Detail & Related papers  (2023-12-11T17:09:12Z)
• Measuring and Modeling Uncertainty Degree for Monocular Depth Estimation [50.920911532133154]
  The intrinsic ill-posedness and ordinal-sensitive nature of monocular depth estimation (MDE) models pose major challenges to the estimation of uncertainty degree. We propose to model the uncertainty of MDE models from the perspective of the inherent probability distributions. By simply introducing additional training regularization terms, our model, with surprisingly simple formations and without requiring extra modules or multiple inferences, can provide uncertainty estimations with state-of-the-art reliability.
  arXiv  Detail & Related papers  (2023-07-19T12:11:15Z)
• Deep Ensembles to Improve Uncertainty Quantification of Statistical Downscaling Models under Climate Change Conditions [0.0]
  We propose deep ensembles as a simple method to improve the uncertainty quantification of statistical downscaling models. Deep ensembles allow for a better risk assessment, highly demanded by sectoral applications to tackle climate change.
  arXiv  Detail & Related papers  (2023-04-27T19:53:18Z)
• Toward Reliable Human Pose Forecasting with Uncertainty [51.628234388046195]
  We develop an open-source library for human pose forecasting, including multiple models, supporting several datasets. We devise two types of uncertainty in the problem to increase performance and convey better trust.
  arXiv  Detail & Related papers  (2023-04-13T17:56:08Z)
• A locally time-invariant metric for climate model ensemble predictions of extreme risk [8.347190888362194]
  We introduce a locally time-invariant method for evaluating climate model simulations with a focus on assessing the simulation of extremes. We explore the behaviour of the proposed method in predicting extreme heat days in Nairobi and provide comparative results for eight additional cities.
  arXiv  Detail & Related papers  (2022-11-26T16:41:50Z)
• The Implicit Delta Method [61.36121543728134]
  In this paper, we propose an alternative, the implicit delta method, which works by infinitesimally regularizing the training loss of uncertainty. We show that the change in the evaluation due to regularization is consistent for the variance of the evaluation estimator, even when the infinitesimal change is approximated by a finite difference.
  arXiv  Detail & Related papers  (2022-11-11T19:34:17Z)
• Uncertainty Quantification for Traffic Forecasting: A Unified Approach [21.556559649467328]
  Uncertainty is an essential consideration for time series forecasting tasks. In this work, we focus on quantifying the uncertainty of traffic forecasting. We develop Deep S-Temporal Uncertainty Quantification (STUQ), which can estimate both aleatoric and relational uncertainty.
  arXiv  Detail & Related papers  (2022-08-11T15:21:53Z)
• Dense Uncertainty Estimation via an Ensemble-based Conditional Latent Variable Model [68.34559610536614]
  We argue that the aleatoric uncertainty is an inherent attribute of the data and can only be correctly estimated with an unbiased oracle model. We propose a new sampling and selection strategy at train time to approximate the oracle model for aleatoric uncertainty estimation. Our results show that our solution achieves both accurate deterministic results and reliable uncertainty estimation.
  arXiv  Detail & Related papers  (2021-11-22T08:54:10Z)
• When in Doubt: Neural Non-Parametric Uncertainty Quantification for Epidemic Forecasting [70.54920804222031]
  Most existing forecasting models disregard uncertainty quantification, resulting in mis-calibrated predictions. Recent works in deep neural models for uncertainty-aware time-series forecasting also have several limitations. We model the forecasting task as a probabilistic generative process and propose a functional neural process model called EPIFNP.
  arXiv  Detail & Related papers  (2021-06-07T18:31:47Z)
• Closer Look at the Uncertainty Estimation in Semantic Segmentation under Distributional Shift [2.05617385614792]
  Uncertainty estimation for the task of semantic segmentation is evaluated under a varying level of domain shift. It was shown that simple color transformations already provide a strong baseline. ensemble of models was utilized in the self-training setting to improve the pseudo-labels generation.
  arXiv  Detail & Related papers  (2021-05-31T19:50:43Z)
• HECT: High-Dimensional Ensemble Consistency Testing for Climate Models [1.7587442088965226]
  Climate models play a crucial role in understanding the effect of environmental changes on climate to help mitigate climate risks and inform decisions. Large global climate models such as the Community Earth System Model (CESM), are very complex with millions of lines of code describing interactions of the atmosphere, land, oceans, and ice. Our work uses probabilistics like tree-based algorithms and deep neural networks to perform a statistically rigorous goodness-of-fit test of high-dimensional and man-made data.
  arXiv  Detail & Related papers  (2020-10-08T15:16:16Z)
• Efficient Ensemble Model Generation for Uncertainty Estimation with Bayesian Approximation in Segmentation [74.06904875527556]
  We propose a generic and efficient segmentation framework to construct ensemble segmentation models. In the proposed method, ensemble models can be efficiently generated by using the layer selection method. We also devise a new pixel-wise uncertainty loss, which improves the predictive performance.
  arXiv  Detail & Related papers  (2020-05-21T16:08:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.