The Ensemble Kalman Inversion Race

• URL: http://arxiv.org/abs/2511.15853v1
• Date: Wed, 19 Nov 2025 20:18:40 GMT
• Title: The Ensemble Kalman Inversion Race
• Abstract summary: Ensemble Kalman methods were initially developed to solve nonlinear data assimilation problems in oceanography.<n>We focus on learning climate model parameters from minimizing the misfit between modeled and observed climate statistics.<n>Given the many variants of ensemble methods proposed, an important question is: Which ensemble Kalman method should be used for climate model calibration?
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ensemble Kalman methods were initially developed to solve nonlinear data assimilation problems in oceanography, but are now popular in applications far beyond their original use cases. Of particular interest is climate model calibration. As hybrid physics and machine-learning models evolve, the number of parameters and complexity of parameterizations in climate models will continue to grow. Thus, robust calibration of these parameters plays an increasingly important role. We focus on learning climate model parameters from minimizing the misfit between modeled and observed climate statistics in an idealized setting. Ensemble Kalman methods are a natural choice for this problem because they are derivative-free, scalable to high dimensions, and robust to noise caused by statistical observations. Given the many variants of ensemble methods proposed, an important question is: Which ensemble Kalman method should be used for climate model calibration? To answer this question, we perform systematic numerical experiments to explore the relative computational efficiencies of several ensemble Kalman methods. The numerical experiments involve statistical observations of Lorenz-type models of increasing complexity, frequently used to represent simplified atmospheric systems, and some feature neural network parameterizations. For each test problem, several ensemble Kalman methods and a derivative-based method "race" to reach a specified accuracy, and we measure the computational cost required to achieve the desired accuracy. We investigate how prior information and the parameter or data dimensions play a role in choosing the ensemble method variant. The derivative-based method consistently fails to complete the race because it does not adaptively handle the noisy loss landscape.

Related papers

• Computation-Aware Kalman Filtering with Model Selection for Neural Dynamics [11.744224268588738]
  We introduce a novel training loss and optimization scheme, which yields tractable inference in large state-spaces.<n>For both synthetic and real data, we show that our method is competitive with data-hungry deep networks.
  arXiv  Detail & Related papers  (2026-05-31T22:02:13Z)
• Calibration of a neural network ocean closure for improved mean state and variability [0.5423054147964751]
  We optimize parameters of a neural network parameterization of mesoscale eddies in two idealized ocean models at coarse resolution.<n>The calibrated parameterization reduces errors in the time-averaged fluid interfaces and their variability by approximately a factor of two.<n>These results demonstrate that systematic calibration can substantially improve coarse-resolution ocean simulations.
  arXiv  Detail & Related papers  (2026-04-07T19:32:25Z)
• Scalable Learning of Multivariate Distributions via Coresets [48.02318786960811]
  We develop a novel coreset construction for multivariate conditional transformation models (MCTMs) to enhance their scalability and training efficiency.<n>Our approach yields substantial data reduction via importance sampling.<n>Compared to conventional full-parametric models, where coresets have been incorporated before, our semi-parametric approach exhibits enhanced adaptability.
  arXiv  Detail & Related papers  (2026-03-20T09:28:43Z)
• Efficient Covariance Estimation for Sparsified Functional Data [51.69796254617083]
  proposed Random-knots (Random-knots-Spatial) and B-spline (Bspline-Spatial) estimators of the covariance function are computationally efficient.<n>Asymptotic pointwise of the covariance are obtained for sparsified individual trajectories under some regularity conditions.
  arXiv  Detail & Related papers  (2025-11-23T00:50:33Z)
• Towards Physically Consistent Deep Learning For Climate Model Parameterizations [46.07009109585047]
  parameterizations are a major source of systematic errors and large uncertainties in climate projections. Deep learning (DL)-based parameterizations, trained on data from computationally expensive short, high-resolution simulations, have shown great promise for improving climate models. We propose an efficient supervised learning framework for DL-based parameterizations that leads to physically consistent models.
  arXiv  Detail & Related papers  (2024-06-06T10:02:49Z)
• On Calibrating Semantic Segmentation Models: Analyses and An Algorithm [51.85289816613351]
  We study the problem of semantic segmentation calibration. Model capacity, crop size, multi-scale testing, and prediction correctness have impact on calibration. We propose a simple, unifying, and effective approach, namely selective scaling.
  arXiv  Detail & Related papers  (2022-12-22T22:05:16Z)
• Bayesian Learning of Coupled Biogeochemical-Physical Models [28.269731698116257]
  Predictive models for marine ecosystems are used for a variety of needs. Due to sparse measurements and limited understanding of the myriad of ocean processes, there is significant uncertainty. We develop a Bayesian model learning methodology that allows handling in the space of candidate models and discovery of new models.
  arXiv  Detail & Related papers  (2022-11-12T17:49:18Z)
• Neural parameter calibration for large-scale multi-agent models [0.7734726150561089]
  We present a method to retrieve accurate probability densities for parameters using neural equations. The two combined create a powerful tool that can quickly estimate densities on model parameters, even for very large systems.
  arXiv  Detail & Related papers  (2022-09-27T17:36:26Z)
• Ensemble Inference Methods for Models With Noisy and Expensive Likelihoods [3.856620400071431]
  This paper is concerned with the use of interacting particle systems for the solution of inverse problems for parameters. The available forward model evaluations are subject to rapid fluctuations, in parameter space, superimposed on the smoothly varying large scale parametric structure of interest. Multiscale analysis is used to study the behaviour of interacting particle system algorithms when such rapid fluctuations, which we refer to as noise, pollute the large scale parametric dependence of the parameter-to-data map.
  arXiv  Detail & Related papers  (2021-04-07T20:29:18Z)
• Variable selection with missing data in both covariates and outcomes: Imputation and machine learning [1.0333430439241666]
  The missing data issue is ubiquitous in health studies. Machine learning methods weaken parametric assumptions. XGBoost and BART have the overall best performance across various settings.
  arXiv  Detail & Related papers  (2021-04-06T20:18:29Z)
• Leveraging Global Parameters for Flow-based Neural Posterior Estimation [90.21090932619695]
  Inferring the parameters of a model based on experimental observations is central to the scientific method. A particularly challenging setting is when the model is strongly indeterminate, i.e., when distinct sets of parameters yield identical observations. We present a method for cracking such indeterminacy by exploiting additional information conveyed by an auxiliary set of observations sharing global parameters.
  arXiv  Detail & Related papers  (2021-02-12T12:23:13Z)
• Machine Learning for Robust Identification of Complex Nonlinear Dynamical Systems: Applications to Earth Systems Modeling [8.896888286819635]
  Systems exhibiting chaos are ubiquitous across Earth Sciences. System Identification remains a challenge in climate science. We consider a chaotic system - two-level Lorenz-96 - used as a benchmark model in the climate science literature.
  arXiv  Detail & Related papers  (2020-08-12T22:37:12Z)
• Uncertainty Quantification and Deep Ensembles [79.4957965474334]
  We show that deep-ensembles do not necessarily lead to improved calibration properties. We show that standard ensembling methods, when used in conjunction with modern techniques such as mixup regularization, can lead to less calibrated models. This text examines the interplay between three of the most simple and commonly used approaches to leverage deep learning when data is scarce.
  arXiv  Detail & Related papers  (2020-07-17T07:32:24Z)
• Considering discrepancy when calibrating a mechanistic electrophysiology model [41.77362715012383]
  Uncertainty quantification (UQ) is a vital step in using mathematical models and simulations to take decisions. In this piece we draw attention to an important and under-addressed source of uncertainty in our predictions -- that of uncertainty in the model structure or the equations themselves.
  arXiv  Detail & Related papers  (2020-01-13T13:26:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.