Design Guidelines for Nonlinear Kalman Filters via Covariance Compensation

• URL: http://arxiv.org/abs/2603.22992v1
• Date: Tue, 24 Mar 2026 09:34:36 GMT
• Title: Design Guidelines for Nonlinear Kalman Filters via Covariance Compensation
• Abstract summary: extensions of the Kalman filter (KF) are indispensable for state estimation in complex systems.<n>Conditions for a nonlinear KF to provide robust and accurate estimations remain poorly understood.<n>This work proposes a theoretical framework that identifies the causes of failure and success in certain nonlinear KFs.
• Score: 1.3987815339128262
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Nonlinear extensions of the Kalman filter (KF), such as the extended Kalman filter (EKF) and the unscented Kalman filter (UKF), are indispensable for state estimation in complex dynamical systems, yet the conditions for a nonlinear KF to provide robust and accurate estimations remain poorly understood. This work proposes a theoretical framework that identifies the causes of failure and success in certain nonlinear KFs and establishes guidelines for their improvement. Central to our framework is the concept of covariance compensation: the deviation between the covariance predicted by a nonlinear KF and that of the EKF. With this definition and detailed theoretical analysis, we derive three design guidelines for nonlinear KFs: (i) invariance under orthogonal transformations, (ii) sufficient covariance compensation beyond the EKF baseline, and (iii) selection of compensation magnitude that favors underconfidence. Both theoretical analysis and empirical validation confirm that adherence to these principles significantly improves estimation accuracy, whereas fixed parameter choices commonly adopted in the literature are often suboptimal. The codes and the proofs for all the theorems in this paper are available at https://github.com/Shida-Jiang/Guidelines-for-Nonlinear-Kalman-Filters.

Related papers

• Theory of approximate quantum error correction and the error-set model [53.73800998389749]
  We develop a theory of approximate quantum error correction based on the error-set model.<n>Code correcting a given error set automatically protects against every channel whose Kraus operators lie in their linear span.<n>This linearity gives rise to code distance, the equivalence between erasures and general errors, and a theory ofally good codes.
  arXiv  Detail & Related papers  (2026-07-25T02:15:33Z)
• Latent Autoencoder Ensemble Kalman Filter for Data assimilation [11.379736533005532]
  We propose a latent autoencoder ensemble Kalman filter (LAE-EnKF) that addresses the assimilation problem in a learned latent space with linear and stable dynamics.<n>The proposed method learns a nonlinear encoder-decoder together with a stable linear latent evolution operator and a consistent latent observation mapping, yielding a closed linear state-space model in the latent coordinates.<n>Compared with existing autoencoder-based and latent assimilation approaches that rely on unconstrained nonlinear latent dynamics, the proposed formulation emphasizes structural consistency, stability, and interpretability.
  arXiv  Detail & Related papers  (2026-03-06T12:11:47Z)
• The Procrustean Bed of Time Series: The Optimization Bias of Point-wise Loss [53.542743390809356]
  This paper aims to provide a first-principles analysis of the Expectation of Optimization Bias (EOB)<n>Our analysis reveals a fundamental paradigm paradox: the more deterministic and structured the time series, the more severe the bias by point-wise loss function.<n>We present a concrete solution that simultaneously achieves both principles via DFT or DWT.
  arXiv  Detail & Related papers  (2025-12-21T06:08:22Z)
• Adaptive Conformal Inference by Betting [51.272991377903274]
  We consider the problem of adaptive conformal inference without any assumptions about the data generating process.<n>Existing approaches for adaptive conformal inference are based on optimizing the pinball loss using variants of online gradient descent.<n>We propose a different approach for adaptive conformal inference that leverages parameter-free online convex optimization techniques.
  arXiv  Detail & Related papers  (2024-12-26T18:42:08Z)
• Optimal Baseline Corrections for Off-Policy Contextual Bandits [61.740094604552475]
  We aim to learn decision policies that optimize an unbiased offline estimate of an online reward metric. We propose a single framework built on their equivalence in learning scenarios. Our framework enables us to characterize the variance-optimal unbiased estimator and provide a closed-form solution for it.
  arXiv  Detail & Related papers  (2024-05-09T12:52:22Z)
• Ensemble Kalman Filtering Meets Gaussian Process SSM for Non-Mean-Field and Online Inference [47.460898983429374]
  We introduce an ensemble Kalman filter (EnKF) into the non-mean-field (NMF) variational inference framework to approximate the posterior distribution of the latent states. This novel marriage between EnKF and GPSSM not only eliminates the need for extensive parameterization in learning variational distributions, but also enables an interpretable, closed-form approximation of the evidence lower bound (ELBO) We demonstrate that the resulting EnKF-aided online algorithm embodies a principled objective function by ensuring data-fitting accuracy while incorporating model regularizations to mitigate overfitting.
  arXiv  Detail & Related papers  (2023-12-10T15:22:30Z)
• Optimization or Architecture: How to Hack Kalman Filtering [52.640789351385266]
  In non-linear filtering, it is traditional to compare non-linear architectures such as neural networks to the standard linear Kalman Filter (KF) We argue that both should be optimized similarly, and to that end present the Optimized KF (OKF)
  arXiv  Detail & Related papers  (2023-10-01T14:00:18Z)
• Inverse Cubature and Quadrature Kalman filters [16.975704972827305]
  We develop inverse cubature KF (I-CKF), inverse quadrature KF (I-QKF), and inverse cubature-quadrature KF (I-CQKF) We derive the stability conditions for the proposed filters in the exponential-mean-squared-boundedness sense and prove the filters' consistency.
  arXiv  Detail & Related papers  (2023-03-18T03:48:39Z)
• Inverse Extended Kalman Filter -- Part II: Highly Non-Linear and Uncertain Systems [18.244578289687123]
  This paper proposes an inverse extended Kalman filter (I-EKF) to address the inverse filtering problem in non-linear systems. Part I: Theory of I-EKF (with and without unknown inputs) and I-KF (with unknown inputs) Part II: Theory of I-EKF (with and without unknown inputs) and I-KF (with unknown inputs)
  arXiv  Detail & Related papers  (2022-08-13T16:55:39Z)
• Inverse Extended Kalman Filter -- Part I: Fundamentals [19.078991171384015]
  In this paper, we develop the theory of inverse extended Kalman filter (I-EKF) in detail. We provide theoretical stability guarantees using both bounded non-linearity and unknown matrix approaches. In the companion paper (Part II), we propose reproducing kernel Hilbert space-based EKF to handle incomplete system model information.
  arXiv  Detail & Related papers  (2022-01-05T10:56:58Z)
• Learning to Estimate Without Bias [57.82628598276623]
  Gauss theorem states that the weighted least squares estimator is a linear minimum variance unbiased estimation (MVUE) in linear models. In this paper, we take a first step towards extending this result to non linear settings via deep learning with bias constraints. A second motivation to BCE is in applications where multiple estimates of the same unknown are averaged for improved performance.
  arXiv  Detail & Related papers  (2021-10-24T10:23:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.