The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery

• URL: http://arxiv.org/abs/2605.26830v1
• Date: Tue, 26 May 2026 10:50:40 GMT
• Title: The Kalman Evolve: Closing the Gap in Kalman Filtering via Interpretable Algorithm Discovery
• Abstract summary: We propose a framework for discovering improved filtering algorithms by jointly optimizing both noise parameters and the update structure.<n>Our approach leverages large language models (LLMs) as a structured prior over program space, enabling the generation of interpretable, non-affine modifications to the classical Kalman filter.
• Score: 9.728186043117896
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: State estimation is a fundamental problem in control and signal processing, for which the Kalman Filter provides an optimal solution under linear dynamics, Gaussian noise, and known noise covariances. However, these assumptions often fail in realistic sensing settings such as Doppler radar and LiDAR. In these cases, the optimal estimator is inherently nonlinear, which leads to systematic performance degradation. This creates a performance gap that cannot be eliminated by tuning the noise covariance parameters (i.e., the process and measurement noise in the Kalman Filter) alone. To address this limitation, we propose Kalman Evolve, a framework for discovering improved filtering algorithms by jointly optimizing both noise parameters and the update structure. Our approach leverages large language models (LLMs) as a structured prior over program space, enabling the generation of interpretable, non-affine modifications to the classical Kalman filter while preserving its recursive form. We provide analytical results establishing the suboptimality of affine estimators under common nonlinear sensing models, motivating the need for structure-aware updates. Across a range of synthetic and real-world tracking benchmarks, including Doppler radar, LiDAR-based localization, and pedestrian tracking, the discovered algorithms consistently improve over strong baselines such as the Optimized Kalman Filter, achieving up to 12\% reduction in RMSE. These results suggest that optimizing the structure of the Kalman filter, rather than only its parameters, provides a practical and interpretable way to improve state estimation.

Related papers

• Hierarchical Variational Kalman Filtering [10.170725007933703]
  We introduce a surrogate variable representing the process-noise-free state, which enables explicit modeling and inference of process noise statistics.<n>We reformulate the conventional coordinate ascent variation inference (CAVI) as a marginalized maximum a posteriori problem.
  arXiv  Detail & Related papers  (2026-07-01T12:38:41Z)
• Closed-Form Spectral Regularization for Multi-Task Model Merging [96.82449201305234]
  Model merging combines several independently fine-tuned experts into a single multi-task model without any training data.<n>State-of-the-art merging methods formulate merging as a layer-wise interference problem.<n>We propose SWUDI, a closed-form method that combines a soft exponential filter, which matches the gradient-flow trajectory of iterative descent.
  arXiv  Detail & Related papers  (2026-06-05T14:00:47Z)
• Gradient-Free Noise Optimization for Reward Alignment in Generative Models [52.42087778653147]
  ZeNO is a gradient-free framework that formulates noise optimization as a path-integral control problem.<n>It enables effective inference-time scaling and demonstrates strong performance across diverse generators and reward functions.
  arXiv  Detail & Related papers  (2026-05-12T00:05:36Z)
• Neural Aided Adaptive Innovation-Based Invariant Kalman Filter [6.037383467521294]
  We propose a neural network that estimates the process noise covariance parameters directly from raw inertial data.<n>Trained entirely in a sim2real framework via domain adaptation, the network captures motion-dependent and sensor-dependent noise characteristics without requiring labeled real-world data.
  arXiv  Detail & Related papers  (2026-03-17T20:32:53Z)
• Recursive KalmanNet: Deep Learning-Augmented Kalman Filtering for State Estimation with Consistent Uncertainty Quantification [0.0]
  This paper introduces Recursive KalmanNet, a Kalman-filter-informed recurrent neural network designed for accurate state estimation.<n> Experiments with non-Gaussian measurement white noise demonstrate that our model outperforms both the conventional Kalman filter and an existing state-of-the-art deep learning based estimator.
  arXiv  Detail & Related papers  (2025-06-13T10:11:32Z)
• Neural optimal feedback control with local learning rules [67.5926699124528]
  A major problem in motor control is understanding how the brain plans and executes proper movements in the face of delayed and noisy stimuli. We introduce a novel online algorithm which combines adaptive Kalman filtering with a model free control approach.
  arXiv  Detail & Related papers  (2021-11-12T20:02:00Z)
• KOALA: A Kalman Optimization Algorithm with Loss Adaptivity [21.93777064606377]
  We show that when training neural networks the loss function changes over (it gradient) time due to the randomized selection of a subset of the samples.<n>We propose to consider the loss as a noisy observation with respect to some reference.<n>This interpretation of the loss allows us to adopt Kalman filtering as an gradient, as its formulation is designed to estimate unknown parameters from noisy measurements.
  arXiv  Detail & Related papers  (2021-07-07T16:13:57Z)
• Using Kalman Filter The Right Way: Noise Estimation Is Not Optimal [46.556605821252276]
  We show that even a seemingly small violation of KF assumptions can significantly modify the effective noise. We suggest a method to apply gradient-based optimization efficiently to the symmetric and positive-definite (SPD) parameters of KF.
  arXiv  Detail & Related papers  (2021-04-06T08:59:15Z)
• Neural Kalman Filtering [62.997667081978825]
  We show that a gradient-descent approximation to the Kalman filter requires only local computations with variance weighted prediction errors. We also show that it is possible under the same scheme to adaptively learn the dynamics model with a learning rule that corresponds directly to Hebbian plasticity.
  arXiv  Detail & Related papers  (2021-02-19T16:43:15Z)
• Self-Tuning Stochastic Optimization with Curvature-Aware Gradient Filtering [53.523517926927894]
  We explore the use of exact per-sample Hessian-vector products and gradients to construct self-tuning quadratics. We prove that our model-based procedure converges in noisy gradient setting. This is an interesting step for constructing self-tuning quadratics.
  arXiv  Detail & Related papers  (2020-11-09T22:07:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.