Adaptive Learned State Estimation based on KalmanNet

• URL: http://arxiv.org/abs/2604.02441v1
• Date: Thu, 02 Apr 2026 18:12:40 GMT
• Title: Adaptive Learned State Estimation based on KalmanNet
• Abstract summary: Adaptive Multi-modal KalmanNet (AM-KNet) is an advancement of KalmanNet tailored to the multi-sensor autonomous driving setting.<n>AM-KNet introduces sensor-specific measurement modules that enable the network to learn the distinct noise characteristics of radar, lidar, and camera independently.<n>Results demonstrate improved estimation accuracy and tracking stability compared to the base KalmanNet.
• Score: 0.38290014221246177
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Hybrid state estimators that combine model-based Kalman filtering with learned components have shown promise on simulated data, yet their performance on real-world automotive data remains insufficient. In this work we present Adaptive Multi-modal KalmanNet (AM-KNet), an advancement of KalmanNet tailored to the multi-sensor autonomous driving setting. AM-KNet introduces sensor-specific measurement modules that enable the network to learn the distinct noise characteristics of radar, lidar, and camera independently. A hypernetwork with context modulation conditions the filter on target type, motion state, and relative pose, allowing adaptation to diverse traffic scenarios. We further incorporate a covariance estimation branch based on the Josephs form and supervise it through negative log-likelihood losses on both the estimation error and the innovation. A comprehensive, component-wise loss function encodes physical priors on sensor reliability, target class, motion state, and measurement flow consistency. AM-KNet is trained and evaluated on the nuScenes and View-of-Delft datasets. The results demonstrate improved estimation accuracy and tracking stability compared to the base KalmanNet, narrowing the performance gap with classical Bayesian filters on real-world automotive data.

Related papers

• Uncertainty-Aware Adaptive Sensor Fusion for Autonomous Navigation [0.0]
  This work introduces a hybrid deep learning approach integrated with an Unscented Kalman Filter (UKF) to enhance pose estimation accuracy in Visual-Inertial Odometry (VIO) for autonomous navigation.<n>The proposed model employs a Vision Transformer (ViT) network to effectively capture temporal dependencies from inertial measurement unit (IMU) data.<n>A novel uncertainty-aware loss function is proposed to explicitly incorporate prediction uncertainty into the learning process, enabling robust and accurate navigation under noisy, incomplete, or unreliable sensor inputs.
  arXiv  Detail & Related papers  (2026-06-03T20:59:42Z)
• Distributed Kalman--Consensus Filtering with Adaptive Uncertainty Weighting for Multi-Object Tracking in Mobile Robot Networks [2.536160127321797]
  This paper presents an implementation and evaluation of a Distributed Kalman--Consensus Filter (DKCF) for Multi-Object Tracking (MOT) in mobile robot networks.<n>A key challenge in such systems is the fusion of information from agents with differing localization quality.<n>We propose an uncertainty-aware adaptive consensus weighting mechanism that dynamically adjusts the influence of neighbor information.
  arXiv  Detail & Related papers  (2026-03-11T21:41:10Z)
• Q-Net: Transferable Queue Length Estimation via Kalman-based Neural Networks [16.815532601851217]
  Estimating queue lengths at signalized intersections remains a challenge in traffic management.<n>This paper introduces Q-Net, a data-efficient and interpretable framework for queue length estimation.<n>Q-Net integrates two widely available and privacy-friendly data sources.
  arXiv  Detail & Related papers  (2025-09-29T12:51:08Z)
• Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet [0.26665679188139185]
  Kalman Filters (KF) are fundamental to real-time state estimation applications. In this work, one prevalent model, KalmanNet, was selected and evaluated on automotive radar data to assess its performance under real-world conditions. Results demonstrate that KalmanNet is outperformed by the IMM filter and indicate that while data-driven methods such as KalmanNet show promise, their current lack of reliability and robustness makes them unsuited for safety-critical applications.
  arXiv  Detail & Related papers  (2024-11-25T20:59:14Z)
• Federated Data-Driven Kalman Filtering for State Estimation [49.40531019551957]
  This paper proposes a novel localization framework based on collaborative training or federated learning paradigm.<n>We build on the standard approach of KalmanNet, a recurrent neural network aiming to estimate the underlying system uncertainty of traditional Extended Kalman Filtering.<n>FedKalmanNet is used by each vehicle to localize itself, by estimating the associated system uncertainty matrices.
  arXiv  Detail & Related papers  (2024-11-06T16:18:33Z)
• Towards better traffic volume estimation: Jointly addressing the underdetermination and nonequilibrium problems with correlation-adaptive GNNs [47.18837782862979]
  This paper studies two key problems with regard to traffic volume estimation: (1) underdetermined traffic flows caused by undetected movements, and (2) non-equilibrium traffic flows arise from congestion propagation. We demonstrate a graph-based deep learning method that can offer a data-driven, model-free and correlation adaptive approach to tackle the above issues.
  arXiv  Detail & Related papers  (2023-03-10T02:22:33Z)
• Split-KalmanNet: A Robust Model-Based Deep Learning Approach for SLAM [101.32324781612172]
  Simultaneous localization and mapping (SLAM) is a method that constructs a map of an unknown environment and localizes the position of a moving agent on the map simultaneously. Extended Kalman filter (EKF) has been widely adopted as a low complexity solution for online SLAM. We present a robust EKF algorithm using the power of deep learning for online SLAM, referred to as Split-KalmanNet.
  arXiv  Detail & Related papers  (2022-10-18T07:10:38Z)
• Unsupervised Learned Kalman Filtering [84.18625250574853]
  unsupervised adaptation is achieved by exploiting the hybrid model-based/data-driven architecture of KalmanNet. We numerically demonstrate that when the noise statistics are unknown, unsupervised KalmanNet achieves a similar performance to KalmanNet with supervised learning.
  arXiv  Detail & Related papers  (2021-10-18T04:04:09Z)
• Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models [84.18625250574853]
  We investigate the ability of KalmanNet, a proposed hybrid model-based deep state tracking algorithm, to estimate an uncertainty measure. We show that the error covariance matrix can be computed based on its internal features, as an uncertainty measure. We demonstrate that when the system dynamics are known, KalmanNet-which learns its mapping from data without access to the statistics-provides uncertainty similar to that provided by the Kalman filter.
  arXiv  Detail & Related papers  (2021-10-10T08:52:18Z)
• KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics [84.18625250574853]
  We present KalmanNet, a real-time state estimator that learns from data to carry out Kalman filtering under non-linear dynamics. We numerically demonstrate that KalmanNet overcomes nonlinearities and model mismatch, outperforming classic filtering methods.
  arXiv  Detail & Related papers  (2021-07-21T12:26:46Z)
• Firearm Detection via Convolutional Neural Networks: Comparing a Semantic Segmentation Model Against End-to-End Solutions [68.8204255655161]
  Threat detection of weapons and aggressive behavior from live video can be used for rapid detection and prevention of potentially deadly incidents. One way for achieving this is through the use of artificial intelligence and, in particular, machine learning for image analysis. We compare a traditional monolithic end-to-end deep learning model and a previously proposed model based on an ensemble of simpler neural networks detecting fire-weapons via semantic segmentation.
  arXiv  Detail & Related papers  (2020-12-17T15:19:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.