Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet

• URL: http://arxiv.org/abs/2411.16930v1
• Date: Mon, 25 Nov 2024 20:59:14 GMT
• Title: Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet
• Authors: Arian Mehrfard, Bharanidhar Duraisamy, Stefan Haag, Florian Geiss,
• Abstract summary: Kalman Filters (KF) are fundamental to real-time state estimation applications. In this work, one prevalent model, KalmanNet, was selected and evaluated on automotive radar data to assess its performance under real-world conditions. Results demonstrate that KalmanNet is outperformed by the IMM filter and indicate that while data-driven methods such as KalmanNet show promise, their current lack of reliability and robustness makes them unsuited for safety-critical applications.
• Score: 0.26665679188139185
• License:
• Abstract: Kalman Filters (KF) are fundamental to real-time state estimation applications, including radar-based tracking systems used in modern driver assistance and safety technologies. In a linear dynamical system with Gaussian noise distributions the KF is the optimal estimator. However, real-world systems often deviate from these assumptions. This deviation combined with the success of deep learning across many disciplines has prompted the exploration of data driven approaches that leverage deep learning for filtering applications. These learned state estimators are often reported to outperform traditional model based systems. In this work, one prevalent model, KalmanNet, was selected and evaluated on automotive radar data to assess its performance under real-world conditions and compare it to an interacting multiple models (IMM) filter. The evaluation is based on raw and normalized errors as well as the state uncertainty. The results demonstrate that KalmanNet is outperformed by the IMM filter and indicate that while data-driven methods such as KalmanNet show promise, their current lack of reliability and robustness makes them unsuited for safety-critical applications.

Related papers

• Federated Data-Driven Kalman Filtering for State Estimation [49.40531019551957]
  This paper proposes a novel localization framework based on collaborative training or federated learning paradigm. We build on the standard approach of KalmanNet, a recurrent neural network aiming to estimate the underlying system uncertainty of traditional Extended Kalman Filtering. FedKalmanNet is used by each vehicle to localize itself, by estimating the associated system uncertainty matrices.
  arXiv  Detail & Related papers  (2024-11-06T16:18:33Z)
• Data-driven Bayesian State Estimation with Compressed Measurement of Model-free Process using Semi-supervised Learning [57.04370580292727]
  The research topic is: data-driven Bayesian state estimation with compressed measurement (BSCM) of model-free process. The dimension of the temporal measurement vector is lower than the dimension of the temporal state vector to be estimated. Two existing unsupervised learning-based data-driven methods fail to address the BSCM problem for model-free process. We develop a semi-supervised learning-based DANSE method, referred to as SemiDANSE.
  arXiv  Detail & Related papers  (2024-07-10T05:03:48Z)
• Outlier-robust Kalman Filtering through Generalised Bayes [45.51425214486509]
  We derive a novel, provably robust, and closed-form Bayesian update rule for online filtering in state-space models. Our method matches or outperforms other robust filtering methods at a much lower computational cost.
  arXiv  Detail & Related papers  (2024-05-09T09:40:56Z)
• Outlier-Insensitive Kalman Filtering: Theory and Applications [26.889182816155838]
  We propose a parameter-free algorithm which mitigates harmful effect of outliers while requiring only a short iterative process of the standard update step of the linear Kalman filter.
  arXiv  Detail & Related papers  (2023-09-18T06:33:28Z)
• Unsupervised Learned Kalman Filtering [84.18625250574853]
  unsupervised adaptation is achieved by exploiting the hybrid model-based/data-driven architecture of KalmanNet. We numerically demonstrate that when the noise statistics are unknown, unsupervised KalmanNet achieves a similar performance to KalmanNet with supervised learning.
  arXiv  Detail & Related papers  (2021-10-18T04:04:09Z)
• Uncertainty in Data-Driven Kalman Filtering for Partially Known State-Space Models [84.18625250574853]
  We investigate the ability of KalmanNet, a proposed hybrid model-based deep state tracking algorithm, to estimate an uncertainty measure. We show that the error covariance matrix can be computed based on its internal features, as an uncertainty measure. We demonstrate that when the system dynamics are known, KalmanNet-which learns its mapping from data without access to the statistics-provides uncertainty similar to that provided by the Kalman filter.
  arXiv  Detail & Related papers  (2021-10-10T08:52:18Z)
• KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics [84.18625250574853]
  We present KalmanNet, a real-time state estimator that learns from data to carry out Kalman filtering under non-linear dynamics. We numerically demonstrate that KalmanNet overcomes nonlinearities and model mismatch, outperforming classic filtering methods.
  arXiv  Detail & Related papers  (2021-07-21T12:26:46Z)
• Out-of-Distribution Detection for Automotive Perception [58.34808836642603]
  Neural networks (NNs) are widely used for object classification in autonomous driving. NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. This paper presents a method for determining whether inputs are OOD, which does not require OOD data during training and does not increase the computational cost of inference.
  arXiv  Detail & Related papers  (2020-11-03T01:46:35Z)
• SDVTracker: Real-Time Multi-Sensor Association and Tracking for Self-Driving Vehicles [11.317136648551537]
  We present a practical and lightweight tracking system, SDVTracker, that uses a deep learned model for association and state estimation. We show this system significantly outperforms hand-engineered methods on a real-world urban driving dataset while running in less than 2.5 ms on CPU for a scene with 100 actors.
  arXiv  Detail & Related papers  (2020-03-09T23:07:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.