DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation

• URL: http://arxiv.org/abs/2404.16558v1
• Date: Thu, 25 Apr 2024 12:15:11 GMT
• Title: DeepKalPose: An Enhanced Deep-Learning Kalman Filter for Temporally Consistent Monocular Vehicle Pose Estimation
• Authors: Leandro Di Bella, Yangxintong Lyu, Adrian Munteanu,
• Abstract summary: DeepKalPose is a novel approach for enhancing temporal consistency in monocular vehicle pose estimation applied on video through a deep-learning-based Kalman Filter. Our method significantly improves pose accuracy and robustness across various conditions, particularly for occluded or distant vehicles.
• Score: 6.483509903853654
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: This paper presents DeepKalPose, a novel approach for enhancing temporal consistency in monocular vehicle pose estimation applied on video through a deep-learning-based Kalman Filter. By integrating a Bi-directional Kalman filter strategy utilizing forward and backward time-series processing, combined with a learnable motion model to represent complex motion patterns, our method significantly improves pose accuracy and robustness across various conditions, particularly for occluded or distant vehicles. Experimental validation on the KITTI dataset confirms that DeepKalPose outperforms existing methods in both pose accuracy and temporal consistency.

Related papers

• Long-time accuracy of ensemble Kalman filters for chaotic and machine-learned dynamical systems [2.5245286741414663]
  This paper establishes long-time accuracy of ensemble Kalman filters. Our theory covers a wide class of partially-observed chaotic dynamical systems. We prove long-time accuracy of ensemble Kalman filters with surrogate dynamics.
  arXiv  Detail & Related papers  (2024-12-18T20:35:21Z)
• Performance Evaluation of Deep Learning-Based State Estimation: A Comparative Study of KalmanNet [0.26665679188139185]
  Kalman Filters (KF) are fundamental to real-time state estimation applications. In this work, one prevalent model, KalmanNet, was selected and evaluated on automotive radar data to assess its performance under real-world conditions. Results demonstrate that KalmanNet is outperformed by the IMM filter and indicate that while data-driven methods such as KalmanNet show promise, their current lack of reliability and robustness makes them unsuited for safety-critical applications.
  arXiv  Detail & Related papers  (2024-11-25T20:59:14Z)
• KFD-NeRF: Rethinking Dynamic NeRF with Kalman Filter [49.85369344101118]
  We introduce KFD-NeRF, a novel dynamic neural radiance field integrated with an efficient and high-quality motion reconstruction framework based on Kalman filtering. Our key idea is to model the dynamic radiance field as a dynamic system whose temporally varying states are estimated based on two sources of knowledge: observations and predictions. Our KFD-NeRF demonstrates similar or even superior performance within comparable computational time and state-of-the-art view synthesis performance with thorough training.
  arXiv  Detail & Related papers  (2024-07-18T05:48:24Z)
• 4-Dimensional deformation part model for pose estimation using Kalman filter constraints [0.0]
  The main goal of this article is to analyze the effect on pose estimation accuracy when using a Kalman filter added to 4-dimensional deformation part model partial solutions. The experiments run with two data sets showing that this method improves pose estimation accuracy compared with state-of-the-art methods and that a Kalman filter helps to increase this accuracy.
  arXiv  Detail & Related papers  (2024-02-07T15:37:17Z)
• Split-KalmanNet: A Robust Model-Based Deep Learning Approach for SLAM [101.32324781612172]
  Simultaneous localization and mapping (SLAM) is a method that constructs a map of an unknown environment and localizes the position of a moving agent on the map simultaneously. Extended Kalman filter (EKF) has been widely adopted as a low complexity solution for online SLAM. We present a robust EKF algorithm using the power of deep learning for online SLAM, referred to as Split-KalmanNet.
  arXiv  Detail & Related papers  (2022-10-18T07:10:38Z)
• A Look at Improving Robustness in Visual-inertial SLAM by Moment Matching [17.995121900076615]
  This paper takes a critical look at the practical implications and limitations posed by the extended Kalman filter (EKF) We employ a moment matching (unscented Kalman filtering) approach to both visual-inertial odometry and visual SLAM.
  arXiv  Detail & Related papers  (2022-05-27T08:22:03Z)
• A Model for Multi-View Residual Covariances based on Perspective Deformation [88.21738020902411]
  We derive a model for the covariance of the visual residuals in multi-view SfM, odometry and SLAM setups. We validate our model with synthetic and real data and integrate it into photometric and feature-based Bundle Adjustment.
  arXiv  Detail & Related papers  (2022-02-01T21:21:56Z)
• KalmanNet: Neural Network Aided Kalman Filtering for Partially Known Dynamics [84.18625250574853]
  We present KalmanNet, a real-time state estimator that learns from data to carry out Kalman filtering under non-linear dynamics. We numerically demonstrate that KalmanNet overcomes nonlinearities and model mismatch, outperforming classic filtering methods.
  arXiv  Detail & Related papers  (2021-07-21T12:26:46Z)
• Layer Pruning on Demand with Intermediate CTC [50.509073206630994]
  We present a training and pruning method for ASR based on the connectionist temporal classification (CTC) We show that a Transformer-CTC model can be pruned in various depth on demand, improving real-time factor from 0.005 to 0.002 on GPU.
  arXiv  Detail & Related papers  (2021-06-17T02:40:18Z)
• A Plug-and-play Scheme to Adapt Image Saliency Deep Model for Video Data [54.198279280967185]
  This paper proposes a novel plug-and-play scheme to weakly retrain a pretrained image saliency deep model for video data. Our method is simple yet effective for adapting any off-the-shelf pre-trained image saliency deep model to obtain high-quality video saliency detection.
  arXiv  Detail & Related papers  (2020-08-02T13:23:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.