Neural Enhanced Belief Propagation for Data Assocation in Multiobject
Tracking
- URL: http://arxiv.org/abs/2203.09948v1
- Date: Thu, 17 Mar 2022 00:12:48 GMT
- Title: Neural Enhanced Belief Propagation for Data Assocation in Multiobject
Tracking
- Authors: Mingchao Liang and Florian Meyer
- Abstract summary: Multiobject tracking (MOT) will create new services and applications in fields such as autonomous navigation and applied ocean sciences.
Belief propagation (BP) is a state-of-the-art method for Bayesian MOT but fully relies on a statistical model and preprocessed sensor measurements.
We establish a hybrid method for model-based and data-driven MOT. The proposed neural enhanced belief propagation (NEBP) approach complements BP by information learned from raw sensor data.
We evaluate the performance of our NEBP approach for MOT on the nuScenes autonomous driving dataset and demonstrate that it can outperform state-of-
- Score: 8.228150100178983
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Situation-aware technologies enabled by multiobject tracking (MOT) methods
will create new services and applications in fields such as autonomous
navigation and applied ocean sciences. Belief propagation (BP) is a
state-of-the-art method for Bayesian MOT but fully relies on a statistical
model and preprocessed sensor measurements. In this paper, we establish a
hybrid method for model-based and data-driven MOT. The proposed neural enhanced
belief propagation (NEBP) approach complements BP by information learned from
raw sensor data with the goal to improve data association and to reject false
alarm measurements. We evaluate the performance of our NEBP approach for MOT on
the nuScenes autonomous driving dataset and demonstrate that it can outperform
state-of-the-art reference methods.
Related papers
- A New Architecture for Neural Enhanced Multiobject Tracking [4.7752948351582605]
Multiobject tracking is an important task in robotics, autonomous driving, and maritime surveillance.
Traditional work on MOT is model-based and aims to establish algorithms in the framework of sequential Bayesian estimation.
More recent methods are fully data-driven and rely on the training of neural networks.
This paper advances a recently introduced hybrid model-based and data-driven method called neural-enhanced belief propagation (NEBP)
arXiv Detail & Related papers (2024-10-08T18:53:45Z) - Data-driven Bayesian State Estimation with Compressed Measurement of Model-free Process using Semi-supervised Learning [57.04370580292727]
The research topic is: data-driven Bayesian state estimation with compressed measurement (BSCM) of model-free process.
The dimension of the temporal measurement vector is lower than the dimension of the temporal state vector to be estimated.
Two existing unsupervised learning-based data-driven methods fail to address the BSCM problem for model-free process.
We develop a semi-supervised learning-based DANSE method, referred to as SemiDANSE.
arXiv Detail & Related papers (2024-07-10T05:03:48Z) - Physics Inspired Hybrid Attention for SAR Target Recognition [61.01086031364307]
We propose a physics inspired hybrid attention (PIHA) mechanism and the once-for-all (OFA) evaluation protocol to address the issues.
PIHA leverages the high-level semantics of physical information to activate and guide the feature group aware of local semantics of target.
Our method outperforms other state-of-the-art approaches in 12 test scenarios with same ASC parameters.
arXiv Detail & Related papers (2023-09-27T14:39:41Z) - Exploiting Multimodal Synthetic Data for Egocentric Human-Object
Interaction Detection in an Industrial Scenario [14.188006024550257]
EgoISM-HOI is a new multimodal dataset composed of synthetic EHOI images in an industrial environment with rich annotations of hands and objects.
Our study shows that exploiting synthetic data to pre-train the proposed method significantly improves performance when tested on real-world data.
To support research in this field, we publicly release the datasets, source code, and pre-trained models at https://iplab.dmi.unict.it/egoism-hoi.
arXiv Detail & Related papers (2023-06-21T09:56:55Z) - MAPS: A Noise-Robust Progressive Learning Approach for Source-Free
Domain Adaptive Keypoint Detection [76.97324120775475]
Cross-domain keypoint detection methods always require accessing the source data during adaptation.
This paper considers source-free domain adaptive keypoint detection, where only the well-trained source model is provided to the target domain.
arXiv Detail & Related papers (2023-02-09T12:06:08Z) - Estimation of Sea State Parameters from Ship Motion Responses Using
Attention-based Neural Networks [0.6193838300896448]
We apply the novel attention-based neural network (AT-NN) for estimating sea state parameters from raw time-series data of ship pitch, heave, and roll motions.
It has been successfully demonstrated that the proposed approaches by modified state-of-the-art techniques reduced estimation MSE by 23% and MAE by 16% compared to the original methods.
arXiv Detail & Related papers (2023-01-21T13:21:50Z) - Neural Enhanced Belief Propagation for Multiobject Tracking [8.228150100178983]
We introduce a variant of BP that combines model-based with data-driven MOT.
Our NEBP method improves tracking performance compared to model-based methods.
We evaluate the performance of our NEBP approach for MOT on the nuScenes autonomous driving dataset.
arXiv Detail & Related papers (2022-12-16T08:31:07Z) - Dynamic Bottleneck for Robust Self-Supervised Exploration [84.78836146128236]
We propose a Dynamic Bottleneck (DB) model, which attains a dynamics-relevant representation based on the information-bottleneck principle.
Based on the DB model, we further propose DB-bonus, which encourages the agent to explore state-action pairs with high information gain.
Our experiments show that exploration with DB bonus outperforms several state-of-the-art exploration methods in noisy environments.
arXiv Detail & Related papers (2021-10-20T19:17:05Z) - DEALIO: Data-Efficient Adversarial Learning for Imitation from
Observation [57.358212277226315]
In imitation learning from observation IfO, a learning agent seeks to imitate a demonstrating agent using only observations of the demonstrated behavior without access to the control signals generated by the demonstrator.
Recent methods based on adversarial imitation learning have led to state-of-the-art performance on IfO problems, but they typically suffer from high sample complexity due to a reliance on data-inefficient, model-free reinforcement learning algorithms.
This issue makes them impractical to deploy in real-world settings, where gathering samples can incur high costs in terms of time, energy, and risk.
We propose a more data-efficient IfO algorithm
arXiv Detail & Related papers (2021-03-31T23:46:32Z) - Incorporating Kinematic Wave Theory into a Deep Learning Method for
High-Resolution Traffic Speed Estimation [3.0969191504482243]
We propose a kinematic wave based Deep Convolutional Neural Network (Deep CNN) to estimate high resolution traffic speed dynamics from sparse probe vehicle trajectories.
We introduce two key approaches that allow us to incorporate kinematic wave theory principles to improve the robustness of existing learning-based estimation methods.
arXiv Detail & Related papers (2021-02-04T21:51:25Z) - Deep Learning based Pedestrian Inertial Navigation: Methods, Dataset and
On-Device Inference [49.88536971774444]
Inertial measurements units (IMUs) are small, cheap, energy efficient, and widely employed in smart devices and mobile robots.
Exploiting inertial data for accurate and reliable pedestrian navigation supports is a key component for emerging Internet-of-Things applications and services.
We present and release the Oxford Inertial Odometry dataset (OxIOD), a first-of-its-kind public dataset for deep learning based inertial navigation research.
arXiv Detail & Related papers (2020-01-13T04:41:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.