Attention-Bayesian Hybrid Approach to Modular Multiple Particle Tracking

• URL: http://arxiv.org/abs/2506.09441v1
• Date: Wed, 11 Jun 2025 06:47:37 GMT
• Title: Attention-Bayesian Hybrid Approach to Modular Multiple Particle Tracking
• Authors: Piyush Mishra, Philippe Roudot,
• Abstract summary: We introduce a hybrid tracking framework that combines the ability of self-attention to learn the underlying representation of particle behavior with the reliability and interpretability of Bayesian filtering.<n>Our approach demonstrates improved tracking accuracy and robustness against spurious detections, offering a solution for high clutter multiple particle tracking scenarios.
• Score: 0.845772524399978
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Tracking multiple particles in noisy and cluttered scenes remains challenging due to a combinatorial explosion of trajectory hypotheses, which scales super-exponentially with the number of particles and frames. The transformer architecture has shown a significant improvement in robustness against this high combinatorial load. However, its performance still falls short of the conventional Bayesian filtering approaches in scenarios presenting a reduced set of trajectory hypothesis. This suggests that while transformers excel at narrowing down possible associations, they may not be able to reach the optimality of the Bayesian approach in locally sparse scenario. Hence, we introduce a hybrid tracking framework that combines the ability of self-attention to learn the underlying representation of particle behavior with the reliability and interpretability of Bayesian filtering. We perform trajectory-to-detection association by solving a label prediction problem, using a transformer encoder to infer soft associations between detections across frames. This prunes the hypothesis set, enabling efficient multiple-particle tracking in Bayesian filtering framework. Our approach demonstrates improved tracking accuracy and robustness against spurious detections, offering a solution for high clutter multiple particle tracking scenarios.

Related papers

• Multi-Agent Path Finding in Continuous Spaces with Projected Diffusion Models [57.45019514036948]
  Multi-Agent Path Finding (MAPF) is a fundamental problem in robotics.<n>This work proposes a novel approach that integrates constrained optimization with diffusion models for MAPF in continuous spaces.
  arXiv  Detail & Related papers  (2024-12-23T21:27:19Z)
• DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions [52.63323657077447]
  We propose DNMOT, an end-to-end trainable DeNoising Transformer for multiple object tracking. Specifically, we augment the trajectory with noises during training and make our model learn the denoising process in an encoder-decoder architecture. We conduct extensive experiments on the MOT17, MOT20, and DanceTrack datasets, and the experimental results show that our method outperforms previous state-of-the-art methods by a clear margin.
  arXiv  Detail & Related papers  (2023-09-09T04:40:01Z)
• Provable Guarantees for Generative Behavior Cloning: Bridging Low-Level Stability and High-Level Behavior [51.60683890503293]
  We propose a theoretical framework for studying behavior cloning of complex expert demonstrations using generative modeling. We show that pure supervised cloning can generate trajectories matching the per-time step distribution of arbitrary expert trajectories.
  arXiv  Detail & Related papers  (2023-07-27T04:27:26Z)
• Variational Bayes for robust radar single object tracking [5.390933335965428]
  We address object tracking by radar and the robustness of the current state-of-the-art methods to process outliers. We take the Gaussian Sum Filter as our baseline and propose a modification by modelling process noise with a distribution that has heavier tails than a Gaussian. Our simulations show that - in the presence of process outliers - the robust tracker outperforms the Gaussian Sum filter when tracking single objects.
  arXiv  Detail & Related papers  (2022-09-28T19:41:33Z)
• Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding [121.66374635092097]
  Trajectories obtained from object detection and tracking are inevitably noisy. We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
  arXiv  Detail & Related papers  (2022-02-03T09:09:56Z)
• Multiple target tracking with interaction using an MCMC MRF Particle Filter [0.0]
  This paper presents and discusses an implementation of a multiple target tracking method. The referenced approach uses a Markov Chain Monte Carlo (MCMC) sampling step to evaluate the filter and constructs an efficient proposal density to generate new samples. It is shown that the implemented approach of modeling target interactions using MRF successfully corrects many of the tracking errors made by the independent, interaction unaware, particle filters.
  arXiv  Detail & Related papers  (2021-11-25T17:32:50Z)
• THOMAS: Trajectory Heatmap Output with learned Multi-Agent Sampling [2.424910201171407]
  We present a unified model architecture for fast and simultaneous agent future heatmap estimation. generating scene-consistent predictions goes beyond the mere generation of collision-free trajectories. We report our results on the Interaction multi-agent prediction challenge and rank $1st$ on the online test leaderboard.
  arXiv  Detail & Related papers  (2021-10-13T10:05:47Z)
• Deep Convolutional Correlation Iterative Particle Filter for Visual Tracking [1.1531505895603305]
  This work proposes a novel framework for visual tracking based on the integration of an iterative particle filter, a deep convolutional neural network, and a correlation filter. We employ a novel strategy to assess the likelihood of the particles after the iterations by applying K-means clustering. Experimental results on two different benchmark datasets show that our tracker performs favorably against state-of-the-art methods.
  arXiv  Detail & Related papers  (2021-07-07T02:44:43Z)
• Probabilistic Ranking-Aware Ensembles for Enhanced Object Detections [50.096540945099704]
  We propose a novel ensemble called the Probabilistic Ranking Aware Ensemble (PRAE) that refines the confidence of bounding boxes from detectors. We also introduce a bandit approach to address the confidence imbalance problem caused by the need to deal with different numbers of boxes.
  arXiv  Detail & Related papers  (2021-05-07T09:37:06Z)
• Haar Wavelet based Block Autoregressive Flows for Trajectories [129.37479472754083]
  Prediction of trajectories such as that of pedestrians is crucial to the performance of autonomous agents. We introduce a novel Haar wavelet based block autoregressive model leveraging split couplings. We illustrate the advantages of our approach for generating diverse and accurate trajectories on two real-world datasets.
  arXiv  Detail & Related papers  (2020-09-21T13:57:10Z)
• Deep Convolutional Likelihood Particle Filter for Visual Tracking [0.7424262881242935]
  We propose a novel particle filter for convolutional-correlation visual trackers. Our method uses correlation response maps to estimate likelihood distributions. Our framework outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-06-11T19:02:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.