GNN-PMB: A Simple but Effective Online 3D Multi-Object Tracker without Bells and Whistles

• URL: http://arxiv.org/abs/2206.10255v1
• Date: Tue, 21 Jun 2022 11:01:49 GMT
• Title: GNN-PMB: A Simple but Effective Online 3D Multi-Object Tracker without Bells and Whistles
• Authors: Jianan Liu, Liping Bai, Yuxuan Xia, Tao Huang, Bing Zhu
• Abstract summary: Multi-object tracking (MOT) is crucial application in advanced driver assistance systems (ADAS) and autonomous driving (AD) systems. Most solutions to MOT are based on random vector Bayesian filters like global nearest neighbor (GNN) plus rule-based datasetal track maintenance. RFS Bayesian filters have been applied in MOT tasks for ADAS and AD systems recently, but their usefulness in the real traffic is open to doubt due to computational cost and implementation complexity.
• Score: 5.412903717011731
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multi-object tracking (MOT) is among crucial applications in modern advanced driver assistance systems (ADAS) and autonomous driving (AD) systems. Most solutions to MOT are based on random vector Bayesian filters like global nearest neighbor (GNN) plus rule-based heuristical track maintenance. With the development of random finite set (RFS) theory, the RFS Bayesian filters have been applied in MOT tasks for ADAS and AD systems recently. However, their usefulness in the real traffic is open to doubt due to computational cost and implementation complexity. In this paper, it is revealed that GNN with rule-based heuristic track maintenance is insufficient for LiDAR-based MOT tasks in ADAS and AD systems. This judgement is illustrated by systematically comparing several different multi-point object filter-based tracking frameworks, including traditional random vector Bayesian filters with rule-based heuristical track maintenance and RFS Bayesian filters. Moreover, a simple and effective tracker, namely Poisson multi-Bernoulli filter using global nearest neighbor (GNN-PMB) tracker, is proposed for LiDAR-based MOT tasks. The proposed GNN-PMB tracker achieves competitive results in nuScenes test dataset, and shows superior tracking performance over other state-of-the-art LiDAR only trackers and LiDAR and camera fusion-based trackers.

Related papers

• OptiPMB: Enhancing 3D Multi-Object Tracking with Optimized Poisson Multi-Bernoulli Filtering [16.047505930360202]
  We present OptiPMB, a novel RFS-based 3D MOT method that employs an optimized Poisson multi-Bernoulli filter. We show that OptiPMB achieves superior tracking accuracy compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2025-03-17T09:24:26Z)
• Beyond Kalman Filters: Deep Learning-Based Filters for Improved Object Tracking [3.5693768338940304]
  We propose two innovative data-driven filtering methods for tracking-by-detection systems. The first method employs a Bayesian filter with a trainable motion model to predict an object's future location. The second method, an end-to-end trainable filter, goes a step further by learning to correct detector errors.
  arXiv  Detail & Related papers  (2024-02-15T10:47:44Z)
• Unsupervised Domain Adaptation for Self-Driving from Past Traversal Features [69.47588461101925]
  We propose a method to adapt 3D object detectors to new driving environments. Our approach enhances LiDAR-based detection models using spatial quantized historical features. Experiments on real-world datasets demonstrate significant improvements.
  arXiv  Detail & Related papers  (2023-09-21T15:00:31Z)
• SOMPT22: A Surveillance Oriented Multi-Pedestrian Tracking Dataset [5.962184741057505]
  We introduce SOMPT22 dataset; a new set for multi person tracking with annotated short videos captured from static cameras located on poles with 6-8 meters in height positioned for city surveillance. We analyze MOT trackers classified as one-shot and two-stage with respect to the way of use of detection and reID networks on this new dataset. The experimental results of our new dataset indicate that SOTA is still far from high efficiency, and single-shot trackers are good candidates to unify fast execution and accuracy with competitive performance.
  arXiv  Detail & Related papers  (2022-08-04T11:09:19Z)
• Interaction-Aware Labeled Multi-Bernoulli Filter [5.255783459833821]
  We present a novel approach to incorporate target interactions within the prediction step of an RFS-based multi-target filter. The method has been developed for two practical applications of tracking a coordinated swarm and vehicles.
  arXiv  Detail & Related papers  (2022-04-19T04:23:32Z)
• Stress-Testing LiDAR Registration [52.24383388306149]
  We propose a method for selecting balanced registration sets, which are challenging sets of frame-pairs from LiDAR datasets. Perhaps unexpectedly, we find that the fastest and simultaneously most accurate approach is a version of advanced RANSAC.
  arXiv  Detail & Related papers  (2022-04-16T05:10:55Z)
• Split and Connect: A Universal Tracklet Booster for Multi-Object Tracking [33.23825397557663]
  Multi-object tracking (MOT) is an essential task in the computer vision field. In this paper, a tracklet booster algorithm is proposed, which can be built upon any other tracker. The motivation is simple and straightforward: split tracklets on potential ID-switch positions and then connect multiple tracklets into one if they are from the same object.
  arXiv  Detail & Related papers  (2021-05-06T03:49:19Z)
• Distractor-Aware Fast Tracking via Dynamic Convolutions and MOT Philosophy [63.91005999481061]
  A practical long-term tracker typically contains three key properties, i.e. an efficient model design, an effective global re-detection strategy and a robust distractor awareness mechanism. We propose a two-task tracking frame work (named DMTrack) to achieve distractor-aware fast tracking via Dynamic convolutions (d-convs) and Multiple object tracking (MOT) philosophy. Our tracker achieves state-of-the-art performance on the LaSOT, OxUvA, TLP, VOT2018LT and VOT 2019LT benchmarks and runs in real-time (3x faster
  arXiv  Detail & Related papers  (2021-04-25T00:59:53Z)
• Multi-Object Tracking using Poisson Multi-Bernoulli Mixture Filtering for Autonomous Vehicles [0.0]
  The ability of an autonomous vehicle to perform 3D tracking is essential for safe planing and navigation in cluttered environments. The main challenges for multi-object tracking (MOT) in autonomous driving applications reside in the inherent uncertainties regarding the number of objects, when and where the objects may appear and disappear, and uncertainties regarding objects' states. In this work, we developed an RFS-based MOT framework for 3D LiDAR data. In partiuclar, we propose a Poisson multi-Bernoulli mixture filter to solve the amodal MOT problem for autonomous driving applications.
  arXiv  Detail & Related papers  (2021-03-13T20:24:18Z)
• Simultaneous Detection and Tracking with Motion Modelling for Multiple Object Tracking [94.24393546459424]
  We introduce Deep Motion Modeling Network (DMM-Net) that can estimate multiple objects' motion parameters to perform joint detection and association. DMM-Net achieves PR-MOTA score of 12.80 @ 120+ fps for the popular UA-DETRAC challenge, which is better performance and orders of magnitude faster. We also contribute a synthetic large-scale public dataset Omni-MOT for vehicle tracking that provides precise ground-truth annotations.
  arXiv  Detail & Related papers  (2020-08-20T08:05:33Z)
• ArTIST: Autoregressive Trajectory Inpainting and Scoring for Tracking [80.02322563402758]
  One of the core components in online multiple object tracking (MOT) frameworks is associating new detections with existing tracklets. We introduce a probabilistic autoregressive generative model to score tracklet proposals by directly measuring the likelihood that a tracklet represents natural motion.
  arXiv  Detail & Related papers  (2020-04-16T06:43:11Z)
• Fully Convolutional Online Tracking [47.78513247048846]
  We present a fully convolutional online tracking framework, coined as FCOT, for both classification and regression branches. Our key contribution is to introduce an online regression model generator (RMG) for initializing weights of the target filter with online samples. Thanks to the unique design of RMG, our FCOT can not only be more effective in handling target variation along temporal dimension thus generating more precise results.
  arXiv  Detail & Related papers  (2020-04-15T14:21:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.