Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker

• URL: http://arxiv.org/abs/2205.00968v3
• Date: Tue, 19 Sep 2023 19:04:50 GMT
• Title: Detection Recovery in Online Multi-Object Tracking with Sparse Graph Tracker
• Authors: Jeongseok Hyun, Myunggu Kang, Dongyoon Wee, Dit-Yan Yeung
• Abstract summary: In existing joint detection and tracking methods, pairwise relational features are used to match previous tracklets to current detections. We present Sparse Graph Tracker (SGT), a novel online graph tracker using higher-order relational features which are more discriminative. In the MOT16/17/20 and HiEve Challenge, SGT outperforms the state-of-the-art trackers with real-time inference speed.
• Score: 17.00871668925939
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: In existing joint detection and tracking methods, pairwise relational features are used to match previous tracklets to current detections. However, the features may not be discriminative enough for a tracker to identify a target from a large number of detections. Selecting only high-scored detections for tracking may lead to missed detections whose confidence score is low. Consequently, in the online setting, this results in disconnections of tracklets which cannot be recovered. In this regard, we present Sparse Graph Tracker (SGT), a novel online graph tracker using higher-order relational features which are more discriminative by aggregating the features of neighboring detections and their relations. SGT converts video data into a graph where detections, their connections, and the relational features of two connected nodes are represented by nodes, edges, and edge features, respectively. The strong edge features allow SGT to track targets with tracking candidates selected by top-K scored detections with large K. As a result, even low-scored detections can be tracked, and the missed detections are also recovered. The robustness of K value is shown through the extensive experiments. In the MOT16/17/20 and HiEve Challenge, SGT outperforms the state-of-the-art trackers with real-time inference speed. Especially, a large improvement in MOTA is shown in the MOT20 and HiEve Challenge. Code is available at https://github.com/HYUNJS/SGT.

Related papers

• Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking [52.04679257903805]
  Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks. Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks.
  arXiv  Detail & Related papers  (2024-07-19T07:48:45Z)
• Effective In-vehicle Intrusion Detection via Multi-view Statistical Graph Learning on CAN Messages [9.04771951523525]
  In-vehicle network (IVN) is facing a wide variety of complex and changing external cyber-attacks. Only coarse-grained recognition can be achieved in current mainstream intrusion detection mechanisms. We propose StatGraph: an Effective Multi-view Statistical Graph Learning Intrusion Detection.
  arXiv  Detail & Related papers  (2023-11-13T03:49:55Z)
• Joint Counting, Detection and Re-Identification for Multi-Object Tracking [8.89262850257871]
  In crowded scenes, joint detection and tracking usually fail to find accurate object associations due to missed or false detections. We jointly model counting, detection and re-identification in an end-to-end framework, named CountingMOT, tailored for crowded scenes. The proposed MOT tracker can perform online and real-time tracking, and achieves the state-of-the-art results on public benchmarks MOT16 (MOTA of 79.7), MOT17 (MOTA of 81.3%) and MOT20 (MOTA of 78.9%)
  arXiv  Detail & Related papers  (2022-12-12T12:53:58Z)
• Minkowski Tracker: A Sparse Spatio-Temporal R-CNN for Joint Object Detection and Tracking [53.64390261936975]
  We present Minkowski Tracker, a sparse-temporal R-CNN that jointly solves object detection and tracking problems. Inspired by region-based CNN (R-CNN), we propose to track motion as a second stage of the object detector R-CNN. We show in large-scale experiments that the overall performance gain of our method is due to four factors.
  arXiv  Detail & Related papers  (2022-08-22T04:47:40Z)
• On the detection-to-track association for online multi-object tracking [30.883165972525347]
  We propose a hybrid track association algorithm that models the historical appearance distances of a track with an incremental Gaussian mixture model (IGMM) Experimental results on three MOT benchmarks confirm that HTA effectively improves the target identification performance with a small compromise to the tracking speed.
  arXiv  Detail & Related papers  (2021-07-01T14:44:12Z)
• Track to Detect and Segment: An Online Multi-Object Tracker [81.15608245513208]
  TraDeS is an online joint detection and tracking model, exploiting tracking clues to assist detection end-to-end. TraDeS infers object tracking offset by a cost volume, which is used to propagate previous object features.
  arXiv  Detail & Related papers  (2021-03-16T02:34:06Z)
• DEFT: Detection Embeddings for Tracking [3.326320568999945]
  We propose an efficient joint detection and tracking model named DEFT. Our approach relies on an appearance-based object matching network jointly-learned with an underlying object detection network. DEFT has comparable accuracy and speed to the top methods on 2D online tracking leaderboards.
  arXiv  Detail & Related papers  (2021-02-03T20:00:44Z)
• Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking [83.75789829291475]
  We introduce a probabilistic autoregressive motion model to score tracklet proposals. This is achieved by training our model to learn the underlying distribution of natural tracklets. Our experiments demonstrate the superiority of our approach at tracking objects in challenging sequences.
  arXiv  Detail & Related papers  (2020-12-03T23:59:27Z)
• Chained-Tracker: Chaining Paired Attentive Regression Results for End-to-End Joint Multiple-Object Detection and Tracking [102.31092931373232]
  We propose a simple online model named Chained-Tracker (CTracker), which naturally integrates all the three subtasks into an end-to-end solution. The two major novelties: chained structure and paired attentive regression, make CTracker simple, fast and effective.
  arXiv  Detail & Related papers  (2020-07-29T02:38:49Z)
• ArTIST: Autoregressive Trajectory Inpainting and Scoring for Tracking [80.02322563402758]
  One of the core components in online multiple object tracking (MOT) frameworks is associating new detections with existing tracklets. We introduce a probabilistic autoregressive generative model to score tracklet proposals by directly measuring the likelihood that a tracklet represents natural motion.
  arXiv  Detail & Related papers  (2020-04-16T06:43:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.