UTrack: Multi-Object Tracking with Uncertain Detections

• URL: http://arxiv.org/abs/2408.17098v1
• Date: Fri, 30 Aug 2024 08:34:51 GMT
• Title: UTrack: Multi-Object Tracking with Uncertain Detections
• Authors: Edgardo Solano-Carrillo, Felix Sattler, Antje Alex, Alexander Klein, Bruno Pereira Costa, Angel Bueno Rodriguez, Jannis Stoppe,
• Abstract summary: We introduce, for the first time, a fast way to obtain the empirical predictive distribution during object detection. Our mechanism can easily be integrated into state-of-the-art trackers, enabling them to fully exploit the uncertainty in the detections. We demonstrate the effectiveness of our contribution on a variety of benchmarks, such as MOT17, MOT20, DanceTrack, and KITTI.
• Score: 37.826006378381955
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The tracking-by-detection paradigm is the mainstream in multi-object tracking, associating tracks to the predictions of an object detector. Although exhibiting uncertainty through a confidence score, these predictions do not capture the entire variability of the inference process. For safety and security critical applications like autonomous driving, surveillance, etc., knowing this predictive uncertainty is essential though. Therefore, we introduce, for the first time, a fast way to obtain the empirical predictive distribution during object detection and incorporate that knowledge in multi-object tracking. Our mechanism can easily be integrated into state-of-the-art trackers, enabling them to fully exploit the uncertainty in the detections. Additionally, novel association methods are introduced that leverage the proposed mechanism. We demonstrate the effectiveness of our contribution on a variety of benchmarks, such as MOT17, MOT20, DanceTrack, and KITTI.

Related papers

• RTracker: Recoverable Tracking via PN Tree Structured Memory [71.05904715104411]
  We propose a recoverable tracking framework, RTracker, that uses a tree-structured memory to dynamically associate a tracker and a detector to enable self-recovery. Specifically, we propose a Positive-Negative Tree-structured memory to chronologically store and maintain positive and negative target samples. Our core idea is to use the support samples of positive and negative target categories to establish a relative distance-based criterion for a reliable assessment of target loss.
  arXiv  Detail & Related papers  (2024-03-28T08:54:40Z)
• UncertaintyTrack: Exploiting Detection and Localization Uncertainty in Multi-Object Tracking [8.645078288584305]
  Multi-object tracking (MOT) methods have seen a significant boost in performance recently. We introduce UncertaintyTrack, a collection of extensions that can be applied to multiple TBD trackers. Experiments on the Berkeley Deep Drive MOT dataset show that the combination of our method and informative uncertainty estimates reduces the number of ID switches by around 19%.
  arXiv  Detail & Related papers  (2024-02-19T17:27:04Z)
• Uncertainty-aware Unsupervised Multi-Object Tracking [33.53331700312752]
  unsupervised multi-object trackers are inferior to learning reliable feature embeddings. Recent self-supervised techniques are adopted, whereas they failed to capture temporal relations. This paper argues that though the uncertainty problem is inevitable, it is possible to leverage the uncertainty itself to improve the learned consistency in turn.
  arXiv  Detail & Related papers  (2023-07-28T09:03:06Z)
• Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding [121.66374635092097]
  Trajectories obtained from object detection and tracking are inevitably noisy. We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
  arXiv  Detail & Related papers  (2022-02-03T09:09:56Z)
• Online Multi-Object Tracking with Unsupervised Re-Identification Learning and Occlusion Estimation [80.38553821508162]
  Occlusion between different objects is a typical challenge in Multi-Object Tracking (MOT) In this paper, we focus on online multi-object tracking and design two novel modules to handle these problems. The proposed unsupervised re-identification learning module does not require any (pseudo) identity information nor suffer from the scalability issue. Our study shows that, when applied to state-of-the-art MOT methods, the proposed unsupervised re-identification learning is comparable to supervised re-identification learning.
  arXiv  Detail & Related papers  (2022-01-04T18:59:58Z)
• CertainNet: Sampling-free Uncertainty Estimation for Object Detection [65.28989536741658]
  Estimating the uncertainty of a neural network plays a fundamental role in safety-critical settings. In this work, we propose a novel sampling-free uncertainty estimation method for object detection. We call it CertainNet, and it is the first to provide separate uncertainties for each output signal: objectness, class, location and size.
  arXiv  Detail & Related papers  (2021-10-04T17:59:31Z)
• Learning Uncertainty For Safety-Oriented Semantic Segmentation In Autonomous Driving [77.39239190539871]
  We show how uncertainty estimation can be leveraged to enable safety critical image segmentation in autonomous driving. We introduce a new uncertainty measure based on disagreeing predictions as measured by a dissimilarity function. We show experimentally that our proposed approach is much less computationally intensive at inference time than competing methods.
  arXiv  Detail & Related papers  (2021-05-28T09:23:05Z)
• Uncertainty-Aware Vehicle Orientation Estimation for Joint Detection-Prediction Models [12.56249869551208]
  Orientation is an important property for downstream modules of an autonomous system. We present a method that extends the existing models that perform joint object detection and motion prediction. In addition, the approach is able to quantify prediction uncertainty, outputting the probability that the inferred orientation is flipped.
  arXiv  Detail & Related papers  (2020-11-05T21:59:44Z)
• RetinaTrack: Online Single Stage Joint Detection and Tracking [22.351109024452462]
  We focus on the tracking-by-detection paradigm for autonomous driving where both tasks are mission critical. We propose a conceptually simple and efficient joint model of detection and tracking, called RetinaTrack, which modifies the popular single stage RetinaNet approach.
  arXiv  Detail & Related papers  (2020-03-30T23:46:29Z)
• Confidence Trigger Detection: Accelerating Real-time Tracking-by-detection Systems [1.6037469030022993]
  Confidence-Triggered Detection (CTD) is an innovative approach that strategically bypasses object detection for frames closely resembling intermediate states. CTD not only enhances tracking speed but also preserves accuracy, surpassing existing tracking algorithms. Our experiments underscore the robustness and versatility of the CTD framework, demonstrating its potential to enable real-time tracking in resource-constrained environments.
  arXiv  Detail & Related papers  (2019-02-02T01:52:53Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.