Local Metrics for Multi-Object Tracking
- URL: http://arxiv.org/abs/2104.02631v1
- Date: Tue, 6 Apr 2021 16:07:04 GMT
- Title: Local Metrics for Multi-Object Tracking
- Authors: Jack Valmadre, Alex Bewley, Jonathan Huang, Chen Sun, Cristian
Sminchisescu, Cordelia Schmid
- Abstract summary: This paper introduces temporally local metrics for Multi-Object Tracking.
The horizon parameter offers a novel, meaningful mechanism by which to define the relative importance of detection and association.
It is shown that the historical Average Tracking Accuracy (ATA) metric exhibits superior sensitivity to association.
- Score: 102.16141039252652
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper introduces temporally local metrics for Multi-Object Tracking.
These metrics are obtained by restricting existing metrics based on track
matching to a finite temporal horizon, and provide new insight into the ability
of trackers to maintain identity over time. Moreover, the horizon parameter
offers a novel, meaningful mechanism by which to define the relative importance
of detection and association, a common dilemma in applications where imperfect
association is tolerable. It is shown that the historical Average Tracking
Accuracy (ATA) metric exhibits superior sensitivity to association, enabling
its proposed local variant, ALTA, to capture a wide range of characteristics.
In particular, ALTA is better equipped to identify advances in association
independent of detection. The paper further presents an error decomposition for
ATA that reveals the impact of four distinct error types and is equally
applicable to ALTA. The diagnostic capabilities of ALTA are demonstrated on the
MOT 2017 and Waymo Open Dataset benchmarks.
Related papers
- Trajectory Anomaly Detection with Language Models [21.401931052512595]
This paper presents a novel approach for trajectory anomaly detection using an autoregressive causal-attention model, termed LM-TAD.
By treating trajectories as sequences of tokens, our model learns the probability distributions over trajectories, enabling the identification of anomalous locations with high precision.
Our experiments demonstrate the effectiveness of LM-TAD on both synthetic and real-world datasets.
arXiv Detail & Related papers (2024-09-18T17:33:31Z) - STCMOT: Spatio-Temporal Cohesion Learning for UAV-Based Multiple Object Tracking [13.269416985959404]
Multiple object tracking (MOT) in Unmanned Aerial Vehicle (UAV) videos is important for diverse applications in computer vision.
We propose a novel Spatio-Temporal Cohesion Multiple Object Tracking framework (STCMOT)
We use historical embedding features to model the representation of ReID and detection features in a sequential order.
Our framework sets a new state-of-the-art performance in MOTA and IDF1 metrics.
arXiv Detail & Related papers (2024-09-17T14:34:18Z) - Temporal Correlation Meets Embedding: Towards a 2nd Generation of JDE-based Real-Time Multi-Object Tracking [52.04679257903805]
Joint Detection and Embedding (JDE) trackers have demonstrated excellent performance in Multi-Object Tracking (MOT) tasks.
Our tracker, named TCBTrack, achieves state-of-the-art performance on multiple public benchmarks.
arXiv Detail & Related papers (2024-07-19T07:48:45Z) - Don't Miss Out on Novelty: Importance of Novel Features for Deep Anomaly
Detection [64.21963650519312]
Anomaly Detection (AD) is a critical task that involves identifying observations that do not conform to a learned model of normality.
We propose a novel approach to AD using explainability to capture such novel features as unexplained observations in the input space.
Our approach establishes a new state-of-the-art across multiple benchmarks, handling diverse anomaly types.
arXiv Detail & Related papers (2023-10-01T21:24:05Z) - Shortcut Detection with Variational Autoencoders [1.3174512123890016]
We present a novel approach to detect shortcuts in image and audio datasets by leveraging variational autoencoders (VAEs)
The disentanglement of features in the latent space of VAEs allows us to discover feature-target correlations in datasets and semi-automatically evaluate them for ML shortcuts.
We demonstrate the applicability of our method on several real-world datasets and identify shortcuts that have not been discovered before.
arXiv Detail & Related papers (2023-02-08T18:26:10Z) - mvHOTA: A multi-view higher order tracking accuracy metric to measure
spatial and temporal associations in multi-point detection [1.039718070553655]
Multi-object tracking (MOT) is a challenging task that involves detecting objects in the scene and tracking them across a sequence of frames.
The main evaluation metric to benchmark MOT methods on datasets such as KITTI has recently become the higher order tracking accuracy (HOTA) metric.
We propose a multi-view higher order tracking metric (mvHOTA) to determine the accuracy of multi-point (multi-instance and multi-class) detection.
arXiv Detail & Related papers (2022-06-19T10:31:53Z) - Adaptive Affinity for Associations in Multi-Target Multi-Camera Tracking [53.668757725179056]
We propose a simple yet effective approach to adapt affinity estimations to corresponding matching scopes in MTMCT.
Instead of trying to deal with all appearance changes, we tailor the affinity metric to specialize in ones that might emerge during data associations.
Minimizing the mismatch, the adaptive affinity module brings significant improvements over global re-ID distance.
arXiv Detail & Related papers (2021-12-14T18:59:11Z) - Learning Dynamic Compact Memory Embedding for Deformable Visual Object
Tracking [82.34356879078955]
We propose a compact memory embedding to enhance the discrimination of the segmentation-based deformable visual tracking method.
Our method outperforms the excellent segmentation-based trackers, i.e., D3S and SiamMask on DAVIS 2017 benchmark.
arXiv Detail & Related papers (2021-11-23T03:07:12Z) - A Non-Parametric Subspace Analysis Approach with Application to Anomaly
Detection Ensembles [8.533981186119068]
We propose a new subspace analysis approach named Agglomerative Attribute Grouping (AAG)
AAG relies on a novel multi-attribute measure, which is derived from information theory measures of partitions.
In the vast majority of cases, the proposed AAG method outperforms classical and state-of-the-art subspace analysis methods.
arXiv Detail & Related papers (2021-01-13T08:23:01Z) - SAMOT: Switcher-Aware Multi-Object Tracking and Still Another MOT
Measure [88.74585449906313]
Multi-Object Tracking (MOT) is a popular topic in computer vision.
Identity issue, i.e., an object is wrongly associated with another object of a different identity, still remains to be a challenging problem.
This paper proposes a novel switcher-aware framework for multi-object tracking.
arXiv Detail & Related papers (2020-09-22T06:22:21Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.