GOSPA and T-GOSPA quasi-metrics for evaluation of multi-object tracking algorithms

• URL: http://arxiv.org/abs/2507.13706v1
• Date: Fri, 18 Jul 2025 07:25:41 GMT
• Title: GOSPA and T-GOSPA quasi-metrics for evaluation of multi-object tracking algorithms
• Abstract summary: This paper introduces two quasi-metrics for performance assessment of multi-object tracking (MOT) algorithms.<n>One quasi-metric is an extension of the generalised optimal subpattern assignment (GOSPA) metric and measures the discrepancy between sets of objects.<n>The other quasi-metric is an extension of the trajectory GOSPA (T-GOSPA) metric and measures the discrepancy between sets of trajectories.
• Score: 4.759792201055905
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper introduces two quasi-metrics for performance assessment of multi-object tracking (MOT) algorithms. In particular, one quasi-metric is an extension of the generalised optimal subpattern assignment (GOSPA) metric and measures the discrepancy between sets of objects. The other quasi-metric is an extension of the trajectory GOSPA (T-GOSPA) metric and measures the discrepancy between sets of trajectories. Similar to the GOSPA-based metrics, these quasi-metrics include costs for localisation error for properly detected objects, the number of false objects and the number of missed objects. The T-GOSPA quasi-metric also includes a track switching cost. Differently from the GOSPA and T-GOSPA metrics, the proposed quasi-metrics have the flexibility of penalising missed and false objects with different costs, and the localisation costs are not required to be symmetric. These properties can be useful in MOT evaluation in certain applications. The performance of several Bayesian MOT algorithms is assessed with the T-GOSPA quasi-metric via simulations.

Related papers

• TAPO: Tool-Aware Policy Optimization via Credit Transfer for Multimodal Search Agents [54.08846865906602]
  We characterize credit misassignment as a systematic failure mode of GRPO in tool-augmented multimodal search agents.<n>We propose Tool-Aware Policy Optimization (TAPO), which exploits the parameter-determinism property of information-acquisition tools.
  arXiv  Detail & Related papers  (2026-06-04T07:15:43Z)
• Beyond Chamfer Distance: Granular Order-aware Evaluation Metric For Online Mapping [9.868903360882262]
  State-of-the-art (SOTA) methods commonly predict map elements as ordered sequences of points that form polylines and polygons.<n>This framework lacks sensitivity to point ordering and provides limited granularity in assessing geometric quality.<n>We introduce sequence optimal sub-pattern assignment (SOSPA), an order-aware metric that enables fine-grained evaluation of individual geometries.
  arXiv  Detail & Related papers  (2026-05-21T14:51:52Z)
• Fast computation of the TGOSPA metric for multiple target tracking via unbalanced optimal transport [0.0]
  In multiple target tracking, it is important to be able to evaluate the performance of different tracking algorithms.<n>The trajectory generalized optimal sub-pattern assignment metric (TGOSPA) is a recently proposed metric for such evaluations.<n>We present an approximation algorithm for evaluating the TGOSPA metric, based on casting the TGOSPA problem as an unbalanced multimarginal optimal transport problem.
  arXiv  Detail & Related papers  (2025-03-12T14:51:03Z)
• RoSTE: An Efficient Quantization-Aware Supervised Fine-Tuning Approach for Large Language Models [53.571195477043496]
  We propose an algorithm named Rotated Straight-Through-Estimator (RoSTE)<n>RoSTE combines quantization-aware supervised fine-tuning (QA-SFT) with an adaptive rotation strategy to reduce activation outliers.<n>Our findings reveal that the prediction error is directly proportional to the quantization error of the converged weights, which can be effectively managed through an optimized rotation configuration.
  arXiv  Detail & Related papers  (2025-02-13T06:44:33Z)
• TGOSPA Metric Parameters Selection and Evaluation for Visual Multi-object Tracking [4.998475411100799]
  We use the trajectory generalized optimal sub-pattern assignment (TGOSPA) metric to evaluate multi-object tracking performance.<n>It accounts for localization errors, the number of missed and false objects, and the number of track switches.<n>By exploring the TGOSPA parameter selection, we enable users to compare, comprehend, and optimize the performance of algorithms tailored for specific tasks.
  arXiv  Detail & Related papers  (2024-12-11T11:57:05Z)
• Improving Statistical Significance in Human Evaluation of Automatic Metrics via Soft Pairwise Accuracy [10.487125740432681]
  We propose a new meta-metric that builds on Pairwise Accuracy (PA) We show that SPA is more stable than PA with respect to changes in the number of systems/segments used for evaluation. SPA was selected as the official system-level metric for the 2024 WMT Metrics Shared Task.
  arXiv  Detail & Related papers  (2024-09-15T03:25:55Z)
• Machine Translation Meta Evaluation through Translation Accuracy Challenge Sets [92.38654521870444]
  We introduce ACES, a contrastive challenge set spanning 146 language pairs. This dataset aims to discover whether metrics can identify 68 translation accuracy errors. We conduct a large-scale study by benchmarking ACES on 50 metrics submitted to the WMT 2022 and 2023 metrics shared tasks.
  arXiv  Detail & Related papers  (2024-01-29T17:17:42Z)
• Joint Metrics Matter: A Better Standard for Trajectory Forecasting [67.1375677218281]
  Multi-modal trajectory forecasting methods evaluate using single-agent metrics (marginal metrics) Only focusing on marginal metrics can lead to unnatural predictions, such as colliding trajectories or diverging trajectories for people who are clearly walking together as a group. We present the first comprehensive evaluation of state-of-the-art trajectory forecasting methods with respect to multi-agent metrics (joint metrics): JADE, JFDE, and collision rate.
  arXiv  Detail & Related papers  (2023-05-10T16:27:55Z)
• Markovian Sliced Wasserstein Distances: Beyond Independent Projections [51.80527230603978]
  We introduce a new family of SW distances, named Markovian sliced Wasserstein (MSW) distance, which imposes a first-order Markov structure on projecting directions. We compare distances with previous SW variants in various applications such as flows, color transfer, and deep generative modeling to demonstrate the favorable performance of MSW.
  arXiv  Detail & Related papers  (2023-01-10T01:58:15Z)
• Tracking Every Thing in the Wild [61.917043381836656]
  We introduce a new metric, Track Every Thing Accuracy (TETA), breaking tracking measurement into three sub-factors: localization, association, and classification. Our experiments show that TETA evaluates trackers more comprehensively, and TETer achieves significant improvements on the challenging large-scale datasets BDD100K and TAO.
  arXiv  Detail & Related papers  (2022-07-26T15:37:19Z)
• mvHOTA: A multi-view higher order tracking accuracy metric to measure spatial and temporal associations in multi-point detection [1.039718070553655]
  Multi-object tracking (MOT) is a challenging task that involves detecting objects in the scene and tracking them across a sequence of frames. The main evaluation metric to benchmark MOT methods on datasets such as KITTI has recently become the higher order tracking accuracy (HOTA) metric. We propose a multi-view higher order tracking metric (mvHOTA) to determine the accuracy of multi-point (multi-instance and multi-class) detection.
  arXiv  Detail & Related papers  (2022-06-19T10:31:53Z)
• A time-weighted metric for sets of trajectories to assess multi-object tracking algorithms [3.3989643515413235]
  This paper proposes a metric for sets of trajectories to evaluate multi-object tracking algorithms. The proposed metric extends the metric in [1] by including weights to the costs associated to different time steps.
  arXiv  Detail & Related papers  (2021-10-26T07:15:52Z)
• HOTA: A Higher Order Metric for Evaluating Multi-Object Tracking [48.497889944886516]
  Multi-Object Tracking (MOT) has been notoriously difficult to evaluate. Previous metrics overemphasize the importance of either detection or association. We present a novel MOT evaluation metric, HOTA, which balances the effect of performing accurate detection, association and localization.
  arXiv  Detail & Related papers  (2020-09-16T15:11:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.