Seg2Track++: Probabilistic Track Validation and Data Association for Multi-Object Tracking and Segmentation

• URL: http://arxiv.org/abs/2606.03875v1
• Date: Tue, 02 Jun 2026 16:43:00 GMT
• Title: Seg2Track++: Probabilistic Track Validation and Data Association for Multi-Object Tracking and Segmentation
• Abstract summary: This work introduces Seg2Track++, a framework that instance integrates segmentation with SAM2 and a novel track management module to perform zero-shot MOTS.<n> Experimental results on KITTI MOTS demonstrate improved identity preservation, reduced false-positive propagation, and robust track management without fine-tuning.
• Score: 3.108551551357326
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Autonomous systems require robust Multi-Object Tracking and Segmentation (MOTS) to operate reliably in dynamic environments, ensuring consistent object identities and precise mask-level delineation. Foundation models such as SAM2 have shown strong zero-shot generalization for segmentation, but their direct application to MOTS is limited by unreliable track association and false-positive propagation. This work introduces Seg2Track++, a framework that integrates instance segmentation with SAM2 and a novel track management module to perform zero-shot MOTS with enhanced temporal consistency. Tracks are associated using Mask Centroid Distance (MCD) and Confidence-Aware Cost Modulation (CCM), while Probabilistic Track Validation (PTV) employs a Bernoulli filter to validate track existence and suppress ghost tracks. Experimental results on KITTI MOTS demonstrate improved identity preservation, reduced false-positive propagation, and robust track management without fine-tuning.

Related papers

• Models as Tools: An Agentic Coordination Framework for Unified Multimodal Visual Tracking [46.37628260203197]
  ACTrack is an agentic coordination framework that treats heterogeneous models as invocable tools under an event-triggered mechanism.<n>We show that ACTrack substantially surpasses the strongest and the largest trackers on eight RGB benchmarks.
  arXiv  Detail & Related papers  (2026-08-01T19:58:09Z)
• SAMOFT: Robust Multi-Object Tracking via Region and Flow [42.6206516982406]
  Multi-object tracking (MOT) is a fundamental task in computer vision that requires continuously tracking multiple targets.<n>Most existing approaches rely on instance-level object features for trajectory association.<n>We propose SAMOFT, a robust tracker that leverages pixel-level cues to improve robustness under complex motion scenarios.
  arXiv  Detail & Related papers  (2026-05-10T08:39:54Z)
• Unified Multimodal Visual Tracking with Dual Mixture-of-Experts [48.73939694967044]
  OneV2 is a unified multimodal tracking framework that enables end-to-end training for any modality.<n>OneV2 achieves state-of-the-art performance across five and RGB+X tracking tasks and 12 benchmarks.
  arXiv  Detail & Related papers  (2026-05-05T13:05:50Z)
• SAMIDARE: Advanced Tracking-by-Segmentation for Dense Scenarios [14.682073556734515]
  SAMIDARE is a framework that enhances multi-object tracking in dense scenes.<n>It achieves robustness on the SportsMOT dataset, outperforming the baseline by 2.5 HOTA and 4.2 IDF1 points on the validation set.<n>These results demonstrate that adaptive feature management using mask control and state-aware association provide a robust and efficient solution for dense sports tracking.
  arXiv  Detail & Related papers  (2026-04-24T02:22:27Z)
• CADTrack: Learning Contextual Aggregation with Deformable Alignment for Robust RGBT Tracking [68.71826342377004]
  RGB-Thermal (RGBT) tracking aims to exploit visible and thermal infrared modalities for robust all-weather object tracking.<n>Existing RGBT trackers struggle to resolve modality discrepancies, which poses great challenges for robust feature representation.<n>We propose a novel Contextual Aggregation with Deformable Alignment framework called CADTrack for RGBT Tracking.
  arXiv  Detail & Related papers  (2025-11-22T08:10:02Z)
• Seg2Track-SAM2: SAM2-based Multi-object Tracking and Segmentation for Zero-shot Generalization [3.108551551357326]
  Seg2Track-SAM2 is a framework that integrates pre-trained object detectors with SAM2 and a novel Seg2Track module.<n>Seg2Track-SAM2 achieves state-of-the-art (SOTA) performance, ranking fourth overall in both car and pedestrian classes on KITTI MOTS.<n>Results confirm that Seg2Track-SAM2 advances MOTS by combining robust zero-shot tracking, enhanced identity preservation, and efficient memory utilization.
  arXiv  Detail & Related papers  (2025-09-15T10:52:27Z)
• Tracking the Unstable: Appearance-Guided Motion Modeling for Robust Multi-Object Tracking in UAV-Captured Videos [58.156141601478794]
  Multi-object tracking (UAVT) aims to track multiple objects while maintaining consistent identities across frames of a given video.<n>Existing methods typically model motion cues and appearance separately, overlooking their interplay and resulting in suboptimal tracking performance.<n>We propose AMOT, which exploits appearance and motion cues through two key components: an Appearance-Motion Consistency (AMC) matrix and a Motion-aware Track Continuation (MTC) module.
  arXiv  Detail & Related papers  (2025-08-03T12:06:47Z)
• CAMELTrack: Context-Aware Multi-cue ExpLoitation for Online Multi-Object Tracking [68.24998698508344]
  We introduce CAMEL, a novel association module for Context-Aware Multi-Cue ExpLoitation.<n>Unlike end-to-end detection-by-tracking approaches, our method remains lightweight and fast to train while being able to leverage external off-the-shelf models.<n>Our proposed online tracking pipeline, CAMELTrack, achieves state-of-the-art performance on multiple tracking benchmarks.
  arXiv  Detail & Related papers  (2025-05-02T13:26:23Z)
• SAM2MOT: A Novel Paradigm of Multi-Object Tracking by Segmentation [11.1906749425206]
  Segment Anything 2 (SAM2) enables robust single-object tracking using segmentation.<n>We propose SAM2MOT, a novel Tracking by paradigm for multi-object tracking.<n> SAM2MOT directly generates tracking boxes from segmentation masks, reducing reliance on detection accuracy.
  arXiv  Detail & Related papers  (2025-04-06T15:32:08Z)
• Single-Shot and Multi-Shot Feature Learning for Multi-Object Tracking [55.13878429987136]
  We propose a simple yet effective two-stage feature learning paradigm to jointly learn single-shot and multi-shot features for different targets. Our method has achieved significant improvements on MOT17 and MOT20 datasets while reaching state-of-the-art performance on DanceTrack dataset.
  arXiv  Detail & Related papers  (2023-11-17T08:17:49Z)
• Unified Transformer Tracker for Object Tracking [58.65901124158068]
  We present the Unified Transformer Tracker (UTT) to address tracking problems in different scenarios with one paradigm. A track transformer is developed in our UTT to track the target in both Single Object Tracking (SOT) and Multiple Object Tracking (MOT)
  arXiv  Detail & Related papers  (2022-03-29T01:38:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.