Visual Multi-Object Tracking with Re-Identification and Occlusion Handling using Labeled Random Finite Sets

• URL: http://arxiv.org/abs/2407.08872v2
• Date: Fri, 30 Aug 2024 22:25:53 GMT
• Title: Visual Multi-Object Tracking with Re-Identification and Occlusion Handling using Labeled Random Finite Sets
• Authors: Linh Van Ma, Tran Thien Dat Nguyen, Changbeom Shim, Du Yong Kim, Namkoo Ha, Moongu Jeon,
• Abstract summary: This paper proposes an online visual multi-object tracking (MOT) algorithm that resolves object appearance-reappearance and occlusion. Our solution is based on the labeled random finite set (LRFS) filtering approach. We propose a fuzzy detection model that takes into consideration the overlapping areas between tracks and their sizes.
• Score: 10.618186767487993
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This paper proposes an online visual multi-object tracking (MOT) algorithm that resolves object appearance-reappearance and occlusion. Our solution is based on the labeled random finite set (LRFS) filtering approach, which in principle, addresses disappearance, appearance, reappearance, and occlusion via a single Bayesian recursion. However, in practice, existing numerical approximations cause reappearing objects to be initialized as new tracks, especially after long periods of being undetected. In occlusion handling, the filter's efficacy is dictated by trade-offs between the sophistication of the occlusion model and computational demand. Our contribution is a novel modeling method that exploits object features to address reappearing objects whilst maintaining a linear complexity in the number of detections. Moreover, to improve the filter's occlusion handling, we propose a fuzzy detection model that takes into consideration the overlapping areas between tracks and their sizes. We also develop a fast version of the filter to further reduce the computational time. The source code is publicly available at https://github.com/linh-gist/mv-glmb-ab.

Related papers

• Keypoint Promptable Re-Identification [76.31113049256375]
  Occluded Person Re-Identification (ReID) is a metric learning task that involves matching occluded individuals based on their appearance. We introduce Keypoint Promptable ReID (KPR), a novel formulation of the ReID problem that explicitly complements the input bounding box with a set of semantic keypoints. We release custom keypoint labels for four popular ReID benchmarks. Experiments on person retrieval, but also on pose tracking, demonstrate that our method systematically surpasses previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-07-25T15:20:58Z)
• Track Initialization and Re-Identification for~3D Multi-View Multi-Object Tracking [12.389483990547223]
  We propose a 3D multi-object tracking (MOT) solution using only 2D detections from monocular cameras. We exploit the 2D detections and extracted features from multiple cameras to provide a better approximation of the multi-object filtering density.
  arXiv  Detail & Related papers  (2024-05-28T21:36:16Z)
• Object-Centric Multiple Object Tracking [124.30650395969126]
  This paper proposes a video object-centric model for multiple-object tracking pipelines. It consists of an index-merge module that adapts the object-centric slots into detection outputs and an object memory module. Benefited from object-centric learning, we only require sparse detection labels for object localization and feature binding.
  arXiv  Detail & Related papers  (2023-09-01T03:34:12Z)
• Spatial-Temporal Graph Enhanced DETR Towards Multi-Frame 3D Object Detection [54.041049052843604]
  We present STEMD, a novel end-to-end framework that enhances the DETR-like paradigm for multi-frame 3D object detection. First, to model the inter-object spatial interaction and complex temporal dependencies, we introduce the spatial-temporal graph attention network. Finally, it poses a challenge for the network to distinguish between the positive query and other highly similar queries that are not the best match.
  arXiv  Detail & Related papers  (2023-07-01T13:53:14Z)
• Linear Object Detection in Document Images using Multiple Object Tracking [58.720142291102135]
  Linear objects convey substantial information about document structure. Many approaches can recover some vector representation, but only one closed-source technique introduced in 1994. We propose a framework for accurate instance segmentation of linear objects in document images using Multiple Object Tracking.
  arXiv  Detail & Related papers  (2023-05-26T14:22:03Z)
• Real-time Multi-Object Tracking Based on Bi-directional Matching [0.0]
  This study offers a bi-directional matching algorithm for multi-object tracking. A stranded area is used in the matching algorithm to temporarily store the objects that fail to be tracked. In the MOT17 challenge, the proposed algorithm achieves 63.4% MOTA, 55.3% IDF1, and 20.1 FPS tracking speed.
  arXiv  Detail & Related papers  (2023-03-15T08:38:08Z)
• Detection Selection Algorithm: A Likelihood based Optimization Method to Perform Post Processing for Object Detection [1.7188280334580197]
  In object detection, post-processing methods like Non-maximum Suppression (NMS) are widely used. In order to find the exact number of objects and their labels in the image, we propose a post processing method called Detection Selection Algorithm (DSA) DSA greedily selects a subset of detected bounding boxes, together with full object reconstructions that give the interpretation of the whole image with highest likelihood.
  arXiv  Detail & Related papers  (2022-12-12T05:15:18Z)
• Learning to Estimate Hidden Motions with Global Motion Aggregation [71.12650817490318]
  Occlusions pose a significant challenge to optical flow algorithms that rely on local evidences. We introduce a global motion aggregation module to find long-range dependencies between pixels in the first image. We demonstrate that the optical flow estimates in the occluded regions can be significantly improved without damaging the performance in non-occluded regions.
  arXiv  Detail & Related papers  (2021-04-06T10:32:03Z)
• Online Multi-Object Tracking with delta-GLMB Filter based on Occlusion and Identity Switch Handling [1.713291434132985]
  We propose an online multi-object tracking (MOT) method in a delta Generalized Labeled Multi-Bernoulli (delta-GLMB) filter framework. To handle occlusion and miss-detection issues, we propose a measurement-to-disappeared track association method. We evaluate the proposed method on well-known and publicly available MOT15 and MOT17 test datasets.
  arXiv  Detail & Related papers  (2020-11-19T21:38:40Z)
• Appearance-free Tripartite Matching for Multiple Object Tracking [6.165592821539306]
  Multiple Object Tracking (MOT) detects the trajectories of multiple objects given an input video. Most existing algorithms depend on the uniqueness of the object's appearance, and the dominating bipartite matching scheme ignores the speed smoothness. We propose an appearance-free tripartite matching to avoid the irregular velocity problem of the bipartite matching.
  arXiv  Detail & Related papers  (2020-08-09T02:16:44Z)
• Towards Accurate Pixel-wise Object Tracking by Attention Retrieval [50.06436600343181]
  We propose an attention retrieval network (ARN) to perform soft spatial constraints on backbone features. We set a new state-of-the-art on recent pixel-wise object tracking benchmark VOT 2020 while running at 40 fps.
  arXiv  Detail & Related papers  (2020-08-06T16:25:23Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.