OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking

• URL: http://arxiv.org/abs/2309.10360v1
• Date: Tue, 19 Sep 2023 06:43:18 GMT
• Title: OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking
• Authors: Jianjun Gao, Yi Wang, Kim-Hui Yap, Kratika Garg, and Boon Siew Han
• Abstract summary: Existing methods suffer from inaccurate motion estimation, appearance feature extraction, and association due to occlusion. We suggest that the key insight is explicit motion estimation, reliable appearance features, and fair association in occlusion scenes. Specifically, we propose an adaptive occlusion-aware multiple pedestrian tracker, OccluTrack.
• Score: 7.964206483424679
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multiple pedestrian tracking faces the challenge of tracking pedestrians in the presence of occlusion. Existing methods suffer from inaccurate motion estimation, appearance feature extraction, and association due to occlusion, leading to inadequate Identification F1-Score (IDF1), excessive ID switches (IDSw), and insufficient association accuracy and recall (AssA and AssR). We found that the main reason is abnormal detections caused by partial occlusion. In this paper, we suggest that the key insight is explicit motion estimation, reliable appearance features, and fair association in occlusion scenes. Specifically, we propose an adaptive occlusion-aware multiple pedestrian tracker, OccluTrack. We first introduce an abnormal motion suppression mechanism into the Kalman Filter to adaptively detect and suppress outlier motions caused by partial occlusion. Second, we propose a pose-guided re-ID module to extract discriminative part features for partially occluded pedestrians. Last, we design a new occlusion-aware association method towards fair IoU and appearance embedding distance measurement for occluded pedestrians. Extensive evaluation results demonstrate that our OccluTrack outperforms state-of-the-art methods on MOT-Challenge datasets. Particularly, the improvements on IDF1, IDSw, AssA, and AssR demonstrate the effectiveness of our OccluTrack on tracking and association performance.

Related papers

• Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion [31.488897675973657]
  We propose to complete features for occluded regions so as to align the features of pedestrians across different occlusion patterns. In order to narrow down the gap between completed features and real fully visible ones, we propose an adversarial learning method. We report experimental results on the CityPersons, Caltech and CrowdHuman datasets.
  arXiv  Detail & Related papers  (2024-05-02T14:20:20Z)
• DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery [71.6345505427213]
  DPMesh is an innovative framework for occluded human mesh recovery. It capitalizes on the profound diffusion prior about object structure and spatial relationships embedded in a pre-trained text-to-image diffusion model.
  arXiv  Detail & Related papers  (2024-04-01T18:59:13Z)
• Multiple Object Tracking based on Occlusion-Aware Embedding Consistency Learning [46.726678333518066]
  Occlusion Prediction Module (OPM) and Occlusion-Aware Association Module (OAAM) OPM predicts occlusion information for each true detection, facilitating the selection of valid samples for consistency learning of the track's visual embedding. OAAM generates two separate embeddings for each track, guaranteeing consistency in both unoccluded and occluded detections.
  arXiv  Detail & Related papers  (2023-11-05T06:08:58Z)
• Occlusion-Aware Detection and Re-ID Calibrated Network for Multi-Object Tracking [38.36872739816151]
  Occlusion-Aware Attention (OAA) module in the detector highlights the object features while suppressing the occluded background regions. OAA can serve as a modulator that enhances the detector for some potentially occluded objects. We design a Re-ID embedding matching block based on the optimal transport problem.
  arXiv  Detail & Related papers  (2023-08-30T06:56:53Z)
• Occlusion Robust 3D Human Pose Estimation with StridedPoseGraphFormer and Data Augmentation [69.49430149980789]
  We show that our proposed method compares favorably with the state-of-the-art (SoA) Our experimental results also reveal that in the absence of any occlusion handling mechanism, the performance of SoA 3D HPE methods degrades significantly when they encounter occlusion.
  arXiv  Detail & Related papers  (2023-04-24T13:05:13Z)
• Feature Calibration Network for Occluded Pedestrian Detection [137.37275165635882]
  We propose a novel feature learning method in the deep learning framework, referred to as Feature Network (FC-Net) FC-Net is based on the observation that the visible parts of pedestrians are selective and decisive for detection. Experiments on CityPersons and Caltech datasets demonstrate that FC-Net improves detection performance on occluded pedestrians up to 10%.
  arXiv  Detail & Related papers  (2022-12-12T05:48:34Z)
• An Objective Method for Pedestrian Occlusion Level Classification [6.125017875330933]
  Occlusion level classification is achieved through the identification of visible pedestrian keypoints and through the use of a novel, effective method of 2D body surface area estimation. Experimental results demonstrate that the proposed method reflects the pixel-wise. occlusion level of pedestrians in images and is effective for all forms of. occlusion, including challenging edge cases such as self-occlusion, truncation. and inter-occluding pedestrians.
  arXiv  Detail & Related papers  (2022-05-11T11:27:41Z)
• Quality-aware Part Models for Occluded Person Re-identification [77.24920810798505]
  Occlusion poses a major challenge for person re-identification (ReID) Existing approaches typically rely on outside tools to infer visible body parts, which may be suboptimal in terms of both computational efficiency and ReID accuracy. We propose a novel method named Quality-aware Part Models (QPM) for occlusion-robust ReID.
  arXiv  Detail & Related papers  (2022-01-01T03:51:09Z)
• Locality-aware Channel-wise Dropout for Occluded Face Recognition [116.2355331029041]
  Face recognition is a challenging task in unconstrained scenarios, especially when faces are partially occluded. We propose a novel and elegant occlusion-simulation method via dropping the activations of a group of neurons in some elaborately selected channel. Experiments on various benchmarks show that the proposed method outperforms state-of-the-art methods with a remarkable improvement.
  arXiv  Detail & Related papers  (2021-07-20T05:53:14Z)
• Online Multi-Object Tracking with delta-GLMB Filter based on Occlusion and Identity Switch Handling [1.713291434132985]
  We propose an online multi-object tracking (MOT) method in a delta Generalized Labeled Multi-Bernoulli (delta-GLMB) filter framework. To handle occlusion and miss-detection issues, we propose a measurement-to-disappeared track association method. We evaluate the proposed method on well-known and publicly available MOT15 and MOT17 test datasets.
  arXiv  Detail & Related papers  (2020-11-19T21:38:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.