OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking

• URL: http://arxiv.org/abs/2309.10360v2
• Date: Sat, 26 Apr 2025 06:31:24 GMT
• Title: OccluTrack: Rethinking Awareness of Occlusion for Enhancing Multiple Pedestrian Tracking
• Authors: Jianjun Gao, Yi Wang, Kim-Hui Yap, Kratika Garg, Boon Siew Han,
• Abstract summary: OccluTrack is an adaptive occlusion-aware multiple pedestrian tracker.<n>We introduce a plug-and-play abnormal motion suppression mechanism into the Kalman Filter.<n>We also develop a pose-guided re-identification (Re-ID) module to extract discriminative part features for partially occluded pedestrians.
• Score: 7.964206483424679
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Multiple pedestrian tracking is crucial for enhancing safety and efficiency in intelligent transport and autonomous driving systems by predicting movements and enabling adaptive decision-making in dynamic environments. It optimizes traffic flow, facilitates human interaction, and ensures compliance with regulations. However, it faces the challenge of tracking pedestrians in the presence of occlusion. Existing methods overlook effects caused by abnormal detections during partial occlusion. Subsequently, these abnormal detections can lead to inaccurate motion estimation, unreliable appearance features, and unfair association. To address these issues, we propose an adaptive occlusion-aware multiple pedestrian tracker, OccluTrack, to mitigate the effects caused by partial occlusion. Specifically, we first introduce a plug-and-play abnormal motion suppression mechanism into the Kalman Filter to adaptively detect and suppress outlier motions caused by partial occlusion. Second, we develop a pose-guided re-identification (Re-ID) module to extract discriminative part features for partially occluded pedestrians. Last, we develop a new occlusion-aware association method towards fair Intersection over Union (IoU) and appearance embedding distance measurement for occluded pedestrians. Extensive evaluation results demonstrate that our method outperforms state-of-the-art methods on MOTChallenge and DanceTrack datasets. Particularly, the performance improvements on IDF1 and ID Switches, as well as visualized results, demonstrate the effectiveness of our method in multiple pedestrian tracking.

Related papers

• Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion [31.488897675973657]
  We propose to complete features for occluded regions so as to align the features of pedestrians across different occlusion patterns. In order to narrow down the gap between completed features and real fully visible ones, we propose an adversarial learning method. We report experimental results on the CityPersons, Caltech and CrowdHuman datasets.
  arXiv  Detail & Related papers  (2024-05-02T14:20:20Z)
• DPMesh: Exploiting Diffusion Prior for Occluded Human Mesh Recovery [71.6345505427213]
  DPMesh is an innovative framework for occluded human mesh recovery. It capitalizes on the profound diffusion prior about object structure and spatial relationships embedded in a pre-trained text-to-image diffusion model.
  arXiv  Detail & Related papers  (2024-04-01T18:59:13Z)
• Multiple Object Tracking based on Occlusion-Aware Embedding Consistency Learning [46.726678333518066]
  Occlusion Prediction Module (OPM) and Occlusion-Aware Association Module (OAAM) OPM predicts occlusion information for each true detection, facilitating the selection of valid samples for consistency learning of the track's visual embedding. OAAM generates two separate embeddings for each track, guaranteeing consistency in both unoccluded and occluded detections.
  arXiv  Detail & Related papers  (2023-11-05T06:08:58Z)
• DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions [52.63323657077447]
  We propose DNMOT, an end-to-end trainable DeNoising Transformer for multiple object tracking. Specifically, we augment the trajectory with noises during training and make our model learn the denoising process in an encoder-decoder architecture. We conduct extensive experiments on the MOT17, MOT20, and DanceTrack datasets, and the experimental results show that our method outperforms previous state-of-the-art methods by a clear margin.
  arXiv  Detail & Related papers  (2023-09-09T04:40:01Z)
• Occlusion-Aware Detection and Re-ID Calibrated Network for Multi-Object Tracking [38.36872739816151]
  Occlusion-Aware Attention (OAA) module in the detector highlights the object features while suppressing the occluded background regions. OAA can serve as a modulator that enhances the detector for some potentially occluded objects. We design a Re-ID embedding matching block based on the optimal transport problem.
  arXiv  Detail & Related papers  (2023-08-30T06:56:53Z)
• Occlusion Robust 3D Human Pose Estimation with StridedPoseGraphFormer and Data Augmentation [69.49430149980789]
  We show that our proposed method compares favorably with the state-of-the-art (SoA) Our experimental results also reveal that in the absence of any occlusion handling mechanism, the performance of SoA 3D HPE methods degrades significantly when they encounter occlusion.
  arXiv  Detail & Related papers  (2023-04-24T13:05:13Z)
• Feature Calibration Network for Occluded Pedestrian Detection [137.37275165635882]
  We propose a novel feature learning method in the deep learning framework, referred to as Feature Network (FC-Net) FC-Net is based on the observation that the visible parts of pedestrians are selective and decisive for detection. Experiments on CityPersons and Caltech datasets demonstrate that FC-Net improves detection performance on occluded pedestrians up to 10%.
  arXiv  Detail & Related papers  (2022-12-12T05:48:34Z)
• An Objective Method for Pedestrian Occlusion Level Classification [6.125017875330933]
  Occlusion level classification is achieved through the identification of visible pedestrian keypoints and through the use of a novel, effective method of 2D body surface area estimation. Experimental results demonstrate that the proposed method reflects the pixel-wise. occlusion level of pedestrians in images and is effective for all forms of. occlusion, including challenging edge cases such as self-occlusion, truncation. and inter-occluding pedestrians.
  arXiv  Detail & Related papers  (2022-05-11T11:27:41Z)
• Quality-aware Part Models for Occluded Person Re-identification [77.24920810798505]
  Occlusion poses a major challenge for person re-identification (ReID) Existing approaches typically rely on outside tools to infer visible body parts, which may be suboptimal in terms of both computational efficiency and ReID accuracy. We propose a novel method named Quality-aware Part Models (QPM) for occlusion-robust ReID.
  arXiv  Detail & Related papers  (2022-01-01T03:51:09Z)
• Locality-aware Channel-wise Dropout for Occluded Face Recognition [116.2355331029041]
  Face recognition is a challenging task in unconstrained scenarios, especially when faces are partially occluded. We propose a novel and elegant occlusion-simulation method via dropping the activations of a group of neurons in some elaborately selected channel. Experiments on various benchmarks show that the proposed method outperforms state-of-the-art methods with a remarkable improvement.
  arXiv  Detail & Related papers  (2021-07-20T05:53:14Z)
• DETR for Crowd Pedestrian Detection [114.00860636622949]
  The proposed detector PED(Pedestrian End-to-end Detector) outperforms both previous EDs and the baseline Faster-RCNN on CityPersons and CrowdHuman. It also achieves comparable performance with state-of-the-art pedestrian detection methods.
  arXiv  Detail & Related papers  (2020-12-12T11:02:05Z)
• Online Multi-Object Tracking with delta-GLMB Filter based on Occlusion and Identity Switch Handling [1.713291434132985]
  We propose an online multi-object tracking (MOT) method in a delta Generalized Labeled Multi-Bernoulli (delta-GLMB) filter framework. To handle occlusion and miss-detection issues, we propose a measurement-to-disappeared track association method. We evaluate the proposed method on well-known and publicly available MOT15 and MOT17 test datasets.
  arXiv  Detail & Related papers  (2020-11-19T21:38:40Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.