Motion-Aware Transformer For Occluded Person Re-identification

• URL: http://arxiv.org/abs/2202.04243v2
• Date: Thu, 10 Feb 2022 11:18:49 GMT
• Title: Motion-Aware Transformer For Occluded Person Re-identification
• Authors: Mi Zhou, Hongye Liu, Zhekun Lv, Wei Hong, Xiai Chen
• Abstract summary: We propose a self-supervised deep learning method to improve the location performance for human parts through occluded person Re-ID. Unlike previous works, we find that motion information derived from the photos of various human postures can help identify major human body components.
• Score: 1.9899263094148867
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Recently, occluded person re-identification(Re-ID) remains a challenging task that people are frequently obscured by other people or obstacles, especially in a crowd massing situation. In this paper, we propose a self-supervised deep learning method to improve the location performance for human parts through occluded person Re-ID. Unlike previous works, we find that motion information derived from the photos of various human postures can help identify major human body components. Firstly, a motion-aware transformer encoder-decoder architecture is designed to obtain keypoints heatmaps and part-segmentation maps. Secondly, an affine transformation module is utilized to acquire motion information from the keypoint detection branch. Then the motion information will support the segmentation branch to achieve refined human part segmentation maps, and effectively divide the human body into reasonable groups. Finally, several cases demonstrate the efficiency of the proposed model in distinguishing different representative parts of the human body, which can avoid the background and occlusion disturbs. Our method consistently achieves state-of-the-art results on several popular datasets, including occluded, partial, and holistic.

Related papers

• AiOS: All-in-One-Stage Expressive Human Pose and Shape Estimation [55.179287851188036]
  We introduce a novel all-in-one-stage framework, AiOS, for expressive human pose and shape recovery without an additional human detection step. We first employ a human token to probe a human location in the image and encode global features for each instance. Then, we introduce a joint-related token to probe the human joint in the image and encoder a fine-grained local feature.
  arXiv  Detail & Related papers  (2024-03-26T17:59:23Z)
• PGDS: Pose-Guidance Deep Supervision for Mitigating Clothes-Changing in Person Re-Identification [10.140070649542949]
  Person Re-Identification (Re-ID) task seeks to enhance the tracking of multiple individuals by surveillance cameras. One of the most significant challenges faced in Re-ID is clothes-changing, where the same person may appear in different outfits. We propose the Pose-Guidance Deep Supervision (PGDS), an effective framework for learning pose guidance within the Re-ID task.
  arXiv  Detail & Related papers  (2023-12-09T18:43:05Z)
• Collaborative Feature Learning for Fine-grained Facial Forgery Detection and Segmentation [56.73855202368894]
  Previous work related to forgery detection mostly focuses on the entire faces. Recent forgery methods have developed to edit important facial components while maintaining others unchanged. We propose a collaborative feature learning approach to simultaneously detect manipulation and segment the falsified components.
  arXiv  Detail & Related papers  (2023-04-17T08:49:11Z)
• Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentification [29.200286257496714]
  We propose a novel identity-guided collaborative learning scheme (IGCL) for cloth-changing person ReID. First, we design a novel clothing attention stream to reasonably reduce the interference caused by clothing information. Second, we propose a human semantic attention and body jigsaw stream to highlight the human semantic information and simulate different poses of the same identity. Third, a pedestrian identity enhancement stream is further proposed to enhance the identity importance and extract more favorable identity robust features.
  arXiv  Detail & Related papers  (2023-04-10T06:05:54Z)
• Occluded Person Re-Identification via Relational Adaptive Feature Correction Learning [8.015703163954639]
  Occluded person re-identification (Re-ID) in images captured by multiple cameras is challenging because the target person is occluded by pedestrians or objects. Most existing methods utilize the off-the-shelf pose or parsing networks as pseudo labels, which are prone to error. We propose a novel Occlusion Correction Network (OCNet) that corrects features through relational-weight learning and obtains diverse and representative features without using external networks.
  arXiv  Detail & Related papers  (2022-12-09T07:48:47Z)
• Body Part-Based Representation Learning for Occluded Person Re-Identification [102.27216744301356]
  Occluded person re-identification (ReID) is a person retrieval task which aims at matching occluded person images with holistic ones. Part-based methods have been shown beneficial as they offer fine-grained information and are well suited to represent partially visible human bodies. We propose BPBreID, a body part-based ReID model for solving the above issues.
  arXiv  Detail & Related papers  (2022-11-07T16:48:41Z)
• Pose-guided Feature Disentangling for Occluded Person Re-identification Based on Transformer [15.839842504357144]
  Occluded person re-identification is a challenging task as human body parts could be occluded by some obstacles. Some existing pose-guided methods solve this problem by aligning body parts according to graph matching. We propose a transformer-based Pose-guided Feature Disentangling (PFD) method by utilizing pose information to clearly disentangle semantic components.
  arXiv  Detail & Related papers  (2021-12-05T03:23:31Z)
• Diverse Part Discovery: Occluded Person Re-identification with Part-Aware Transformer [95.02123369512384]
  Occluded person re-identification (Re-ID) is a challenging task as persons are frequently occluded by various obstacles or other persons. We propose a novel end-to-end Part-Aware Transformer (PAT) for occluded person Re-ID through diverse part discovery.
  arXiv  Detail & Related papers  (2021-06-08T04:29:07Z)
• Generalized Organ Segmentation by Imitating One-shot Reasoning using Anatomical Correlation [55.1248480381153]
  We propose OrganNet which learns a generalized organ concept from a set of annotated organ classes and then transfer this concept to unseen classes. We show that OrganNet can effectively resist the wide variations in organ morphology and produce state-of-the-art results in one-shot segmentation task.
  arXiv  Detail & Related papers  (2021-03-30T13:41:12Z)
• PoseTrackReID: Dataset Description [97.7241689753353]
  Pose information is helpful to disentangle useful feature information from background or occlusion noise. With PoseTrackReID, we want to bridge the gap between person re-ID and multi-person pose tracking. This dataset provides a good benchmark for current state-of-the-art methods on multi-frame person re-ID.
  arXiv  Detail & Related papers  (2020-11-12T07:44:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.