Semantic-guided Pixel Sampling for Cloth-Changing Person Re-identification

• URL: http://arxiv.org/abs/2107.11522v1
• Date: Sat, 24 Jul 2021 03:41:00 GMT
• Title: Semantic-guided Pixel Sampling for Cloth-Changing Person Re-identification
• Authors: Xiujun Shu, Ge Li, Xiao Wang, Weijian Ruan, Qi Tian
• Abstract summary: This paper proposes a semantic-guided pixel sampling approach for the cloth-changing person re-ID task. We first recognize the pedestrian's upper clothes and pants, then randomly change them by sampling pixels from other pedestrians. Our method achieved 65.8% on Rank1 accuracy, which outperforms previous methods with a large margin.
• Score: 80.70419698308064
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Cloth-changing person re-identification (re-ID) is a new rising research topic that aims at retrieving pedestrians whose clothes are changed. This task is quite challenging and has not been fully studied to date. Current works mainly focus on body shape or contour sketch, but they are not robust enough due to view and posture variations. The key to this task is to exploit cloth-irrelevant cues. This paper proposes a semantic-guided pixel sampling approach for the cloth-changing person re-ID task. We do not explicitly define which feature to extract but force the model to automatically learn cloth-irrelevant cues. Specifically, we first recognize the pedestrian's upper clothes and pants, then randomly change them by sampling pixels from other pedestrians. The changed samples retain the identity labels but exchange the pixels of clothes or pants among different pedestrians. Besides, we adopt a loss function to constrain the learned features to keep consistent before and after changes. In this way, the model is forced to learn cues that are irrelevant to upper clothes and pants. We conduct extensive experiments on the latest released PRCC dataset. Our method achieved 65.8% on Rank1 accuracy, which outperforms previous methods with a large margin. The code is available at https://github.com/shuxjweb/pixel_sampling.git.

Related papers

• Neural Point-based Shape Modeling of Humans in Challenging Clothing [75.75870953766935]
  Parametric 3D body models like SMPL only represent minimally-clothed people and are hard to extend to clothing. We extend point-based methods with a coarse stage, that replaces canonicalization with a learned pose-independent "coarse shape" The approach works well for garments that both conform to, and deviate from, the body.
  arXiv  Detail & Related papers  (2022-09-14T17:59:17Z)
• A Semantic-aware Attention and Visual Shielding Network for Cloth-changing Person Re-identification [29.026249268566303]
  Cloth-changing person reidentification (ReID) is a newly emerging research topic that aims to retrieve pedestrians whose clothes are changed. Since the human appearance with different clothes exhibits large variations, it is very difficult for existing approaches to extract discriminative and robust feature representations. This work proposes a novel semantic-aware attention and visual shielding network for cloth-changing person ReID.
  arXiv  Detail & Related papers  (2022-07-18T05:38:37Z)
• Clothes-Changing Person Re-identification with RGB Modality Only [102.44387094119165]
  We propose a Clothes-based Adrial Loss (CAL) to mine clothes-irrelevant features from the original RGB images. Videos contain richer appearance and additional temporal information, which can be used to model propertemporal patterns.
  arXiv  Detail & Related papers  (2022-04-14T11:38:28Z)
• Multigranular Visual-Semantic Embedding for Cloth-Changing Person Re-identification [38.7806002518266]
  This work proposes a novel visual-semantic embedding algorithm (MVSE) for cloth-changing person ReID. To fully represent a person with clothing changes, a multigranular feature representation scheme (MGR) is employed, and then a cloth desensitization network (CDN) is designed. A partially semantically aligned network (PSA) is proposed to obtain the visual-semantic information that is used to align the human attributes.
  arXiv  Detail & Related papers  (2021-08-10T09:14:44Z)
• Apparel-invariant Feature Learning for Apparel-changed Person Re-identification [70.16040194572406]
  Most public ReID datasets are collected in a short time window in which persons' appearance rarely changes. In real-world applications such as in a shopping mall, the same person's clothing may change, and different persons may wearing similar clothes. It is critical to learn an apparel-invariant person representation under cases like cloth changing or several persons wearing similar clothes.
  arXiv  Detail & Related papers  (2020-08-14T03:49:14Z)
• Long-Term Cloth-Changing Person Re-identification [154.57752691285046]
  Person re-identification (Re-ID) aims to match a target person across camera views at different locations and times. Existing Re-ID studies focus on the short-term cloth-consistent setting, under which a person re-appears in different camera views with the same outfit. In this work, we focus on a much more difficult yet practical setting where person matching is conducted over long-duration, e.g., over days and months.
  arXiv  Detail & Related papers  (2020-05-26T11:27:21Z)
• Person Re-identification by Contour Sketch under Moderate Clothing Change [95.83034113646657]
  Person re-id, the process of matching pedestrian images across different camera views, is an important task in visual surveillance. In this work, we call the person re-id under clothing change the "cross-clothes person re-id" Due to the lack of a large-scale dataset for cross-clothes person re-id, we contribute a new dataset that consists of 33698 images from 221 identities.
  arXiv  Detail & Related papers  (2020-02-06T15:13:55Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.