Identity-aware Feature Decoupling Learning for Clothing-change Person Re-identification

• URL: http://arxiv.org/abs/2501.05851v1
• Date: Fri, 10 Jan 2025 10:45:38 GMT
• Title: Identity-aware Feature Decoupling Learning for Clothing-change Person Re-identification
• Authors: Haoxuan Xu, Bo Li, Guanglin Niu,
• Abstract summary: We propose an Identity-aware Feature Decoupling (IFD) learning framework to mine identity-related features. IFD exploits a dual stream architecture that consists of a main stream and an attention stream. We propose a clothing bias diminishing module specific to the main stream to regularize the features of clothing-relevant regions.
• Score: 9.174737809840416
• License:
• Abstract: Clothing-change person re-identification (CC Re-ID) has attracted increasing attention in recent years due to its application prospect. Most existing works struggle to adequately extract the ID-related information from the original RGB images. In this paper, we propose an Identity-aware Feature Decoupling (IFD) learning framework to mine identity-related features. Particularly, IFD exploits a dual stream architecture that consists of a main stream and an attention stream. The attention stream takes the clothing-masked images as inputs and derives the identity attention weights for effectively transferring the spatial knowledge to the main stream and highlighting the regions with abundant identity-related information. To eliminate the semantic gap between the inputs of two streams, we propose a clothing bias diminishing module specific to the main stream to regularize the features of clothing-relevant regions. Extensive experimental results demonstrate that our framework outperforms other baseline models on several widely-used CC Re-ID datasets.

Related papers

• See What You Seek: Semantic Contextual Integration for Cloth-Changing Person Re-Identification [16.845045499676793]
  Cloth-changing person re-identification (CC-ReID) aims to match individuals across multiple surveillance cameras despite variations in clothing. Existing methods typically focus on mitigating the effects of clothing changes or enhancing ID-relevant features. We propose a novel prompt learning framework, Semantic Contextual Integration (SCI), for CC-ReID.
  arXiv  Detail & Related papers  (2024-12-02T10:11:16Z)
• Content and Salient Semantics Collaboration for Cloth-Changing Person Re-Identification [74.10897798660314]
  Cloth-changing person Re-IDentification aims at recognizing the same person with clothing changes across non-overlapping cameras. We propose the Content and Salient Semantics Collaboration framework, facilitating cross-parallel semantics interaction and refinement. Our framework is simple yet effective, and the vital design is the Semantics Mining and Refinement (SMR) module.
  arXiv  Detail & Related papers  (2024-05-26T15:17:28Z)
• ID-Aligner: Enhancing Identity-Preserving Text-to-Image Generation with Reward Feedback Learning [57.91881829308395]
  Identity-preserving text-to-image generation (ID-T2I) has received significant attention due to its wide range of application scenarios like AI portrait and advertising. We present textbfID-Aligner, a general feedback learning framework to enhance ID-T2I performance.
  arXiv  Detail & Related papers  (2024-04-23T18:41:56Z)
• Identity-aware Dual-constraint Network for Cloth-Changing Person Re-identification [13.709863134725335]
  Cloth-Changing Person Re-Identification (CC-ReID) aims to accurately identify the target person in more realistic surveillance scenarios, where pedestrians usually change their clothing. Despite great progress, limited cloth-changing training samples in existing CC-ReID datasets still prevent the model from adequately learning cloth-irrelevant features. We propose an Identity-aware Dual-constraint Network (IDNet) for the CC-ReID task.
  arXiv  Detail & Related papers  (2024-03-13T05:46:36Z)
• HFORD: High-Fidelity and Occlusion-Robust De-identification for Face Privacy Protection [60.63915939982923]
  Face de-identification is a practical way to solve the identity protection problem. The existing facial de-identification methods have revealed several problems. We present a High-Fidelity and Occlusion-Robust De-identification (HFORD) method to deal with these issues.
  arXiv  Detail & Related papers  (2023-11-15T08:59:02Z)
• Semantic-aware Consistency Network for Cloth-changing Person Re-Identification [8.885551377703944]
  We present a Semantic-aware Consistency Network (SCNet) to learn identity-related semantic features. We generate the black-clothing image by erasing pixels in the clothing area. We further design a semantic consistency loss to facilitate the learning of high-level identity-related semantic features.
  arXiv  Detail & Related papers  (2023-08-27T14:07:57Z)
• Exploring Fine-Grained Representation and Recomposition for Cloth-Changing Person Re-Identification [78.52704557647438]
  We propose a novel FIne-grained Representation and Recomposition (FIRe$2$) framework to tackle both limitations without any auxiliary annotation or data. Experiments demonstrate that FIRe$2$ can achieve state-of-the-art performance on five widely-used cloth-changing person Re-ID benchmarks.
  arXiv  Detail & Related papers  (2023-08-21T12:59:48Z)
• Identity-Guided Collaborative Learning for Cloth-Changing Person Reidentification [29.200286257496714]
  We propose a novel identity-guided collaborative learning scheme (IGCL) for cloth-changing person ReID. First, we design a novel clothing attention stream to reasonably reduce the interference caused by clothing information. Second, we propose a human semantic attention and body jigsaw stream to highlight the human semantic information and simulate different poses of the same identity. Third, a pedestrian identity enhancement stream is further proposed to enhance the identity importance and extract more favorable identity robust features.
  arXiv  Detail & Related papers  (2023-04-10T06:05:54Z)
• FaceDancer: Pose- and Occlusion-Aware High Fidelity Face Swapping [62.38898610210771]
  We present a new single-stage method for subject face swapping and identity transfer, named FaceDancer. We have two major contributions: Adaptive Feature Fusion Attention (AFFA) and Interpreted Feature Similarity Regularization (IFSR)
  arXiv  Detail & Related papers  (2022-10-19T11:31:38Z)
• Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization [65.50321170655225]
  We introduce Gait recognition as an auxiliary task to drive the Image ReID model to learn cloth-agnostic representations. Experiments on image-based Cloth-Changing ReID benchmarks, e.g., LTCC, PRCC, Real28, and VC-Clothes, demonstrate that GI-ReID performs favorably against the state-of-the-arts.
  arXiv  Detail & Related papers  (2021-03-29T12:10:50Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.