Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization

• URL: http://arxiv.org/abs/2103.15537v1
• Date: Mon, 29 Mar 2021 12:10:50 GMT
• Title: Cloth-Changing Person Re-identification from A Single Image with Gait Prediction and Regularization
• Authors: Xin Jin, Tianyu He, Kecheng Zheng, Zhiheng Yin, Xu Shen, Zhen Huang, Ruoyu Feng, Jianqiang Huang, Xian-Sheng Hua, Zhibo Chen
• Abstract summary: We introduce Gait recognition as an auxiliary task to drive the Image ReID model to learn cloth-agnostic representations. Experiments on image-based Cloth-Changing ReID benchmarks, e.g., LTCC, PRCC, Real28, and VC-Clothes, demonstrate that GI-ReID performs favorably against the state-of-the-arts.
• Score: 65.50321170655225
• License: http://creativecommons.org/publicdomain/zero/1.0/
• Abstract: Cloth-Changing person re-identification (CC-ReID) aims at matching the same person across different locations over a long-duration, e.g., over days, and therefore inevitably meets challenge of changing clothing. In this paper, we focus on handling well the CC-ReID problem under a more challenging setting, i.e., just from a single image, which enables high-efficiency and latency-free pedestrian identify for real-time surveillance applications. Specifically, we introduce Gait recognition as an auxiliary task to drive the Image ReID model to learn cloth-agnostic representations by leveraging personal unique and cloth-independent gait information, we name this framework as GI-ReID. GI-ReID adopts a two-stream architecture that consists of a image ReID-Stream and an auxiliary gait recognition stream (Gait-Stream). The Gait-Stream, that is discarded in the inference for high computational efficiency, acts as a regulator to encourage the ReID-Stream to capture cloth-invariant biometric motion features during the training. To get temporal continuous motion cues from a single image, we design a Gait Sequence Prediction (GSP) module for Gait-Stream to enrich gait information. Finally, a high-level semantics consistency over two streams is enforced for effective knowledge regularization. Experiments on multiple image-based Cloth-Changing ReID benchmarks, e.g., LTCC, PRCC, Real28, and VC-Clothes, demonstrate that GI-ReID performs favorably against the state-of-the-arts. Codes are available at https://github.com/jinx-USTC/GI-ReID.

Related papers

• Comprehensive Generative Replay for Task-Incremental Segmentation with Concurrent Appearance and Semantic Forgetting [49.87694319431288]
  Generalist segmentation models are increasingly favored for diverse tasks involving various objects from different image sources. We propose a Comprehensive Generative (CGR) framework that restores appearance and semantic knowledge by synthesizing image-mask pairs. Experiments on incremental tasks (cardiac, fundus and prostate segmentation) show its clear advantage for alleviating concurrent appearance and semantic forgetting.
  arXiv  Detail & Related papers  (2024-06-28T10:05:58Z)
• Synthesizing Efficient Data with Diffusion Models for Person Re-Identification Pre-Training [51.87027943520492]
  We present a novel paradigm Diffusion-ReID to efficiently augment and generate diverse images based on known identities. Benefiting from our proposed paradigm, we first create a new large-scale person Re-ID dataset Diff-Person, which consists of over 777K images from 5,183 identities.
  arXiv  Detail & Related papers  (2024-06-10T06:26:03Z)
• A Generative Approach for Wikipedia-Scale Visual Entity Recognition [56.55633052479446]
  We address the task of mapping a given query image to one of the 6 million existing entities in Wikipedia. We introduce a novel Generative Entity Recognition framework, which learns to auto-regressively decode a semantic and discriminative code'' identifying the target entity.
  arXiv  Detail & Related papers  (2024-03-04T13:47:30Z)
• CCPA: Long-term Person Re-Identification via Contrastive Clothing and Pose Augmentation [2.1756081703276]
  Long-term Person Re-Identification aims at matching an individual across cameras after a long period of time. We propose CCPA: Contrastive Clothing and Pose Augmentation framework for LRe-ID.
  arXiv  Detail & Related papers  (2024-02-22T11:16:34Z)
• Semantic-aware Consistency Network for Cloth-changing Person Re-Identification [8.885551377703944]
  We present a Semantic-aware Consistency Network (SCNet) to learn identity-related semantic features. We generate the black-clothing image by erasing pixels in the clothing area. We further design a semantic consistency loss to facilitate the learning of high-level identity-related semantic features.
  arXiv  Detail & Related papers  (2023-08-27T14:07:57Z)
• Distillation-guided Representation Learning for Unconstrained Gait Recognition [50.0533243584942]
  We propose a framework, termed GAit DEtection and Recognition (GADER), for human authentication in challenging outdoor scenarios. GADER builds discriminative features through a novel gait recognition method, where only frames containing gait information are used. We evaluate our method on multiple State-of-The-Arts(SoTA) gait baselines and demonstrate consistent improvements on indoor and outdoor datasets.
  arXiv  Detail & Related papers  (2023-07-27T01:53:57Z)
• Learning Invariance from Generated Variance for Unsupervised Person Re-identification [15.096776375794356]
  We propose to replace traditional data augmentation with a generative adversarial network (GAN) A 3D mesh guided person image generator is proposed to disentangle a person image into id-related and id-unrelated features. By jointly training the generative and the contrastive modules, our method achieves new state-of-the-art unsupervised person ReID performance on mainstream large-scale benchmarks.
  arXiv  Detail & Related papers  (2023-01-02T15:40:14Z)
• A Benchmark of Video-Based Clothes-Changing Person Re-Identification [20.010401795892125]
  We study the relatively new yet practical problem of clothes-changing video-based person re-identification (CCVReID) We develop a two-branch confidence-aware re-ranking framework for handling the CCVReID problem. We build two new benchmark datasets for CCVReID problem.
  arXiv  Detail & Related papers  (2022-11-21T03:38:18Z)
• Revisiting Consistency Regularization for Semi-supervised Change Detection in Remote Sensing Images [60.89777029184023]
  We propose a semi-supervised CD model in which we formulate an unsupervised CD loss in addition to the supervised Cross-Entropy (CE) loss. Experiments conducted on two publicly available CD datasets show that the proposed semi-supervised CD method can reach closer to the performance of supervised CD.
  arXiv  Detail & Related papers  (2022-04-18T17:59:01Z)
• Unleashing the Potential of Unsupervised Pre-Training with Intra-Identity Regularization for Person Re-Identification [10.045028405219641]
  We design an Unsupervised Pre-training framework for ReID based on the contrastive learning (CL) pipeline, dubbed UP-ReID. We introduce an intra-identity (I$2$-)regularization in the UP-ReID, which is instantiated as two constraints coming from global image aspect and local patch aspect. Our UP-ReID pre-trained model can significantly benefit the downstream ReID fine-tuning and achieve state-of-the-art performance.
  arXiv  Detail & Related papers  (2021-12-01T07:16:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.