Rethinking of Pedestrian Attribute Recognition: A Reliable Evaluation under Zero-Shot Pedestrian Identity Setting

• URL: http://arxiv.org/abs/2107.03576v1
• Date: Thu, 8 Jul 2021 03:12:24 GMT
• Title: Rethinking of Pedestrian Attribute Recognition: A Reliable Evaluation under Zero-Shot Pedestrian Identity Setting
• Authors: Jian Jia, Houjing Huang, Xiaotang Chen and Kaiqi Huang
• Abstract summary: We argue that it is time to step back and analyze the status quo of pedestrian attribute recognition. We formally define and distinguish pedestrian attribute recognition from other similar tasks. Experiments are conducted on four existing datasets and two proposed datasets to measure progress on pedestrian attribute recognition.
• Score: 48.347987541336146
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Pedestrian attribute recognition aims to assign multiple attributes to one pedestrian image captured by a video surveillance camera. Although numerous methods are proposed and make tremendous progress, we argue that it is time to step back and analyze the status quo of the area. We review and rethink the recent progress from three perspectives. First, given that there is no explicit and complete definition of pedestrian attribute recognition, we formally define and distinguish pedestrian attribute recognition from other similar tasks. Second, based on the proposed definition, we expose the limitations of the existing datasets, which violate the academic norm and are inconsistent with the essential requirement of practical industry application. Thus, we propose two datasets, PETA\textsubscript{$ZS$} and RAP\textsubscript{$ZS$}, constructed following the zero-shot settings on pedestrian identity. In addition, we also introduce several realistic criteria for future pedestrian attribute dataset construction. Finally, we reimplement existing state-of-the-art methods and introduce a strong baseline method to give reliable evaluations and fair comparisons. Experiments are conducted on four existing datasets and two proposed datasets to measure progress on pedestrian attribute recognition.

Related papers

• Keypoint Promptable Re-Identification [76.31113049256375]
  Occluded Person Re-Identification (ReID) is a metric learning task that involves matching occluded individuals based on their appearance. We introduce Keypoint Promptable ReID (KPR), a novel formulation of the ReID problem that explicitly complements the input bounding box with a set of semantic keypoints. We release custom keypoint labels for four popular ReID benchmarks. Experiments on person retrieval, but also on pose tracking, demonstrate that our method systematically surpasses previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-07-25T15:20:58Z)
• A Solution to Co-occurrence Bias: Attributes Disentanglement via Mutual Information Minimization for Pedestrian Attribute Recognition [10.821982414387525]
  We show that current methods can actually suffer in generalizing such fitted attributes interdependencies onto scenes or identities off the dataset distribution. To render models robust in realistic scenes, we propose the attributes-disentangled feature learning to ensure the recognition of an attribute not inferring on the existence of others.
  arXiv  Detail & Related papers  (2023-07-28T01:34:55Z)
• UPAR: Unified Pedestrian Attribute Recognition and Person Retrieval [4.6193503399184275]
  We present UPAR, the Unified Person Attribute Recognition dataset. It is based on four well-known person attribute recognition datasets: PA100k, PETA, RAPv2, and Market1501. We unify those datasets by providing 3,3M additional annotations to harmonize 40 important binary attributes over 12 attribute categories.
  arXiv  Detail & Related papers  (2022-09-06T14:20:56Z)
• Visual Recognition by Request [111.94887516317735]
  We present a novel protocol of annotation and evaluation for visual recognition. It does not require the labeler/algorithm to annotate/recognize all targets (objects, parts, etc.) at once, but instead raises a number of recognition instructions and the algorithm recognizes targets by request. We evaluate the recognition system on two mixed-annotated datasets, CPP and ADE20K, and demonstrate its promising ability of learning from partially labeled data.
  arXiv  Detail & Related papers  (2022-07-28T16:55:11Z)
• Spatial and Semantic Consistency Regularizations for Pedestrian Attribute Recognition [50.932864767867365]
  We propose a framework that consists of two complementary regularizations to achieve spatial and semantic consistency for each attribute. Based on the precise attribute locations, we propose a semantic consistency regularization to extract intrinsic and discriminative semantic features. Results show that the proposed method performs favorably against state-of-the-art methods without increasing parameters.
  arXiv  Detail & Related papers  (2021-09-13T03:36:44Z)
• Exploring Visual Context for Weakly Supervised Person Search [155.46727990750227]
  Person search has recently emerged as a challenging task that jointly addresses pedestrian detection and person re-identification. Existing approaches follow a fully supervised setting where both bounding box and identity annotations are available. This paper inventively considers weakly supervised person search with only bounding box annotations.
  arXiv  Detail & Related papers  (2021-06-19T14:47:13Z)
• Do Feature Attribution Methods Correctly Attribute Features? [5.58592454173439]
  Feature attribution methods are exceedingly popular in interpretable machine learning. There is no consensus on the definition of "attribution" We evaluate three methods: saliency maps, rationales, and attention.
  arXiv  Detail & Related papers  (2021-04-27T20:35:30Z)
• From Handcrafted to Deep Features for Pedestrian Detection: A Survey [148.35460817092908]
  Pedestrian detection is an important but challenging problem in computer vision. Over the past decade, significant improvement has been witnessed with the help of handcrafted features and deep features. In addition to single-spectral pedestrian detection, we also review multi-spectral pedestrian detection.
  arXiv  Detail & Related papers  (2020-10-01T14:51:10Z)
• Rethinking of Pedestrian Attribute Recognition: Realistic Datasets with Efficient Method [39.867773623939435]
  Images of same pedestrian identity in train set and test set are extremely similar, leading to overestimated performance of state-of-the-art methods on existing datasets. We propose two realistic datasets PETAtextsubscript$zs$ and RAPv2textsubscript$zs$ following zero-shot setting of pedestrian identities. Our method achieves state-of-the-art performance on PETA, RAPv2, PETAtextsubscript$zs$ and RAPv2textsubscript$zs$.
  arXiv  Detail & Related papers  (2020-05-25T03:30:15Z)
• Pedestrian Attribute Recognition: A Survey [26.939872088531036]
  We introduce the background of pedestrian attribute recognition (PAR) We introduce existing benchmarks, including popular datasets and evaluation criteria. We show some applications that take pedestrian attributes into consideration and achieve better performance.
  arXiv  Detail & Related papers  (2019-01-22T17:16:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.