Context-Aware Unsupervised Clustering for Person Search

• URL: http://arxiv.org/abs/2110.01341v1
• Date: Mon, 4 Oct 2021 11:39:18 GMT
• Title: Context-Aware Unsupervised Clustering for Person Search
• Authors: Byeong-Ju Han, Kuhyeun Ko, and Jae-Young Sim
• Abstract summary: We introduce a novel framework of person search that is able to train the network in the absence of the person identity labels. We propose efficient unsupervised clustering methods to substitute the supervision process using annotated person identity labels. The experimental results show that the proposed method achieves comparable performance to that of the state-of-the-art supervised person search methods.
• Score: 13.99348653165494
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The existing person search methods use the annotated labels of person identities to train deep networks in a supervised manner that requires a huge amount of time and effort for human labeling. In this paper, we first introduce a novel framework of person search that is able to train the network in the absence of the person identity labels, and propose efficient unsupervised clustering methods to substitute the supervision process using annotated person identity labels. Specifically, we propose a hard negative mining scheme based on the uniqueness property that only a single person has the same identity to a given query person in each image. We also propose a hard positive mining scheme by using the contextual information of co-appearance that neighboring persons in one image tend to appear simultaneously in other images. The experimental results show that the proposed method achieves comparable performance to that of the state-of-the-art supervised person search methods, and furthermore outperforms the extended unsupervised person re-identification methods on the benchmark person search datasets.

Related papers

• Disentangled Representations for Short-Term and Long-Term Person Re-Identification [33.76874948187976]
  We propose a new generative adversarial network, dubbed identity shuffle GAN (IS-GAN) It disentangles identity-related and unrelated features from person images through an identity-shuffling technique. Experimental results validate the effectiveness of IS-GAN, showing state-of-the-art performance on standard reID benchmarks.
  arXiv  Detail & Related papers  (2024-09-09T02:09:49Z)
• Keypoint Promptable Re-Identification [76.31113049256375]
  Occluded Person Re-Identification (ReID) is a metric learning task that involves matching occluded individuals based on their appearance. We introduce Keypoint Promptable ReID (KPR), a novel formulation of the ReID problem that explicitly complements the input bounding box with a set of semantic keypoints. We release custom keypoint labels for four popular ReID benchmarks. Experiments on person retrieval, but also on pose tracking, demonstrate that our method systematically surpasses previous state-of-the-art approaches.
  arXiv  Detail & Related papers  (2024-07-25T15:20:58Z)
• Unsupervised Text Deidentification [101.2219634341714]
  We propose an unsupervised deidentification method that masks words that leak personally-identifying information. Motivated by K-anonymity based privacy, we generate redactions that ensure a minimum reidentification rank.
  arXiv  Detail & Related papers  (2022-10-20T18:54:39Z)
• End-to-End Context-Aided Unicity Matching for Person Re-identification [100.02321122258638]
  We propose an end-to-end person unicity matching architecture for learning and refining the person matching relations. We use the samples' global context relationship to refine the soft matching results and reach the matching unicity through bipartite graph matching. Given full consideration to real-world person re-identification applications, we achieve the unicity matching in both one-shot and multi-shot settings.
  arXiv  Detail & Related papers  (2022-10-20T07:33:57Z)
• CGUA: Context-Guided and Unpaired-Assisted Weakly Supervised Person Search [54.106662998673514]
  We introduce a Context-Guided and Unpaired-Assisted (CGUA) weakly supervised person search framework. Specifically, we propose a novel Context-Guided Cluster (CGC) algorithm to leverage context information in the clustering process. Our method achieves comparable or better performance to the state-of-the-art supervised methods by leveraging more diverse unlabeled data.
  arXiv  Detail & Related papers  (2022-03-27T13:57:30Z)
• Taking Modality-free Human Identification as Zero-shot Learning [46.51413603352702]
  We develop a novel Modality-Free Human Identification (named MFHI) task as a generic zero-shot learning model in a scalable way. It is capable of bridging the visual and semantic modalities by learning a discriminative prototype of each identity. In addition, the semantics-guided spatial attention is enforced on visual modality to obtain representations with both high global category-level and local attribute-level discrimination.
  arXiv  Detail & Related papers  (2020-10-02T13:08:27Z)
• Learning Person Re-identification Models from Videos with Weak Supervision [53.53606308822736]
  We introduce the problem of learning person re-identification models from videos with weak supervision. We propose a multiple instance attention learning framework for person re-identification using such video-level labels. The attention weights are obtained based on all person images instead of person tracklets in a video, making our learned model less affected by noisy annotations.
  arXiv  Detail & Related papers  (2020-07-21T07:23:32Z)
• FMT:Fusing Multi-task Convolutional Neural Network for Person Search [33.91664470686695]
  We propose a fusing multi-task convolutional neural network(FMT-CNN) to tackle the correlation and heterogeneity of detection and re-identification. Experiment results on CUHK-SYSU Person Search dataset show that the performance of our proposed method is superior to state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-03-01T05:20:47Z)
• Intra-Camera Supervised Person Re-Identification [87.88852321309433]
  We propose a novel person re-identification paradigm based on an idea of independent per-camera identity annotation. This eliminates the most time-consuming and tedious inter-camera identity labelling process. We formulate a Multi-tAsk mulTi-labEl (MATE) deep learning method for Intra-Camera Supervised (ICS) person re-id.
  arXiv  Detail & Related papers  (2020-02-12T15:26:33Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.