Learning Longterm Representations for Person Re-Identification Using Radio Signals

• URL: http://arxiv.org/abs/2004.01091v1
• Date: Thu, 2 Apr 2020 15:50:42 GMT
• Title: Learning Longterm Representations for Person Re-Identification Using Radio Signals
• Authors: Lijie Fan, Tianhong Li, Rongyao Fang, Rumen Hristov, Yuan Yuan, Dina Katabi
• Abstract summary: Person Re-Identification (ReID) aims to recognize a person-of-interest across different places and times. We introduce RF-ReID, a novel approach that harnesses radio frequency (RF) signals for longterm person ReID. RF-ReID outperforms state-of-the-art RGB-based ReID approaches for long term person ReID.
• Score: 26.900504973871122
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Person Re-Identification (ReID) aims to recognize a person-of-interest across different places and times. Existing ReID methods rely on images or videos collected using RGB cameras. They extract appearance features like clothes, shoes, hair, etc. Such features, however, can change drastically from one day to the next, leading to inability to identify people over extended time periods. In this paper, we introduce RF-ReID, a novel approach that harnesses radio frequency (RF) signals for longterm person ReID. RF signals traverse clothes and reflect off the human body; thus they can be used to extract more persistent human-identifying features like body size and shape. We evaluate the performance of RF-ReID on longitudinal datasets that span days and weeks, where the person may wear different clothes across days. Our experiments demonstrate that RF-ReID outperforms state-of-the-art RGB-based ReID approaches for long term person ReID. Our results also reveal two interesting features: First since RF signals work in the presence of occlusions and poor lighting, RF-ReID allows for person ReID in such scenarios. Second, unlike photos and videos which reveal personal and private information, RF signals are more privacy-preserving, and hence can help extend person ReID to privacy-concerned domains, like healthcare.

Related papers

• CCPA: Long-term Person Re-Identification via Contrastive Clothing and Pose Augmentation [2.1756081703276]
  Long-term Person Re-Identification aims at matching an individual across cameras after a long period of time. We propose CCPA: Contrastive Clothing and Pose Augmentation framework for LRe-ID.
  arXiv  Detail & Related papers  (2024-02-22T11:16:34Z)
• Instruct-ReID: A Multi-purpose Person Re-identification Task with Instructions [64.55715112644562]
  We propose a new instruct-ReID task that requires the model to retrieve images according to the given image or language instructions. Our instruct-ReID is a more general ReID setting, where existing 6 ReID tasks can be viewed as special cases by designing different instructions. Experimental results show that the proposed multi-purpose ReID model, trained on our OmniReID benchmark without fine-tuning, can improve +0.5%, +0.6%, +7.7% mAP on Market1501, MSMT17, CUHK03 for traditional ReID, +6.4%, +7.1%, +11.2% mAP on PRCC,
  arXiv  Detail & Related papers  (2023-06-13T03:25:33Z)
• Cross Vision-RF Gait Re-identification with Low-cost RGB-D Cameras and mmWave Radars [15.662787088335618]
  This work studies the problem of cross-modal human re-identification (ReID) We propose the first-of-its-kind vision-RF system for cross-modal multi-person ReID at the same time. Our proposed system is able to achieve 92.5% top-1 accuracy and 97.5% top-5 accuracy out of 56 volunteers.
  arXiv  Detail & Related papers  (2022-07-16T10:34:25Z)
• Unsupervised Learning for Human Sensing Using Radio Signals [29.118868792782937]
  This paper explores the feasibility of adapting RGB-based unsupervised representation learning to RF signals. We show that while contrastive learning has emerged as the main technique for unsupervised representation learning from images and videos, such methods produce poor performance when applied to sensing humans using RF signals. In contrast, predictive unsupervised learning methods learn high-quality representations that can be used for multiple downstream RF-based sensing tasks.
  arXiv  Detail & Related papers  (2022-07-06T00:28:18Z)
• Clothes-Changing Person Re-identification with RGB Modality Only [102.44387094119165]
  We propose a Clothes-based Adrial Loss (CAL) to mine clothes-irrelevant features from the original RGB images. Videos contain richer appearance and additional temporal information, which can be used to model propertemporal patterns.
  arXiv  Detail & Related papers  (2022-04-14T11:38:28Z)
• RFGAN: RF-Based Human Synthesis [9.709890321556204]
  This paper aims to generate fine-grained optical human images by introducing a novel cross-modal RFGAN model. To the best of our knowledge, this is the first work to generate optical images based on RF signals.
  arXiv  Detail & Related papers  (2021-12-07T14:34:35Z)
• Video Person Re-identification using Attribute-enhanced Features [49.68392018281875]
  We propose a novel network architecture named Attribute Salience Assisted Network (ASA-Net) for attribute-assisted video person Re-ID. To learn a better separation of the target from background, we propose to learn the visual attention from middle-level attribute instead of high-level identities.
  arXiv  Detail & Related papers  (2021-08-16T07:41:27Z)
• PoseTrackReID: Dataset Description [97.7241689753353]
  Pose information is helpful to disentangle useful feature information from background or occlusion noise. With PoseTrackReID, we want to bridge the gap between person re-ID and multi-person pose tracking. This dataset provides a good benchmark for current state-of-the-art methods on multi-frame person re-ID.
  arXiv  Detail & Related papers  (2020-11-12T07:44:25Z)
• Vision Meets Wireless Positioning: Effective Person Re-identification with Recurrent Context Propagation [120.18969251405485]
  Existing person re-identification methods rely on the visual sensor to capture the pedestrians. Mobile phone can be sensed by WiFi and cellular networks in the form of a wireless positioning signal. We propose a novel recurrent context propagation module that enables information to propagate between visual data and wireless positioning data.
  arXiv  Detail & Related papers  (2020-08-10T14:19:15Z)
• Long-Term Cloth-Changing Person Re-identification [154.57752691285046]
  Person re-identification (Re-ID) aims to match a target person across camera views at different locations and times. Existing Re-ID studies focus on the short-term cloth-consistent setting, under which a person re-appears in different camera views with the same outfit. In this work, we focus on a much more difficult yet practical setting where person matching is conducted over long-duration, e.g., over days and months.
  arXiv  Detail & Related papers  (2020-05-26T11:27:21Z)
• Cross-Spectrum Dual-Subspace Pairing for RGB-infrared Cross-Modality Person Re-Identification [15.475897856494583]
  Conventional person re-identification can only handle RGB color images, which will fail at dark conditions. RGB-infrared ReID (also known as Infrared-Visible ReID or Visible-Thermal ReID) is proposed. In this paper, a novel multi-spectrum image generation method is proposed and the generated samples are utilized to help the network to find discriminative information.
  arXiv  Detail & Related papers  (2020-02-29T09:01:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.