SelfGait: A Spatiotemporal Representation Learning Method for
Self-supervised Gait Recognition
- URL: http://arxiv.org/abs/2103.14811v1
- Date: Sat, 27 Mar 2021 05:15:39 GMT
- Title: SelfGait: A Spatiotemporal Representation Learning Method for
Self-supervised Gait Recognition
- Authors: Yiqun Liu, Yi Zeng, Jian Pu, Hongming Shan, Peiyang He, Junping Zhang
- Abstract summary: Gait recognition plays a vital role in human identification since gait is a unique biometric feature that can be perceived at a distance.
Existing gait recognition methods can learn gait features from gait sequences in different ways, but the performance of gait recognition suffers from labeled data.
We propose a self-supervised gait recognition method, termed SelfGait, which takes advantage of the massive, diverse, unlabeled gait data as a pre-training process.
- Score: 24.156710529672775
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Gait recognition plays a vital role in human identification since gait is a
unique biometric feature that can be perceived at a distance. Although existing
gait recognition methods can learn gait features from gait sequences in
different ways, the performance of gait recognition suffers from insufficient
labeled data, especially in some practical scenarios associated with short gait
sequences or various clothing styles. It is unpractical to label the numerous
gait data. In this work, we propose a self-supervised gait recognition method,
termed SelfGait, which takes advantage of the massive, diverse, unlabeled gait
data as a pre-training process to improve the representation abilities of
spatiotemporal backbones. Specifically, we employ the horizontal pyramid
mapping (HPM) and micro-motion template builder (MTB) as our spatiotemporal
backbones to capture the multi-scale spatiotemporal representations.
Experiments on CASIA-B and OU-MVLP benchmark gait datasets demonstrate the
effectiveness of the proposed SelfGait compared with four state-of-the-art gait
recognition methods. The source code has been released at
https://github.com/EchoItLiu/SelfGait.
Related papers
- Distillation-guided Representation Learning for Unconstrained Gait Recognition [50.0533243584942]
We propose a framework, termed GAit DEtection and Recognition (GADER), for human authentication in challenging outdoor scenarios.
GADER builds discriminative features through a novel gait recognition method, where only frames containing gait information are used.
We evaluate our method on multiple State-of-The-Arts(SoTA) gait baselines and demonstrate consistent improvements on indoor and outdoor datasets.
arXiv Detail & Related papers (2023-07-27T01:53:57Z) - DOAD: Decoupled One Stage Action Detection Network [77.14883592642782]
Localizing people and recognizing their actions from videos is a challenging task towards high-level video understanding.
Existing methods are mostly two-stage based, with one stage for person bounding box generation and the other stage for action recognition.
We present a decoupled one-stage network dubbed DOAD, to improve the efficiency for-temporal action detection.
arXiv Detail & Related papers (2023-04-01T08:06:43Z) - Gait Recognition in the Wild: A Large-scale Benchmark and NAS-based
Baseline [95.88825497452716]
Gait benchmarks empower the research community to train and evaluate high-performance gait recognition systems.
GREW is the first large-scale dataset for gait recognition in the wild.
SPOSGait is the first NAS-based gait recognition model.
arXiv Detail & Related papers (2022-05-05T14:57:39Z) - HEATGait: Hop-Extracted Adjacency Technique in Graph Convolution based
Gait Recognition [0.0]
HEATGait is a gait recognition system that improves the existing multi-scale convolution graph by efficient hop-extraction technique to alleviate the issue.
We propose a powerful feature extractor that utilizes ResG to achieve state-of-the-art performance in model-based gait recognition on the CASIA-BCN gait dataset.
arXiv Detail & Related papers (2022-04-21T16:13:58Z) - Towards a Deeper Understanding of Skeleton-based Gait Recognition [4.812321790984493]
In recent years, most gait recognition methods used the person's silhouette to extract the gait features.
Model-based methods do not suffer from these problems and are able to represent the temporal motion of body joints.
In this work, we propose an approach based on Graph Convolutional Networks (GCNs) that combines higher-order inputs, and residual networks.
arXiv Detail & Related papers (2022-04-16T18:23:37Z) - Spatio-temporal Gait Feature with Adaptive Distance Alignment [90.5842782685509]
We try to increase the difference of gait features of different subjects from two aspects: the optimization of network structure and the refinement of extracted gait features.
Our method is proposed, it consists of Spatio-temporal Feature Extraction (SFE) and Adaptive Distance Alignment (ADA)
ADA uses a large number of unlabeled gait data in real life as a benchmark to refine the extracted-temporal features to make them have low inter-class similarity and high intra-class similarity.
arXiv Detail & Related papers (2022-03-07T13:34:00Z) - RealGait: Gait Recognition for Person Re-Identification [79.67088297584762]
We construct a new gait dataset by extracting silhouettes from an existing video person re-identification challenge which consists of 1,404 persons walking in an unconstrained manner.
Our results suggest that recognizing people by their gait in real surveillance scenarios is feasible and the underlying gait pattern is probably the true reason why video person re-idenfification works in practice.
arXiv Detail & Related papers (2022-01-13T06:30:56Z) - Associated Spatio-Temporal Capsule Network for Gait Recognition [36.85667679699001]
State-of-the-art approaches rely on analysis of temporal or spatial characteristics of gait.
ASTCapsNet trained on multi-sensor datasets to analyze multimodal information for gait recognition.
arXiv Detail & Related papers (2021-01-07T09:55:17Z) - A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D
Skeleton Based Person Re-Identification [65.18004601366066]
Person re-identification (Re-ID) via gait features within 3D skeleton sequences is a newly-emerging topic with several advantages.
This paper proposes a self-supervised gait encoding approach that can leverage unlabeled skeleton data to learn gait representations for person Re-ID.
arXiv Detail & Related papers (2020-09-05T16:06:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.