Towards a Deeper Understanding of Skeleton-based Gait Recognition

• URL: http://arxiv.org/abs/2204.07855v1
• Date: Sat, 16 Apr 2022 18:23:37 GMT
• Title: Towards a Deeper Understanding of Skeleton-based Gait Recognition
• Authors: Torben Teepe, Johannes Gilg, Fabian Herzog, Stefan H\"ormann, Gerhard Rigoll
• Abstract summary: In recent years, most gait recognition methods used the person's silhouette to extract the gait features. Model-based methods do not suffer from these problems and are able to represent the temporal motion of body joints. In this work, we propose an approach based on Graph Convolutional Networks (GCNs) that combines higher-order inputs, and residual networks.
• Score: 4.812321790984493
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Gait recognition is a promising biometric with unique properties for identifying individuals from a long distance by their walking patterns. In recent years, most gait recognition methods used the person's silhouette to extract the gait features. However, silhouette images can lose fine-grained spatial information, suffer from (self) occlusion, and be challenging to obtain in real-world scenarios. Furthermore, these silhouettes also contain other visual clues that are not actual gait features and can be used for identification, but also to fool the system. Model-based methods do not suffer from these problems and are able to represent the temporal motion of body joints, which are actual gait features. The advances in human pose estimation started a new era for model-based gait recognition with skeleton-based gait recognition. In this work, we propose an approach based on Graph Convolutional Networks (GCNs) that combines higher-order inputs, and residual networks to an efficient architecture for gait recognition. Extensive experiments on the two popular gait datasets, CASIA-B and OUMVLP-Pose, show a massive improvement (3x) of the state-of-the-art (SotA) on the largest gait dataset OUMVLP-Pose and strong temporal modeling capabilities. Finally, we visualize our method to understand skeleton-based gait recognition better and to show that we model real gait features.

Related papers

• Distillation-guided Representation Learning for Unconstrained Gait Recognition [50.0533243584942]
  We propose a framework, termed GAit DEtection and Recognition (GADER), for human authentication in challenging outdoor scenarios. GADER builds discriminative features through a novel gait recognition method, where only frames containing gait information are used. We evaluate our method on multiple State-of-The-Arts(SoTA) gait baselines and demonstrate consistent improvements on indoor and outdoor datasets.
  arXiv  Detail & Related papers  (2023-07-27T01:53:57Z)
• Multi-Modal Human Authentication Using Silhouettes, Gait and RGB [59.46083527510924]
  Whole-body-based human authentication is a promising approach for remote biometrics scenarios. We propose Dual-Modal Ensemble (DME), which combines both RGB and silhouette data to achieve more robust performances for indoor and outdoor whole-body based recognition. Within DME, we propose GaitPattern, which is inspired by the double helical gait pattern used in traditional gait analysis.
  arXiv  Detail & Related papers  (2022-10-08T15:17:32Z)
• Learning from Temporal Spatial Cubism for Cross-Dataset Skeleton-based Action Recognition [88.34182299496074]
  Action labels are only available on a source dataset, but unavailable on a target dataset in the training stage. We utilize a self-supervision scheme to reduce the domain shift between two skeleton-based action datasets. By segmenting and permuting temporal segments or human body parts, we design two self-supervised learning classification tasks.
  arXiv  Detail & Related papers  (2022-07-17T07:05:39Z)
• Combining the Silhouette and Skeleton Data for Gait Recognition [13.345465199699]
  Two dominant gait recognition works are appearance-based and model-based, which extract features from silhouettes and skeletons, respectively. This paper proposes a CNN-based branch taking silhouettes as input and a GCN-based branch taking skeletons as input. For better gait representation in the GCN-based branch, we present a fully connected graph convolution operator to integrate multi-scale graph convolutions.
  arXiv  Detail & Related papers  (2022-02-22T03:21:51Z)
• RealGait: Gait Recognition for Person Re-Identification [79.67088297584762]
  We construct a new gait dataset by extracting silhouettes from an existing video person re-identification challenge which consists of 1,404 persons walking in an unconstrained manner. Our results suggest that recognizing people by their gait in real surveillance scenarios is feasible and the underlying gait pattern is probably the true reason why video person re-idenfification works in practice.
  arXiv  Detail & Related papers  (2022-01-13T06:30:56Z)
• Model-based gait recognition using graph network on very large population database [3.8707695363745223]
  In this paper, to resist the increase of subjects and views variation, local features are built and a siamese network is proposed. Experiments on the very large population dataset named OUM-Pose and the popular dataset, CASIA-B, show that our method archives some state-of-the-art (SOTA) performances in model-based gait recognition.
  arXiv  Detail & Related papers  (2021-12-20T02:28:02Z)
• Revisiting Skeleton-based Action Recognition [107.08112310075114]
  PoseC3D is a new approach to skeleton-based action recognition, which relies on a 3D heatmap instead stack a graph sequence as the base representation of human skeletons. On four challenging datasets, PoseC3D consistently obtains superior performance, when used alone on skeletons and in combination with the RGB modality.
  arXiv  Detail & Related papers  (2021-04-28T06:32:17Z)
• SelfGait: A Spatiotemporal Representation Learning Method for Self-supervised Gait Recognition [24.156710529672775]
  Gait recognition plays a vital role in human identification since gait is a unique biometric feature that can be perceived at a distance. Existing gait recognition methods can learn gait features from gait sequences in different ways, but the performance of gait recognition suffers from labeled data. We propose a self-supervised gait recognition method, termed SelfGait, which takes advantage of the massive, diverse, unlabeled gait data as a pre-training process.
  arXiv  Detail & Related papers  (2021-03-27T05:15:39Z)
• GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition [6.353193172884524]
  Gait recognition is a promising video-based biometric for identifying individual walking patterns from a long distance. Most gait recognition methods use silhouette images to represent a person in each frame. We propose GaitGraph that combines skeleton poses with Graph Convolutional Network (GCN) to obtain a modern model-based approach for gait recognition.
  arXiv  Detail & Related papers  (2021-01-27T07:14:06Z)
• A Self-Supervised Gait Encoding Approach with Locality-Awareness for 3D Skeleton Based Person Re-Identification [65.18004601366066]
  Person re-identification (Re-ID) via gait features within 3D skeleton sequences is a newly-emerging topic with several advantages. This paper proposes a self-supervised gait encoding approach that can leverage unlabeled skeleton data to learn gait representations for person Re-ID.
  arXiv  Detail & Related papers  (2020-09-05T16:06:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.