GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition

• URL: http://arxiv.org/abs/2101.11228v1
• Date: Wed, 27 Jan 2021 07:14:06 GMT
• Title: GaitGraph: Graph Convolutional Network for Skeleton-Based Gait Recognition
• Authors: Torben Teepe, Ali Khan, Johannes Gilg, Fabian Herzog, Stefan H\"ormann, Gerhard Rigoll
• Abstract summary: Gait recognition is a promising video-based biometric for identifying individual walking patterns from a long distance. Most gait recognition methods use silhouette images to represent a person in each frame. We propose GaitGraph that combines skeleton poses with Graph Convolutional Network (GCN) to obtain a modern model-based approach for gait recognition.
• Score: 6.353193172884524
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Gait recognition is a promising video-based biometric for identifying individual walking patterns from a long distance. At present, most gait recognition methods use silhouette images to represent a person in each frame. However, silhouette images can lose fine-grained spatial information, and most papers do not regard how to obtain these silhouettes in complex scenes. Furthermore, silhouette images contain not only gait features but also other visual clues that can be recognized. Hence these approaches can not be considered as strict gait recognition. We leverage recent advances in human pose estimation to estimate robust skeleton poses directly from RGB images to bring back model-based gait recognition with a cleaner representation of gait. Thus, we propose GaitGraph that combines skeleton poses with Graph Convolutional Network (GCN) to obtain a modern model-based approach for gait recognition. The main advantages are a cleaner, more elegant extraction of the gait features and the ability to incorporate powerful spatio-temporal modeling using GCN. Experiments on the popular CASIA-B gait dataset show that our method archives state-of-the-art performance in model-based gait recognition. The code and models are publicly available.

Related papers

• Learning to Simplify Spatial-Temporal Graphs in Gait Analysis [4.831663144935878]
  This paper proposes a novel method to simplify the spatial-temporal graph representation for gait-based gender estimation. Our approach employs two models, an upstream and a downstream model, that can adjust the adjacency matrix for each walking instance. We demonstrate the effectiveness of our approach on the CASIA-B dataset for gait-based gender estimation.
  arXiv  Detail & Related papers  (2023-10-05T09:03:51Z)
• Parsing is All You Need for Accurate Gait Recognition in the Wild [51.206166843375364]
  This paper presents a novel gait representation, named Gait Parsing Sequence (GPS) GPSs are sequences of fine-grained human segmentation, extracted from video frames, so they have much higher information entropy. We also propose a novel human parsing-based gait recognition framework, named ParsingGait. The experimental results show a significant improvement in accuracy brought by the GPS representation and the superiority of ParsingGait.
  arXiv  Detail & Related papers  (2023-08-31T13:57:38Z)
• Distillation-guided Representation Learning for Unconstrained Gait Recognition [50.0533243584942]
  We propose a framework, termed GAit DEtection and Recognition (GADER), for human authentication in challenging outdoor scenarios. GADER builds discriminative features through a novel gait recognition method, where only frames containing gait information are used. We evaluate our method on multiple State-of-The-Arts(SoTA) gait baselines and demonstrate consistent improvements on indoor and outdoor datasets.
  arXiv  Detail & Related papers  (2023-07-27T01:53:57Z)
• What Can Human Sketches Do for Object Detection? [127.67444974452411]
  Sketches are highly expressive, inherently capturing subjective and fine-grained visual cues. A sketch-enabled object detection framework detects based on what textityou sketch -- textitthat zebra'' We show an intuitive synergy between foundation models (e.g., CLIP) and existing sketch models build for sketch-based image retrieval (SBIR) In particular, we first perform independent on both sketch branches of an encoder model to build highly generalisable sketch and photo encoders.
  arXiv  Detail & Related papers  (2023-03-27T12:33:23Z)
• Multi-Modal Human Authentication Using Silhouettes, Gait and RGB [59.46083527510924]
  Whole-body-based human authentication is a promising approach for remote biometrics scenarios. We propose Dual-Modal Ensemble (DME), which combines both RGB and silhouette data to achieve more robust performances for indoor and outdoor whole-body based recognition. Within DME, we propose GaitPattern, which is inspired by the double helical gait pattern used in traditional gait analysis.
  arXiv  Detail & Related papers  (2022-10-08T15:17:32Z)
• Gait Recognition in the Wild: A Large-scale Benchmark and NAS-based Baseline [95.88825497452716]
  Gait benchmarks empower the research community to train and evaluate high-performance gait recognition systems. GREW is the first large-scale dataset for gait recognition in the wild. SPOSGait is the first NAS-based gait recognition model.
  arXiv  Detail & Related papers  (2022-05-05T14:57:39Z)
• Towards a Deeper Understanding of Skeleton-based Gait Recognition [4.812321790984493]
  In recent years, most gait recognition methods used the person's silhouette to extract the gait features. Model-based methods do not suffer from these problems and are able to represent the temporal motion of body joints. In this work, we propose an approach based on Graph Convolutional Networks (GCNs) that combines higher-order inputs, and residual networks.
  arXiv  Detail & Related papers  (2022-04-16T18:23:37Z)
• Combining the Silhouette and Skeleton Data for Gait Recognition [13.345465199699]
  Two dominant gait recognition works are appearance-based and model-based, which extract features from silhouettes and skeletons, respectively. This paper proposes a CNN-based branch taking silhouettes as input and a GCN-based branch taking skeletons as input. For better gait representation in the GCN-based branch, we present a fully connected graph convolution operator to integrate multi-scale graph convolutions.
  arXiv  Detail & Related papers  (2022-02-22T03:21:51Z)
• RealGait: Gait Recognition for Person Re-Identification [79.67088297584762]
  We construct a new gait dataset by extracting silhouettes from an existing video person re-identification challenge which consists of 1,404 persons walking in an unconstrained manner. Our results suggest that recognizing people by their gait in real surveillance scenarios is feasible and the underlying gait pattern is probably the true reason why video person re-idenfification works in practice.
  arXiv  Detail & Related papers  (2022-01-13T06:30:56Z)
• Model-based gait recognition using graph network on very large population database [3.8707695363745223]
  In this paper, to resist the increase of subjects and views variation, local features are built and a siamese network is proposed. Experiments on the very large population dataset named OUM-Pose and the popular dataset, CASIA-B, show that our method archives some state-of-the-art (SOTA) performances in model-based gait recognition.
  arXiv  Detail & Related papers  (2021-12-20T02:28:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.