PSGait: Gait Recognition using Parsing Skeleton

• URL: http://arxiv.org/abs/2503.12047v2
• Date: Mon, 14 Apr 2025 15:46:04 GMT
• Title: PSGait: Gait Recognition using Parsing Skeleton
• Authors: Hangrui Xu, Chuanrui Zhang, Zhengxian Wu, Peng Jiao, Haoqian Wang,
• Abstract summary: We propose a novel gait representation, named Parsing Skeleton, to achieve accurate gait recognition in the wild.<n>We also propose a novel gait recognition framework, named PSGait, which takes Parsing Skeletons and silhouettes as input.<n>Our results demonstrate that PSGait offers a lightweight, effective, and highly generalizable representation for gait recognition in the wild.
• Score: 11.899411968690185
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Gait recognition has emerged as a robust biometric modality due to its non-intrusive nature and resilience to occlusion. Conventional gait recognition methods typically rely on silhouettes or skeletons. Despite their success in gait recognition for controlled laboratory environments, they usually fail in real-world scenarios due to their limited information entropy for gait representations. To achieve accurate gait recognition in the wild, we propose a novel gait representation, named Parsing Skeleton. This representation innovatively introduces the skeleton-guided human parsing method to capture fine-grained body dynamics, so they have much higher information entropy to encode the shapes and dynamics of fine-grained human parts during walking. Moreover, to effectively explore the capability of the Parsing Skeleton representation, we propose a novel Parsing Skeleton-based gait recognition framework, named PSGait, which takes Parsing Skeletons and silhouettes as input. By fusing these two modalities, the resulting image sequences are fed into gait recognition models for enhanced individual differentiation. We conduct comprehensive benchmarks on various datasets to evaluate our model. PSGait outperforms existing state-of-the-art multimodal methods that utilize both skeleton and silhouette inputs while significantly reducing computational resources. Furthermore, as a plug-and-play method, PSGait leads to a maximum improvement of 10.9% in Rank-1 accuracy across various gait recognition models. These results demonstrate that Parsing Skeleton offers a lightweight, effective, and highly generalizable representation for gait recognition in the wild.

Related papers

• It Takes Two: Accurate Gait Recognition in the Wild via Cross-granularity Alignment [72.75844404617959]
  This paper proposes a novel cross-granularity alignment gait recognition method, named XGait. To achieve this goal, the XGait first contains two branches of backbone encoders to map the silhouette sequences and the parsing sequences into two latent spaces. Comprehensive experiments on two large-scale gait datasets show XGait with the Rank-1 accuracy of 80.5% on Gait3D and 88.3% CCPG.
  arXiv  Detail & Related papers  (2024-11-16T08:54:27Z)
• ZipGait: Bridging Skeleton and Silhouette with Diffusion Model for Advancing Gait Recognition [31.732554267037305]
  We make the first attempt to reconstruct dense body shapes from discrete skeleton distributions via the diffusion model. We introduce Perception Gait Integration (PGI) to integrate different gait features through a two-stage process. ZipGait demonstrates superior performance, outperforming the state-of-the-art methods by a large margin under both cross-domain and intra-domain settings.
  arXiv  Detail & Related papers  (2024-08-22T03:52:44Z)
• Expressive Keypoints for Skeleton-based Action Recognition via Skeleton Transformation [14.033701085783177]
  We propose Expressive Keypoints that incorporates hand and foot details to form a fine-grained skeletal representation, improving the discriminative ability for existing models in discerning intricate actions. A plug-and-play Instance Pooling module is exploited to extend our approach to multi-person scenarios without surging computation costs.
  arXiv  Detail & Related papers  (2024-06-26T01:48:56Z)
• GaitSTR: Gait Recognition with Sequential Two-stream Refinement [12.256802601846749]
  Gait recognition aims to identify a person based on their walking sequences, serving as a useful biometric modality. In representing a person's walking sequence, silhouettes and skeletons are the two primary modalities used. We explore the use of a two-stream representation of skeletons for gait recognition, alongside silhouettes.
  arXiv  Detail & Related papers  (2024-04-02T22:39:35Z)
• SkeleTR: Towrads Skeleton-based Action Recognition in the Wild [86.03082891242698]
  SkeleTR is a new framework for skeleton-based action recognition. It first models the intra-person skeleton dynamics for each skeleton sequence with graph convolutions. It then uses stacked Transformer encoders to capture person interactions that are important for action recognition in general scenarios.
  arXiv  Detail & Related papers  (2023-09-20T16:22:33Z)
• Parsing is All You Need for Accurate Gait Recognition in the Wild [51.206166843375364]
  This paper presents a novel gait representation, named Gait Parsing Sequence (GPS) GPSs are sequences of fine-grained human segmentation, extracted from video frames, so they have much higher information entropy. We also propose a novel human parsing-based gait recognition framework, named ParsingGait. The experimental results show a significant improvement in accuracy brought by the GPS representation and the superiority of ParsingGait.
  arXiv  Detail & Related papers  (2023-08-31T13:57:38Z)
• GaitPT: Skeletons Are All You Need For Gait Recognition [4.089889918897877]
  We propose a novel gait recognition architecture called Gait Pyramid Transformer (GaitPT) GaitPT uses pose estimation skeletons to capture unique walking patterns, without relying on appearance information. Our results show that GaitPT achieves state-of-the-art performance compared to other skeleton-based gait recognition works.
  arXiv  Detail & Related papers  (2023-08-21T10:47:52Z)
• Distillation-guided Representation Learning for Unconstrained Gait Recognition [50.0533243584942]
  We propose a framework, termed GAit DEtection and Recognition (GADER), for human authentication in challenging outdoor scenarios. GADER builds discriminative features through a novel gait recognition method, where only frames containing gait information are used. We evaluate our method on multiple State-of-The-Arts(SoTA) gait baselines and demonstrate consistent improvements on indoor and outdoor datasets.
  arXiv  Detail & Related papers  (2023-07-27T01:53:57Z)
• SkeletonMAE: Graph-based Masked Autoencoder for Skeleton Sequence Pre-training [110.55093254677638]
  We propose an efficient skeleton sequence learning framework, named Skeleton Sequence Learning (SSL) In this paper, we build an asymmetric graph-based encoder-decoder pre-training architecture named SkeletonMAE. Our SSL generalizes well across different datasets and outperforms the state-of-the-art self-supervised skeleton-based action recognition methods.
  arXiv  Detail & Related papers  (2023-07-17T13:33:11Z)
• One-Shot Action Recognition via Multi-Scale Spatial-Temporal Skeleton Matching [77.6989219290789]
  One-shot skeleton action recognition aims to learn a skeleton action recognition model with a single training sample. This paper presents a novel one-shot skeleton action recognition technique that handles skeleton action recognition via multi-scale spatial-temporal feature matching.
  arXiv  Detail & Related papers  (2023-07-14T11:52:10Z)
• Towards a Deeper Understanding of Skeleton-based Gait Recognition [4.812321790984493]
  In recent years, most gait recognition methods used the person's silhouette to extract the gait features. Model-based methods do not suffer from these problems and are able to represent the temporal motion of body joints. In this work, we propose an approach based on Graph Convolutional Networks (GCNs) that combines higher-order inputs, and residual networks.
  arXiv  Detail & Related papers  (2022-04-16T18:23:37Z)
• Predictively Encoded Graph Convolutional Network for Noise-Robust Skeleton-based Action Recognition [6.729108277517129]
  We propose a skeleton-based action recognition method which is robust to noise information of given skeleton features. Our approach achieves outstanding performance when skeleton samples are noised compared with existing state-of-the-art methods.
  arXiv  Detail & Related papers  (2020-03-17T03:37:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.