An Adversarial Human Pose Estimation Network Injected with Graph Structure

• URL: http://arxiv.org/abs/2103.15534v1
• Date: Mon, 29 Mar 2021 12:07:08 GMT
• Title: An Adversarial Human Pose Estimation Network Injected with Graph Structure
• Authors: Lei Tian, Guoqiang Liang, Peng Wang, Chunhua Shen
• Abstract summary: In this paper, we design a novel generative adversarial network (GAN) to improve the localization accuracy of visible joints when some joints are invisible. The network consists of two simple but efficient modules, Cascade Feature Network (CFN) and Graph Structure Network (GSN)
• Score: 75.08618278188209
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Because of the invisible human keypoints in images caused by illumination, occlusion and overlap, it is likely to produce unreasonable human pose prediction for most of the current human pose estimation methods. In this paper, we design a novel generative adversarial network (GAN) to improve the localization accuracy of visible joints when some joints are invisible. The network consists of two simple but efficient modules, Cascade Feature Network (CFN) and Graph Structure Network (GSN). First, the CFN utilizes the prediction maps from the previous stages to guide the prediction maps in the next stage to produce accurate human pose. Second, the GSN is designed to contribute to the localization of invisible joints by passing message among different joints. According to GAN, if the prediction pose produced by the generator G cannot be distinguished by the discriminator D, the generator network G has successfully obtained the underlying dependence of human joints. We conduct experiments on three widely used human pose estimation benchmark datasets, LSP, MPII and COCO, whose results show the effectiveness of our proposed framework.

Related papers

• Uncertainty-Aware Adaptation for Self-Supervised 3D Human Pose Estimation [70.32536356351706]
  We introduce MRP-Net that constitutes a common deep network backbone with two output heads subscribing to two diverse configurations. We derive suitable measures to quantify prediction uncertainty at both pose and joint level. We present a comprehensive evaluation of the proposed approach and demonstrate state-of-the-art performance on benchmark datasets.
  arXiv  Detail & Related papers  (2022-03-29T07:14:58Z)
• Joint-bone Fusion Graph Convolutional Network for Semi-supervised Skeleton Action Recognition [65.78703941973183]
  We propose a novel correlation-driven joint-bone fusion graph convolutional network (CD-JBF-GCN) as an encoder and use a pose prediction head as a decoder. Specifically, the CD-JBF-GC can explore the motion transmission between the joint stream and the bone stream. The pose prediction based auto-encoder in the self-supervised training stage allows the network to learn motion representation from unlabeled data.
  arXiv  Detail & Related papers  (2022-02-08T16:03:15Z)
• MSR-GCN: Multi-Scale Residual Graph Convolution Networks for Human Motion Prediction [34.565986275769745]
  We propose a novel Multi-Scale Residual Graph Convolution Network (MSR-GCN) for human pose prediction task. Our proposed approach is evaluated on two standard benchmark datasets, i.e., the Human3.6M dataset and the CMU Mocap dataset.
  arXiv  Detail & Related papers  (2021-08-16T15:26:23Z)
• Conditional Directed Graph Convolution for 3D Human Pose Estimation [23.376538132362498]
  Graph convolutional networks have significantly improved 3D human pose estimation by representing the human skeleton as an undirected graph. This paper proposes to represent the human skeleton as a directed graph with the joints as nodes and bones as edges that are directed from parent joints to child joints.
  arXiv  Detail & Related papers  (2021-07-16T09:50:40Z)
• GPRAR: Graph Convolutional Network based Pose Reconstruction and Action Recognition for Human Trajectory Prediction [1.2891210250935146]
  Existing prediction models are easily prone to errors in real-world settings where observations are often noisy. We introduce GPRAR, a graph convolutional network based pose reconstruction and action recognition for human trajectory prediction. We show that GPRAR improves the prediction accuracy up to 22% and 50% under noisy observations on JAAD and TITAN datasets.
  arXiv  Detail & Related papers  (2021-03-25T20:12:14Z)
• On the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition [97.14064057840089]
  Graphal networks (GCNs) promising performance in skeleton-based human action recognition by modeling a sequence of skeletons as a graph. Most of the recently proposed G-temporal-based methods improve the performance by learning the graph structure at each layer of the network.
  arXiv  Detail & Related papers  (2020-11-07T19:03:04Z)
• CatGCN: Graph Convolutional Networks with Categorical Node Features [99.555850712725]
  CatGCN is tailored for graph learning when the node features are categorical. We train CatGCN in an end-to-end fashion and demonstrate it on semi-supervised node classification.
  arXiv  Detail & Related papers  (2020-09-11T09:25:17Z)
• Appearance Consensus Driven Self-Supervised Human Mesh Recovery [67.20942777949793]
  We present a self-supervised human mesh recovery framework to infer human pose and shape from monocular images. We achieve state-of-the-art results on the standard model-based 3D pose estimation benchmarks. The resulting colored mesh prediction opens up the usage of our framework for a variety of appearance-related tasks beyond the pose and shape estimation.
  arXiv  Detail & Related papers  (2020-08-04T05:40:39Z)
• JUMPS: Joints Upsampling Method for Pose Sequences [0.0]
  We build on a deep generative model that combines aGenerative Adversarial Network (GAN) and an encoder. We show experimentally that thelocalization accuracy of the additional joints is on average onpar with the original pose estimates.
  arXiv  Detail & Related papers  (2020-07-02T14:36:40Z)
• Feedback Graph Convolutional Network for Skeleton-based Action Recognition [38.782491442635205]
  We propose a novel network, named Feedback Graph Convolutional Network (FGCN) This is the first work that introduces the feedback mechanism into GCNs and action recognition. It achieves the state-of-the-art performance on three datasets.
  arXiv  Detail & Related papers  (2020-03-17T07:20:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.