Human Pose Estimation from Sparse Inertial Measurements through Recurrent Graph Convolution

• URL: http://arxiv.org/abs/2107.11214v1
• Date: Fri, 23 Jul 2021 13:23:10 GMT
• Title: Human Pose Estimation from Sparse Inertial Measurements through Recurrent Graph Convolution
• Abstract summary: We propose the adjacency adaptive graph convolutional long-short term memory network (AAGC-LSTM) for human pose estimation. AAGC-LSTM combines both spatial and temporal dependency in a single network operation.
• Score: 7.975054349697541
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: We propose the adjacency adaptive graph convolutional long-short term memory network (AAGC-LSTM) for human pose estimation from sparse inertial measurements, obtained from only 6 measurement units. The AAGC-LSTM combines both spatial and temporal dependency in a single network operation. This is made possible by equipping graph convolutions with adjacency adaptivity, which also allows for learning unknown dependencies of the human body joints. To further boost accuracy, we propose longitudinal loss weighting to consider natural movement patterns, as well as body-aware contralateral data augmentation. By combining these contributions, we are able to utilize the inherent graph nature of the human body, and can thus outperform the state of the art for human pose estimation from sparse inertial measurements.

Related papers

• Learning human joint torques from pixels [4.463973085741068]
  We introduce VID, a vision-based inverse dynamics dataset and benchmark for predicting human joint torques directly from real monocular images.<n>VID contains 63,369 synchronized frames with real human images, kinematic annotations, anthropometric attributes, and OpenSim-derived dynamic labels.<n>We propose VID-Network, which combines pose-pretrained spatial probabilistic features, marker regression, and temporal torque inference to recover joint torques from image sequences.
  arXiv  Detail & Related papers  (2026-08-10T03:29:48Z)
• Integrative Deep Learning Framework for Parkinson's Disease Early Detection using Gait Cycle Data Measured by Wearable Sensors: A CNN-GRU-GNN Approach [0.3222802562733786]
  We present a pioneering deep learning architecture tailored for the binary classification of subjects. Our model harnesses the power of 1D-Convolutional Neural Networks (CNN), Gated Recurrent Units (GRU), and Graph Neural Network (GNN) layers. Our proposed model achieves exceptional performance metrics, boasting accuracy, precision, recall, and F1 score values of 99.51%, 99.57%, 99.71%, and 99.64%, respectively.
  arXiv  Detail & Related papers  (2024-04-09T15:19:13Z)
• Analyzing Participants' Engagement during Online Meetings Using Unsupervised Remote Photoplethysmography with Behavioral Features [50.82725748981231]
  Engagement measurement finds application in healthcare, education, services. Use of physiological and behavioral features is viable, but impracticality of traditional physiological measurement arises due to the need for contact sensors. We demonstrate the feasibility of the unsupervised photoplethysmography (rmography) as an alternative for contact sensors.
  arXiv  Detail & Related papers  (2024-04-05T20:39:16Z)
• Full-Body Motion Reconstruction with Sparse Sensing from Graph Perspective [22.761692765158646]
  Estimating 3D full-body pose from sparse sensor data is a pivotal technique employed for the reconstruction of realistic human motions in Augmented Reality and Virtual Reality. We use Body Pose Graph (BPG) to represent the human body and translate the challenge into a prediction problem of graph missing nodes. Our method's effectiveness is evidenced by the attained state-of-the-art performance, particularly in lower body motion, outperforming other baseline methods.
  arXiv  Detail & Related papers  (2024-01-22T09:29:42Z)
• Spatio-temporal MLP-graph network for 3D human pose estimation [8.267311047244881]
  Graph convolutional networks and their variants have shown significant promise in 3D human pose estimation. We introduce a new weighted Jacobi feature rule obtained through graph filtering with implicit propagation fairing. We also employ adjacency modulation with the aim of learning meaningful correlations beyond defined between body joints.
  arXiv  Detail & Related papers  (2023-08-29T14:00:55Z)
• Back to MLP: A Simple Baseline for Human Motion Prediction [59.18776744541904]
  This paper tackles the problem of human motion prediction, consisting in forecasting future body poses from historically observed sequences. We show that the performance of these approaches can be surpassed by a light-weight and purely architectural architecture with only 0.14M parameters. An exhaustive evaluation on Human3.6M, AMASS and 3DPW datasets shows that our method, which we dub siMLPe, consistently outperforms all other approaches.
  arXiv  Detail & Related papers  (2022-07-04T16:35:58Z)
• Koopman pose predictions for temporally consistent human walking estimations [11.016730029019522]
  We introduce a new factor graph factor based on Koopman theory that embeds the nonlinear dynamics of lower-limb movement activities. We show that our approach reduces outliers on the skeleton form by almost 1 m, while preserving natural walking trajectories at depths up to more than 10 m.
  arXiv  Detail & Related papers  (2022-05-05T16:16:06Z)
• Learning Dynamical Human-Joint Affinity for 3D Pose Estimation in Videos [47.601288796052714]
  Graph Convolution Network (GCN) has been successfully used for 3D human pose estimation in videos. New Dynamical Graph Network (DGNet) can estimate 3D pose by adaptively learning spatial/temporal joint relations from videos.
  arXiv  Detail & Related papers  (2021-09-15T15:06:19Z)
• Conditional Directed Graph Convolution for 3D Human Pose Estimation [23.376538132362498]
  Graph convolutional networks have significantly improved 3D human pose estimation by representing the human skeleton as an undirected graph. This paper proposes to represent the human skeleton as a directed graph with the joints as nodes and bones as edges that are directed from parent joints to child joints.
  arXiv  Detail & Related papers  (2021-07-16T09:50:40Z)
• An Adversarial Human Pose Estimation Network Injected with Graph Structure [75.08618278188209]
  In this paper, we design a novel generative adversarial network (GAN) to improve the localization accuracy of visible joints when some joints are invisible. The network consists of two simple but efficient modules, Cascade Feature Network (CFN) and Graph Structure Network (GSN)
  arXiv  Detail & Related papers  (2021-03-29T12:07:08Z)
• On the spatial attention in Spatio-Temporal Graph Convolutional Networks for skeleton-based human action recognition [97.14064057840089]
  Graphal networks (GCNs) promising performance in skeleton-based human action recognition by modeling a sequence of skeletons as a graph. Most of the recently proposed G-temporal-based methods improve the performance by learning the graph structure at each layer of the network.
  arXiv  Detail & Related papers  (2020-11-07T19:03:04Z)
• Anatomy-aware 3D Human Pose Estimation with Bone-based Pose Decomposition [92.99291528676021]
  Instead of directly regressing the 3D joint locations, we decompose the task into bone direction prediction and bone length prediction. Our motivation is the fact that the bone lengths of a human skeleton remain consistent across time. Our full model outperforms the previous best results on Human3.6M and MPI-INF-3DHP datasets.
  arXiv  Detail & Related papers  (2020-02-24T15:49:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.