3D Human Motion Prediction: A Survey
- URL: http://arxiv.org/abs/2203.01593v2
- Date: Mon, 7 Mar 2022 09:18:05 GMT
- Title: 3D Human Motion Prediction: A Survey
- Authors: Kedi Lyu, Haipeng Chen, Zhenguang Liu, Beiqi Zhang, Ruili Wang
- Abstract summary: 3D human motion prediction, predicting future poses from a given sequence, is an issue of great significance and challenge in computer vision and machine intelligence.
A comprehensive survey on 3D human motion prediction is conducted for the purpose of retrospecting and analyzing relevant works from existing released literature.
- Score: 23.605334184939164
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: 3D human motion prediction, predicting future poses from a given sequence, is
an issue of great significance and challenge in computer vision and machine
intelligence, which can help machines in understanding human behaviors. Due to
the increasing development and understanding of Deep Neural Networks (DNNs) and
the availability of large-scale human motion datasets, the human motion
prediction has been remarkably advanced with a surge of interest among academia
and industrial community. In this context, a comprehensive survey on 3D human
motion prediction is conducted for the purpose of retrospecting and analyzing
relevant works from existing released literature. In addition, a pertinent
taxonomy is constructed to categorize these existing approaches for 3D human
motion prediction. In this survey, relevant methods are categorized into three
categories: human pose representation, network structure design, and
\textit{prediction target}. We systematically review all relevant journal and
conference papers in the field of human motion prediction since 2015, which are
presented in detail based on proposed categorizations in this survey.
Furthermore, the outline for the public benchmark datasets, evaluation
criteria, and performance comparisons are respectively presented in this paper.
The limitations of the state-of-the-art methods are discussed as well, hoping
for paving the way for future explorations.
Related papers
- Human Action Anticipation: A Survey [86.415721659234]
The literature on behavior prediction spans various tasks, including action anticipation, activity forecasting, intent prediction, goal prediction, and so on.
Our survey aims to tie together this fragmented literature, covering recent technical innovations as well as the development of new large-scale datasets for model training and evaluation.
arXiv Detail & Related papers (2024-10-17T21:37:40Z) - Human Modelling and Pose Estimation Overview [0.0]
Human modelling and pose estimation stands at the crossroads of Computer Vision, Computer Graphics, and Machine Learning.
This paper presents a thorough investigation of this interdisciplinary field, examining various algorithms, methodologies, and practical applications.
arXiv Detail & Related papers (2024-06-27T16:04:41Z) - Multimodal Sense-Informed Prediction of 3D Human Motions [16.71099574742631]
This work introduces a novel multi-modal sense-informed motion prediction approach, which conditions high-fidelity generation on two modal information.
The gaze information is regarded as the human intention, and combined with both motion and scene features, we construct a ternary intention-aware attention to supervise the generation.
On two real-world benchmarks, the proposed method achieves state-of-the-art performance both in 3D human pose and trajectory prediction.
arXiv Detail & Related papers (2024-05-05T12:38:10Z) - Context-based Interpretable Spatio-Temporal Graph Convolutional Network
for Human Motion Forecasting [0.0]
We present a Context- Interpretable Stemporal Graphal Network (IST-GCN) as an efficient 3D human pose forecasting model.
Our architecture extracts meaningful information from pose sequences, aggregates displacements and accelerations into the input model, and finally predicts the output displacements.
arXiv Detail & Related papers (2024-02-21T17:51:30Z) - Recent Advances in Deterministic Human Motion Prediction: A Review [2.965405736351051]
Human motion prediction technology has gradually gained prominence in various fields such as human-computer interaction, autonomous driving, sports analysis, and personnel tracking.
This article introduces common model architectures in this domain along with their respective advantages and disadvantages.
It also systematically summarizes recent research innovations, focusing on in-depth discussions of relevant papers in these areas.
arXiv Detail & Related papers (2023-12-11T07:54:42Z) - Learn to Predict How Humans Manipulate Large-sized Objects from
Interactive Motions [82.90906153293585]
We propose a graph neural network, HO-GCN, to fuse motion data and dynamic descriptors for the prediction task.
We show the proposed network that consumes dynamic descriptors can achieve state-of-the-art prediction results and help the network better generalize to unseen objects.
arXiv Detail & Related papers (2022-06-25T09:55:39Z) - GIMO: Gaze-Informed Human Motion Prediction in Context [75.52839760700833]
We propose a large-scale human motion dataset that delivers high-quality body pose sequences, scene scans, and ego-centric views with eye gaze.
Our data collection is not tied to specific scenes, which further boosts the motion dynamics observed from our subjects.
To realize the full potential of gaze, we propose a novel network architecture that enables bidirectional communication between the gaze and motion branches.
arXiv Detail & Related papers (2022-04-20T13:17:39Z) - Investigating Pose Representations and Motion Contexts Modeling for 3D
Motion Prediction [63.62263239934777]
We conduct an indepth study on various pose representations with a focus on their effects on the motion prediction task.
We propose a novel RNN architecture termed AHMR (Attentive Hierarchical Motion Recurrent network) for motion prediction.
Our approach outperforms the state-of-the-art methods in short-term prediction and achieves much enhanced long-term prediction proficiency.
arXiv Detail & Related papers (2021-12-30T10:45:22Z) - TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
TRiPOD is a novel method for predicting body dynamics based on graph attentional networks.
To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame.
Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
arXiv Detail & Related papers (2021-04-08T20:01:00Z) - Deep Learning-Based Human Pose Estimation: A Survey [66.01917727294163]
Human pose estimation has drawn increasing attention during the past decade.
It has been utilized in a wide range of applications including human-computer interaction, motion analysis, augmented reality, and virtual reality.
Recent deep learning-based solutions have achieved high performance in human pose estimation.
arXiv Detail & Related papers (2020-12-24T18:49:06Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.