3D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review

• URL: http://arxiv.org/abs/2509.12197v2
• Date: Tue, 23 Sep 2025 16:13:36 GMT
• Title: 3D Human Pose and Shape Estimation from LiDAR Point Clouds: A Review
• Authors: Salma Galaaoui, Eduardo Valle, David Picard, Nermin Samet,
• Abstract summary: We present a comprehensive review of 3D human pose estimation and human mesh recovery from in-the-wild LiDAR point clouds.<n>We propose a structured taxonomy to classify these methods and analyze each method's strengths, limitations, and design choices.<n>We outline open challenges and research directions critical for advancing LiDAR-based 3D human understanding.
• Score: 17.976933696702247
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: In this paper, we present a comprehensive review of 3D human pose estimation and human mesh recovery from in-the-wild LiDAR point clouds. We compare existing approaches across several key dimensions, and propose a structured taxonomy to classify these methods. Following this taxonomy, we analyze each method's strengths, limitations, and design choices. In addition, (i) we perform a quantitative comparison of the three most widely used datasets, detailing their characteristics; (ii) we compile unified definitions of all evaluation metrics; and (iii) we establish benchmark tables for both tasks on these datasets to enable fair comparisons and promote progress in the field. We also outline open challenges and research directions critical for advancing LiDAR-based 3D human understanding. Moreover, we maintain an accompanying webpage that organizes papers according to our taxonomy and continuously update it with new studies: https://github.com/valeoai/3D-Human-Pose-Shape-Estimation-from-LiDAR

Related papers

• SAM 3D Body: Robust Full-Body Human Mesh Recovery [65.0108906331903]
  We introduce SAM 3D Body (3DB), a promptable model for single-image full-body 3D human mesh recovery (HMR)<n>3DB estimates the human pose of the body, feet, and hands.<n>It is the first model to use a new parametric mesh representation, Momentum Human Rig (MHR), which decouples skeletal structure and surface shape.
  arXiv  Detail & Related papers  (2026-02-17T20:26:37Z)
• 3D and 4D World Modeling: A Survey [104.20852751473392]
  World modeling has become a cornerstone in AI research, enabling agents to understand, represent, and predict the dynamic environments they inhabit.<n>We introduce a structured taxonomy spanning video-based (VideoGen), occupancy-based (OccGen), and LiDAR-based (LiDARGen) approaches.<n>We discuss practical applications, identify open challenges, and highlight promising research directions.
  arXiv  Detail & Related papers  (2025-09-04T17:59:58Z)
• Advancing 3D Point Cloud Understanding through Deep Transfer Learning: A Comprehensive Survey [3.929140365559557]
  This paper provides a comprehensive overview of the latest techniques for understanding 3DPC using deep transfer learning (DTL) and domain adaptation (DA) The paper covers various applications, such as 3DPC object detection, semantic labeling, segmentation, classification, registration, downsampling/upsampling, and denoising.
  arXiv  Detail & Related papers  (2024-07-25T08:47:27Z)
• SPOT: Scalable 3D Pre-training via Occupancy Prediction for Learning Transferable 3D Representations [76.45009891152178]
  Pretraining-finetuning approach can alleviate the labeling burden by fine-tuning a pre-trained backbone across various downstream datasets as well as tasks.<n>We show, for the first time, that general representations learning can be achieved through the task of occupancy prediction.<n>Our findings will facilitate the understanding of LiDAR points and pave the way for future advancements in LiDAR pre-training.
  arXiv  Detail & Related papers  (2023-09-19T11:13:01Z)
• Point Cloud Registration for LiDAR and Photogrammetric Data: a Critical Synthesis and Performance Analysis on Classic and Deep Learning Algorithms [7.874736360019618]
  We provide a comprehensive review of the state-of-the-art (SOTA) point cloud registration methods. We analyze and evaluate these methods using a diverse set of point cloud data from indoor to satellite sources. More than ten methods, including classic hand-crafted, deep-learning-based feature correspondence, and robust C2C methods were tested.
  arXiv  Detail & Related papers  (2023-02-14T16:52:26Z)
• Learning 3D Human Pose Estimation from Dozens of Datasets using a Geometry-Aware Autoencoder to Bridge Between Skeleton Formats [80.12253291709673]
  We propose a novel affine-combining autoencoder (ACAE) method to perform dimensionality reduction on the number of landmarks. Our approach scales to an extreme multi-dataset regime, where we use 28 3D human pose datasets to supervise one model.
  arXiv  Detail & Related papers  (2022-12-29T22:22:49Z)
• OccAM's Laser: Occlusion-based Attribution Maps for 3D Object Detectors on LiDAR Data [8.486063950768694]
  We propose a method to generate attribution maps for 3D object detection in LiDAR point clouds. These maps indicate the importance of each 3D point in predicting the specific objects. We show a detailed evaluation of the attribution maps and demonstrate that they are interpretable and highly informative.
  arXiv  Detail & Related papers  (2022-04-13T18:00:30Z)
• From 2D to 3D: Re-thinking Benchmarking of Monocular Depth Prediction [80.67873933010783]
  We argue that MDP is currently witnessing benchmark over-fitting and relying on metrics that are only partially helpful to gauge the usefulness of the predictions for 3D applications. This limits the design and development of novel methods that are truly aware of - and improving towards estimating - the 3D structure of the scene rather than optimizing 2D-based distances. We propose a set of metrics well suited to evaluate the 3D geometry of MDP approaches and a novel indoor benchmark, RIO-D3D, crucial for the proposed evaluation methodology.
  arXiv  Detail & Related papers  (2022-03-15T17:50:54Z)
• Recovering 3D Human Mesh from Monocular Images: A Survey [49.00136388529404]
  Estimating human pose and shape from monocular images is a long-standing problem in computer vision. This survey focuses on the task of monocular 3D human mesh recovery.
  arXiv  Detail & Related papers  (2022-03-03T18:56:08Z)
• Machine Learning in LiDAR 3D point clouds [0.0]
  We present a preliminary comparison study for the classification of 3D point cloud LiDAR data. In particular, we demonstrate that providing context by augmenting each point in the LiDAR point cloud with information about its neighboring points can improve the performance of downstream learning algorithms. We also experiment with several dimension reduction strategies, ranging from Principal Component Analysis (PCA) to neural network-based auto-encoders, and demonstrate how they affect classification performance in LiDAR point clouds.
  arXiv  Detail & Related papers  (2021-01-22T20:23:23Z)
• Deep Learning-Based Human Pose Estimation: A Survey [66.01917727294163]
  Human pose estimation has drawn increasing attention during the past decade. It has been utilized in a wide range of applications including human-computer interaction, motion analysis, augmented reality, and virtual reality. Recent deep learning-based solutions have achieved high performance in human pose estimation.
  arXiv  Detail & Related papers  (2020-12-24T18:49:06Z)
• Campus3D: A Photogrammetry Point Cloud Benchmark for Hierarchical Understanding of Outdoor Scene [76.4183572058063]
  We present a richly-annotated 3D point cloud dataset for multiple outdoor scene understanding tasks. The dataset has been point-wisely annotated with both hierarchical and instance-based labels. We formulate a hierarchical learning problem for 3D point cloud segmentation and propose a measurement evaluating consistency across various hierarchies.
  arXiv  Detail & Related papers  (2020-08-11T19:10:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.