Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors

• URL: http://arxiv.org/abs/2510.17101v1
• Date: Mon, 20 Oct 2025 02:20:31 GMT
• Title: Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors
• Authors: Lu Yin, Ziying Shi, Yinghao Wu, Xinyu Yi, Feng Xu, Shihui Guo,
• Abstract summary: Shape-aware Inertial Poser (SAIP) is first solution considering body shape differences in sparse inertial-based motion capture.<n>We train a regression model to transfer the IMU-measured accelerations of a real body to match the template adult body model.<n>We then use a shape-aware physical optimization strategy to calculate global motions on the subject.
• Score: 18.850688096145493
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Human motion capture with sparse inertial sensors has gained significant attention recently. However, existing methods almost exclusively rely on a template adult body shape to model the training data, which poses challenges when generalizing to individuals with largely different body shapes (such as a child). This is primarily due to the variation in IMU-measured acceleration caused by changes in body shape. To fill this gap, we propose Shape-aware Inertial Poser (SAIP), the first solution considering body shape differences in sparse inertial-based motion capture. Specifically, we decompose the sensor measurements related to shape and pose in order to effectively model their joint correlations. Firstly, we train a regression model to transfer the IMU-measured accelerations of a real body to match the template adult body model, compensating for the shape-related sensor measurements. Then, we can easily follow the state-of-the-art methods to estimate the full body motions of the template-shaped body. Finally, we utilize a second regression model to map the joint velocities back to the real body, combined with a shape-aware physical optimization strategy to calculate global motions on the subject. Furthermore, our method relies on body shape awareness, introducing the first inertial shape estimation scheme. This is accomplished by modeling the shape-conditioned IMU-pose correlation using an MLP-based network. To validate the effectiveness of SAIP, we also present the first IMU motion capture dataset containing individuals of different body sizes. This dataset features 10 children and 10 adults, with heights ranging from 110 cm to 190 cm, and a total of 400 minutes of paired IMU-Motion samples. Extensive experimental results demonstrate that SAIP can effectively handle motion capture tasks for diverse body shapes. The code and dataset are available at https://github.com/yinlu5942/SAIP.

Related papers

• Human-Like Coarse Object Representations in Vision Models [7.548979981481746]
  Humans represent objects for intuitive physics with coarse, bodies'' that are largely unknown.<n>We optimize pixel-accurate masks that may misalign with such bodies.<n>We find that alignment with human behavior follows an inverse U-shaped curve.
  arXiv  Detail & Related papers  (2026-02-12T23:59:58Z)
• ATLAS: Decoupling Skeletal and Shape Parameters for Expressive Parametric Human Modeling [43.66748605071065]
  We present ATLAS, a high-fidelity body model learned from 600k high-resolution scans captured using 240 synchronized cameras.<n>We explicitly decouple the shape and skeleton bases by grounding our mesh representation in the human skeleton.<n> ATLAS outperforms existing methods by fitting unseen subjects in diverse poses more accurately, and quantitative evaluations show that our non-linear pose correctives more effectively capture complex poses compared to linear models.
  arXiv  Detail & Related papers  (2025-08-21T17:58:56Z)
• DPoser-X: Diffusion Model as Robust 3D Whole-body Human Pose Prior [82.9526308672547]
  We present DPoser-X, a diffusion-based prior model for 3D whole-body human poses.<n>Our approach unifies various pose-centric tasks as inverse problems, solving them through variational diffusion sampling.<n>Our model consistently outperforms state-of-the-art alternatives, establishing a new benchmark for whole-body human pose prior modeling.
  arXiv  Detail & Related papers  (2025-08-01T12:56:39Z)
• Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose [3.4616587016280183]
  We present a 3D articulated statistical fetal body model based on the Skinned Multi-Person Linear Model (SMPL)<n>Our algorithm iteratively estimates body pose in the image space and body shape in the canonical pose space.<n>Our model captures body shape and motion across time series and provides intuitive visualization.
  arXiv  Detail & Related papers  (2025-06-21T23:45:35Z)
• Leveraging Anthropometric Measurements to Improve Human Mesh Estimation and Ensure Consistent Body Shapes [12.932412290302258]
  We find that SOTA 3D human pose estimation (HPE) models outperform HME models regarding the precision of the estimated 3D keypoint positions.<n>We create a model called A2B that converts given anthropometric measurements to basic body shape parameters of human mesh models.
  arXiv  Detail & Related papers  (2024-09-26T09:30:37Z)
• ShapeBoost: Boosting Human Shape Estimation with Part-Based Parameterization and Clothing-Preserving Augmentation [58.50613393500561]
  We propose ShapeBoost, a new human shape recovery framework. It achieves pixel-level alignment even for rare body shapes and high accuracy for people wearing different types of clothes.
  arXiv  Detail & Related papers  (2024-03-02T23:40:23Z)
• Transformer Inertial Poser: Attention-based Real-time Human Motion Reconstruction from Sparse IMUs [79.72586714047199]
  We propose an attention-based deep learning method to reconstruct full-body motion from six IMU sensors in real-time. Our method achieves new state-of-the-art results both quantitatively and qualitatively, while being simple to implement and smaller in size.
  arXiv  Detail & Related papers  (2022-03-29T16:24:52Z)
• Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation [67.23327074124855]
  This paper presents an elegant solution for the integration of temporal constraints in the fitting process. We derive parameters of a sequence of body models, representing shape and motion of a person, including jaw poses, facial expressions, and finger poses. Our approach enables the derivation of realistic 3D body models from image sequences, including facial expression and articulated hands.
  arXiv  Detail & Related papers  (2022-02-07T11:11:55Z)
• LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies [78.17425779503047]
  We propose a novel neural implicit representation for the human body. It is fully differentiable and optimizable with disentangled shape and pose latent spaces. Our model can be trained and fine-tuned directly on non-watertight raw data with well-designed losses.
  arXiv  Detail & Related papers  (2021-11-30T04:10:57Z)
• HEMlets PoSh: Learning Part-Centric Heatmap Triplets for 3D Human Pose and Shape Estimation [60.35776484235304]
  This work attempts to address the uncertainty of lifting the detected 2D joints to the 3D space by introducing an intermediate state-Part-Centric Heatmap Triplets (HEMlets) The HEMlets utilize three joint-heatmaps to represent the relative depth information of the end-joints for each skeletal body part. A Convolutional Network (ConvNet) is first trained to predict HEMlets from the input image, followed by a volumetric joint-heatmap regression.
  arXiv  Detail & Related papers  (2020-03-10T04:03:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.