Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose

• URL: http://arxiv.org/abs/2506.17858v3
• Date: Thu, 17 Jul 2025 04:53:51 GMT
• Title: Fetuses Made Simple: Modeling and Tracking of Fetal Shape and Pose
• Authors: Yingcheng Liu, Peiqi Wang, Sebastian Diaz, Esra Abaci Turk, Benjamin Billot, P. Ellen Grant, Polina Golland,
• Abstract summary: We present a 3D articulated statistical fetal body model based on the Skinned Multi-Person Linear Model (SMPL)<n>Our algorithm iteratively estimates body pose in the image space and body shape in the canonical pose space.<n>Our model captures body shape and motion across time series and provides intuitive visualization.
• Score: 3.4616587016280183
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Analyzing fetal body motion and shape is paramount in prenatal diagnostics and monitoring. Existing methods for fetal MRI analysis mainly rely on anatomical keypoints or volumetric body segmentations. Keypoints simplify body structure to facilitate motion analysis, but may ignore important details of full-body shape. Body segmentations capture complete shape information but complicate temporal analysis due to large non-local fetal movements. To address these limitations, we construct a 3D articulated statistical fetal body model based on the Skinned Multi-Person Linear Model (SMPL). Our algorithm iteratively estimates body pose in the image space and body shape in the canonical pose space. This approach improves robustness to MRI motion artifacts and intensity distortions, and reduces the impact of incomplete surface observations due to challenging fetal poses. We train our model on segmentations and keypoints derived from $19,816$ MRI volumes across $53$ subjects. Our model captures body shape and motion across time series and provides intuitive visualization. Furthermore, it enables automated anthropometric measurements traditionally difficult to obtain from segmentations and keypoints. When tested on unseen fetal body shapes, our method yields a surface alignment error of $3.2$ mm for $3$ mm MRI voxel size. To our knowledge, this represents the first 3D articulated statistical fetal body model, paving the way for enhanced fetal motion and shape analysis in prenatal diagnostics. The code is available at https://github.com/MedicalVisionGroup/fetal-smpl .

Related papers

• Equivariant Symmetry-Aware Head Pose Estimation for Fetal MRI [5.003133209582619]
  We present E(3)-Pose, a novel fast pose estimation method.<n>We aim to enable automatic adaptive prescription of 2D diagnostic MRI slices with 6-DoF head pose estimation.<n>Our experiments on publicly available and representative clinical fetal MRI datasets demonstrate the superior robustness and generalization of our method.
  arXiv  Detail & Related papers  (2025-12-04T15:15:55Z)
• Shape-aware Inertial Poser: Motion Tracking for Humans with Diverse Shapes Using Sparse Inertial Sensors [18.850688096145493]
  Shape-aware Inertial Poser (SAIP) is first solution considering body shape differences in sparse inertial-based motion capture.<n>We train a regression model to transfer the IMU-measured accelerations of a real body to match the template adult body model.<n>We then use a shape-aware physical optimization strategy to calculate global motions on the subject.
  arXiv  Detail & Related papers  (2025-10-20T02:20:31Z)
• A Simple Strategy for Body Estimation from Partial-View Images [8.05538560322898]
  Virtual try-on and product personalization have become increasingly important in modern online shopping, highlighting the need for accurate body measurement estimation. Previous research has advanced in estimating 3D body shapes from RGB images, but the task is inherently ambiguous as the observed scale of human subjects in the images depends on two unknown factors: capture distance and body dimensions. We propose a modular and simple height normalization solution, which relocates the subject skeleton to the desired position, normalizing the scale and disentangling the relationship between the two variables.
  arXiv  Detail & Related papers  (2024-04-14T16:55:23Z)
• TailorMe: Self-Supervised Learning of an Anatomically Constrained Volumetric Human Shape Model [4.474107938692397]
  Human shape spaces have been extensively studied, as they are a core element of human shape and pose inference tasks. We create an anatomical template, consisting of skeleton bones and soft tissue, to the surface scans of the CAESAR database. This data is then used to learn an anthropo constrained volumetric human shape model in a self-supervised fashion.
  arXiv  Detail & Related papers  (2023-11-03T07:42:19Z)
• FetusMapV2: Enhanced Fetal Pose Estimation in 3D Ultrasound [28.408626329596668]
  We propose a novel 3D fetal pose estimation framework (called FetusMapV2) to overcome the above challenges. First, we propose a scheme that explores the complementary network structure-unconstrained and activation-unreserved GPU memory management approaches. Second, we design a novel Pair Loss to mitigate confusion caused by symmetrical and similar anatomical structures. Third, we propose a shape priors-based self-supervised learning by selecting the relatively stable landmarks to refine the pose online.
  arXiv  Detail & Related papers  (2023-10-30T06:18:47Z)
• Abdominal organ segmentation via deep diffeomorphic mesh deformations [5.4173776411667935]
  Abdominal organ segmentation from CT and MRI is an essential prerequisite for surgical planning and computer-aided navigation systems. We employ template-based mesh reconstruction methods for joint liver, kidney, pancreas, and spleen segmentation. The resulting method, UNetFlow, generalizes well to all four organs and can be easily fine-tuned on new data.
  arXiv  Detail & Related papers  (2023-06-27T14:41:18Z)
• SUPR: A Sparse Unified Part-Based Human Representation [61.693373050670644]
  We show that existing models of the head and hands fail to capture the full range of motion for these parts. Previous body part models are trained using 3D scans that are isolated to the individual parts. We propose a new learning scheme that jointly trains a full-body model and specific part models.
  arXiv  Detail & Related papers  (2022-10-25T09:32:34Z)
• OSSO: Obtaining Skeletal Shape from Outside [50.47978215230605]
  OSSO (Obtaining Skeletal Shape from Outside) is the first to learn the mapping from the 3D body surface to the internal skeleton from real data. To these, we fit a parametric 3D body shape model (STAR) to capture the body surface and a novel part-based 3D skeleton model to capture the bones. We then train a regressor from body shape parameters to skeleton shape parameters and refine the skeleton to satisfy constraints on physical plausibility.
  arXiv  Detail & Related papers  (2022-04-21T14:33:42Z)
• Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation [67.23327074124855]
  This paper presents an elegant solution for the integration of temporal constraints in the fitting process. We derive parameters of a sequence of body models, representing shape and motion of a person, including jaw poses, facial expressions, and finger poses. Our approach enables the derivation of realistic 3D body models from image sequences, including facial expression and articulated hands.
  arXiv  Detail & Related papers  (2022-02-07T11:11:55Z)
• LatentHuman: Shape-and-Pose Disentangled Latent Representation for Human Bodies [78.17425779503047]
  We propose a novel neural implicit representation for the human body. It is fully differentiable and optimizable with disentangled shape and pose latent spaces. Our model can be trained and fine-tuned directly on non-watertight raw data with well-designed losses.
  arXiv  Detail & Related papers  (2021-11-30T04:10:57Z)
• Detailed Avatar Recovery from Single Image [50.82102098057822]
  This paper presents a novel framework to recover emphdetailed avatar from a single image. We use the deep neural networks to refine the 3D shape in a Hierarchical Mesh Deformation framework. Our method can restore detailed human body shapes with complete textures beyond skinned models.
  arXiv  Detail & Related papers  (2021-08-06T03:51:26Z)
• Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy [1.8648073685057092]
  Estimation of fetal pose in real time during MRI stands to benefit prospective methods to detect and mitigate fetal motion artifacts. Current developments of deep reinforcement learning (DRL) offer a novel approach for fetal landmarks detection. In this task 15 agents are deployed to detect 15 landmarks simultaneously by DRL. Evaluation of this method on a repository of 3-mm resolution in vivo data demonstrates a mean accuracy of landmark estimation within 10 mm of ground truth as 87.3%, and a mean error of 6.9 mm.
  arXiv  Detail & Related papers  (2020-07-16T07:10:21Z)
• HEMlets PoSh: Learning Part-Centric Heatmap Triplets for 3D Human Pose and Shape Estimation [60.35776484235304]
  This work attempts to address the uncertainty of lifting the detected 2D joints to the 3D space by introducing an intermediate state-Part-Centric Heatmap Triplets (HEMlets) The HEMlets utilize three joint-heatmaps to represent the relative depth information of the end-joints for each skeletal body part. A Convolutional Network (ConvNet) is first trained to predict HEMlets from the input image, followed by a volumetric joint-heatmap regression.
  arXiv  Detail & Related papers  (2020-03-10T04:03:45Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.