ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss

• URL: http://arxiv.org/abs/2604.28025v1
• Date: Thu, 30 Apr 2026 15:42:17 GMT
• Title: ResiHMR: Residual-Limb Aware Single-Image 3D Human Mesh Recovery for Individuals with Limb Loss
• Abstract summary: We present ResiHMR, a residual-limb aware framework for single-image 3D human modeling.<n>To the best of our knowledge, this is the first single-image HMR system that explicitly reconstructs residual-limb surfaces.
• Score: 28.590347498910006
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Single-image human mesh recovery provides a compact 3D, person-centric representation that supports analysis, animation, AR and VR, rehabilitation, and human-computer interaction. However, prevailing systems impose an intact-limb prior and degrade on people with limb loss, because fixed-topology models cannot represent residual limbs. In this work, we present ResiHMR, a residual-limb aware framework for single-image 3D human modeling. ResiHMR adopts residual-limb keypoints and introduces two components: (i) a topology-adaptive Residual Anchor-Factor Optimization module that constrains estimation to the observed kinematic subgraph of anatomically valid structures, and (ii) a geometry-based Residual-Limb Reconstruction module that estimates residual-limb boundaries and convex limb-termination geometry. These components introduce topology-aware optimization and explicit termination geometry as tools for human mesh recovery under non-standard limb anatomy. Unlike joint-removal methods in a fixed topology, ResiHMR explicitly reconstructs residual-limb surfaces and aligns optimization with limb-loss topology, which better matches prosthetic biomechanics and real-world use. To the best of our knowledge, this is the first single-image HMR system that explicitly reconstructs residual-limb surfaces and performs topology-adaptive optimization for individuals with limb loss. On a curated dataset of real-world images with limb loss, ResiHMR improves reconstruction quality under both SMPLify-X and HSMR backbones, reducing intact-joint 2D MPJPE from 41.32 to 37.40 with SMPLify-X and residual-limb 2D MPJPE from 73.61 to 23.19 with HSMR.

Related papers

• FactorizedHMR: A Hybrid Framework for Video Human Mesh Recovery [6.1625435030904745]
  Human Mesh Recovery (HMR) is fundamentally ambiguous.<n>We propose FactorizedHMR, a two-stage framework that treats these two regimes differently.<n>We show that FactorizedHMR remains competitive with strong baselines across camera-space and world-space benchmarks.
  arXiv  Detail & Related papers  (2026-05-14T13:59:56Z)
• OAHuman: Occlusion-Aware 3D Human Reconstruction from Monocular Images [49.90475154034411]
  OAHuman is a framework that explicitly decouples geometry reconstruction and texture synthesis for robust 3D human modeling from a single RGB image.<n>Our framework ensures geometry reconstruction is perceptually reinforced even in occluded areas, isolating it from texture interference.<n>In parallel, texture synthesis is learned exclusively from visible regions, preventing texture errors from being transferred to the occluded areas.
  arXiv  Detail & Related papers  (2026-03-15T06:57:26Z)
• Towards Geometry-Aware and Motion-Guided Video Human Mesh Recovery [60.51998732898099]
  We introduce HMRMamba, a new paradigm for 3D Human Mesh Recovery.<n>It pioneers the use of Structured State Space Models for their efficiency and long-range modeling prowess.<n>Our framework is distinguished by two core contributions. First, the Geometry-Aware Lifting Module, featuring a novel dual-scan Mamba architecture.
  arXiv  Detail & Related papers  (2026-01-29T08:05:02Z)
• Spinal Line Detection for Posture Evaluation through Train-ing-free 3D Human Body Reconstruction with 2D Depth Images [1.655840696749311]
  It is important to restore the 3D shape of the human body and estimate the spine center line.<n>Existing mul-ti-image-based body restoration methods require expensive equipment and complex pro-cedures.<n>This study proposes a method to compensate for the shortcomings of the multi-image-based method and to solve the limitations of the sin-gle-image method.
  arXiv  Detail & Related papers  (2025-12-14T14:43:42Z)
• Likelihood-Scheduled Score-Based Generative Modeling for Fully 3D PET Image Reconstruction [40.34650079545031]
  We propose a practical methodology for fully 3D reconstruction that accelerates reconstruction and reduces the number of critical hyper parameters.<n>We show our methodology can match or improve on the NRMSE and SSIM of existing state-of-the-art SGM-based PET reconstruction.<n>We demonstrate a first-ever implementation of SGM-based reconstruction for real 3D PET data, specifically [$18$F]DPA-714 data.
  arXiv  Detail & Related papers  (2024-12-05T16:58:45Z)
• ARTS: Semi-Analytical Regressor using Disentangled Skeletal Representations for Human Mesh Recovery from Videos [18.685856290041283]
  ARTS surpasses existing state-of-the-art video-based methods in both per-frame accuracy and temporal consistency on popular benchmarks. A skeleton estimation and disentanglement module is proposed to estimate the 3D skeletons from a video. The regressor consists of three modules: Temporal Inverse Kinematics (TIK), Bone-guided Shape Fitting (BSF), and Motion-Centric Refinement (MCR)
  arXiv  Detail & Related papers  (2024-10-21T02:06:43Z)
• Multi-class point cloud completion networks for 3D cardiac anatomy reconstruction from cine magnetic resonance images [4.1448595037512925]
  We propose a novel fully automatic surface reconstruction pipeline capable of reconstructing multi-class 3D cardiac anatomy meshes. Its key component is a multi-class point cloud completion network (PCCN) capable of correcting both the sparsity and misalignment issues of the 3D reconstruction task.
  arXiv  Detail & Related papers  (2023-07-17T14:52:52Z)
• Probabilistic 3D surface reconstruction from sparse MRI information [58.14653650521129]
  We present a novel probabilistic deep learning approach for concurrent 3D surface reconstruction from sparse 2D MR image data and aleatoric uncertainty prediction. Our method is capable of reconstructing large surface meshes from three quasi-orthogonal MR imaging slices from limited training sets.
  arXiv  Detail & Related papers  (2020-10-05T14:18:52Z)
• Monocular Human Pose and Shape Reconstruction using Part Differentiable Rendering [53.16864661460889]
  Recent works succeed in regression-based methods which estimate parametric models directly through a deep neural network supervised by 3D ground truth. In this paper, we introduce body segmentation as critical supervision. To improve the reconstruction with part segmentation, we propose a part-level differentiable part that enables part-based models to be supervised by part segmentation.
  arXiv  Detail & Related papers  (2020-03-24T14:25:46Z)
• HEMlets PoSh: Learning Part-Centric Heatmap Triplets for 3D Human Pose and Shape Estimation [60.35776484235304]
  This work attempts to address the uncertainty of lifting the detected 2D joints to the 3D space by introducing an intermediate state-Part-Centric Heatmap Triplets (HEMlets) The HEMlets utilize three joint-heatmaps to represent the relative depth information of the end-joints for each skeletal body part. A Convolutional Network (ConvNet) is first trained to predict HEMlets from the input image, followed by a volumetric joint-heatmap regression.
  arXiv  Detail & Related papers  (2020-03-10T04:03:45Z)
• Learning Nonparametric Human Mesh Reconstruction from a Single Image without Ground Truth Meshes [56.27436157101251]
  We propose a novel approach to learn human mesh reconstruction without any ground truth meshes. This is made possible by introducing two new terms into the loss function of a graph convolutional neural network (Graph CNN)
  arXiv  Detail & Related papers  (2020-02-28T20:30:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.