Statistical Hand Shape Modeling from Clinical CT Scans Using Deep Learning and Implicit Skinning

• URL: http://arxiv.org/abs/2605.16980v1
• Date: Sat, 16 May 2026 13:00:34 GMT
• Title: Statistical Hand Shape Modeling from Clinical CT Scans Using Deep Learning and Implicit Skinning
• Abstract summary: This study proposes an AI-assisted reconstruction pipeline for segmenting and analyzing hand anatomy from 1,271 elbow-to-hand (e2h-CT) computed tomography scans.<n>A Pix2Pix-based conditional generative adversarial network is first employed to remove plaster cast and background artifacts from CT volumes.<n> Segmented bone meshes are used to construct skeletal representations, enabling implicit skinning to align all hand models into a standardized anatomical configuration.
• Score: 0.0
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Accurate segmentation and statistical shape modeling of hand anatomy have significant implications for medical diagnostics, ergonomics, and biomechanics. This study proposes an AI-assisted reconstruction pipeline for segmenting and analyzing hand anatomy from 1,271 elbow-to-hand (e2h-CT) computed tomography scans. A Pix2Pix-based conditional generative adversarial network is first employed to remove plaster cast and background artifacts from CT volumes. The cleaned scans are then processed in 3D Slicer to extract skin and bone masks, which are converted into closed-surface mesh models. Segmented bone meshes are used to construct skeletal representations, enabling implicit skinning to align all hand models into a standardized anatomical configuration. Subsequently, non-rigid registration is performed on the hand skin surfaces using the Geodesic Based Coherent Point Drift++ (GBCPD++) algorithm to establish point-wise correspondence across subjects. Principal Component Analysis (PCA) is then applied to the registered models to quantify anatomical shape variability. The Pix2Pix preprocessing stage achieved a Dice coefficient of 0.9856 and an IoU of 0.9720 on the held-out test set. Statistical modeling was performed on a subset of 90 scans in which the fingers were fully visible and anatomically separated. The resulting statistical shape distributions demonstrate strong agreement with the U.S. Army Anthropometric Survey (ANSUR II), supporting the anatomical validity of the reconstructed models. The proposed methodology demonstrates significant potential for advancing biomechanical modeling, ergonomic optimization, prosthetic design, and precision medical diagnostics.

Related papers

• LegSegNet: A Public Deep Learning System for Lower Extremity CT Tissue Segmentation and Quantification [9.556625323268959]
  LegSegNet is a deep learning system for lower extremity CT tissue segmentation and body composition quantification.<n>Given an input CT scan, LegSegNet segments bone, skeletal muscle, subcutaneous adipose tissue, and inter/intramuscular adipose tissue.<n>LegSegNet achieves the best overall segmentation performance, with an average Dice score of 89.31 on the held-out test set.
  arXiv  Detail & Related papers  (2026-05-29T04:33:56Z)
• Rule-based Key-Point Extraction for MR-Guided Biomechanical Digital Twins of the Spine [7.472140755231005]
  We present a rule-based approach for subpixel-accurate key-point extraction from MRI.<n>Our approach incorporates robust image alignment and vertebra-specific orientation estimation to generate anatomically meaningful landmarks.<n>This work contributes to the digital twin ecosystem by bridging the gap between precise medical image analysis with biomechanical simulation.
  arXiv  Detail & Related papers  (2025-08-20T13:31:40Z)
• Semantic Segmentation for Preoperative Planning in Transcatheter Aortic Valve Replacement [61.573750959726475]
  We consider medical guidelines for preoperative planning of the transcatheter aortic valve replacement (TAVR) and identify tasks that may be supported via semantic segmentation models.<n>We first derive fine-grained TAVR-relevant pseudo-labels from coarse-grained anatomical information, in order to train segmentation models and quantify how well they are able to find these structures in the scans.
  arXiv  Detail & Related papers  (2025-07-22T13:24:45Z)
• Med-PU: Point Cloud Upsampling for High-Fidelity 3D Medical Shape Reconstruction [3.03428788883563]
  We present Med-PU, a framework that integrates medical image segmentation with point cloud upsampling for accurate pelvic shape reconstruction.<n>Unlike landmark- or PCA-based statistical shape models, Med-PU learns an implicit anatomical prior directly from large-scale 3D shape data.<n>Med-PU consistently improves surface quality and anatomical fidelity while reducing artifacts, demonstrating robustness across input densities.
  arXiv  Detail & Related papers  (2025-01-28T05:47:50Z)
• Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labeling [66.75096111651062]
  We created a large-scale dataset of 10,021 thoracic CTs with 157 labels. We applied an ensemble of 3D anatomy segmentation models to extract anatomical pseudo-labels. Our resulting segmentation models demonstrated remarkable performance on CXR.
  arXiv  Detail & Related papers  (2023-06-06T18:01:08Z)
• BOSS: Bones, Organs and Skin Shape Model [10.50175010474078]
  We propose a deformable human shape and pose model that combines skin, internal organs, and bones, learned from CT images. By modeling the statistical variations in a pose-normalized space using probabilistic PCA, our approach offers a holistic representation of the body.
  arXiv  Detail & Related papers  (2023-03-08T22:31:24Z)
• TotalSegmentator: robust segmentation of 104 anatomical structures in CT images [48.50994220135258]
  We present a deep learning segmentation model for body CT images. The model can segment 104 anatomical structures relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning.
  arXiv  Detail & Related papers  (2022-08-11T15:16:40Z)
• A multi-stage machine learning model on diagnosis of esophageal manometry [50.591267188664666]
  The framework includes deep-learning models at the swallow-level stage and feature-based machine learning models at the study-level stage. This is the first artificial-intelligence-style model to automatically predict CC diagnosis of HRM study from raw multi-swallow data.
  arXiv  Detail & Related papers  (2021-06-25T20:09:23Z)
• Deep Implicit Statistical Shape Models for 3D Medical Image Delineation [47.78425002879612]
  3D delineation of anatomical structures is a cardinal goal in medical imaging analysis. Prior to deep learning, statistical shape models that imposed anatomical constraints and produced high quality surfaces were a core technology. We present deep implicit statistical shape models (DISSMs), a new approach to delineation that marries the representation power of CNNs with the robustness of SSMs.
  arXiv  Detail & Related papers  (2021-04-07T01:15:06Z)
• Benchmarking off-the-shelf statistical shape modeling tools in clinical applications [53.47202621511081]
  We systematically assess the outcome of widely used, state-of-the-art SSM tools. We propose validation frameworks for anatomical landmark/measurement inference and lesion screening. ShapeWorks and Deformetrica shape models are found to capture clinically relevant population-level variability.
  arXiv  Detail & Related papers  (2020-09-07T03:51:35Z)
• A Deep Learning-Based Method for Automatic Segmentation of Proximal Femur from Quantitative Computed Tomography Images [5.731199807877257]
  We developed a 3D image segmentation method based V on-Net, an end-to-end fully convolutional neural network (CNN) We performed experiments to evaluate the effectiveness of the proposed segmentation method.
  arXiv  Detail & Related papers  (2020-06-09T21:16:47Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.