Patient-Specific Articulated Digital Twins from a Single Full-Body CT Scan

• URL: http://arxiv.org/abs/2607.02156v1
• Date: Thu, 02 Jul 2026 13:30:45 GMT
• Title: Patient-Specific Articulated Digital Twins from a Single Full-Body CT Scan
• Abstract summary: Patient-specific anatomical models provide context for surgical planning, image-guided intervention, and algorithm development.<n>We present a proof-of-concept for constructing a patient-specific articulated digital twin from a single full-body CT scan.
• Score: 10.261106856853742
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Patient-specific anatomical models provide individualized context for surgical planning, image-guided intervention, and algorithm development. However, most CT-derived models are static: they preserve the body configuration captured at scan time, but cannot represent how the same anatomy would appear after patient repositioning. This limitation is especially important for radiographic imaging, where appearance depends jointly on imaging geometry and patient pose. We present a proof-of-concept for constructing a patient-specific articulated digital twin from a single full-body CT scan. The method fits a parametric human body model (SMPL) to obtain a patient-aligned kinematic scaffold, binds segmented bones and organs to an anatomy-aware rig, and retargets body-pose changes while preserving skeletal geometry. On three full-body CT subjects, the fitted scaffold achieved 15.8 $\pm$ 4.0 mm chamfer distance and 95.9 $\pm$ 1.8% skeletal enclosure. Recomposition at the acquisition pose preserved major radiographic structure, with overall SSIM of 0.872 $\pm$ 0.016 and PSNR of 18.5 $\pm$ 1.4 dB across paired DRRs. Across unseen target poses, the resulting twins enabled articulation while maintaining high skeletal enclosure (94.4 $\pm$ 0.4%). As a feasibility demonstration, we render the articulated twin as pose-dependent DRRs. These results suggest the feasibility of extending static, view-controllable CT simulation toward pose-controllable anatomical twins for future synthetic imaging and positioning studies.

Related papers

• Rendering Novel Views of MRI Using 3D Gaussian Splatting [54.6286495315908]
  We adapt 3D Gaussian Splatting to form a reconstruction starting from sparse anisotropic MRIs, and imaging planes aligned with the anatomy relevant for clinical evaluation are then sampled and rendered.<n>The novel view plane is optimal for diagnostic radiological grading of the target anatomy, whereas the original MRI is not.
  arXiv  Detail & Related papers  (2026-06-24T18:00:03Z)
• Statistical Hand Shape Modeling from Clinical CT Scans Using Deep Learning and Implicit Skinning [0.0]
  This study proposes an AI-assisted reconstruction pipeline for segmenting and analyzing hand anatomy from 1,271 elbow-to-hand (e2h-CT) computed tomography scans.<n>A Pix2Pix-based conditional generative adversarial network is first employed to remove plaster cast and background artifacts from CT volumes.<n> Segmented bone meshes are used to construct skeletal representations, enabling implicit skinning to align all hand models into a standardized anatomical configuration.
  arXiv  Detail & Related papers  (2026-05-16T13:00:34Z)
• Surf2CT: Cascaded 3D Flow Matching Models for Torso 3D CT Synthesis from Skin Surface [13.161605581865357]
  Surf2CT is a framework that synthesizes full 3D computed tomography (CT) volumes of the human torso from external surface scans and demographic data.<n>We trained our model on a combined dataset of 3,198 torso CT scans sourced from Massachusetts General Hospital (MGH) and the AutoPET challenge.
  arXiv  Detail & Related papers  (2025-05-28T16:01:36Z)
• seg2med: a bridge from artificial anatomy to multimodal medical images [5.92914320764123]
  seg2med is a framework for anatomy-driven multimodal medical image synthesis.<n> anatomical maps are independently derived from three sources: real patient data, XCAT digital phantoms, and synthetic anatomies created by combining organs from multiple patients.<n>The framework achieves SSIM of 0.94 for CT and 0.89 for MR compared to real data, and FSIM of 0.78 for simulated CT.
  arXiv  Detail & Related papers  (2025-04-12T11:32:32Z)
• Accurate Fine-Grained Segmentation of Human Anatomy in Radiographs via Volumetric Pseudo-Labeling [66.75096111651062]
  We created a large-scale dataset of 10,021 thoracic CTs with 157 labels. We applied an ensemble of 3D anatomy segmentation models to extract anatomical pseudo-labels. Our resulting segmentation models demonstrated remarkable performance on CXR.
  arXiv  Detail & Related papers  (2023-06-06T18:01:08Z)
• TotalSegmentator: robust segmentation of 104 anatomical structures in CT images [48.50994220135258]
  We present a deep learning segmentation model for body CT images. The model can segment 104 anatomical structures relevant for use cases such as organ volumetry, disease characterization, and surgical or radiotherapy planning.
  arXiv  Detail & Related papers  (2022-08-11T15:16:40Z)
• Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading [70.04389979779195]
  This paper proposes a novel transformer-based model architecture for medical imaging problems involving analysis of vertebrae. It considers two applications of such models in MR images: (a) detection of spinal metastases and the related conditions of vertebral fractures and metastatic cord compression. We show that by considering the context of vertebral bodies in the image, SCT improves the accuracy for several gradings compared to previously published model.
  arXiv  Detail & Related papers  (2022-06-27T10:31:03Z)
• Weakly-supervised Biomechanically-constrained CT/MRI Registration of the Spine [72.85011943179894]
  We propose a weakly-supervised deep learning framework that preserves the rigidity and the volume of each vertebra while maximizing the accuracy of the registration. We specifically design these losses to depend only on the CT label maps since automatic vertebra segmentation in CT gives more accurate results contrary to MRI. Our results show that adding the anatomy-aware losses increases the plausibility of the inferred transformation while keeping the accuracy untouched.
  arXiv  Detail & Related papers  (2022-05-16T10:59:55Z)
• One shot PACS: Patient specific Anatomic Context and Shape prior aware recurrent registration-segmentation of longitudinal thoracic cone beam CTs [3.3504365823045044]
  Thoracic CBCTs are hard to segment because of low-tissue contrast, imaging artifacts, respiratory motion, and large treatment induced intra-thoracic anatomic changes. We developed a novel Patient-specific Anatomic Context and prior Shape or PACS- 3D recurrent registration-segmentation network for longitudinal CBCT segmentation.
  arXiv  Detail & Related papers  (2022-01-26T15:18:30Z)
• Comprehensive Validation of Automated Whole Body Skeletal Muscle, Adipose Tissue, and Bone Segmentation from 3D CT images for Body Composition Analysis: Towards Extended Body Composition [0.6176955945418618]
  Powerful tools of artificial intelligence such as deep learning are making it feasible now to segment the entire 3D image and generate accurate measurements of all internal anatomy. These will enable the overcoming of the severe bottleneck that existed previously, namely, the need for manual segmentation. These measurements were hitherto unavailable thereby limiting the field to a very small and limited subset.
  arXiv  Detail & Related papers  (2021-06-01T17:30:45Z)
• iPhantom: a framework for automated creation of individualized computational phantoms and its application to CT organ dosimetry [58.943644554192936]
  This study aims to develop and validate a novel framework, iPhantom, for automated creation of patient-specific phantoms or digital-twins. The framework is applied to assess radiation dose to radiosensitive organs in CT imaging of individual patients. iPhantom precisely predicted all organ locations with good accuracy of Dice Similarity Coefficients (DSC) >0.6 for anchor organs and DSC of 0.3-0.9 for all other organs.
  arXiv  Detail & Related papers  (2020-08-20T01:50:49Z)
• Appearance Learning for Image-based Motion Estimation in Tomography [60.980769164955454]
  In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Patient motion corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object.
  arXiv  Detail & Related papers  (2020-06-18T09:49:11Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.