Rule-based Key-Point Extraction for MR-Guided Biomechanical Digital Twins of the Spine

• URL: http://arxiv.org/abs/2508.14708v1
• Date: Wed, 20 Aug 2025 13:31:40 GMT
• Title: Rule-based Key-Point Extraction for MR-Guided Biomechanical Digital Twins of the Spine
• Authors: Robert Graf, Tanja Lerchl, Kati Nispel, Hendrik Möller, Matan Atad, Julian McGinnis, Julius Maria Watrinet, Johannes Paetzold, Daniel Rueckert, Jan S. Kirschke,
• Abstract summary: We present a rule-based approach for subpixel-accurate key-point extraction from MRI.<n>Our approach incorporates robust image alignment and vertebra-specific orientation estimation to generate anatomically meaningful landmarks.<n>This work contributes to the digital twin ecosystem by bridging the gap between precise medical image analysis with biomechanical simulation.
• Score: 7.472140755231005
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Digital twins offer a powerful framework for subject-specific simulation and clinical decision support, yet their development often hinges on accurate, individualized anatomical modeling. In this work, we present a rule-based approach for subpixel-accurate key-point extraction from MRI, adapted from prior CT-based methods. Our approach incorporates robust image alignment and vertebra-specific orientation estimation to generate anatomically meaningful landmarks that serve as boundary conditions and force application points, like muscle and ligament insertions in biomechanical models. These models enable the simulation of spinal mechanics considering the subject's individual anatomy, and thus support the development of tailored approaches in clinical diagnostics and treatment planning. By leveraging MR imaging, our method is radiation-free and well-suited for large-scale studies and use in underrepresented populations. This work contributes to the digital twin ecosystem by bridging the gap between precise medical image analysis with biomechanical simulation, and aligns with key themes in personalized modeling for healthcare.

Related papers

• Attention-Driven Framework for Non-Rigid Medical Image Registration [15.540035635369504]
  We propose a novel Attention-Driven Framework for Non-Rigid Medical Image Registration (AD-RegNet)<n>Our approach combines a 3D UNet backbone with bidirectional cross-attention, which establishes correspondences between moving and fixed images at multiple scales.<n>The proposed method maintains a favorable balance between registration accuracy and computational efficiency, making it suitable for clinical applications.
  arXiv  Detail & Related papers  (2026-02-06T09:23:37Z)
• GRASPing Anatomy to Improve Pathology Segmentation [67.98147643529309]
  We introduce GRASP, a modular plug-and-play framework that enhances pathology segmentation models.<n>We evaluate GRASP on two PET/CT datasets, conduct systematic ablation studies, and investigate the framework's inner workings.
  arXiv  Detail & Related papers  (2025-08-05T12:26:36Z)
• Semantic Segmentation for Preoperative Planning in Transcatheter Aortic Valve Replacement [61.573750959726475]
  We consider medical guidelines for preoperative planning of the transcatheter aortic valve replacement (TAVR) and identify tasks that may be supported via semantic segmentation models.<n>We first derive fine-grained TAVR-relevant pseudo-labels from coarse-grained anatomical information, in order to train segmentation models and quantify how well they are able to find these structures in the scans.
  arXiv  Detail & Related papers  (2025-07-22T13:24:45Z)
• Framework of a multiscale data-driven DT of the musculoskeletal system [5.95624397453931]
  Musculoskeletal disorders (MSDs) are a leading cause of disability worldwide.<n>This paper introduces the Musculoskeletal Digital Twin (MS-DT), a novel framework that integrates multiscale biomechanical data with computational modelling.
  arXiv  Detail & Related papers  (2025-06-13T14:26:09Z)
• AI-Powered Automated Model Construction for Patient-Specific CFD Simulations of Aortic Flows [8.062885940500259]
  This study introduces a deep-learning framework that automates the creation of simulation-ready vascular models from medical images.<n>The proposed approach demonstrates state-of-the-art performance in segmentation and mesh quality while significantly reducing manual effort and processing time.
  arXiv  Detail & Related papers  (2025-03-16T14:18:25Z)
• Clinical Utility of Foundation Segmentation Models in Musculoskeletal MRI: Biomarker Fidelity and Predictive Outcomes [0.0]
  We evaluate three widely used segmentation models (SAM, SAM2, MedSAM) across eleven musculoskeletal (MSK) MRI datasets.<n>Our framework assesses both zero-shot and finetuned performance, with attention to segmentation accuracy, generalizability across imaging protocols, and reliability of derived quantitative biomarkers.
  arXiv  Detail & Related papers  (2025-01-23T04:41:20Z)
• MS-MANO: Enabling Hand Pose Tracking with Biomechanical Constraints [50.61346764110482]
  We integrate a musculoskeletal system with a learnable parametric hand model, MANO, to create MS-MANO. This model emulates the dynamics of muscles and tendons to drive the skeletal system, imposing physiologically realistic constraints on the resulting torque trajectories. We also propose a simulation-in-the-loop pose refinement framework, BioPR, that refines the initial estimated pose through a multi-layer perceptron network.
  arXiv  Detail & Related papers  (2024-04-16T02:18:18Z)
• Three-dimensional numerical schemes for the segmentation of the psoas muscle in X-ray computed tomography images [0.0]
  The analysis of the psoas muscle in morphological and functional imaging has proved to be an accurate approach to assess sarcopenia. The present study utilizes three-dimensional numerical schemes for psoas segmentation in low-dose X-ray computed tomography images.
  arXiv  Detail & Related papers  (2023-12-10T13:37:39Z)
• ShaRPy: Shape Reconstruction and Hand Pose Estimation from RGB-D with Uncertainty [6.559796851992517]
  We propose ShaRPy, the first RGB-D Shape Reconstruction and hand Pose tracking system. ShaRPy approximates a personalized hand shape, promoting a more realistic and intuitive understanding of its digital twin. We evaluate ShaRPy on a keypoint detection benchmark and show qualitative results of hand function assessments for activity monitoring of musculoskeletal diseases.
  arXiv  Detail & Related papers  (2023-03-17T15:12:25Z)
• Context-Aware Transformers For Spinal Cancer Detection and Radiological Grading [70.04389979779195]
  This paper proposes a novel transformer-based model architecture for medical imaging problems involving analysis of vertebrae. It considers two applications of such models in MR images: (a) detection of spinal metastases and the related conditions of vertebral fractures and metastatic cord compression. We show that by considering the context of vertebral bodies in the image, SCT improves the accuracy for several gradings compared to previously published model.
  arXiv  Detail & Related papers  (2022-06-27T10:31:03Z)
• SpineOne: A One-Stage Detection Framework for Degenerative Discs and Vertebrae [54.751251046196494]
  We propose a one-stage detection framework termed SpineOne to simultaneously localize and classify degenerative discs and vertebrae from MRI slices. SpineOne is built upon the following three key techniques: 1) a new design of the keypoint heatmap to facilitate simultaneous keypoint localization and classification; 2) the use of attention modules to better differentiate the representations between discs and vertebrae; and 3) a novel gradient-guided objective association mechanism to associate multiple learning objectives at the later training stage.
  arXiv  Detail & Related papers  (2021-10-28T12:59:06Z)
• Benchmarking off-the-shelf statistical shape modeling tools in clinical applications [53.47202621511081]
  We systematically assess the outcome of widely used, state-of-the-art SSM tools. We propose validation frameworks for anatomical landmark/measurement inference and lesion screening. ShapeWorks and Deformetrica shape models are found to capture clinically relevant population-level variability.
  arXiv  Detail & Related papers  (2020-09-07T03:51:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.