HandSplatter: Automated Digital Goniometry from Neural Rendering

• URL: http://arxiv.org/abs/2608.09735v1
• Date: Mon, 10 Aug 2026 15:35:20 GMT
• Title: HandSplatter: Automated Digital Goniometry from Neural Rendering
• Abstract summary: Manual goniometry is labor-intensive and suffers from inconsistent inter-rater reliability.<n>We present a novel pipeline for 3-D hand joint location and pose estimation using neural rendering.
• Score: 9.424505965573307
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Hand and finger disorders are leading contributors to musculoskeletal disability, creating a clinical need for precise methods to quantify joint motion. Range of motion (ROM) serves as the metric for diagnosis, rehabilitation monitoring, and evaluating surgical outcomes. Currently, the goniometer is the standard tool for assessing finger flexion and extension. However, manual goniometry is labor-intensive and suffers from inconsistent inter-rater reliability due to variations in examiner technique. While digital alternatives exist, current software-based approaches often lack the necessary accuracy for clinical usage. To address these limitations, we present a novel pipeline for 3-D hand joint location and pose estimation using neural rendering. Unlike previous methods, our approach combines 2-D feature extraction with view synthesis to significantly improve accuracy and clinical viability. Furthermore, we introduce a discrete density hill climbing algorithm that facilitates the meaningful correction of projected landmarks in 3-D space. This system overcomes the inefficiencies of manual measurement and the inaccuracies of existing software, providing a robust tool for objective functional assessment.

Related papers

• Training-free Detection and 6D Pose Estimation of Unseen Surgical Instruments [45.387920812487465]
  This work introduces a training-free pipeline for accurate multi-view 6D pose estimation of unseen surgical instruments.<n>The proposed method was rigorously evaluated on real-world surgical data from the MVPSP dataset.
  arXiv  Detail & Related papers  (2026-03-26T09:28:19Z)
• Extend Your Horizon: A Device-Agnostic Surgical Tool Tracking Framework with Multi-View Optimization for Augmented Reality [40.023882327049684]
  Surgical navigation provides real-time guidance by estimating the pose of patient anatomy and surgical instruments.<n>Most existing approaches rely on a clear line of sight, which is difficult to maintain in dynamic operating room environments.<n>This work introduces a framework for tracking surgical instruments under occlusion by fusing multiple sensing modalities within a dynamic scene graph representation.
  arXiv  Detail & Related papers  (2026-03-09T05:37:49Z)
• A Multi-View Pipeline and Benchmark Dataset for 3D Hand Pose Estimation in Surgery [1.120882117110929]
  We propose a robust pipeline for 3D hand pose estimation in surgical contexts.<n>The pipeline integrates reliable person detection, whole-body pose estimation, and state-of-the-art 2D hand keypoint prediction.<n>We introduce a novel surgical benchmark dataset comprising over 68,000 frames and 3,000 manually annotated 2D hand poses.
  arXiv  Detail & Related papers  (2026-01-22T12:48:24Z)
• On-the-fly hand-eye calibration for the da Vinci surgical robot [35.18343759591773]
  We propose a calibration framework to produce accurate tool localization results through computing the hand-eye transformation matrix on-the-fly.<n>Results show a significant reduction in tool localization errors under the proposed calibration framework.
  arXiv  Detail & Related papers  (2026-01-21T10:58:28Z)
• Accelerating 3D Photoacoustic Computed Tomography with End-to-End Physics-Aware Neural Operators [74.65171736966131]
  Photoacoustic computed tomography (PACT) combines optical contrast with ultrasonic resolution, achieving deep-tissue imaging beyond the optical diffusion limit.<n>Current implementations require dense transducer arrays and prolonged acquisition times, limiting clinical translation.<n>We introduce Pano, an end-to-end physics-aware model that directly learns the inverse acoustic mapping from sensor measurements to volumetric reconstructions.
  arXiv  Detail & Related papers  (2025-09-11T23:12:55Z)
• STROKEVISION-BENCH: A Multimodal Video And 2D Pose Benchmark For Tracking Stroke Recovery [41.140934816875806]
  We introduce StrokeVision-Bench, the first-ever dedicated dataset of stroke patients performing clinically structured block transfer tasks.<n>StrokeVision-Bench comprises 1,000 annotated videos categorized into four clinically meaningful action classes.<n>We benchmark several state-of-the-art video action recognition and skeleton-based action classification methods to establish performance baselines.
  arXiv  Detail & Related papers  (2025-09-02T18:48:37Z)
• Wound3DAssist: A Practical Framework for 3D Wound Assessment [24.184493298243392]
  We present Wound3DAssist, a framework for 3D wound assessment using monocular consumer-grade videos.<n>Our framework generates accurate 3D models from short handheld smartphone video recordings.<n>We integrate 3D reconstruction, wound segmentation, tissue classification, and periwound analysis into a modular workflow.
  arXiv  Detail & Related papers  (2025-08-25T03:50:04Z)
• Mitigating Biases in Surgical Operating Rooms with Geometry [40.5145973787288]
  Deep neural networks are prone to learning spurious correlations, exploiting dataset-specific artifacts for prediction.<n>In surgical operating rooms (OR), these manifest through the standardization of smocks and gowns that obscure robust identifying landmarks.<n>We address this problem by encoding personnel as 3D point cloud sequences, disentangling identity-relevant shape and motion patterns from appearance-based confounders.
  arXiv  Detail & Related papers  (2025-08-11T14:32:32Z)
• P3Net: Progressive and Periodic Perturbation for Semi-Supervised Medical Image Segmentation [60.08541107831459]
  We propose a progressive and periodic perturbation mechanism (P3M) and a boundary-focused loss to guide the learning of unlabeled data.<n>Our method achieves state-of-the-art performance on two 2D and 3D datasets.
  arXiv  Detail & Related papers  (2025-05-21T05:35:28Z)
• Hand tracking for clinical applications: validation of the Google MediaPipe Hand (GMH) and the depth-enhanced GMH-D frameworks [0.0]
  The aim is to validate the handtracking framework implemented by Google MediaPipe Hand (GMH) and an innovative enhanced version, GMH-D. Three dynamic exercises commonly administered by clinicians to assess hand dysfunctions are considered. Results demonstrate high temporal and spectral consistency of both frameworks with the gold standard.
  arXiv  Detail & Related papers  (2023-08-02T11:44:49Z)
• Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose Estimation of Surgical Instruments [64.59698930334012]
  We present a multi-camera capture setup consisting of static and head-mounted cameras.<n>Second, we publish a multi-view RGB-D video dataset of ex-vivo spine surgeries, captured in a surgical wet lab and a real operating theatre.<n>Third, we evaluate three state-of-the-art single-view and multi-view methods for the task of 6DoF pose estimation of surgical instruments.
  arXiv  Detail & Related papers  (2023-05-05T13:42:19Z)
• ShaRPy: Shape Reconstruction and Hand Pose Estimation from RGB-D with Uncertainty [6.559796851992517]
  We propose ShaRPy, the first RGB-D Shape Reconstruction and hand Pose tracking system. ShaRPy approximates a personalized hand shape, promoting a more realistic and intuitive understanding of its digital twin. We evaluate ShaRPy on a keypoint detection benchmark and show qualitative results of hand function assessments for activity monitoring of musculoskeletal diseases.
  arXiv  Detail & Related papers  (2023-03-17T15:12:25Z)
• Real-time landmark detection for precise endoscopic submucosal dissection via shape-aware relation network [51.44506007844284]
  We propose a shape-aware relation network for accurate and real-time landmark detection in endoscopic submucosal dissection surgery. We first devise an algorithm to automatically generate relation keypoint heatmaps, which intuitively represent the prior knowledge of spatial relations among landmarks. We then develop two complementary regularization schemes to progressively incorporate the prior knowledge into the training process.
  arXiv  Detail & Related papers  (2021-11-08T07:57:30Z)
• Occlusion-robust Visual Markerless Bone Tracking for Computer-Assisted Orthopaedic Surgery [41.681134859412246]
  We propose a RGB-D sensing-based markerless tracking method that is robust against occlusion. By using a high-quality commercial RGB-D camera, our proposed visual tracking method achieves an accuracy of 1-2 degress and 2-4 mm on a model knee.
  arXiv  Detail & Related papers  (2021-08-24T09:49:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.