Scalable Injury-Risk Screening in Baseball Pitching From Broadcast Video
- URL: http://arxiv.org/abs/2603.04864v1
- Date: Thu, 05 Mar 2026 06:38:32 GMT
- Title: Scalable Injury-Risk Screening in Baseball Pitching From Broadcast Video
- Abstract summary: We present a monocular video pipeline that recovers 18 clinically relevant biomechanics metrics from broadcast footage.<n>Built on DreamPose3D, our approach introduces a drift-controlled global lifting module that recovers pelvis trajectory.<n>Using these metrics for injury prediction, an automated screening model achieves AUC 0.811 for Tommy John surgery and 0.825 for significant arm injuries on 7,348 pitchers.
- Score: 2.994962964425238
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Injury prediction in pitching depends on precise biomechanical signals, yet gold-standard measurements come from expensive, stadium-installed multi-camera systems that are unavailable outside professional venues. We present a monocular video pipeline that recovers 18 clinically relevant biomechanics metrics from broadcast footage, positioning pose-derived kinematics as a scalable source for injury-risk modeling. Built on DreamPose3D, our approach introduces a drift-controlled global lifting module that recovers pelvis trajectory via velocity-based parameterization and sliding-window inference, lifting pelvis-rooted poses into global space. To address motion blur, compression artifacts, and extreme pitching poses, we incorporate a kinematics refinement pipeline with bone-length constraints, joint-limited inverse kinematics, smoothing, and symmetry constraints to ensure temporally stable and physically plausible kinematics. On 13 professional pitchers (156 paired pitches), 16/18 metrics achieve sub-degree agreement (MAE $< 1^{\circ}$). Using these metrics for injury prediction, an automated screening model achieves AUC 0.811 for Tommy John surgery and 0.825 for significant arm injuries on 7,348 pitchers. The resulting pose-derived metrics support scalable injury-risk screening, establishing monocular broadcast video as a viable alternative to stadium-scale motion capture for biomechanics.
Related papers
- Learning Biomechanically Plausible Human Motion from Sparse Radar Point Clouds [39.56983715336933]
We integrate a full-body skeletal model into a differentiable, end-to-end trainable radar-based pose estimation framework.<n>Subject-specific body segment proportions are predicted from radar point cloud features to scale a biomechanical skeleton.<n>A motion prediction network maps temporal radar sequences to generalized coordinates, and differentiable forward kinematics converts predicted joint angles into 3D positions.
arXiv Detail & Related papers (2026-08-04T13:20:05Z) - A Physics-Grounded Benchmark for Multi-Agent Dynamics in World Models [96.64934195520802]
We introduce CrashTwin, a physics-grounded evaluation framework designed to stress-test the physical trustworthiness of world models.<n>CrashTwin couples a diverse dataset of multi-agent collision scenarios, comprising 25K controllable synthetic 12K in-the-wild real-world collision sequences.<n>We propose a diagnostic suite that systematically evaluates three dimensions:-temporal consistency, momentum and kinetic energy conservation, and world-dynamics integrity.
arXiv Detail & Related papers (2026-06-27T06:13:35Z) - From Pixels to Newtons: Predicting In Vivo Joint Contact Forces from Monocular Video [0.6768558752130311]
I present a physics-free pipeline to predict instantaneous 3D hip and knee contact forces from an uncalibrated monocular video.<n>Parametric body meshes are recovered per frame, encoded as kinematic features, and decoded into forces by a transformer.<n>This pipeline establishes uncalibrated monocular video as a viable modality for estimating joint loading.
arXiv Detail & Related papers (2026-06-04T18:31:00Z) - Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants [0.9332987715848714]
This study systematically evaluated three state-of-the-art pose estimation frameworks on 100 videos over 13 sessions of 8 infants recorded with a multi-view motion capture system.<n>We quantified keypoint detection accuracy using reprojection error, geometric consistency, and Procrustes-aligned 3D position error, and demonstrated proof-of-concept for fitting an inverse kinematic framework to infant data.<n>We demonstrate in a case comparison example that biomechanical models fit to SAM 3D estimates distinguish representative movement patterns in infants related to motor development, as identified by a clinical expert.
arXiv Detail & Related papers (2026-05-16T18:55:06Z) - ViPS: Video-informed Pose Spaces for Auto-Rigged Meshes [55.32681167870698]
Video-informed Pose Spaces (ViPS) is a feed-forward framework that discovers the latent distribution of valid articulations for auto-rigged meshes.<n>ViPS transfers generative video priors into a universal distribution over a given rig parameterization.<n>Our evaluations show that ViPS matches the performance of state-of-the-art methods trained on synthetic artist-created 4D data in both plausibility and diversity.
arXiv Detail & Related papers (2026-04-19T21:21:11Z) - ReconPhys: Reconstruct Appearance and Physical Attributes from Single Video [51.2815592637053]
ReconPhys is a feedforward framework that jointly learns physical attribute estimation and 3D Gaussian Splatting reconstruction from a single monocular video.<n>Our method employs a dual-branch architecture trained via a self-supervised strategy, eliminating the need for ground-truth physics labels.<n> Experiments on a large-scale synthetic dataset demonstrate superior performance.
arXiv Detail & Related papers (2026-04-09T06:51:14Z) - Towards Athlete Fatigue Assessment from Association Football Videos [53.20057980542362]
This paper builds on state-of-theart Game State Reconstruction methods to extract player trajectories in pitch coordinates.<n>We then construct acceleration--speed profiles from these signals and analyze their behavior as fatigue-related performance indicators.<n>Our results indicate that monocular broadcast videos can recover kinematic patterns that are compatible with A-S-temporal while also revealing sensitivity to trajectory noise, calibration errors, and temporal discontinuities inherent to broadcast footage.
arXiv Detail & Related papers (2026-04-07T09:36:28Z) - Interpretable Pre-Release Baseball Pitch Type Anticipation from Broadcast 3D Kinematics [3.1224081969539714]
We classify eight pitch types from monocular 3D pose sequences without access to ball-flight data.<n>Our pipeline chains a diffusion-based 3D pose backbone with automatic pitching-event detection.<n>We achieve 80.4% accuracy using body kinematics alone on 119,561 professional pitches.
arXiv Detail & Related papers (2026-03-05T07:04:35Z) - Physics Informed Human Posture Estimation Based on 3D Landmarks from Monocular RGB-Videos [1.3399128310861848]
State-of-the-art models like BlazePose excel in real-time pose tracking, but their lack of anatomical constraints indicates improvement potential by including physical knowledge.<n>We present a real-time post-processing algorithm fusing the strengths of BlazePose 3D and 2D estimations using a weighted optimization.<n> Evaluation using the Physio2.2M dataset shows a 10.2 percent reduction in 3D MPJPE and a 16.6 percent decrease in errors of angles between body segments compared to BlazePose 3D estimation.
arXiv Detail & Related papers (2025-12-07T10:54:09Z) - PhysHMR: Learning Humanoid Control Policies from Vision for Physically Plausible Human Motion Reconstruction [52.44375492811009]
We present PhysHMR, a unified framework that learns a visual-to-action policy for humanoid control in a physics-based simulator.<n>A key component of our approach is the pixel-as-ray strategy, which lifts 2D keypoints into 3D spatial rays and transforms them into global space.<n>PhysHMR produces high-fidelity, physically plausible motion across diverse scenarios, outperforming prior approaches in both visual accuracy and physical realism.
arXiv Detail & Related papers (2025-10-02T21:01:11Z) - Validation of Human Pose Estimation and Human Mesh Recovery for Extracting Clinically Relevant Motion Data from Videos [79.62407455005561]
Marker-less motion capture using human pose estimation produces results in-line with the results of both the IMU and MoCap kinematics.<n>While there is still room for improvement when it comes to the quality of the data produced, we believe that this compromise is within the room of error.
arXiv Detail & Related papers (2025-03-18T22:18:33Z) - Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulation [88.83749146867665]
Existing approaches learn a policy to predict a distant next-best end-effector pose.<n>They then compute the corresponding joint rotation angles for motion using inverse kinematics.<n>We propose Kinematics enhanced Spatial-TemporAl gRaph diffuser.
arXiv Detail & Related papers (2025-03-13T17:48:35Z) - Bridging Structural Dynamics and Biomechanics: Human Motion Estimation through Footstep-Induced Floor Vibrations [2.7180946990643466]
Existing approaches involve monitoring devices such as cameras, wearables, and pressure mats.<n>We leverage gait-induced floor vibration to estimate lower-limb joint motion.<n>Our model poses physical constraints to reduce uncertainty while allowing information sharing between the body and the floor.
arXiv Detail & Related papers (2025-02-21T20:10:15Z) - Estimating Body and Hand Motion in an Ego-sensed World [62.61989004520802]
We present EgoAllo, a system for human motion estimation from a head-mounted device.<n>Using only egocentric SLAM poses and images, EgoAllo guides sampling from a conditional diffusion model to estimate 3D body pose, height, and hand parameters.
arXiv Detail & Related papers (2024-10-04T17:59:57Z) - Real-time, accurate, and open source upper-limb musculoskeletal analysis using a single RGBD camera [0.14999444543328289]
Biomechanical biofeedback may enhance rehabilitation and provide clinicians with more objective task evaluation.
Our open-source approach offers a user-friendly solution for high-fidelity upper-limb kinematics using a single low-cost RGBD camera.
arXiv Detail & Related papers (2024-06-14T13:20:05Z) - 3D Kinematics Estimation from Video with a Biomechanical Model and
Synthetic Training Data [4.130944152992895]
We propose a novel biomechanics-aware network that directly outputs 3D kinematics from two input views.
Our experiments demonstrate that the proposed approach, only trained on synthetic data, outperforms previous state-of-the-art methods.
arXiv Detail & Related papers (2024-02-20T17:33:40Z) - PhysCap: Physically Plausible Monocular 3D Motion Capture in Real Time [89.68248627276955]
Marker-less 3D motion capture from a single colour camera has seen significant progress.
However, it is a very challenging and severely ill-posed problem.
We present PhysCap, the first algorithm for physically plausible, real-time and marker-less human 3D motion capture.
arXiv Detail & Related papers (2020-08-20T10:46:32Z) - Contact and Human Dynamics from Monocular Video [73.47466545178396]
Existing deep models predict 2D and 3D kinematic poses from video that are approximately accurate, but contain visible errors.
We present a physics-based method for inferring 3D human motion from video sequences that takes initial 2D and 3D pose estimates as input.
arXiv Detail & Related papers (2020-07-22T21:09:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.