A Gait Foundation Model Predicts Multi-System Health Phenotypes from 3D Skeletal Motion

• URL: http://arxiv.org/abs/2603.25283v1
• Date: Thu, 26 Mar 2026 10:21:02 GMT
• Title: A Gait Foundation Model Predicts Multi-System Health Phenotypes from 3D Skeletal Motion
• Abstract summary: Gait is increasingly recognized as a vital sign, yet current approaches treat it as a symptom of specific pathologies rather than a systemic biomarker.<n>We developed a gait foundation model for 3D skeletal motion from 3,414 deeply phenotyped adults, recorded via a depth camera during five motor tasks.
• Score: 0.5607972967536581
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Gait is increasingly recognized as a vital sign, yet current approaches treat it as a symptom of specific pathologies rather than a systemic biomarker. We developed a gait foundation model for 3D skeletal motion from 3,414 deeply phenotyped adults, recorded via a depth camera during five motor tasks. Learned embeddings outperformed engineered features, predicting age (Pearson r = 0.69), BMI (r = 0.90), and visceral adipose tissue area (r = 0.82). Embeddings significantly predicted 1,980 of 3,210 phenotypic targets; after adjustment for age, BMI, VAT, and height, gait provided independent gains in all 18 body systems in males and 17 of 18 in females, and improved prediction of clinical diagnoses and medication use. Anatomical ablation revealed that legs dominated metabolic and frailty predictions while torso encoded sleep and lifestyle phenotypes. These findings establish gait as an independent multi-system biosignal, motivating translation to consumer-grade video and its integration as a scalable, passive vital sign.

Related papers

• STST-JEPA: Shallow-Target Spatio-Temporal Joint Embedding Prediction Architecture For EEG Self-Supervised Learning [0.0]
  Brain age is an emerging biomarker whose deviation from chronological age tracks neurological and psychiatric burden.<n>We introduce STST-JEPA, a self-supervised transformer for resting-state and task EEG, pretrained on 47,703 sessions spanning ages 5-81.
  arXiv  Detail & Related papers  (2026-07-07T12:19:54Z)
• From Pixels to Newtons: Predicting In Vivo Joint Contact Forces from Monocular Video [0.6768558752130311]
  I present a physics-free pipeline to predict instantaneous 3D hip and knee contact forces from an uncalibrated monocular video.<n>Parametric body meshes are recovered per frame, encoded as kinematic features, and decoded into forces by a transformer.<n>This pipeline establishes uncalibrated monocular video as a viable modality for estimating joint loading.
  arXiv  Detail & Related papers  (2026-06-04T18:31:00Z)
• Markerless Motion Capture for Biomechanical Whole-Body Kinematic Estimation in Infants [0.9332987715848714]
  This study systematically evaluated three state-of-the-art pose estimation frameworks on 100 videos over 13 sessions of 8 infants recorded with a multi-view motion capture system.<n>We quantified keypoint detection accuracy using reprojection error, geometric consistency, and Procrustes-aligned 3D position error, and demonstrated proof-of-concept for fitting an inverse kinematic framework to infant data.<n>We demonstrate in a case comparison example that biomechanical models fit to SAM 3D estimates distinguish representative movement patterns in infants related to motor development, as identified by a clinical expert.
  arXiv  Detail & Related papers  (2026-05-16T18:55:06Z)
• UniSurg: A Video-Native Foundation Model for Universal Understanding of Surgical Videos [81.9180187964947]
  We present UniSurg, a foundation model that shifts the learning paradigm from pixel-level reconstruction to latent motion prediction.<n>To enable large-scale pretraining, we curate the largest surgical video dataset to date, comprising 3,658 hours of video from 50 sources across 13 anatomical regions.<n>These results establish UniSurg as a new standard for universal, motion-oriented surgical video understanding.
  arXiv  Detail & Related papers  (2026-02-05T13:18:33Z)
• OpenMAP-BrainAge: Generalizable and Interpretable Brain Age Predictor [0.0]
  We develop an age prediction model which is interpretable and robust to demographic and technological MRI scans.<n>Our model processes T1-dimensional pseudo-3D MRI scans from three views and incorporates linear brain information.
  arXiv  Detail & Related papers  (2025-06-21T05:24:42Z)
• Finetuning and Quantization of EEG-Based Foundational BioSignal Models on ECG and PPG Data for Blood Pressure Estimation [46.36100528165335]
  Photoplethysmography and electrocardiography can potentially enable continuous blood pressure (BP) monitoring.<n>Yet accurate and robust machine learning (ML) models remains challenging due to variability in data quality and patient-specific factors.<n>In this work, we investigate whether a model pre-trained on one modality can effectively be exploited to improve the accuracy of a different signal type.<n>Our approach achieves near state-of-the-art accuracy for diastolic BP and surpasses by 1.5x the accuracy of prior works for systolic BP.
  arXiv  Detail & Related papers  (2025-02-10T13:33:12Z)
• Enhancing Brain Age Estimation with a Multimodal 3D CNN Approach Combining Structural MRI and AI-Synthesized Cerebral Blood Volume Data [14.815462507141163]
  Brain Age Gap Estimation (BrainAGE) offers a neuroimaging biomarker for understanding brain age.<n>Current approaches primarily use T1-weighted magnetic resonance imaging (T1w MRI) data, capturing only structural brain information.<n>We developed a deep learning model using a VGG-based architecture for both modalities and combined their predictions using linear regression.<n>Our model achieved a mean absolute error (MAE) of 3.95 years and an $R2$ of 0.943 on the test set, outperforming existing models trained on similar data.
  arXiv  Detail & Related papers  (2024-12-01T21:54:08Z)
• Atlas-Based Interpretable Age Prediction In Whole-Body MR Images [8.947616387158142]
  We investigate the ageing of the human body on a large scale by using whole-body 3D images.<n>We utilise the Grad-CAM method to determine the body areas most predictive of a person's age.<n>We show that the investigation of the full 3D volume of the whole body and the population-wide analysis can give important insights into which body parts play the most important roles in predicting a person's age.
  arXiv  Detail & Related papers  (2023-07-14T16:04:03Z)
• Automatic Classification of Neuromuscular Diseases in Children Using Photoacoustic Imaging [77.32032399775152]
  Neuromuscular diseases (NMDs) cause a significant burden for both healthcare systems and society. They can lead to severe progressive muscle weakness, muscle degeneration, contracture, deformity and progressive disability.
  arXiv  Detail & Related papers  (2022-01-27T16:37:19Z)
• Predi\c{c}\~ao da Idade Cerebral a partir de Imagens de Resson\^ancia Magn\'etica utilizando Redes Neurais Convolucionais [57.52103125083341]
  Deep learning techniques for brain age prediction from magnetic resonance images are investigated. The identification of biomarkers is useful for detecting an early-stage neurodegenerative process, as well as for predicting age-related or non-age-related cognitive decline. The best result was obtained by the 2D model, which achieved a mean absolute error of 3.83 years.
  arXiv  Detail & Related papers  (2021-12-23T14:51:45Z)
• Voxel-level Importance Maps for Interpretable Brain Age Estimation [70.5330922395729]
  We focus on the task of brain age regression from 3D brain Magnetic Resonance (MR) images using a Convolutional Neural Network, termed prediction model. We implement a noise model which aims to add as much noise as possible to the input without harming the performance of the prediction model. We test our method on 13,750 3D brain MR images from the UK Biobank, and our findings are consistent with the existing neuropathology literature.
  arXiv  Detail & Related papers  (2021-08-11T18:08:09Z)
• Patch-based Brain Age Estimation from MR Images [64.66978138243083]
  Brain age estimation from Magnetic Resonance Images (MRI) derives the difference between a subject's biological brain age and their chronological age. Early detection of neurodegeneration manifesting as a higher brain age can potentially facilitate better medical care and planning for affected individuals. We develop a new deep learning approach that uses 3D patches of the brain as well as convolutional neural networks (CNNs) to develop a localised brain age estimator.
  arXiv  Detail & Related papers  (2020-08-29T11:50:37Z)
• Anatomy-aware 3D Human Pose Estimation with Bone-based Pose Decomposition [92.99291528676021]
  Instead of directly regressing the 3D joint locations, we decompose the task into bone direction prediction and bone length prediction. Our motivation is the fact that the bone lengths of a human skeleton remain consistent across time. Our full model outperforms the previous best results on Human3.6M and MPI-INF-3DHP datasets.
  arXiv  Detail & Related papers  (2020-02-24T15:49:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.