TokenSTFormer: A Tokenized Spatial-temporal Attention Model for Holistic Motion Analysis in Adolescent Idiopathic Scoliosis Screening

• URL: http://arxiv.org/abs/2608.16122v1
• Date: Mon, 17 Aug 2026 05:27:44 GMT
• Title: TokenSTFormer: A Tokenized Spatial-temporal Attention Model for Holistic Motion Analysis in Adolescent Idiopathic Scoliosis Screening
• Abstract summary: Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity in adolescents that, if left untreated, can result in severe health outcomes.<n>To address these challenges, we present ScoliGait dataset, which comprises 1,516 gait video clips paired with corresponding X-ray records.<n>We also introduce TokenSTFormer, a novel model that tokenizes spatial and temporal semantics to enhance feature representation and convergence.
• Score: 7.133441017694392
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity in adolescents that, if left untreated, can result in severe health outcomes. Traditional screening methods are limited by subjective interpretation, reliance on professional expertise and low scalability. To address these challenges, we present ScoliGait dataset, which comprises 1,516 gait video clips paired with corresponding X-ray records. We also introduce TokenSTFormer, a novel model that tokenizes spatial and temporal semantics to enhance feature representation and convergence. Our model achieves state-of-the-art performance, surpassing vanilla Vision Transformer encoder across key metrics, including accuracy of 0.79. This study highlights the potential of leveraging holistic motion features derived from gait video and attention-based models for scalable, cost-effective AIS screening, paving the way for future clinical applications in scoliosis detection.

Related papers

• Towards a General Intelligence and Interface for Wearable Health Data [45.854819784803055]
  We propose a foundation model for wearable health that is pretrained on more than one trillion minutes of unlabeled sensor signals.<n>We find that this population scale representation unlocks label-efficient few-shot learning and generative capabilities for robust daily metric estimation.
  arXiv  Detail & Related papers  (2026-05-21T17:24:06Z)
• Clinical-Prior Guided Multi-Modal Learning with Latent Attention Pooling for Gait-Based Scoliosis Screening [8.010714901985898]
  Adolescent Idiopathic Scoliosis (AIS) is a prevalent spinal deformity whose progression can be mitigated through early detection.<n>Current screening methods are subjective, difficult to scale, and reliant on specialized clinical expertise.<n>Video-based gait analysis offers a promising alternative, but current datasets and methods frequently suffer from data leakage.<n>ScoliGait is a new benchmark dataset comprising 1,572 gait video clips for training and 300 fully independent clips for testing.
  arXiv  Detail & Related papers  (2026-02-06T14:44:22Z)
• A Semantically Enhanced Generative Foundation Model Improves Pathological Image Synthesis [82.01597026329158]
  We introduce a Correlation-Regulated Alignment Framework for Tissue Synthesis (CRAFTS) for pathology-specific text-to-image synthesis.<n>CRAFTS incorporates a novel alignment mechanism that suppresses semantic drift to ensure biological accuracy.<n>This model generates diverse pathological images spanning 30 cancer types, with quality rigorously validated by objective metrics and pathologist evaluations.
  arXiv  Detail & Related papers  (2025-12-15T10:22:43Z)
• Epistemic-aware Vision-Language Foundation Model for Fetal Ultrasound Interpretation [83.02147613524032]
  We introduce FetalMind, a medical AI system tailored to fetal ultrasound for both report generation and diagnosis.<n>We propose Salient Epistemic Disentanglement (SED), which injects an expert-curated bipartite graph into the model to decouple view-disease associations.<n>FetalMind outperforms open- and closed-source baselines across all gestational stages, achieving +14% average gains and +61.2% higher accuracy on critical conditions.
  arXiv  Detail & Related papers  (2025-10-14T19:57:03Z)
• Revolutionizing Precise Low Back Pain Diagnosis via Contrastive Learning [0.3499870393443268]
  Low back pain affects millions worldwide, driving the need for robust diagnostic models.<n>We present LumbarCLIP, a novel framework that leverages contrastive language-image pretraining to align lumbar spine MRI scans with corresponding radiological descriptions.
  arXiv  Detail & Related papers  (2025-09-25T06:52:25Z)
• Pose as Clinical Prior: Learning Dual Representations for Scoliosis Screening [15.000310203998012]
  Scoliosis1K-Pose is a 2D human pose annotation set that extends the original Scoliosis1K dataset.<n>We introduce the Dual Representation Framework (DRF), which integrates a continuous skeleton map with a discrete Postural Asymmetry Vector (PAV)<n>A novel PAV-Guided Attention (PGA) module further uses the PAV as clinical prior to direct feature extraction.
  arXiv  Detail & Related papers  (2025-08-31T14:34:11Z)
• Text-Guided Multi-Instance Learning for Scoliosis Screening via Gait Video Analysis [33.88520129574637]
  Early-stage scoliosis is difficult to detect, particularly in adolescents, where delayed diagnosis can lead to serious health issues.<n>Traditional X-ray-based methods carry radiation risks and rely heavily on clinical expertise, limiting their use in large-scale screenings.<n>We propose a Text-Guided Multi-Instance Learning Network (TG-MILNet) for non-invasive scoliosis detection using gait videos.
  arXiv  Detail & Related papers  (2025-07-01T22:13:27Z)
• Gait Patterns as Biomarkers: A Video-Based Approach for Classifying Scoliosis [10.335383345968966]
  Scoliosis presents significant diagnostic challenges, particularly in adolescents. Traditional diagnostic and follow-up methods face limitations due to the need for clinical expertise and the risk of radiation exposure. We introduce a novel video-based, non-invasive method for scoliosis classification using gait analysis.
  arXiv  Detail & Related papers  (2024-07-08T08:29:02Z)
• Shape Matters: Detecting Vertebral Fractures Using Differentiable Point-Based Shape Decoding [51.38395069380457]
  Degenerative spinal pathologies are highly prevalent among the elderly population. Timely diagnosis of osteoporotic fractures and other degenerative deformities facilitates proactive measures to mitigate the risk of severe back pain and disability. In this study, we specifically explore the use of shape auto-encoders for vertebrae.
  arXiv  Detail & Related papers  (2023-12-08T18:11:22Z)
• Automatic diagnosis of knee osteoarthritis severity using Swin transformer [55.01037422579516]
  Knee osteoarthritis (KOA) is a widespread condition that can cause chronic pain and stiffness in the knee joint. We propose an automated approach that employs the Swin Transformer to predict the severity of KOA.
  arXiv  Detail & Related papers  (2023-07-10T09:49:30Z)
• Variational Knowledge Distillation for Disease Classification in Chest X-Rays [102.04931207504173]
  We propose itvariational knowledge distillation (VKD), which is a new probabilistic inference framework for disease classification based on X-rays. We demonstrate the effectiveness of our method on three public benchmark datasets with paired X-ray images and EHRs.
  arXiv  Detail & Related papers  (2021-03-19T14:13:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.