Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism
- URL: http://arxiv.org/abs/2609.08317v1
- Date: Tue, 08 Sep 2026 06:40:50 GMT
- Title: Supervised Cross-Modal Feature Alignment for Zero-Wearable Freezing of Gait Detection in Parkinsonism
- Abstract summary: Objective assessment of Freezing of Gait (FoG) in Parkinson's disease relies predominantly on wearable Inertial Measurement Units (IMUs)<n>We propose a supervised cross-modal subspace distillation framework to resolve these physical observation limits.<n>During optimisation, pre-trained kinematic data from IMU sensors and contextual clinical metadata act as oracles to guide a deployable visual architecture.
- Score: 0.0
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Objective assessment of Freezing of Gait (FoG) in Parkinson's disease (PD) relies predominantly on wearable Inertial Measurement Units (IMUs). While IMUs provide optimal kinematic precision, mandatory sensor attachment restricts continuous clinical deployment. Conversely, unobtrusive vision-based alternatives suffer substantial classification errors during turning-in-place tasks, where geometric self-occlusion degrades deterministic skeletal coordinates and obscures the high-frequency precursors required for FoG detection. To resolve these physical observation limits, we propose a supervised cross-modal subspace distillation framework. During optimisation, pre-trained kinematic data from IMU sensors and contextual clinical metadata act as oracles to guide a deployable visual architecture. By incorporating joint velocity and acceleration derivatives, utilising a confidence-based gating mechanism, the visual model mitigates some of the tracking errors during occlusion events. Empirical evaluations confirm this latent alignment transfers the predictive fidelity of hardware sensors directly into the visual representation, yielding $85.5\%$ accuracy, and $82.4\%$ balanced accuracy. All the while maintaining a vision only model at inference.
Related papers
- Freezing of Gait Prediction Under Spatial Occlusion: An IMU-Supervised Cross-Modal Distillation Approach [0.0]
Parkinson's disease is a progressive neurodegenerative disorder characterised by gradual deterioration of movement control.<n> automated freezing-of-gait (FOG) detection supports the objective assessment of gait-related motor impairment.<n>Two common approaches are used for FOG prediction: (i) analysing video recordings of the patient's movements and (ii) analysing data collected using inertial measurement unit (IMU) wearable sensors attached to the patient's lower limbs.<n>Video-based approaches may suffer detection errors during continuous turning-in-place tasks because the lower limbs undergo substantial geometric self-occlusion, degrading pose-estimation accuracy.
arXiv Detail & Related papers (2026-09-09T07:29:13Z) - ProCA: Progressive Contrastive Alignment for Robust EEG Visual Decoding [47.35612571473169]
EEG visual decoding aims to recover visual semantics from non-invasive neural time-series signals.<n>Existing methods rely on fixed visual or textual anchors whose semantic relations may become misaligned with EEG representations that vary across trials, subjects, and learning stages.<n>We propose Progressive Contrastive Alignment (ProCA), a unified and model-agnostic framework for adaptive neural-semantic alignment.
arXiv Detail & Related papers (2026-09-04T12:48:25Z) - EndoMD-SLAM: Endoscopic Gaussian Splatting SLAM under Optical Degradation with Memory and Static-Transient Decomposition [46.23526592715223]
EndoMD-SLAM is a framework designed to maintain stability under optical degradation.<n>On the tracking side, a memory-driven gating mechanism detects unreliable observations to suspend map updates.<n>On the mapping side, a self-supervised static-transient decomposition isolates visual contaminants into a dedicated transient field.
arXiv Detail & Related papers (2026-08-09T22:59:01Z) - Partial Skeleton Visibility for Action Recognition: A Constrained Field-of-View Approach [60.596944437968524]
PartialVisGraph is a novel framework for robust skeleton-based action recognition under constrained field-of-view.<n>It consistently achieves state-of-the-art accuracy under partial visibility, with gains of up to 68.8% on subsets with severe FoV restrictions.<n>Our approach offers a principled and practical pathway toward deployable skeleton-based action understanding in unconstrained environments.
arXiv Detail & Related papers (2026-07-01T10:03:11Z) - DriftScope: Measuring The Hidden Effects of Diffusion Model Adaptation [50.584834483403675]
Adapting pre-trained text-to-image diffusion models, whether to learn new visual concepts or erase unwanted ones, is routinely evaluated on its intended effects alone.<n>We demonstrate that adaptation systematically damages semantically unrelated concepts in ways that aggregate metrics structurally cannot surface.<n>We introduce DriftScope, a prompt-level diagnostic tool that takes any two model checkpoints and returns a ranked list of tokens whose visual concepts have shifted most between them.
arXiv Detail & Related papers (2026-06-30T20:57:51Z) - BiliVLA: Scene-Aware Vision-Language-Action Model with Reinforcement Learning for Autonomous Biliary Endoscopic Navigation [6.2182538853159]
Endoscopic retrograde cholangiopancreatography (ERCP) demands precise endoscopic navigation and stable biliary cannulation.<n>Recent robotic systems and vision-based assistance techniques improve operator ergonomics and provide perceptual cues.<n>We present BiliVLA, a scene-aware Vision-Language-Action framework that formulates biliary endoscopic navigation as an instruction-conditioned visuomotor learning problem.
arXiv Detail & Related papers (2026-06-22T16:11:15Z) - Online Learning of Robust Legged Odometry with Minimal Exteroceptive Supervision [7.541859903866144]
Industrially packaged exteroceptive sensors can provide accurate motion tracking but remain vulnerable to perceptually degraded conditions.<n>We develop a plug-and-play, robust legged odometry system that eliminates the need for explicit exteroceptive-to-proprioceptive calibration or system kinematic modeling.<n>We demonstrate the platform-agnostic, easily deployable nature of our approach on different quadruped platforms.
arXiv Detail & Related papers (2026-06-19T18:20:55Z) - Causally-Constrained Probabilistic Forecasting for Time-Series Anomaly Detection [1.8995711908407733]
This study introduces a causally-constrained probabilistic forecasting framework for anomaly detection.<n>It integrates an explicit time-lagged causal graph prior with deep sequence modeling.<n>Experiments indicate that the proposed method achieves state-of-the-art detection performance.
arXiv Detail & Related papers (2026-04-20T09:24:28Z) - Event-Level Detection of Surgical Instrument Handovers in Videos with Interpretable Vision Models [32.17113044802459]
We propose a vision framework for event-level detection and direction classification of instrument handovers in surgical videos.<n>A unified multi-task formulation jointly predicts handover occurrence and interaction direction.<n>Experiments on a dataset of kidney transplant procedures demonstrate strong performance.
arXiv Detail & Related papers (2026-04-08T20:31:28Z) - KGS-GCN: Enhancing Sparse Skeleton Sensing via Kinematics-Driven Gaussian Splatting and Probabilistic Topology for Action Recognition [20.09080176203823]
KGS-GCN is a graph convolutional network that integrates kinematics-driven Gaussian splatting with probabilistic topology.<n>Our framework offers a robust solution for processing lowfidelity sensor data.
arXiv Detail & Related papers (2026-03-16T07:47:33Z) - Optical aberrations in autonomous driving: Physics-informed parameterized temperature scaling for neural network uncertainty calibration [49.03824084306578]
We propose to incorporate a physical inductive bias into the neural network calibration architecture to enhance the robustness and the trustworthiness of the AI target application.<n>We pave the way for a trustworthy uncertainty representation and for a holistic verification strategy of the perception chain.
arXiv Detail & Related papers (2024-12-18T10:36:46Z) - Statistical control for spatio-temporal MEG/EEG source imaging with
desparsified multi-task Lasso [102.84915019938413]
Non-invasive techniques like magnetoencephalography (MEG) or electroencephalography (EEG) offer promise of non-invasive techniques.
The problem of source localization, or source imaging, poses however a high-dimensional statistical inference challenge.
We propose an ensemble of desparsified multi-task Lasso (ecd-MTLasso) to deal with this problem.
arXiv Detail & Related papers (2020-09-29T21:17:16Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.