Foundation models for movement data: Are they ready for prime-time?

• URL: http://arxiv.org/abs/2608.13316v1
• Date: Thu, 13 Aug 2026 14:39:53 GMT
• Title: Foundation models for movement data: Are they ready for prime-time?
• Abstract summary: Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring.<n>We present the first comprehensive evaluation of four open-source accelerometer FMs against supervised baselines.
• Score: 44.17303085911197
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Foundation models (FMs) trained on large-scale accelerometer data have been proposed as general-purpose feature extractors for health monitoring, but systematic evidence of their advantages is lacking. We present the first comprehensive evaluation of four open-source accelerometer FMs against supervised baselines covering 19 tasks across the domains of activity recognition including activities of daily living, clinical monitoring, and physiological inference. We find task-dependent performance results: supervised models remain competitive with FMs on human action recognition (HAR), with no consistent advantage for either, while selected FMs lead on fall and stress detection and are the most robust to sensor-placement variation. As frozen feature extractors, FMs are strongest for demographic inference, whereas sleep staging performance remains near chance level for all models. The internal FM representations show strong similarity across layers, highlighting potential for future FM improvements. Linear and frozen probing reveals that UniMTS provides the strongest representations and is the only FM that surpasses the supervised baselines without finetuning. Concept discovery analysis shows all models capture high-intensity activities clearly but struggle with sedentary, complex or ambiguous activities. We provide scenario-based deployment recommendations. Furthermore, we identify FM-derived activity profile inference-moving beyond fixed category classification-as a promising research direction.

Related papers

• Exploring Zero-Shot Foundation Models for Multivariate Time Series Anomaly Detection [4.468174618435543]
  MTSAD is essential for reliability and safety in domains such as industrial process monitoring and financial risk management.<n>Foundation Models (FMs) are pre-trained on broad data with strong zero-shot generalization.<n>We investigate the zero-shot application of a FM to industrial MTSAD on the Secure Water Treatment (SWaT) benchmark.
  arXiv  Detail & Related papers  (2026-07-14T07:32:08Z)
• Scalable and Trustworthy Earth Observation Foundation Models [0.0]
  Foundation models (FMs) have transformed machine learning from isolated task-specific models to general-purpose models pretrained on broad data.<n>This chapter defines the FMs paradigm in remote sensing (RS), then synthesizes the current model landscape.<n>The chapter also incorporates recent benchmark evidence showing that no single geospatial foundation model is universally best.
  arXiv  Detail & Related papers  (2026-07-08T14:31:02Z)
• Foundation models for discovering robust biomarkers of neurological disorders from dynamic functional connectivity [10.811185986109136]
  Brain foundation models (FMs) have recently been proposed to predict brain disorders by modelling functional connectivity.<n>We propose RE-CONFIRM, a framework for evaluating the robustness of potential biomarker candidates elucidated by DL models including FMs.
  arXiv  Detail & Related papers  (2026-04-23T19:18:41Z)
• Earth System Foundation Model (ESFM): A unified framework for heterogeneous data integration and forecasting [52.53742727060265]
  Foundation models (FMs) for the Earth system learn statistical relationships between physical variables across massive datasets.<n>Here, we introduce Earth System Foundation Model (ESFM), a fully open model building on the 3Dwin UNet backbone of the pioneering model.<n>We present findings using dense gridded data (ERA5, CMIP6), regionally masked dense data, sparse gridded MODIS satellite data, and station data.<n>Results demonstrate competitive or superior performance relative to state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2026-04-20T11:40:39Z)
• SMFormer: Empowering Self-supervised Stereo Matching via Foundation Models and Data Augmentation [55.67206878777881]
  We propose SMFormer, a framework integrating more reliable self-supervision guided by the Vision Foundation Model (VFM) and data augmentation.<n> SMFormer achieves state-of-the-art (SOTA) performance among self-supervised methods and even competes on par with supervised ones.
  arXiv  Detail & Related papers  (2026-04-11T13:56:41Z)
• SlotFM: A Motion Foundation Model with Slot Attention for Diverse Downstream Tasks [2.0906347671401018]
  We present SlotFM, an accelerometer foundation model that generalizes across diverse downstream tasks.<n>We evaluate SlotFM on 16 classification and regression downstream tasks that extend beyond standard human activity recognition.
  arXiv  Detail & Related papers  (2025-09-25T22:41:43Z)
• A Vector-Quantized Foundation Model for Patient Behavior Monitoring [41.48188433408574]
  This paper introduces a novel foundation model based on a modified vector quantized variational autoencoder, specifically designed to process real-world data from smartphones and wearable devices.<n>We leveraged the discrete latent representation of this model to effectively perform two downstream tasks, suicide risk assessment and emotional state prediction, on different held-out clinical cohorts without the need of fine-tuning.
  arXiv  Detail & Related papers  (2025-03-19T14:01:16Z)
• Large Model for Small Data: Foundation Model for Cross-Modal RF Human Activity Recognition [7.351361666395708]
  We introduce FM-Fi, a cross-modal framework engineered to translate the knowledge of vision-based FMs for enhancing RF-based HAR systems. FM-Fi involves a novel cross-modal contrastive knowledge distillation mechanism, enabling an RF encoder to inherit the interpretative power of FMs. It also employs the intrinsic capabilities of FM and RF to remove extraneous features for better alignment between the two modalities.
  arXiv  Detail & Related papers  (2024-10-13T03:43:59Z)
• On the Evaluation of Speech Foundation Models for Spoken Language Understanding [87.52911510306011]
  The Spoken Language Understanding Evaluation (SLUE) suite of benchmark tasks was recently introduced to address the need for open resources and benchmarking. The benchmark has demonstrated preliminary success in using pre-trained speech foundation models (SFM) for these SLU tasks. We ask: which SFMs offer the most benefits for these complex SLU tasks, and what is the most effective approach for incorporating these SFMs?
  arXiv  Detail & Related papers  (2024-06-14T14:37:52Z)
• Learning from models beyond fine-tuning [78.20895343699658]
  Learn From Model (LFM) focuses on the research, modification, and design of foundation models (FM) based on the model interface.<n>The study of LFM techniques can be broadly categorized into five major areas: model tuning, model distillation, model reuse, meta learning and model editing.<n>This paper gives a comprehensive review of the current methods based on FM from the perspective of LFM.
  arXiv  Detail & Related papers  (2023-10-12T10:20:36Z)
• VideoGLUE: Video General Understanding Evaluation of Foundation Models [89.07145427268948]
  We evaluate video understanding capabilities of foundation models (FMs) using a carefully designed experiment protocol. We jointly profile FMs' hallmark and efficacy efficiency when adapting to general video understanding tasks.
  arXiv  Detail & Related papers  (2023-07-06T17:47:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.