TSPFN: A Temporal Tabular Foundation Model for Physiological Time Series Classification
- URL: http://arxiv.org/abs/2608.31013v1
- Date: Mon, 31 Aug 2026 15:58:22 GMT
- Title: TSPFN: A Temporal Tabular Foundation Model for Physiological Time Series Classification
- Abstract summary: TSPFN is a foundation model that redesigns TabPFN's architecture for time series data.<n>It is pretrained on 140,000 real-world physiological time series across multiple medical domains.
- Score: 13.560779950533759
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Designing models that generalize effectively in low- to medium-data regimes remains a primary challenge in medical machine learning, particularly for physiological time-series classification. While tabular foundation models such as TabPFN offer an attractive alternative to conventional fine-tuning through in-context learning, they are not designed to capture the temporal dependencies inherent to physiological signals. ~In this paper, we introduce TSPFN, a foundation model that redesigns TabPFN's architecture for time series data. TSPFN integrates structured temporal representations and positional embeddings to capture intra-sample temporal and channel dependencies. To fully leverage its spatio-temporal design, the model is pretrained on 140,000 real-world physiological time series across multiple medical domains. This yields a unified, generalizable framework capable of learning the specificities of medical time series. Experiments across diverse physiological benchmarks demonstrate that TSPFN consistently outperforms standard tabular baselines and TabPFN, and achieves superior cross-domain generalization compared to specialized deep time-series models. All our experiments, ablation studies, and pre-processing scheme are publicly available at https://github.com/Jeremstym/TSPFN
Related papers
- In-Context Time Series Classification with Random Convolutional Features [38.40148298084127]
Time series classification is central to domains like medical signal analysis, industrial monitoring, and sensor-based activity recognition.<n>We propose MASHT, a pipeline that marries MultiRocket and Hydra features with the power of in-context tabular foundation models.<n>Our approach completely bypasses task-specific model training, requiring only feature extraction and direct inference.
arXiv Detail & Related papers (2026-07-21T16:04:35Z) - Towards Unified and Data-Efficient Prognostics and Health Management with Tabular Foundation Models [13.382059615065167]
Data-driven Prognostics and Health Management (PHM) uses time-varying condition-monitoring data to diagnose system states and estimate remaining useful life in engineered assets.<n>These tasks are central to maintenance planning, but industrial PHM data are often fragmented, partially observed, and poorly labeled.<n>We propose a framework for applying Tabular Foundation Models to industrial time series using in-context learning.
arXiv Detail & Related papers (2026-06-03T22:00:29Z) - Comparative Analysis of Liquid Neural Networks and LSTM for Sequential Pattern Recognition: Robustness, Efficiency, and Clinical Utility [0.30586855806896046]
Liquid Neural Networks (LNNs) provide superior parameter efficiency and significantly higher robustness in native temporal domains.<n>This extended preprint provides additional background on related datasets and the LNN theoretical lineage.
arXiv Detail & Related papers (2026-05-26T08:18:52Z) - Estimating Time Series Foundation Model Transferability via In-Context Learning [74.65355820906355]
Time series foundation models (TSFMs) offer strong zero-shot forecasting via large-scale pre-training.<n>Fine-tuning remains critical for boosting performance in domains with limited public data.<n>We introduce TimeTic, a transferability estimation framework that recasts model selection as an in-context-learning problem.
arXiv Detail & Related papers (2025-09-28T07:07:13Z) - Multivariate Long-term Time Series Forecasting with Fourier Neural Filter [42.60778405812048]
We introduce FNF as the backbone and DBD as architecture to provide excellent learning capabilities and optimal learning pathways for spatial-temporal modeling.<n>We show that FNF unifies local time-domain and global frequency-domain information processing within a single backbone that extends naturally to spatial modeling.
arXiv Detail & Related papers (2025-06-10T18:40:20Z) - General Time-series Model for Universal Knowledge Representation of Multivariate Time-Series data [61.163542597764796]
We show that time series with different time granularities (or corresponding frequency resolutions) exhibit distinct joint distributions in the frequency domain.<n>A novel Fourier knowledge attention mechanism is proposed to enable learning time-aware representations from both the temporal and frequency domains.<n>An autoregressive blank infilling pre-training framework is incorporated to time series analysis for the first time, leading to a generative tasks agnostic pre-training strategy.
arXiv Detail & Related papers (2025-02-05T15:20:04Z) - ViTime: Foundation Model for Time Series Forecasting Powered by Vision Intelligence [49.60944381032587]
Time series forecasting (TSF) possesses great practical values in various fields, including power and energy, transportation, etc.<n>TSF models have long been known to be problem-specific and lacking application generalizability.<n>This paper proposes a vision intelligence-powered framework, ViTime, for the first time.
arXiv Detail & Related papers (2024-07-10T02:11:01Z) - Self-Supervised Spatial-Temporal Normality Learning for Time Series Anomaly Detection [30.364392156075294]
Time Series Anomaly Detection (TSAD) finds widespread applications across various domains such as financial markets, industrial production, and healthcare.
Most existing TSAD methods focus on modeling data from the temporal dimension, while ignoring the semantic information in the spatial dimension.
We introduce a novel approach, called Spatial-Temporal Normality learning (STEN)
arXiv Detail & Related papers (2024-06-28T09:17:58Z) - PDETime: Rethinking Long-Term Multivariate Time Series Forecasting from
the perspective of partial differential equations [49.80959046861793]
We present PDETime, a novel LMTF model inspired by the principles of Neural PDE solvers.
Our experimentation across seven diversetemporal real-world LMTF datasets reveals that PDETime adapts effectively to the intrinsic nature of the data.
arXiv Detail & Related papers (2024-02-25T17:39:44Z) - TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling [67.02157180089573]
Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks.
This paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks.
arXiv Detail & Related papers (2024-02-04T13:10:51Z) - T-Phenotype: Discovering Phenotypes of Predictive Temporal Patterns in
Disease Progression [82.85825388788567]
We develop a novel temporal clustering method, T-Phenotype, to discover phenotypes of predictive temporal patterns from labeled time-series data.
We show that T-Phenotype achieves the best phenotype discovery performance over all the evaluated baselines.
arXiv Detail & Related papers (2023-02-24T13:30:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.