Combining Statistical Features and Deep Encodings for Rehearsal-Based Class-Incremental Time Series Classification

• URL: http://arxiv.org/abs/2606.03292v1
• Date: Tue, 02 Jun 2026 08:02:42 GMT
• Title: Combining Statistical Features and Deep Encodings for Rehearsal-Based Class-Incremental Time Series Classification
• Abstract summary: We present a novel approach for performing class incremental continual learning for the classification of time series data.<n>The proposed system achieves competitive average accuracy across all datasets while maintaining low forgetting rates across all experimental configurations.
• Score: 1.0195618602298682
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Many systems used in real-world environments require adding new categories and incorporating new information without forgetting what was previously learnt by the classification model. This is known as class-incremental continual learning, and in the case of multivariate time-series, is further complicated by the temporal structure of the data. In this paper, we present a novel approach for performing class incremental continual learning for the classification of multivariate time series data based upon the construction of a dual-stream feature extraction pipeline (using both deep temporal embedding features generated via a pre-trained frozen foundation model and application of statistical features). Evaluated on five benchmark datasets, the proposed system achieves competitive average accuracy across all datasets while maintaining low forgetting rates across all experimental configurations.

Related papers

• Contrastive Representation-Guided Genetic Minority Oversampling for Imbalanced Time-Series Classification [56.54664402339568]
  Real-world time-series classification tasks often exhibit class imbalance, which can be extremely severe in some applications.<n>This paper proposes a Frequency-domain representation-guided Multi-tree Genetic Programming-based oversampling approach to imbalanced time-series classification.
  arXiv  Detail & Related papers  (2026-08-24T05:03:51Z)
• Structural Classification of Locally Stationary Time Series Based on Second-order Characteristics [18.368110934638207]
  We present a numerically efficient, practically competitive, and theoretically rigorous classification method for distinguishing between two classes of locally stationary time series.<n>Our approach builds on the autoregressive approximation for locally stationary time series, combined with an ensemble aggregation and a distance-based threshold for classification.<n>It imposes no requirement on the training sample size, and is shown to achieve zero misclassification error rate.
  arXiv  Detail & Related papers  (2025-07-06T04:00:26Z)
• FreRA: A Frequency-Refined Augmentation for Contrastive Learning on Time Series Classification [56.925103708982164]
  We present a novel perspective from the frequency domain and identify three advantages for downstream classification: global, independent, and compact.<n>We propose the lightweight yet effective Frequency Refined Augmentation (FreRA) tailored for time series contrastive learning on classification tasks.<n>FreRA consistently outperforms ten leading baselines on time series classification, anomaly detection, and transfer learning tasks.
  arXiv  Detail & Related papers  (2025-05-29T07:18:28Z)
• VSFormer: Value and Shape-Aware Transformer with Prior-Enhanced Self-Attention for Multivariate Time Series Classification [47.92529531621406]
  We propose a novel method, VSFormer, that incorporates both discriminative patterns (shape) and numerical information (value)<n>In addition, we extract class-specific prior information derived from supervised information to enrich the positional encoding.<n>Extensive experiments on all 30 UEA archived datasets demonstrate the superior performance of our method compared to SOTA models.
  arXiv  Detail & Related papers  (2024-12-21T07:31:22Z)
• Enhancing Foundation Models for Time Series Forecasting via Wavelet-based Tokenization [74.3339999119713]
  We develop a wavelet-based tokenizer that allows models to learn complex representations directly in the space of time-localized frequencies.<n>Our method first scales and decomposes the input time series, then thresholds and quantizes the wavelet coefficients, and finally pre-trains an autoregressive model to forecast coefficients for the forecast horizon.
  arXiv  Detail & Related papers  (2024-12-06T18:22:59Z)
• Capturing Temporal Components for Time Series Classification [5.70772577110828]
  This work introduces a textitcompositional representation learning approach trained on statistically coherent components extracted from sequential data. Based on a multi-scale change space, an unsupervised approach is proposed to segment the sequential data into chunks with similar statistical properties. A sequence-based encoder model is trained in a multi-task setting to learn compositional representations from these temporal components for time series classification.
  arXiv  Detail & Related papers  (2024-06-20T16:15:21Z)
• TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling [67.02157180089573]
  Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks. This paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks.
  arXiv  Detail & Related papers  (2024-02-04T13:10:51Z)
• Few-Shot Forecasting of Time-Series with Heterogeneous Channels [4.635820333232681]
  We develop a model composed of permutation-invariant deep set-blocks which incorporate a temporal embedding. We show through experiments that our model provides a good generalization, outperforming baselines carried over from simpler scenarios.
  arXiv  Detail & Related papers  (2022-04-07T14:02:15Z)
• Learnable Dynamic Temporal Pooling for Time Series Classification [22.931314501371805]
  We present a dynamic temporal pooling (DTP) technique that reduces the temporal size of hidden representations by aggregating the features at the segment-level. For the partition of a whole series into multiple segments, we utilize dynamic time warping (DTW) to align each time point in a temporal order with the prototypical features of the segments. The DTP layer combined with a fully-connected layer helps to extract further discriminative features considering their temporal position within an input time series.
  arXiv  Detail & Related papers  (2021-04-02T08:58:44Z)
• Learning summary features of time series for likelihood free inference [93.08098361687722]
  We present a data-driven strategy for automatically learning summary features from time series data. Our results indicate that learning summary features from data can compete and even outperform LFI methods based on hand-crafted values.
  arXiv  Detail & Related papers  (2020-12-04T19:21:37Z)
• Time Series Forecasting With Deep Learning: A Survey [5.351996099005896]
  We survey common encoder and decoder designs used in both one-step-ahead and multi-horizon time series forecasting. We highlight recent developments in hybrid deep learning models, which combine well-studied statistical models with neural network components.
  arXiv  Detail & Related papers  (2020-04-28T10:32:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.