Revisit Time Series Classification Benchmark: The Impact of Temporal Information for Classification

• URL: http://arxiv.org/abs/2503.20264v1
• Date: Wed, 26 Mar 2025 06:13:41 GMT
• Title: Revisit Time Series Classification Benchmark: The Impact of Temporal Information for Classification
• Authors: Yunrui Zhang, Gustavo Batista, Salil S. Kanhere,
• Abstract summary: We perform permutation tests that disrupt temporal information on the UCR time series classification archive.<n>We identify a significant proportion of datasets where temporal information has little to no impact on classification.<n>We propose UCR Augmented, a benchmark based on the UCR time series classification archive designed to evaluate classifiers' ability to extract and utilize temporal information.
• Score: 7.331937231993605
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Time series classification is usually regarded as a distinct task from tabular data classification due to the importance of temporal information. However, in this paper, by performing permutation tests that disrupt temporal information on the UCR time series classification archive, the most widely used benchmark for time series classification, we identify a significant proportion of datasets where temporal information has little to no impact on classification. Many of these datasets are tabular in nature or rely mainly on tabular features, leading to potentially biased evaluations of time series classifiers focused on temporal information. To address this, we propose UCR Augmented, a benchmark based on the UCR time series classification archive designed to evaluate classifiers' ability to extract and utilize temporal information. Testing classifiers from seven categories on this benchmark revealed notable shifts in performance rankings. Some previously overlooked approaches perform well, while others see their performance decline significantly when temporal information is crucial. UCR Augmented provides a more robust framework for assessing time series classifiers, ensuring fairer evaluations. Our code is available at https://github.com/YunruiZhang/Revisit-Time-Series-Classification-Benchmark.

Related papers

• VSFormer: Value and Shape-Aware Transformer with Prior-Enhanced Self-Attention for Multivariate Time Series Classification [47.92529531621406]
  We propose a novel method, VSFormer, that incorporates both discriminative patterns (shape) and numerical information (value)<n>In addition, we extract class-specific prior information derived from supervised information to enrich the positional encoding.<n>Extensive experiments on all 30 UEA archived datasets demonstrate the superior performance of our method compared to SOTA models.
  arXiv  Detail & Related papers  (2024-12-21T07:31:22Z)
• Capturing Temporal Components for Time Series Classification [5.70772577110828]
  This work introduces a textitcompositional representation learning approach trained on statistically coherent components extracted from sequential data. Based on a multi-scale change space, an unsupervised approach is proposed to segment the sequential data into chunks with similar statistical properties. A sequence-based encoder model is trained in a multi-task setting to learn compositional representations from these temporal components for time series classification.
  arXiv  Detail & Related papers  (2024-06-20T16:15:21Z)
• TimeSiam: A Pre-Training Framework for Siamese Time-Series Modeling [67.02157180089573]
  Time series pre-training has recently garnered wide attention for its potential to reduce labeling expenses and benefit various downstream tasks. This paper proposes TimeSiam as a simple but effective self-supervised pre-training framework for Time series based on Siamese networks.
  arXiv  Detail & Related papers  (2024-02-04T13:10:51Z)
• Improving performance of heart rate time series classification by grouping subjects [0.0]
  The accuracy is sensitive to the choice of window/stride size. Various techniques were used to minimize subject variability. Heart rate time series can be utilized for classification tasks like predicting activity.
  arXiv  Detail & Related papers  (2023-11-22T10:08:33Z)
• Self-Supervised Learning for Time Series Analysis: Taxonomy, Progress, and Prospects [84.6945070729684]
  Self-supervised learning (SSL) has recently achieved impressive performance on various time series tasks. This article reviews current state-of-the-art SSL methods for time series data.
  arXiv  Detail & Related papers  (2023-06-16T18:23:10Z)
• Convolutional and Deep Learning based techniques for Time Series Ordinal Classification [7.047582157120573]
  Time Series Ordinal Classification (TSOC) is the field covering this gap, yet unexplored in the literature. This paper presents a first benchmarking of TSOC methodologies, exploiting the ordering of the target labels to boost the performance of current TSC state-of-the-art.
  arXiv  Detail & Related papers  (2023-06-16T11:57:11Z)
• Robust Explainer Recommendation for Time Series Classification [4.817429789586127]
  Time series classification is a task common in domains such as human activity recognition, sports analytics and general sensing. Recently, a great variety of techniques have been proposed and adapted for time series to provide explanation in the form of saliency maps. This paper provides a novel framework to quantitatively evaluate and rank explanation methods for time series classification.
  arXiv  Detail & Related papers  (2023-06-08T18:49:23Z)
• Parametric Classification for Generalized Category Discovery: A Baseline Study [70.73212959385387]
  Generalized Category Discovery (GCD) aims to discover novel categories in unlabelled datasets using knowledge learned from labelled samples. We investigate the failure of parametric classifiers, verify the effectiveness of previous design choices when high-quality supervision is available, and identify unreliable pseudo-labels as a key problem. We propose a simple yet effective parametric classification method that benefits from entropy regularisation, achieves state-of-the-art performance on multiple GCD benchmarks and shows strong robustness to unknown class numbers.
  arXiv  Detail & Related papers  (2022-11-21T18:47:11Z)
• Early Time-Series Classification Algorithms: An Empirical Comparison [59.82930053437851]
  Early Time-Series Classification (ETSC) is the task of predicting the class of incoming time-series by observing as few measurements as possible. We evaluate six existing ETSC algorithms on publicly available data, as well as on two newly introduced datasets.
  arXiv  Detail & Related papers  (2022-03-03T10:43:56Z)
• Fine-Grain Few-Shot Vision via Domain Knowledge as Hyperspherical Priors [79.22051549519989]
  Prototypical networks have been shown to perform well at few-shot learning tasks in computer vision. We show how we can achieve few-shot fine-grain classification by maximally separating the classes while incorporating domain knowledge as informative priors.
  arXiv  Detail & Related papers  (2020-05-23T02:10:57Z)
• Complexity Measures and Features for Times Series classification [0.0]
  We propose a set of characteristics capable of extracting information on the structure of the time series to face time series classification problems. The experimental results of our proposal show no statistically significant differences from the second and third best models of the state-of-the-art.
  arXiv  Detail & Related papers  (2020-02-27T11:08:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.