TAB: Unified Benchmarking of Time Series Anomaly Detection Methods

• URL: http://arxiv.org/abs/2506.18046v2
• Date: Tue, 15 Jul 2025 09:18:30 GMT
• Title: TAB: Unified Benchmarking of Time Series Anomaly Detection Methods
• Authors: Xiangfei Qiu, Zhe Li, Wanghui Qiu, Shiyan Hu, Lekui Zhou, Xingjian Wu, Zhengyu Li, Chenjuan Guo, Aoying Zhou, Zhenli Sheng, Jilin Hu, Christian S. Jensen, Bin Yang,
• Abstract summary: Time series anomaly detection (TSAD) plays an important role in many domains such as finance, transportation, and healthcare.<n>We propose a new time series anomaly detection benchmark, called TAB.
• Score: 30.95339040034454
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Time series anomaly detection (TSAD) plays an important role in many domains such as finance, transportation, and healthcare. With the ongoing instrumentation of reality, more time series data will be available, leading also to growing demands for TSAD. While many TSAD methods already exist, new and better methods are still desirable. However, effective progress hinges on the availability of reliable means of evaluating new methods and comparing them with existing methods. We address deficiencies in current evaluation procedures related to datasets and experimental settings and protocols. Specifically, we propose a new time series anomaly detection benchmark, called TAB. First, TAB encompasses 29 public multivariate datasets and 1,635 univariate time series from different domains to facilitate more comprehensive evaluations on diverse datasets. Second, TAB covers a variety of TSAD methods, including Non-learning, Machine learning, Deep learning, LLM-based, and Time-series pre-trained methods. Third, TAB features a unified and automated evaluation pipeline that enables fair and easy evaluation of TSAD methods. Finally, we employ TAB to evaluate existing TSAD methods and report on the outcomes, thereby offering a deeper insight into the performance of these methods. Besides, all datasets and code are available at https://github.com/decisionintelligence/TAB.

Related papers

• OpenTAD: A Unified Framework and Comprehensive Study of Temporal Action Detection [86.30994231610651]
  Temporal action detection (TAD) is a fundamental video understanding task that aims to identify human actions and localize their temporal boundaries in videos.<n>We propose textbfOpenTAD, a unified TAD framework consolidating 16 different TAD methods and 9 standard datasets into a modular framework.<n>Minimal effort is required to replace one module with a different design, train a feature-based TAD model in end-to-end mode, or switch between the two.
  arXiv  Detail & Related papers  (2025-02-27T18:32:27Z)
• A New Perspective on Time Series Anomaly Detection: Faster Patch-based Broad Learning System [59.38402187365612]
  Time series anomaly detection (TSAD) has been a research hotspot in both academia and industry in recent years.<n>Deep learning is not required for TSAD due to limitations such as slow deep learning speed.<n>We propose Contrastive Patch-based Broad Learning System (CBLS)
  arXiv  Detail & Related papers  (2024-12-07T01:58:18Z)
• Quanda: An Interpretability Toolkit for Training Data Attribution Evaluation and Beyond [14.062323566963972]
  Training data attribution (TDA) methods have emerged as a promising direction for the interpretability of neural networks. We introduce Quanda, a Python toolkit designed to facilitate the evaluation of TDA methods.
  arXiv  Detail & Related papers  (2024-10-09T17:56:41Z)
• Active Test-Time Adaptation: Theoretical Analyses and An Algorithm [51.84691955495693]
  Test-time adaptation (TTA) addresses distribution shifts for streaming test data in unsupervised settings. We propose the novel problem setting of active test-time adaptation (ATTA) that integrates active learning within the fully TTA setting.
  arXiv  Detail & Related papers  (2024-04-07T22:31:34Z)
• TFB: Towards Comprehensive and Fair Benchmarking of Time Series Forecasting Methods [27.473935782550388]
  Time series are generated in diverse domains such as economic, traffic, health, and energy. We propose TFB, an automated benchmark for Time Series Forecasting (TSF) methods.
  arXiv  Detail & Related papers  (2024-03-29T12:37:57Z)
• ActiveAD: Planning-Oriented Active Learning for End-to-End Autonomous Driving [96.92499034935466]
  End-to-end differentiable learning for autonomous driving has recently become a prominent paradigm. One main bottleneck lies in its voracious appetite for high-quality labeled data. We propose a planning-oriented active learning method which progressively annotates part of collected raw data.
  arXiv  Detail & Related papers  (2024-03-05T11:39:07Z)
• On Pitfalls of Test-Time Adaptation [82.8392232222119]
  Test-Time Adaptation (TTA) has emerged as a promising approach for tackling the robustness challenge under distribution shifts. We present TTAB, a test-time adaptation benchmark that encompasses ten state-of-the-art algorithms, a diverse array of distribution shifts, and two evaluation protocols.
  arXiv  Detail & Related papers  (2023-06-06T09:35:29Z)
• Regularized Bilinear Discriminant Analysis for Multivariate Time Series Data [5.198140836737883]
  We propose regularized BLDA (RBLDA) for MTS data classification. We develop an efficient implementation of RBLDA and an efficient model selection algorithm. The results reveal that RBLDA achieves the best overall recognition performance and the proposed model selection algorithm is efficient.
  arXiv  Detail & Related papers  (2022-02-26T17:06:01Z)
• TSDAE: Using Transformer-based Sequential Denoising Auto-Encoder for Unsupervised Sentence Embedding Learning [53.32740707197856]
  We present a new state-of-the-art unsupervised method based on pre-trained Transformers and Sequential Denoising Auto-Encoder (TSDAE) It can achieve up to 93.1% of the performance of in-domain supervised approaches.
  arXiv  Detail & Related papers  (2021-04-14T17:02:18Z)
• Time Series Change Point Detection with Self-Supervised Contrastive Predictive Coding [7.60848038196539]
  We propose a novel approach for self-supervised Time Series Change Point detection method based onContrastivePredictive coding (TS-CP2) TS-CP2 is the first approach to employ a contrastive learning strategy for CPD by learning an embedded representation that separates pairs of embeddings of time adjacent intervals from pairs of interval embeddings separated across time.
  arXiv  Detail & Related papers  (2020-11-28T09:36:18Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.