Is it worth it? An experimental comparison of six deep- and classical machine learning methods for unsupervised anomaly detection in time series

• URL: http://arxiv.org/abs/2212.11080v1
• Date: Wed, 21 Dec 2022 15:27:52 GMT
• Title: Is it worth it? An experimental comparison of six deep- and classical machine learning methods for unsupervised anomaly detection in time series
• Authors: Ferdinand Rewicki and Joachim Denzler and Julia Niebling
• Abstract summary: We compare six unsupervised anomaly detection methods with different complexities to answer the questions: Are the more complex methods usually performing better? We show with broad experiments, that the classical machine learning methods show a superior performance compared to the deep learning methods across a wide range of anomaly types.
• Score: 35.07288247575299
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The detection of anomalies in time series data is crucial in a wide range of applications, such as system monitoring, health care or cyber security. While the vast number of available methods makes selecting the right method for a certain application hard enough, different methods have different strengths, e.g. regarding the type of anomalies they are able to find. In this work, we compare six unsupervised anomaly detection methods with different complexities to answer the questions: Are the more complex methods usually performing better? And are there specific anomaly types that those method are tailored to? The comparison is done on the UCR anomaly archive, a recent benchmark dataset for anomaly detection. We compare the six methods by analyzing the experimental results on a dataset- and anomaly type level after tuning the necessary hyperparameter for each method. Additionally we examine the ability of individual methods to incorporate prior knowledge about the anomalies and analyse the differences of point-wise and sequence wise features. We show with broad experiments, that the classical machine learning methods show a superior performance compared to the deep learning methods across a wide range of anomaly types.

Related papers

• Anomaly Detection by Context Contrasting [57.695202846009714]
  Anomaly Detection focuses on identifying samples that deviate from the norm. Recent advances in self-supervised learning have shown great promise in this regard. We propose Con2, which addresses this problem by setting normal training data into distinct contexts. Our approach achieves state-of-the-art performance on various benchmarks while exhibiting superior performance in a more realistic healthcare setting.
  arXiv  Detail & Related papers  (2024-05-29T07:59:06Z)
• Anomaly Detection Based on Isolation Mechanisms: A Survey [13.449446806837422]
  Isolation-based unsupervised anomaly detection is a novel and effective approach for identifying anomalies in data. We review the state-of-the-art isolation-based anomaly detection methods, including their data partitioning strategies, anomaly score functions, and algorithmic details.
  arXiv  Detail & Related papers  (2024-03-16T04:29:21Z)
• Learn Suspected Anomalies from Event Prompts for Video Anomaly Detection [49.91075101563298]
  A novel framework is proposed to guide the learning of suspected anomalies from event prompts. It enables a new multi-prompt learning process to constrain the visual-semantic features across all videos. Our proposed model outperforms most state-of-the-art methods in terms of AP or AUC.
  arXiv  Detail & Related papers  (2024-03-02T10:42:47Z)
• SaliencyCut: Augmenting Plausible Anomalies for Anomaly Detection [24.43321988051129]
  We propose a novel saliency-guided data augmentation method, SaliencyCut, to produce pseudo but more common anomalies. We then design a novel patch-wise residual module in the anomaly learning head to extract and assess the fine-grained anomaly features from each sample.
  arXiv  Detail & Related papers  (2023-06-14T08:55:36Z)
• A Comparative Study on Unsupervised Anomaly Detection for Time Series: Experiments and Analysis [28.79393419730138]
  Time series anomaly detection is often essential to enable reliability and safety. Many recent studies target anomaly detection for time series data. We introduce for data, methods, and evaluation strategies. We systematically evaluate and compare state-of-the-art traditional as well as deep learning techniques.
  arXiv  Detail & Related papers  (2022-09-10T10:44:25Z)
• An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time Series [7.675917669905486]
  This paper presents a systematic and comprehensive evaluation of unsupervised and semi-supervised deep-learning based methods for anomaly detection and diagnosis. We vary the model and post-processing of model errors, through a grid of 10 models and 4 scoring functions, comparing these variants to state of the art methods. We find that the existing evaluation metrics either do not take events into account, or cannot distinguish between a good detector and trivial detectors.
  arXiv  Detail & Related papers  (2021-09-23T15:14:24Z)
• TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networks [73.01104041298031]
  TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs) To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics. To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
  arXiv  Detail & Related papers  (2020-09-16T15:52:04Z)
• Toward Deep Supervised Anomaly Detection: Reinforcement Learning from Partially Labeled Anomaly Data [150.9270911031327]
  We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset. Existing related methods either exclusively fit the limited anomaly examples that typically do not span the entire set of anomalies, or proceed with unsupervised learning from the unlabeled data. We propose here instead a deep reinforcement learning-based approach that enables an end-to-end optimization of the detection of both labeled and unlabeled anomalies.
  arXiv  Detail & Related papers  (2020-09-15T03:05:39Z)
• Self-trained Deep Ordinal Regression for End-to-End Video Anomaly Detection [114.9714355807607]
  We show that applying self-trained deep ordinal regression to video anomaly detection overcomes two key limitations of existing methods. We devise an end-to-end trainable video anomaly detection approach that enables joint representation learning and anomaly scoring without manually labeled normal/abnormal data.
  arXiv  Detail & Related papers  (2020-03-15T08:44:55Z)
• CRATOS: Cognition of Reliable Algorithm for Time-series Optimal Solution [12.906367105870341]
  CRATOS is a self-adapt algorithms that extract features from time series, and then cluster series with similar features into one group. Our methods can significantly reduce the cost of development and maintenance of anomaly detection. The accuracy of the anomaly detection algorithms in this paper is 85.1%.
  arXiv  Detail & Related papers  (2020-03-03T09:49:30Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.