Refining the Optimization Target for Automatic Univariate Time Series Anomaly Detection in Monitoring Services

• URL: http://arxiv.org/abs/2307.10653v1
• Date: Thu, 20 Jul 2023 07:33:36 GMT
• Title: Refining the Optimization Target for Automatic Univariate Time Series Anomaly Detection in Monitoring Services
• Authors: Manqing Dong and Zhanxiang Zhao and Yitong Geng and Wentao Li and Wei Wang and Huai Jiang
• Abstract summary: This paper proposes a comprehensive framework for automatic parameter optimization in time series anomaly detection models. The framework introduces three optimization targets: prediction score, shape score, and sensitivity score, which can be easily adapted to different model backbones. The proposed framework has been successfully applied online for over six months, serving more than 50,000 time series every minute.
• Score: 7.950139316901604
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Time series anomaly detection is crucial for industrial monitoring services that handle a large volume of data, aiming to ensure reliability and optimize system performance. Existing methods often require extensive labeled resources and manual parameter selection, highlighting the need for automation. This paper proposes a comprehensive framework for automatic parameter optimization in time series anomaly detection models. The framework introduces three optimization targets: prediction score, shape score, and sensitivity score, which can be easily adapted to different model backbones without prior knowledge or manual labeling efforts. The proposed framework has been successfully applied online for over six months, serving more than 50,000 time series every minute. It simplifies the user's experience by requiring only an expected sensitive value, offering a user-friendly interface, and achieving desired detection results. Extensive evaluations conducted on public datasets and comparison with other methods further confirm the effectiveness of the proposed framework.

Related papers

• Fully Automated Correlated Time Series Forecasting in Minutes [31.198713853170375]
  We propose a fully automated and highly efficient correlated time series forecasting framework. It includes a data-driven, iterative strategy to automatically prune a large search space to obtain a high-quality search space for a new forecasting task. Experiments on seven benchmark datasets offer evidence that the framework is capable of state-of-the-art accuracy and is much more efficient than existing methods.
  arXiv  Detail & Related papers  (2024-11-06T09:02:13Z)
• A CLIP-Powered Framework for Robust and Generalizable Data Selection [51.46695086779598]
  Real-world datasets often contain redundant and noisy data, imposing a negative impact on training efficiency and model performance. Data selection has shown promise in identifying the most representative samples from the entire dataset. We propose a novel CLIP-powered data selection framework that leverages multimodal information for more robust and generalizable sample selection.
  arXiv  Detail & Related papers  (2024-10-15T03:00:58Z)
• PeFAD: A Parameter-Efficient Federated Framework for Time Series Anomaly Detection [51.20479454379662]
  We propose a. Federated Anomaly Detection framework named PeFAD with the increasing privacy concerns. We conduct extensive evaluations on four real datasets, where PeFAD outperforms existing state-of-the-art baselines by up to 28.74%.
  arXiv  Detail & Related papers  (2024-06-04T13:51:08Z)
• AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving [68.73885845181242]
  We propose an Automatic Data Engine (AIDE) that automatically identifies issues, efficiently curates data, improves the model through auto-labeling, and verifies the model through generation of diverse scenarios. We further establish a benchmark for open-world detection on AV datasets to comprehensively evaluate various learning paradigms, demonstrating our method's superior performance at a reduced cost.
  arXiv  Detail & Related papers  (2024-03-26T04:27:56Z)
• auto-sktime: Automated Time Series Forecasting [18.640815949661903]
  We introduce auto-sktime, a novel framework for automated time series forecasting. The proposed framework uses the power of automated machine learning (AutoML) techniques to automate the creation of the entire forecasting pipeline. Experimental results on 64 diverse real-world time series datasets demonstrate the effectiveness and efficiency of the framework.
  arXiv  Detail & Related papers  (2023-12-13T21:34:30Z)
• Active Reinforcement Learning for Personalized Stress Monitoring in Everyday Settings [4.4353357514621745]
  In this paper, we consider a fine-grain stress detection problem based on wearable sensors targeting everyday settings. We develop a multilayered sensor-edge-cloud platform to periodically capture physiological signals and process them in real-time. We show that the context-aware active learning technique we propose achieves a desirable detection performance using 88% and 32% fewer queries from users.
  arXiv  Detail & Related papers  (2023-04-28T22:09:19Z)
• HyperImpute: Generalized Iterative Imputation with Automatic Model Selection [77.86861638371926]
  We propose a generalized iterative imputation framework for adaptively and automatically configuring column-wise models. We provide a concrete implementation with out-of-the-box learners, simulators, and interfaces.
  arXiv  Detail & Related papers  (2022-06-15T19:10:35Z)
• MOSPAT: AutoML based Model Selection and Parameter Tuning for Time Series Anomaly Detection [8.942168855247548]
  MOSPAT is an end-to-end automated machine learning based approach for model and parameter selection. Our experiments on real and synthetic data demonstrate that this method consistently outperforms using any single algorithm.
  arXiv  Detail & Related papers  (2022-05-24T03:28:52Z)
• Automated Model Selection for Time-Series Anomaly Detection [6.396011708581161]
  Many companies need to monitor thousands of temporal signals for their applications and services and require instant feedback and alerts for potential incidents in time. The task is challenging because of the complex characteristics of time-series, which are messy, and often without proper labels. This prohibits training supervised models because of lack of labels and a single model hardly fits different time series. We present an automated model selection framework to automatically find the most suitable detection model with proper parameters for the incoming data.
  arXiv  Detail & Related papers  (2020-08-25T07:23:43Z)
• AutoSimulate: (Quickly) Learning Synthetic Data Generation [70.82315853981838]
  We propose an efficient alternative for optimal synthetic data generation based on a novel differentiable approximation of the objective. We demonstrate that the proposed method finds the optimal data distribution faster (up to $50times$), with significantly reduced training data generation (up to $30times$) and better accuracy ($+8.7%$) on real-world test datasets than previous methods.
  arXiv  Detail & Related papers  (2020-08-16T11:36:11Z)
• SADet: Learning An Efficient and Accurate Pedestrian Detector [68.66857832440897]
  This paper proposes a series of systematic optimization strategies for the detection pipeline of one-stage detector. It forms a single shot anchor-based detector (SADet) for efficient and accurate pedestrian detection. Though structurally simple, it presents state-of-the-art result and real-time speed of $20$ FPS for VGA-resolution images.
  arXiv  Detail & Related papers  (2020-07-26T12:32:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.