Ensemble Grammar Induction For Detecting Anomalies in Time Series
- URL: http://arxiv.org/abs/2001.11102v1
- Date: Wed, 29 Jan 2020 21:33:03 GMT
- Title: Ensemble Grammar Induction For Detecting Anomalies in Time Series
- Abstract summary: We introduce a grammar-induction-based anomaly detection method utilizing ensemble learning.
We demonstrate that the proposed ensemble approach can outperform existing grammar-induction-based approaches.
- Score: 6.161998499946999
- License: http://creativecommons.org/licenses/by-sa/4.0/
- Abstract: Time series anomaly detection is an important task, with applications in a
broad variety of domains. Many approaches have been proposed in recent years,
but often they require that the length of the anomalies be known in advance and
provided as an input parameter. This limits the practicality of the algorithms,
as such information is often unknown in advance, or anomalies with different
lengths might co-exist in the data. To address this limitation, previously, a
linear time anomaly detection algorithm based on grammar induction has been
proposed. While the algorithm can find variable-length patterns, it still
requires preselecting values for at least two parameters at the discretization
step. How to choose these parameter values properly is still an open problem.
In this paper, we introduce a grammar-induction-based anomaly detection method
utilizing ensemble learning. Instead of using a particular choice of parameter
values for anomaly detection, the method generates the final result based on a
set of results obtained using different parameter values. We demonstrate that
the proposed ensemble approach can outperform existing grammar-induction-based
approaches with different criteria for selection of parameter values. We also
show that the proposed approach can achieve performance similar to that of the
state-of-the-art distance-based anomaly detection algorithm.
Related papers
- Distance metric learning for conditional anomaly detection [17.631037059604477]
A recently proposed conditional anomaly detection framework extends anomaly detection to the problem of identifying anomalous patterns on a subset of attributes in the data.<n>The work presented in this paper focuses on instance-based methods for detecting conditional anomalies.<n>To optimize the performance of such methods we study and devise a metric learning method that learns the distance metric to reflect best the conditional anomaly pattern.
arXiv Detail & Related papers (2026-05-01T07:55:29Z) - GraphSubDetector: Time Series Subsequence Anomaly Detection via Density-Aware Adaptive Graph Neural Network [24.37330736887409]
We present a novel approach to subsequence anomaly detection, namely GraphSubDetector.
First, it adaptively learns the appropriate subsequence length with a length selection mechanism that highlights the characteristics of both normal and anomalous patterns.
Second, we propose a density-aware adaptive graph neural network (DAGNN), which can generate further robust representations against variance of normal data for anomaly detection by message passing between subsequences.
arXiv Detail & Related papers (2024-11-26T08:36:07Z) - Bagged Regularized $k$-Distances for Anomaly Detection [9.899763598214122]
We propose a new distance-based algorithm called bagged regularized $k$-distances for anomaly detection (BRDAD)
Our BRDAD algorithm selects the weights by minimizing the surrogate risk, i.e., the finite sample bound of the empirical risk of the bagged weighted $k$-distances for density estimation (BWDDE)
On the theoretical side, we establish fast convergence rates of the AUC regret of our algorithm and demonstrate that the bagging technique significantly reduces the computational complexity.
arXiv Detail & Related papers (2023-12-02T07:00:46Z) - Learning to Bound Counterfactual Inference in Structural Causal Models
from Observational and Randomised Data [64.96984404868411]
We derive a likelihood characterisation for the overall data that leads us to extend a previous EM-based algorithm.
The new algorithm learns to approximate the (unidentifiability) region of model parameters from such mixed data sources.
It delivers interval approximations to counterfactual results, which collapse to points in the identifiable case.
arXiv Detail & Related papers (2022-12-06T12:42:11Z) - Series2Graph: Graph-based Subsequence Anomaly Detection for Time Series [22.630676187747696]
Subsequence anomaly detection in long sequences is an important problem with applications in a wide range of domains.
In this work, we propose an unsupervised method suitable for domain subsequence anomaly detection.
Our method, Series2Graph, is based on a graph representation of a novel low-dimensional agnosticity embedding of subsequences.
arXiv Detail & Related papers (2022-07-25T13:55:43Z) - Diverse Counterfactual Explanations for Anomaly Detection in Time Series [26.88575131193757]
We propose a model-agnostic algorithm that generates counterfactual ensemble explanations for time series anomaly detection models.
Our method generates a set of diverse counterfactual examples, i.e., multiple versions of the original time series that are not considered anomalous by the detection model.
Our algorithm is applicable to any differentiable anomaly detection model.
arXiv Detail & Related papers (2022-03-21T16:30:34Z) - TiSAT: Time Series Anomaly Transformer [30.68108039722565]
We show that a rudimentary Random Guess method can outperform state-of-the-art detectors in terms of this popular but faulty evaluation criterion.
In this work, we propose a proper evaluation metric that measures the timeliness and precision of detecting sequential anomalies.
arXiv Detail & Related papers (2022-03-10T05:46:58Z) - E-detectors: a nonparametric framework for sequential change detection [86.15115654324488]
We develop a fundamentally new and general framework for sequential change detection.
Our procedures come with clean, nonasymptotic bounds on the average run length.
We show how to design their mixtures in order to achieve both statistical and computational efficiency.
arXiv Detail & Related papers (2022-03-07T17:25:02Z) - Run2Survive: A Decision-theoretic Approach to Algorithm Selection based
on Survival Analysis [75.64261155172856]
survival analysis (SA) naturally supports censored data and offers appropriate ways to use such data for learning distributional models of algorithm runtime.
We leverage such models as a basis of a sophisticated decision-theoretic approach to algorithm selection, which we dub Run2Survive.
In an extensive experimental study with the standard benchmark ASlib, our approach is shown to be highly competitive and in many cases even superior to state-of-the-art AS approaches.
arXiv Detail & Related papers (2020-07-06T15:20:17Z) - Accelerated Message Passing for Entropy-Regularized MAP Inference [89.15658822319928]
Maximum a posteriori (MAP) inference in discrete-valued random fields is a fundamental problem in machine learning.
Due to the difficulty of this problem, linear programming (LP) relaxations are commonly used to derive specialized message passing algorithms.
We present randomized methods for accelerating these algorithms by leveraging techniques that underlie classical accelerated gradient.
arXiv Detail & Related papers (2020-07-01T18:43:32Z) - Implicit differentiation of Lasso-type models for hyperparameter
optimization [82.73138686390514]
We introduce an efficient implicit differentiation algorithm, without matrix inversion, tailored for Lasso-type problems.
Our approach scales to high-dimensional data by leveraging the sparsity of the solutions.
arXiv Detail & Related papers (2020-02-20T18:43:42Z) - Extreme Algorithm Selection With Dyadic Feature Representation [78.13985819417974]
We propose the setting of extreme algorithm selection (XAS) where we consider fixed sets of thousands of candidate algorithms.
We assess the applicability of state-of-the-art AS techniques to the XAS setting and propose approaches leveraging a dyadic feature representation.
arXiv Detail & Related papers (2020-01-29T09:40:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.