Anomaly Attribution of Multivariate Time Series using Counterfactual
Reasoning
- URL: http://arxiv.org/abs/2109.06562v1
- Date: Tue, 14 Sep 2021 10:15:52 GMT
- Title: Anomaly Attribution of Multivariate Time Series using Counterfactual
Reasoning
- Authors: Violeta Teodora Trifunov, Maha Shadaydeh, Bj\"orn Barz, Joachim
Denzler
- Abstract summary: We develop a novel attribution scheme for multivariate time series relying on counterfactual reasoning.
We detect anomalous intervals using the Maximally Divergent Interval (MDI) algorithm.
- Score: 7.616400192843963
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: There are numerous methods for detecting anomalies in time series, but that
is only the first step to understanding them. We strive to exceed this by
explaining those anomalies. Thus we develop a novel attribution scheme for
multivariate time series relying on counterfactual reasoning. We aim to answer
the counterfactual question of would the anomalous event have occurred if the
subset of the involved variables had been more similarly distributed to the
data outside of the anomalous interval. Specifically, we detect anomalous
intervals using the Maximally Divergent Interval (MDI) algorithm, replace a
subset of variables with their in-distribution values within the detected
interval and observe if the interval has become less anomalous, by re-scoring
it with MDI. We evaluate our method on multivariate temporal and
spatio-temporal data and confirm the accuracy of our anomaly attribution of
multiple well-understood extreme climate events such as heatwaves and
hurricanes.
Related papers
- Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - Causal Discovery-Driven Change Point Detection in Time Series [32.424281626708336]
Change point detection in time series seeks to identify times when the probability distribution of time series changes.
In practical applications, we may be interested only in certain components of the time series, exploring abrupt changes in their distributions.
arXiv Detail & Related papers (2024-07-10T00:54:42Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Entropy Causal Graphs for Multivariate Time Series Anomaly Detection [7.402342914903391]
This work proposes a novel framework called CGAD, an entropy Causal Graph for multivariate time series Anomaly Detection.
CGAD utilizes transfer entropy to construct graph structures that unveil the underlying causal relationships among time series data.
CGAD outperforms state-of-the-art methods on real-world datasets with a 15% average improvement.
arXiv Detail & Related papers (2023-12-15T01:35:00Z) - Compatible Transformer for Irregularly Sampled Multivariate Time Series [75.79309862085303]
We propose a transformer-based encoder to achieve comprehensive temporal-interaction feature learning for each individual sample.
We conduct extensive experiments on 3 real-world datasets and validate that the proposed CoFormer significantly and consistently outperforms existing methods.
arXiv Detail & Related papers (2023-10-17T06:29:09Z) - Algorithmic Recourse for Anomaly Detection in Multivariate Time Series [19.74694026053318]
We propose an algorithmic recourse framework, called RecAD, which can recommend recourse actions to flip the abnormal time steps.
Experiments on two synthetic and one real-world datasets show the effectiveness of our framework.
arXiv Detail & Related papers (2023-09-28T23:50:11Z) - CARLA: Self-supervised Contrastive Representation Learning for Time Series Anomaly Detection [53.83593870825628]
One main challenge in time series anomaly detection (TSAD) is the lack of labelled data in many real-life scenarios.
Most of the existing anomaly detection methods focus on learning the normal behaviour of unlabelled time series in an unsupervised manner.
We introduce a novel end-to-end self-supervised ContrAstive Representation Learning approach for time series anomaly detection.
arXiv Detail & Related papers (2023-08-18T04:45:56Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - An Evaluation of Anomaly Detection and Diagnosis in Multivariate Time
Series [7.675917669905486]
This paper presents a systematic and comprehensive evaluation of unsupervised and semi-supervised deep-learning based methods for anomaly detection and diagnosis.
We vary the model and post-processing of model errors, through a grid of 10 models and 4 scoring functions, comparing these variants to state of the art methods.
We find that the existing evaluation metrics either do not take events into account, or cannot distinguish between a good detector and trivial detectors.
arXiv Detail & Related papers (2021-09-23T15:14:24Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.