HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly
Detection
- URL: http://arxiv.org/abs/2211.00277v2
- Date: Wed, 2 Nov 2022 02:43:53 GMT
- Title: HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly
Detection
- Authors: Jun Zhan, Chengkun Wu, Canqun Yang, Qiucheng Miao and Xiandong Ma
- Abstract summary: We propose a novel semi-supervised anomaly detection framework based on a heterogeneous feature network (HFN) for MTS.
We first combine the embedding similarity subgraph generated by sensor embedding and feature value similarity subgraph generated by sensor values to construct a time-series heterogeneous graph.
This approach fuses the state-of-the-art technologies of heterogeneous graph structure learning (HGSL) and representation learning.
- Score: 2.253268952202213
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Network or physical attacks on industrial equipment or computer systems may
cause massive losses. Therefore, a quick and accurate anomaly detection (AD)
based on monitoring data, especially the multivariate time-series (MTS) data,
is of great significance. As the key step of anomaly detection for MTS data,
learning the relations among different variables has been explored by many
approaches. However, most of the existing approaches do not consider the
heterogeneity between variables, that is, different types of variables
(continuous numerical variables, discrete categorical variables or hybrid
variables) may have different and distinctive edge distributions. In this
paper, we propose a novel semi-supervised anomaly detection framework based on
a heterogeneous feature network (HFN) for MTS, learning heterogeneous structure
information from a mass of unlabeled time-series data to improve the accuracy
of anomaly detection, and using attention coefficient to provide an explanation
for the detected anomalies. Specifically, we first combine the embedding
similarity subgraph generated by sensor embedding and feature value similarity
subgraph generated by sensor values to construct a time-series heterogeneous
graph, which fully utilizes the rich heterogeneous mutual information among
variables. Then, a prediction model containing nodes and channel attentions is
jointly optimized to obtain better time-series representations. This approach
fuses the state-of-the-art technologies of heterogeneous graph structure
learning (HGSL) and representation learning. The experiments on four sensor
datasets from real-world applications demonstrate that our approach detects the
anomalies more accurately than those baseline approaches, thus providing a
basis for the rapid positioning of anomalies.
Related papers
- Hypergraph-based multi-scale spatio-temporal graph convolution network for Time-Series anomaly detection [8.878898677348086]
Multi-dimensional time series anomaly detection technology plays an important role in many fields including aerospace, water treatment, cloud service providers, etc.
It is becoming increasingly challenging to perform effective and accurate anomaly detection in high-dimensional and complex data sets.
We propose a hypergraph basedtemporal graph convolutional network model STGCN_Hyper, which explicitly captures high-order, multi-hop correlations between multiple variables.
Our model can flexibly learn the multi-scale time series features in the data and the dependencies between features, and outperforms most existing baseline models in terms of precision, recall, F1-score on anomaly detection
arXiv Detail & Related papers (2024-10-29T17:19:18Z) - Interdependency Matters: Graph Alignment for Multivariate Time Series Anomaly Detection [30.101707763778013]
We introduce MADGA (MTS Anomaly Detection via Graph Alignment), which redefines anomaly detection as a graph alignment (GA) problem.
Uniquely, our GA approach involves explicit alignment of both nodes and edges, employing Wasserstein distance for nodes and Gromov-Wasserstein distance for edges.
Experiments on diverse real-world datasets validate the effectiveness of MADGA, demonstrating its capability to detect anomalies and differentiate interdependencies.
arXiv Detail & Related papers (2024-10-11T14:54:08Z) - Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Entropy Causal Graphs for Multivariate Time Series Anomaly Detection [7.402342914903391]
This work proposes a novel framework called CGAD, an entropy Causal Graph for multivariate time series Anomaly Detection.
CGAD utilizes transfer entropy to construct graph structures that unveil the underlying causal relationships among time series data.
CGAD outperforms state-of-the-art methods on real-world datasets with a 15% average improvement.
arXiv Detail & Related papers (2023-12-15T01:35:00Z) - Correlation-aware Spatial-Temporal Graph Learning for Multivariate
Time-series Anomaly Detection [67.60791405198063]
We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection.
CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module.
A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
arXiv Detail & Related papers (2023-07-17T11:04:27Z) - GIT: Detecting Uncertainty, Out-Of-Distribution and Adversarial Samples
using Gradients and Invariance Transformations [77.34726150561087]
We propose a holistic approach for the detection of generalization errors in deep neural networks.
GIT combines the usage of gradient information and invariance transformations.
Our experiments demonstrate the superior performance of GIT compared to the state-of-the-art on a variety of network architectures.
arXiv Detail & Related papers (2023-07-05T22:04:38Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time
Series [12.745860899424532]
Anomaly detection is a widely studied task for a broad variety of data types.
We propose a graph-augmented normalizing flow approach for anomaly detection.
We conduct experiments on real-world datasets and demonstrate the effectiveness of GANF.
arXiv Detail & Related papers (2022-02-16T04:42:53Z) - Graph Neural Network-Based Anomaly Detection in Multivariate Time Series [17.414474298706416]
We develop a new way to detect anomalies in high-dimensional time series data.
Our approach combines a structure learning approach with graph neural networks.
We show that our method detects anomalies more accurately than baseline approaches.
arXiv Detail & Related papers (2021-06-13T09:07:30Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.