HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly
Detection
- URL: http://arxiv.org/abs/2211.00277v2
- Date: Wed, 2 Nov 2022 02:43:53 GMT
- Title: HFN: Heterogeneous Feature Network for Multivariate Time Series Anomaly
Detection
- Authors: Jun Zhan, Chengkun Wu, Canqun Yang, Qiucheng Miao and Xiandong Ma
- Abstract summary: We propose a novel semi-supervised anomaly detection framework based on a heterogeneous feature network (HFN) for MTS.
We first combine the embedding similarity subgraph generated by sensor embedding and feature value similarity subgraph generated by sensor values to construct a time-series heterogeneous graph.
This approach fuses the state-of-the-art technologies of heterogeneous graph structure learning (HGSL) and representation learning.
- Score: 2.253268952202213
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Network or physical attacks on industrial equipment or computer systems may
cause massive losses. Therefore, a quick and accurate anomaly detection (AD)
based on monitoring data, especially the multivariate time-series (MTS) data,
is of great significance. As the key step of anomaly detection for MTS data,
learning the relations among different variables has been explored by many
approaches. However, most of the existing approaches do not consider the
heterogeneity between variables, that is, different types of variables
(continuous numerical variables, discrete categorical variables or hybrid
variables) may have different and distinctive edge distributions. In this
paper, we propose a novel semi-supervised anomaly detection framework based on
a heterogeneous feature network (HFN) for MTS, learning heterogeneous structure
information from a mass of unlabeled time-series data to improve the accuracy
of anomaly detection, and using attention coefficient to provide an explanation
for the detected anomalies. Specifically, we first combine the embedding
similarity subgraph generated by sensor embedding and feature value similarity
subgraph generated by sensor values to construct a time-series heterogeneous
graph, which fully utilizes the rich heterogeneous mutual information among
variables. Then, a prediction model containing nodes and channel attentions is
jointly optimized to obtain better time-series representations. This approach
fuses the state-of-the-art technologies of heterogeneous graph structure
learning (HGSL) and representation learning. The experiments on four sensor
datasets from real-world applications demonstrate that our approach detects the
anomalies more accurately than those baseline approaches, thus providing a
basis for the rapid positioning of anomalies.
Related papers
- Multi-Source and Test-Time Domain Adaptation on Multivariate Signals using Spatio-Temporal Monge Alignment [59.75420353684495]
Machine learning applications on signals such as computer vision or biomedical data often face challenges due to the variability that exists across hardware devices or session recordings.
In this work, we propose Spatio-Temporal Monge Alignment (STMA) to mitigate these variabilities.
We show that STMA leads to significant and consistent performance gains between datasets acquired with very different settings.
arXiv Detail & Related papers (2024-07-19T13:33:38Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - Entropy Causal Graphs for Multivariate Time Series Anomaly Detection [7.402342914903391]
This work proposes a novel framework called CGAD, an entropy Causal Graph for multivariate time series Anomaly Detection.
CGAD utilizes transfer entropy to construct graph structures that unveil the underlying causal relationships among time series data.
CGAD outperforms state-of-the-art methods on real-world datasets with a 15% average improvement.
arXiv Detail & Related papers (2023-12-15T01:35:00Z) - Correlation-aware Spatial-Temporal Graph Learning for Multivariate
Time-series Anomaly Detection [67.60791405198063]
We propose a correlation-aware spatial-temporal graph learning (termed CST-GL) for time series anomaly detection.
CST-GL explicitly captures the pairwise correlations via a multivariate time series correlation learning module.
A novel anomaly scoring component is further integrated into CST-GL to estimate the degree of an anomaly in a purely unsupervised manner.
arXiv Detail & Related papers (2023-07-17T11:04:27Z) - GIT: Detecting Uncertainty, Out-Of-Distribution and Adversarial Samples
using Gradients and Invariance Transformations [77.34726150561087]
We propose a holistic approach for the detection of generalization errors in deep neural networks.
GIT combines the usage of gradient information and invariance transformations.
Our experiments demonstrate the superior performance of GIT compared to the state-of-the-art on a variety of network architectures.
arXiv Detail & Related papers (2023-07-05T22:04:38Z) - Causality-Based Multivariate Time Series Anomaly Detection [63.799474860969156]
We formulate the anomaly detection problem from a causal perspective and view anomalies as instances that do not follow the regular causal mechanism to generate the multivariate data.
We then propose a causality-based anomaly detection approach, which first learns the causal structure from data and then infers whether an instance is an anomaly relative to the local causal mechanism.
We evaluate our approach with both simulated and public datasets as well as a case study on real-world AIOps applications.
arXiv Detail & Related papers (2022-06-30T06:00:13Z) - Graph-Augmented Normalizing Flows for Anomaly Detection of Multiple Time
Series [12.745860899424532]
Anomaly detection is a widely studied task for a broad variety of data types.
We propose a graph-augmented normalizing flow approach for anomaly detection.
We conduct experiments on real-world datasets and demonstrate the effectiveness of GANF.
arXiv Detail & Related papers (2022-02-16T04:42:53Z) - Unsupervised Deep Anomaly Detection for Multi-Sensor Time-Series Signals [10.866594993485226]
We propose a novel deep learning-based anomaly detection algorithm called Deep Convolutional Autoencoding Memory network (CAE-M)
We first build a Deep Convolutional Autoencoder to characterize spatial dependence of multi-sensor data with a Maximum Mean Discrepancy (MMD)
Then, we construct a Memory Network consisting of linear (Autoregressive Model) and non-linear predictions (Bigressive LSTM with Attention) to capture temporal dependence from time-series data.
arXiv Detail & Related papers (2021-07-27T06:48:20Z) - Graph Neural Network-Based Anomaly Detection in Multivariate Time Series [17.414474298706416]
We develop a new way to detect anomalies in high-dimensional time series data.
Our approach combines a structure learning approach with graph neural networks.
We show that our method detects anomalies more accurately than baseline approaches.
arXiv Detail & Related papers (2021-06-13T09:07:30Z) - Learning Graph Structures with Transformer for Multivariate Time Series
Anomaly Detection in IoT [11.480824844205864]
This work proposed a novel framework, namely GTA, for multivariate time series anomaly detection by automatically learning a graph structure followed by the graph convolution.
We also devised a novel graph convolution named Influence propagation convolution to model the anomaly information flow between graph nodes.
The experiments on four public anomaly detection benchmarks further demonstrate our approach's superiority over other state-of-the-arts.
arXiv Detail & Related papers (2021-04-08T01:45:28Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.