Fast and Multi-aspect Mining of Complex Time-stamped Event Streams

• URL: http://arxiv.org/abs/2303.03789v2
• Date: Thu, 6 Jul 2023 02:49:12 GMT
• Title: Fast and Multi-aspect Mining of Complex Time-stamped Event Streams
• Authors: Kota Nakamura, Yasuko Matsubara, Koki Kawabata, Yuhei Umeda, Yuichiro Wada and Yasushi Sakurai
• Abstract summary: We present CubeScope, an efficient and effective method over high-order tensor streams. Specifically, it identifies any sudden discontinuity and recognizes distinct dynamical patterns. In each regime, it also performs multi-way summarization for all attributes. It can also detect the sudden appearance of anomalies and identify the types of anomalies that occur in practice.
• Score: 9.528974201794963
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Given a huge, online stream of time-evolving events with multiple attributes, such as online shopping logs: (item, price, brand, time), and local mobility activities: (pick-up and drop-off locations, time), how can we summarize large, dynamic high-order tensor streams? How can we see any hidden patterns, rules, and anomalies? Our answer is to focus on two types of patterns, i.e., ''regimes'' and ''components'', for which we present CubeScope, an efficient and effective method over high-order tensor streams. Specifically, it identifies any sudden discontinuity and recognizes distinct dynamical patterns, ''regimes'' (e.g., weekday/weekend/holiday patterns). In each regime, it also performs multi-way summarization for all attributes (e.g., item, price, brand, and time) and discovers hidden ''components'' representing latent groups (e.g., item/brand groups) and their relationship. Thanks to its concise but effective summarization, CubeScope can also detect the sudden appearance of anomalies and identify the types of anomalies that occur in practice. Our proposed method has the following properties: (a) Effective: it captures dynamical multi-aspect patterns, i.e., regimes and components, and statistically summarizes all the events; (b) General: it is practical for successful application to data compression, pattern discovery, and anomaly detection on various types of tensor streams; (c) Scalable: our algorithm does not depend on the length of the data stream and its dimensionality. Extensive experiments on real datasets demonstrate that CubeScope finds meaningful patterns and anomalies correctly, and consistently outperforms the state-of-the-art methods as regards accuracy and execution speed.

Related papers

• CyberCScope: Mining Skewed Tensor Streams and Online Anomaly Detection in Cybersecurity Systems [7.337687622011136]
  We propose a novel streaming method, namely CyberCScope. It effectively decomposes incoming tensors into major trends while explicitly distinguishing between categorical and skewed continuous attributes. Experiments on large-scale real datasets demonstrate that CyberCScope detects various intrusions with higher accuracy than state-of-the-art baselines.
  arXiv  Detail & Related papers  (2025-03-02T12:17:24Z)
• Graph Spatiotemporal Process for Multivariate Time Series Anomaly Detection with Missing Values [67.76168547245237]
  We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies. Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-01-11T10:10:16Z)
• TimeGraphs: Graph-based Temporal Reasoning [64.18083371645956]
  TimeGraphs is a novel approach that characterizes dynamic interactions as a hierarchical temporal graph. Our approach models the interactions using a compact graph-based representation, enabling adaptive reasoning across diverse time scales. We evaluate TimeGraphs on multiple datasets with complex, dynamic agent interactions, including a football simulator, the Resistance game, and the MOMA human activity dataset.
  arXiv  Detail & Related papers  (2024-01-06T06:26:49Z)
• Label-Free Multivariate Time Series Anomaly Detection [17.092022624954705]
  MTGFlow is an unsupervised anomaly detection approach for MTS anomaly detection via dynamic Graph and entity-aware normalizing Flow. We utilize the graph structure learning model to learn and evolving relations among entities, which effectively captures complex and accurate distribution patterns of MTS. Our approach incorporates the unique characteristics of individual entities by employing an entity-aware normalizing flow.
  arXiv  Detail & Related papers  (2023-12-17T04:58:18Z)
• Dynamic Erasing Network Based on Multi-Scale Temporal Features for Weakly Supervised Video Anomaly Detection [103.92970668001277]
  We propose a Dynamic Erasing Network (DE-Net) for weakly supervised video anomaly detection. We first propose a multi-scale temporal modeling module, capable of extracting features from segments of varying lengths. Then, we design a dynamic erasing strategy, which dynamically assesses the completeness of the detected anomalies.
  arXiv  Detail & Related papers  (2023-12-04T09:40:11Z)
• Detecting Multivariate Time Series Anomalies with Zero Known Label [17.930211011723447]
  MTGFlow is an unsupervised anomaly detection approach for multivariate time series anomaly detection. The complex interdependencies among entities and the diverse inherent characteristics of each entity pose significant challenges on the density estimation. Experiments on five public datasets with seven baselines are conducted, MTGFlow outperforms the SOTA methods by up to 5.0 AUROC%.
  arXiv  Detail & Related papers  (2022-08-03T14:38:19Z)
• Multi-scale Attention Flow for Probabilistic Time Series Forecasting [68.20798558048678]
  We propose a novel non-autoregressive deep learning model, called Multi-scale Attention Normalizing Flow(MANF) Our model avoids the influence of cumulative error and does not increase the time complexity. Our model achieves state-of-the-art performance on many popular multivariate datasets.
  arXiv  Detail & Related papers  (2022-05-16T07:53:42Z)
• A Semi-Supervised Approach for Abnormal Event Prediction on Large Operational Network Time-Series Data [1.544681800932596]
  This paper presents a novel semi-supervised method that efficiently captures dependencies between network time series and across time points. The method can use the limited labeled data to explicitly learn separable embedding space for normal and abnormal samples. Experiments demonstrate that our approach significantly outperformed state-of-the-art approaches for event detection on a large real-world network log.
  arXiv  Detail & Related papers  (2021-10-14T18:33:57Z)
• AugSplicing: Synchronized Behavior Detection in Streaming Tensors [38.90084196554039]
  We propose a fast streaming algorithm, AugSplicing, which can detect dense blocks by splicing the previous detection with incoming ones in news. Compared to the state-of-the-art methods, our method is (1) effective to detect fraudulent behavior in installing data of real-world apps and find a group of students with interesting features in campus Wi-Fi data.
  arXiv  Detail & Related papers  (2020-12-03T15:39:58Z)
• MSTREAM: Fast Anomaly Detection in Multi-Aspect Streams [33.20161160552062]
  MSTREAM can detect unusual group anomalies as they occur in a dynamic manner. It is evaluated over the KDDCUP99, CICIDS-DoS, UNSW-NB 15 and CICIDS-DDoS datasets.
  arXiv  Detail & Related papers  (2020-09-17T17:59:16Z)
• TadGAN: Time Series Anomaly Detection Using Generative Adversarial Networks [73.01104041298031]
  TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs) To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics. To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
  arXiv  Detail & Related papers  (2020-09-16T15:52:04Z)
• Multi-scale Interactive Network for Salient Object Detection [91.43066633305662]
  We propose the aggregate interaction modules to integrate the features from adjacent levels. To obtain more efficient multi-scale features, the self-interaction modules are embedded in each decoder unit. Experimental results on five benchmark datasets demonstrate that the proposed method without any post-processing performs favorably against 23 state-of-the-art approaches.
  arXiv  Detail & Related papers  (2020-07-17T15:41:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.