AugSplicing: Synchronized Behavior Detection in Streaming Tensors
- URL: http://arxiv.org/abs/2012.02006v5
- Date: Tue, 30 Mar 2021 14:42:58 GMT
- Title: AugSplicing: Synchronized Behavior Detection in Streaming Tensors
- Authors: Jiabao Zhang, Shenghua Liu, Wenting Hou, Siddharth Bhatia, Huawei
Shen, Wenjian Yu, Xueqi Cheng
- Abstract summary: We propose a fast streaming algorithm, AugSplicing, which can detect dense blocks by splicing the previous detection with incoming ones in news.
Compared to the state-of-the-art methods, our method is (1) effective to detect fraudulent behavior in installing data of real-world apps and find a group of students with interesting features in campus Wi-Fi data.
- Score: 38.90084196554039
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: How can we track synchronized behavior in a stream of time-stamped tuples,
such as mobile devices installing and uninstalling applications in the
lockstep, to boost their ranks in the app store? We model such tuples as
entries in a streaming tensor, which augments attribute sizes in its modes over
time. Synchronized behavior tends to form dense blocks (i.e. subtensors) in
such a tensor, signaling anomalous behavior, or interesting communities.
However, existing dense block detection methods are either based on a static
tensor, or lack an efficient algorithm in a streaming setting. Therefore, we
propose a fast streaming algorithm, AugSplicing, which can detect the top dense
blocks by incrementally splicing the previous detection with the incoming ones
in new tuples, avoiding re-runs over all the history data at every tracking
time step. AugSplicing is based on a splicing condition that guides the
algorithm (Section 4). Compared to the state-of-the-art methods, our method is
(1) effective to detect fraudulent behavior in installing data of real-world
apps and find a synchronized group of students with interesting features in
campus Wi-Fi data; (2) robust with splicing theory for dense block detection;
(3) streaming and faster than the existing streaming algorithm, with closely
comparable accuracy.
Related papers
- Bidirectional Decoding: Improving Action Chunking via Closed-Loop Resampling [51.38330727868982]
Bidirectional Decoding (BID) is a test-time inference algorithm that bridges action chunking with closed-loop operations.
We show that BID boosts the performance of two state-of-the-art generative policies across seven simulation benchmarks and two real-world tasks.
arXiv Detail & Related papers (2024-08-30T15:39:34Z) - Efficient pattern-based anomaly detection in a network of multivariate
devices [0.17188280334580192]
We propose a scalable approach to detect anomalies using a two-step approach.
First, we recover relations between entities in the network, since relations are often dynamic in nature and caused by an unknown underlying process.
Next, we report anomalies based on an embedding of sequential patterns.
arXiv Detail & Related papers (2023-05-07T16:05:30Z) - Fast and Multi-aspect Mining of Complex Time-stamped Event Streams [9.528974201794963]
We present CubeScope, an efficient and effective method over high-order tensor streams.
Specifically, it identifies any sudden discontinuity and recognizes distinct dynamical patterns.
In each regime, it also performs multi-way summarization for all attributes.
It can also detect the sudden appearance of anomalies and identify the types of anomalies that occur in practice.
arXiv Detail & Related papers (2023-03-07T10:52:59Z) - Streaming Anomaly Detection [7.60882697435906]
We first propose MIDAS which uses a count-min sketch to detect anomalous edges in dynamic graphs in an online manner.
We then extend the count-min sketch to a Higher-Order sketch to capture complex relations in graph data.
Using this sketch, we propose four streaming methods to detect edge and subgraph anomalies.
arXiv Detail & Related papers (2023-01-30T18:59:51Z) - Streaming End-to-End ASR based on Blockwise Non-Autoregressive Models [57.20432226304683]
Non-autoregressive (NAR) modeling has gained more and more attention in speech processing.
We propose a novel end-to-end streaming NAR speech recognition system.
We show that the proposed method improves online ASR recognition in low latency conditions.
arXiv Detail & Related papers (2021-07-20T11:42:26Z) - MemStream: Memory-Based Anomaly Detection in Multi-Aspect Streams with
Concept Drift [20.143379054091536]
We propose MemStream, a streaming multi-aspect anomaly detection framework.
We leverage the power of a denoising autoencoder to learn representations and a memory module to learn the dynamically changing trend in data.
Experimental results show the effectiveness of our approach compared to state-of-the-art streaming baselines.
arXiv Detail & Related papers (2021-06-07T17:54:57Z) - Efficient Two-Stream Network for Violence Detection Using Separable
Convolutional LSTM [0.0]
We propose an efficient two-stream deep learning architecture leveraging Separable Convolutional LSTM (SepConvLSTM) and pre-trained MobileNet.
SepConvLSTM is constructed by replacing convolution operation at each gate of ConvLSTM with a depthwise separable convolution.
Our model outperforms the accuracy on the larger and more challenging RWF-2000 dataset by more than a 2% margin.
arXiv Detail & Related papers (2021-02-21T12:01:48Z) - Real-Time Anomaly Detection in Edge Streams [49.26098240310257]
We propose MIDAS, which focuses on detecting microcluster anomalies, or suddenly arriving groups of suspiciously similar edges.
We further propose MIDAS-F, to solve the problem by which anomalies are incorporated into the algorithm's internal states.
Experiments show that MIDAS-F has significantly higher accuracy than MIDAS.
arXiv Detail & Related papers (2020-09-17T17:59:27Z) - LoCo: Local Contrastive Representation Learning [93.98029899866866]
We show that by overlapping local blocks stacking on top of each other, we effectively increase the decoder depth and allow upper blocks to implicitly send feedbacks to lower blocks.
This simple design closes the performance gap between local learning and end-to-end contrastive learning algorithms for the first time.
arXiv Detail & Related papers (2020-08-04T05:41:29Z) - Multi-scale Interactive Network for Salient Object Detection [91.43066633305662]
We propose the aggregate interaction modules to integrate the features from adjacent levels.
To obtain more efficient multi-scale features, the self-interaction modules are embedded in each decoder unit.
Experimental results on five benchmark datasets demonstrate that the proposed method without any post-processing performs favorably against 23 state-of-the-art approaches.
arXiv Detail & Related papers (2020-07-17T15:41:37Z) - Towards Streaming Perception [70.68520310095155]
We present an approach that coherently integrates latency and accuracy into a single metric for real-time online perception.
The key insight behind this metric is to jointly evaluate the output of the entire perception stack at every time instant.
We focus on the illustrative tasks of object detection and instance segmentation in urban video streams, and contribute a novel dataset with high-quality and temporally-dense annotations.
arXiv Detail & Related papers (2020-05-21T01:51:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.