InQMAD: Incremental Quantum Measurement Anomaly Detection
- URL: http://arxiv.org/abs/2210.05061v1
- Date: Tue, 11 Oct 2022 00:22:34 GMT
- Title: InQMAD: Incremental Quantum Measurement Anomaly Detection
- Authors: Joseph Gallego-Mejia and Oscar Bustos-Brinez and Fabio Gonzalez
- Abstract summary: Streaming anomaly detection refers to the problem of detecting anomalous data samples in streams of data.
This problem poses challenges that classical and deep anomaly detection methods are not designed to cope with.
We present a new incremental anomaly detection method that performs continuous density estimation.
- Score: 0.0
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Streaming anomaly detection refers to the problem of detecting anomalous data
samples in streams of data. This problem poses challenges that classical and
deep anomaly detection methods are not designed to cope with, such as
conceptual drift and continuous learning. State-of-the-art flow anomaly
detection methods rely on fixed memory using hash functions or nearest
neighbors that may not be able to constrain high-frequency values as in a
moving average or remove seamless outliers and cannot be trained in an
end-to-end deep learning architecture. We present a new incremental anomaly
detection method that performs continuous density estimation based on random
Fourier features and the mechanism of quantum measurements and density matrices
that can be viewed as an exponential moving average density. It can process
potentially endless data and its update complexity is constant $O(1)$. A
systematic evaluation against 12 state-of-the-art streaming anomaly detection
algorithms using 12 streaming datasets is presented.
Related papers
- DeepHYDRA: Resource-Efficient Time-Series Anomaly Detection in Dynamically-Configured Systems [3.44012349879073]
We present DeepHYDRA (Deep Hybrid DBSCAN/Reduction-Based Anomaly Detection)
It combines DBSCAN and learning-based anomaly detection.
It is shown to reliably detect different types of anomalies in both large and complex datasets.
arXiv Detail & Related papers (2024-05-13T13:47:15Z) - Graph Spatiotemporal Process for Multivariate Time Series Anomaly
Detection with Missing Values [67.76168547245237]
We introduce a novel framework called GST-Pro, which utilizes a graphtemporal process and anomaly scorer to detect anomalies.
Our experimental results show that the GST-Pro method can effectively detect anomalies in time series data and outperforms state-of-the-art methods.
arXiv Detail & Related papers (2024-01-11T10:10:16Z) - MSFlow: Multi-Scale Flow-based Framework for Unsupervised Anomaly
Detection [124.52227588930543]
Unsupervised anomaly detection (UAD) attracts a lot of research interest and drives widespread applications.
An inconspicuous yet powerful statistics model, the normalizing flows, is appropriate for anomaly detection and localization in an unsupervised fashion.
We propose a novel Multi-Scale Flow-based framework dubbed MSFlow composed of asymmetrical parallel flows followed by a fusion flow.
Our MSFlow achieves a new state-of-the-art with a detection AUORC score of up to 99.7%, localization AUCROC score of 98.8%, and PRO score of 97.1%.
arXiv Detail & Related papers (2023-08-29T13:38:35Z) - Are we certain it's anomalous? [57.729669157989235]
Anomaly detection in time series is a complex task since anomalies are rare due to highly non-linear temporal correlations.
Here we propose the novel use of Hyperbolic uncertainty for Anomaly Detection (HypAD)
HypAD learns self-supervisedly to reconstruct the input signal.
arXiv Detail & Related papers (2022-11-16T21:31:39Z) - Real-time Anomaly Detection for Multivariate Data Streams [0.0]
We present a real-time multivariate anomaly detection algorithm for data streams based on the Probabilistic Exponentially Weighted Moving Average (PEWMA)
Our formulation is resilient to (abrupt transient, abrupt distributional, and gradual distributional) shifts in the data.
Our proposed anomaly detection algorithm works in an unsupervised manner eliminating the need for labeled examples.
arXiv Detail & Related papers (2022-09-26T03:40:37Z) - Smart Meter Data Anomaly Detection using Variational Recurrent
Autoencoders with Attention [0.0]
This paper proposes an unsupervised anomaly detection method based on a Variational Recurrent Autoencoder with attention mechanism.
With "dirty" data from smart meters, our method pre-detects missing values and global anomalies to shrink their contribution while training.
arXiv Detail & Related papers (2022-06-08T19:39:51Z) - MissDAG: Causal Discovery in the Presence of Missing Data with
Continuous Additive Noise Models [78.72682320019737]
We develop a general method, which we call MissDAG, to perform causal discovery from data with incomplete observations.
MissDAG maximizes the expected likelihood of the visible part of observations under the expectation-maximization framework.
We demonstrate the flexibility of MissDAG for incorporating various causal discovery algorithms and its efficacy through extensive simulations and real data experiments.
arXiv Detail & Related papers (2022-05-27T09:59:46Z) - Graph Neural Network-Based Anomaly Detection in Multivariate Time Series [17.414474298706416]
We develop a new way to detect anomalies in high-dimensional time series data.
Our approach combines a structure learning approach with graph neural networks.
We show that our method detects anomalies more accurately than baseline approaches.
arXiv Detail & Related papers (2021-06-13T09:07:30Z) - Low-rank on Graphs plus Temporally Smooth Sparse Decomposition for
Anomaly Detection in Spatiotemporal Data [37.65687661747699]
We introduce an unsupervised tensor-based anomaly detection method that takes the sparse and temporally continuous nature of anomalies into account.
The resulting optimization problem is convex, scalable, and is shown to be robust against missing data and noise.
arXiv Detail & Related papers (2020-10-23T19:34:40Z) - TadGAN: Time Series Anomaly Detection Using Generative Adversarial
Networks [73.01104041298031]
TadGAN is an unsupervised anomaly detection approach built on Generative Adversarial Networks (GANs)
To capture the temporal correlations of time series, we use LSTM Recurrent Neural Networks as base models for Generators and Critics.
To demonstrate the performance and generalizability of our approach, we test several anomaly scoring techniques and report the best-suited one.
arXiv Detail & Related papers (2020-09-16T15:52:04Z) - Toward Deep Supervised Anomaly Detection: Reinforcement Learning from
Partially Labeled Anomaly Data [150.9270911031327]
We consider the problem of anomaly detection with a small set of partially labeled anomaly examples and a large-scale unlabeled dataset.
Existing related methods either exclusively fit the limited anomaly examples that typically do not span the entire set of anomalies, or proceed with unsupervised learning from the unlabeled data.
We propose here instead a deep reinforcement learning-based approach that enables an end-to-end optimization of the detection of both labeled and unlabeled anomalies.
arXiv Detail & Related papers (2020-09-15T03:05:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.