Anomaly detection with superexperts under delayed feedback
- URL: http://arxiv.org/abs/2010.03857v2
- Date: Thu, 22 Apr 2021 09:57:31 GMT
- Title: Anomaly detection with superexperts under delayed feedback
- Authors: Raisa Dzhamtyrova, Carsten Maple
- Abstract summary: We propose a new approach for aggregating unsupervised anomaly detection algorithms.
We show that both aggregating models, which we call experts, and incorporating feedback significantly improve the performance.
An important property of the proposed approaches is their theoretical guarantees that they perform close to the best superexpert.
- Score: 1.3960152426268768
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: The increasing connectivity of data and cyber-physical systems has resulted
in a growing number of cyber-attacks. Real-time detection of such attacks,
through the identification of anomalous activity, is required so that
mitigation and contingent actions can be effectively and rapidly deployed. We
propose a new approach for aggregating unsupervised anomaly detection
algorithms and incorporating feedback when it becomes available. We apply this
approach to open-source real datasets and show that both aggregating models,
which we call experts, and incorporating feedback significantly improve the
performance. An important property of the proposed approaches is their
theoretical guarantees that they perform close to the best superexpert, which
can switch between the best performing experts, in terms of the cumulative
average losses.
Related papers
- Leveraging Mixture of Experts for Improved Speech Deepfake Detection [53.69740463004446]
Speech deepfakes pose a significant threat to personal security and content authenticity.
We introduce a novel approach for enhancing speech deepfake detection performance using a Mixture of Experts architecture.
arXiv Detail & Related papers (2024-09-24T13:24:03Z) - Re-thinking Data Availablity Attacks Against Deep Neural Networks [53.64624167867274]
In this paper, we re-examine the concept of unlearnable examples and discern that the existing robust error-minimizing noise presents an inaccurate optimization objective.
We introduce a novel optimization paradigm that yields improved protection results with reduced computational time requirements.
arXiv Detail & Related papers (2023-05-18T04:03:51Z) - Few-shot Weakly-supervised Cybersecurity Anomaly Detection [1.179179628317559]
We propose an enhancement to an existing few-shot weakly-supervised deep learning anomaly detection framework.
This framework incorporates data augmentation, representation learning and ordinal regression.
We then evaluated and showed the performance of our implemented framework on three benchmark datasets.
arXiv Detail & Related papers (2023-04-15T04:37:54Z) - AntPivot: Livestream Highlight Detection via Hierarchical Attention
Mechanism [64.70568612993416]
We formulate a new task Livestream Highlight Detection, discuss and analyze the difficulties listed above and propose a novel architecture AntPivot to solve this problem.
We construct a fully-annotated dataset AntHighlight to instantiate this task and evaluate the performance of our model.
arXiv Detail & Related papers (2022-06-10T05:58:11Z) - Large-Scale Sequential Learning for Recommender and Engineering Systems [91.3755431537592]
In this thesis, we focus on the design of an automatic algorithms that provide personalized ranking by adapting to the current conditions.
For the former, we propose novel algorithm called SAROS that take into account both kinds of feedback for learning over the sequence of interactions.
The proposed idea of taking into account the neighbour lines shows statistically significant results in comparison with the initial approach for faults detection in power grid.
arXiv Detail & Related papers (2022-05-13T21:09:41Z) - Little Help Makes a Big Difference: Leveraging Active Learning to
Improve Unsupervised Time Series Anomaly Detection [2.1684857243537334]
A large set of anomaly detection algorithms have been deployed for detecting unexpected network incidents.
Unsupervised anomaly detection algorithms often suffer from excessive false alarms.
We propose to use active learning to introduce and benefit from the feedback of operators.
arXiv Detail & Related papers (2022-01-25T13:54:19Z) - Human readable network troubleshooting based on anomaly detection and
feature scoring [11.593495085674343]
We present a system based on (i) unsupervised learning methods for detecting anomalies in the time domain, (ii) an attention mechanism to rank features in the feature space and (iii) an expert knowledge module.
We thoroughly evaluate the performance of the full system and of its individual building blocks.
arXiv Detail & Related papers (2021-08-26T14:20:36Z) - HURRA! Human readable router anomaly detection [11.564082628014638]
HURRA aims to reduce the time spent by human operators in the process of network troubleshooting.
It comprises two modules that are plugged after any anomaly detection algorithm.
arXiv Detail & Related papers (2021-07-23T08:38:29Z) - Adversarial Imitation Learning with Trajectorial Augmentation and
Correction [61.924411952657756]
We introduce a novel augmentation method which preserves the success of the augmented trajectories.
We develop an adversarial data augmented imitation architecture to train an imitation agent using synthetic experts.
Experiments show that our data augmentation strategy can improve accuracy and convergence time of adversarial imitation.
arXiv Detail & Related papers (2021-03-25T14:49:32Z) - Bayesian Optimization with Machine Learning Algorithms Towards Anomaly
Detection [66.05992706105224]
In this paper, an effective anomaly detection framework is proposed utilizing Bayesian Optimization technique.
The performance of the considered algorithms is evaluated using the ISCX 2012 dataset.
Experimental results show the effectiveness of the proposed framework in term of accuracy rate, precision, low-false alarm rate, and recall.
arXiv Detail & Related papers (2020-08-05T19:29:35Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.