Proactive Network Maintenance using Fast, Accurate Anomaly Localization
and Classification on 1-D Data Series
- URL: http://arxiv.org/abs/2007.08752v1
- Date: Fri, 17 Jul 2020 04:27:20 GMT
- Title: Proactive Network Maintenance using Fast, Accurate Anomaly Localization
and Classification on 1-D Data Series
- Authors: Jingjie Zhu, Karthik Sundaresan, Jason Rupe
- Abstract summary: Proactive network maintenance (PNM) is the concept of using data from a network to identify and locate network faults, many or all of which could worsen to become service failures.
We introduce a new algorithm that leverages Deep Convolutional Neural Networks to efficiently and accurately detect anomalies and events on data series.
- Score: 2.8876310962094727
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Proactive network maintenance (PNM) is the concept of using data from a
network to identify and locate network faults, many or all of which could
worsen to become service failures. The separation between the network fault and
the service failure affords early detection of problems in the network to allow
PNM to take place. Consequently, PNM is a form of prognostics and health
management (PHM).
The problem of localizing and classifying anomalies on 1-dimensional data
series has been under research for years. We introduce a new algorithm that
leverages Deep Convolutional Neural Networks to efficiently and accurately
detect anomalies and events on data series, and it reaches 97.82% mean average
precision (mAP) in our evaluation.
Related papers
- Automated Fault Detection in 5G Core Networks Using Large Language Models [0.9041331849728441]
In this study, we leverage Large Language Models (LLMs) to automate network fault detection and classification.<n>The dataset includes logs from different network components (pods), along with complementary data such as system descriptions, Round Trip Time (RTT) tests, and pod status information.<n>We fine-tuned the GPT-4.1 nano model via its API on this dataset, resulting in a significant improvement in fault-detection accuracy compared to the base model.
arXiv Detail & Related papers (2025-11-24T15:55:29Z) - HiFiNet: Hierarchical Fault Identification in Wireless Sensor Networks via Edge-Based Classification and Graph Aggregation [11.108171977551619]
HiFiNet is a hierarchical fault identification framework for wireless networks.<n>It produces more accurate predictions by capturing both local temporal patterns and network-wide spatial dependencies.<n>It significantly outperforms existing methods in accuracy, F1-score, and precision.
arXiv Detail & Related papers (2025-11-06T16:15:19Z) - CESNET-TimeSeries24: Time Series Dataset for Network Traffic Anomaly Detection and Forecasting [0.0]
This manuscript introduces a dataset comprising time series data of network entities' behavior.
The dataset was created from 40 weeks of network traffic of 275 thousand active IP addresses.
It provides valuable insights into the practical deployment of forecast-based anomaly detection approaches.
arXiv Detail & Related papers (2024-09-27T16:10:11Z) - Detecting Contextual Network Anomalies with Graph Neural Networks [4.671648049111933]
We formulate the problem as contextual anomaly detection on network traffic measurements.
We propose a custom GNN-based solution that detects traffic anomalies on origin-destination flows.
The results show that the anomalies detected by our solution are quite complementary to those captured by the baselines.
arXiv Detail & Related papers (2023-12-11T12:45:43Z) - Detection of DDoS Attacks in Software Defined Networking Using Machine
Learning Models [0.6193838300896449]
This paper investigates the effectiveness of machine learning algorithms to detect distributed denial-of-service (DDoS) attacks in software-defined networking (SDN) environments.
The results indicate that ML-based detection is a more accurate and effective method for identifying DDoS attacks in SDN.
arXiv Detail & Related papers (2023-03-11T22:56:36Z) - TELESTO: A Graph Neural Network Model for Anomaly Classification in
Cloud Services [77.454688257702]
Machine learning (ML) and artificial intelligence (AI) are applied on IT system operation and maintenance.
One direction aims at the recognition of re-occurring anomaly types to enable remediation automation.
We propose a method that is invariant to dimensionality changes of given data.
arXiv Detail & Related papers (2021-02-25T14:24:49Z) - Few-shot Network Anomaly Detection via Cross-network Meta-learning [45.8111239825361]
We propose a new family of graph neural networks -- Graph Deviation Networks (GDN)
GDN can leverage a small number of labeled anomalies for enforcing statistically significant deviations between abnormal and normal nodes on a network.
We equip the proposed GDN with a new cross-network meta-learning algorithm to realize few-shot network anomaly detection.
arXiv Detail & Related papers (2021-02-22T16:42:37Z) - Improving Uncertainty Calibration via Prior Augmented Data [56.88185136509654]
Neural networks have proven successful at learning from complex data distributions by acting as universal function approximators.
They are often overconfident in their predictions, which leads to inaccurate and miscalibrated probabilistic predictions.
We propose a solution by seeking out regions of feature space where the model is unjustifiably overconfident, and conditionally raising the entropy of those predictions towards that of the prior distribution of the labels.
arXiv Detail & Related papers (2021-02-22T07:02:37Z) - Uncertainty-Aware Deep Calibrated Salient Object Detection [74.58153220370527]
Existing deep neural network based salient object detection (SOD) methods mainly focus on pursuing high network accuracy.
These methods overlook the gap between network accuracy and prediction confidence, known as the confidence uncalibration problem.
We introduce an uncertaintyaware deep SOD network, and propose two strategies to prevent deep SOD networks from being overconfident.
arXiv Detail & Related papers (2020-12-10T23:28:36Z) - An Uncertainty-Driven GCN Refinement Strategy for Organ Segmentation [53.425900196763756]
We propose a segmentation refinement method based on uncertainty analysis and graph convolutional networks.
We employ the uncertainty levels of the convolutional network in a particular input volume to formulate a semi-supervised graph learning problem.
We show that our method outperforms the state-of-the-art CRF refinement method by improving the dice score by 1% for the pancreas and 2% for spleen.
arXiv Detail & Related papers (2020-12-06T18:55:07Z) - Enabling certification of verification-agnostic networks via
memory-efficient semidefinite programming [97.40955121478716]
We propose a first-order dual SDP algorithm that requires memory only linear in the total number of network activations.
We significantly improve L-inf verified robust accuracy from 1% to 88% and 6% to 40% respectively.
We also demonstrate tight verification of a quadratic stability specification for the decoder of a variational autoencoder.
arXiv Detail & Related papers (2020-10-22T12:32:29Z) - Collaborative Boundary-aware Context Encoding Networks for Error Map
Prediction [65.44752447868626]
We propose collaborative boundaryaware context encoding networks called AEP-Net for error prediction task.
Specifically, we propose a collaborative feature transformation branch for better feature fusion between images and masks, and precise localization of error regions.
The AEP-Net achieves an average DSC of 0.8358, 0.8164 for error prediction task, and shows a high Pearson correlation coefficient of 0.9873.
arXiv Detail & Related papers (2020-06-25T12:42:01Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.