Towards a graph-based foundation model for network traffic analysis

• URL: http://arxiv.org/abs/2409.08111v1
• Date: Thu, 12 Sep 2024 15:04:34 GMT
• Title: Towards a graph-based foundation model for network traffic analysis
• Authors: Louis Van Langendonck, Ismael Castell-Uroz, Pere Barlet-Ros,
• Abstract summary: Foundation models can grasp the complexities of network traffic dynamics and adapt to any specific task or environment with minimal fine-tuning. Previous approaches have used tokenized hex-level packet data. We propose a new, efficient graph-based alternative at the flow-level.
• Score: 3.0558245652654907
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Foundation models have shown great promise in various fields of study. A potential application of such models is in computer network traffic analysis, where these models can grasp the complexities of network traffic dynamics and adapt to any specific task or network environment with minimal fine-tuning. Previous approaches have used tokenized hex-level packet data and the model architecture of large language transformer models. We propose a new, efficient graph-based alternative at the flow-level. Our approach represents network traffic as a dynamic spatio-temporal graph, employing a self-supervised link prediction pretraining task to capture the spatial and temporal dynamics in this network graph framework. To evaluate the effectiveness of our approach, we conduct a few-shot learning experiment for three distinct downstream network tasks: intrusion detection, traffic classification, and botnet classification. Models finetuned from our pretrained base achieve an average performance increase of 6.87\% over training from scratch, demonstrating their ability to effectively learn general network traffic dynamics during pretraining. This success suggests the potential for a large-scale version to serve as an operational foundational model.

Related papers

• Transferable Post-training via Inverse Value Learning [83.75002867411263]
  We propose modeling changes at the logits level during post-training using a separate neural network (i.e., the value network) After training this network on a small base model using demonstrations, this network can be seamlessly integrated with other pre-trained models during inference. We demonstrate that the resulting value network has broad transferability across pre-trained models of different parameter sizes.
  arXiv  Detail & Related papers  (2024-10-28T13:48:43Z)
• FLEXIBLE: Forecasting Cellular Traffic by Leveraging Explicit Inductive Graph-Based Learning [1.4216957119562985]
  We introduce a novel inductive learning scheme and a generalizable GNN-based forecasting model that can process diverse graphs of cellular traffic with one-time training. Experimental results show up to 9.8% performance improvement compared to the state-of-the-art.
  arXiv  Detail & Related papers  (2024-05-14T07:53:23Z)
• Dynamic Causal Graph Convolutional Network for Traffic Prediction [19.759695727682935]
  We propose an approach for predicting traffic that embeds time-varying dynamic network to capture finetemporal patterns of traffic data. We then use graph convolutional networks to generate traffic forecasts. Our experimental results on a real traffic dataset demonstrate the superior prediction performance of the proposed method.
  arXiv  Detail & Related papers  (2023-06-12T10:46:31Z)
• A spatial-temporal short-term traffic flow prediction model based on dynamical-learning graph convolution mechanism [0.0]
  Short-term traffic flow prediction is a vital branch of the Intelligent Traffic System (ITS) and plays an important role in traffic management. Graph convolution network (GCN) is widely used in traffic prediction models to better deal with the graphical structure data of road networks. To deal with this drawback, this paper proposes a novel location graph convolutional network (Location-GCN)
  arXiv  Detail & Related papers  (2022-05-10T09:19:12Z)
• Pretraining Graph Neural Networks for few-shot Analog Circuit Modeling and Design [68.1682448368636]
  We present a supervised pretraining approach to learn circuit representations that can be adapted to new unseen topologies or unseen prediction tasks. To cope with the variable topological structure of different circuits we describe each circuit as a graph and use graph neural networks (GNNs) to learn node embeddings. We show that pretraining GNNs on prediction of output node voltages can encourage learning representations that can be adapted to new unseen topologies or prediction of new circuit level properties.
  arXiv  Detail & Related papers  (2022-03-29T21:18:47Z)
• Data-Driven Traffic Assignment: A Novel Approach for Learning Traffic Flow Patterns Using a Graph Convolutional Neural Network [1.3706331473063877]
  We present a novel data-driven approach of learning traffic flow patterns of a transportation network. We develop a neural network-based framework known as Graph Convolutional Neural Network (GCNN) to solve it. When the training of the model is complete, it can instantly determine the traffic flows of a large-scale network.
  arXiv  Detail & Related papers  (2022-02-21T19:45:15Z)
• Temporal Graph Network Embedding with Causal Anonymous Walks Representations [54.05212871508062]
  We propose a novel approach for dynamic network representation learning based on Temporal Graph Network. For evaluation, we provide a benchmark pipeline for the evaluation of temporal network embeddings. We show the applicability and superior performance of our model in the real-world downstream graph machine learning task provided by one of the top European banks.
  arXiv  Detail & Related papers  (2021-08-19T15:39:52Z)
• TCL: Transformer-based Dynamic Graph Modelling via Contrastive Learning [87.38675639186405]
  We propose a novel graph neural network approach, called TCL, which deals with the dynamically-evolving graph in a continuous-time fashion. To the best of our knowledge, this is the first attempt to apply contrastive learning to representation learning on dynamic graphs.
  arXiv  Detail & Related papers  (2021-05-17T15:33:25Z)
• Graph-Based Neural Network Models with Multiple Self-Supervised Auxiliary Tasks [79.28094304325116]
  Graph Convolutional Networks are among the most promising approaches for capturing relationships among structured data points. We propose three novel self-supervised auxiliary tasks to train graph-based neural network models in a multi-task fashion.
  arXiv  Detail & Related papers  (2020-11-14T11:09:51Z)
• Optimizing Large-Scale Fleet Management on a Road Network using Multi-Agent Deep Reinforcement Learning with Graph Neural Network [0.8702432681310401]
  We propose a novel approach to optimize fleet management by combining multi-agent reinforcement learning with graph neural network. We design a realistic simulator that emulates the empirical taxi call data, and confirm the effectiveness of the proposed model under various conditions.
  arXiv  Detail & Related papers  (2020-11-12T03:01:37Z)
• Pre-Trained Models for Heterogeneous Information Networks [57.78194356302626]
  We propose a self-supervised pre-training and fine-tuning framework, PF-HIN, to capture the features of a heterogeneous information network. PF-HIN consistently and significantly outperforms state-of-the-art alternatives on each of these tasks, on four datasets.
  arXiv  Detail & Related papers  (2020-07-07T03:36:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.