On the Burstiness of Distributed Machine Learning Traffic

• URL: http://arxiv.org/abs/2401.00329v1
• Date: Sat, 30 Dec 2023 21:33:59 GMT
• Title: On the Burstiness of Distributed Machine Learning Traffic
• Authors: Natchanon Luangsomboon, Fahimeh Fazel, J\"org Liebeherr, Ashkan Sobhani, Shichao Guan, Xingjun Chu
• Abstract summary: We study the traffic characteristics generated by the training of the ResNet-50 neural network. Our analysis reveals that distributed ML traffic exhibits a very high degree of burstiness on short time scales. We observe that training software orchestrates transmissions in such a way that burst transmissions from different sources within the same application do not result in congestion and packet losses.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Traffic from distributed training of machine learning (ML) models makes up a large and growing fraction of the traffic mix in enterprise data centers. While work on distributed ML abounds, the network traffic generated by distributed ML has received little attention. Using measurements on a testbed network, we investigate the traffic characteristics generated by the training of the ResNet-50 neural network with an emphasis on studying its short-term burstiness. For the latter we propose metrics that quantify traffic burstiness at different time scales. Our analysis reveals that distributed ML traffic exhibits a very high degree of burstiness on short time scales, exceeding a 60:1 peak-to-mean ratio on time intervals as long as 5~ms. We observe that training software orchestrates transmissions in such a way that burst transmissions from different sources within the same application do not result in congestion and packet losses. An extrapolation of the measurement data to multiple applications underscores the challenges of distributed ML traffic for congestion and flow control algorithms.

Related papers

• m4: A Learned Flow-level Network Simulator [14.802940782072122]
  Flow-level simulators abstract traffic as continuous flows with dynamically assigned transmission rates. We present m4, an accurate and scalable flow-level simulator that uses machine learning to learn the dynamics of the network of interest.
  arXiv  Detail & Related papers  (2025-03-03T17:51:08Z)
• Learning Traffic Anomalies from Generative Models on Real-Time Observations [49.1574468325115]
  We use the Spatiotemporal Generative Adversarial Network (STGAN) framework to capture complex spatial and temporal dependencies in traffic data. We apply STGAN to real-time, minute-by-minute observations from 42 traffic cameras across Gothenburg, Sweden, collected over several months in 2020. Our results demonstrate that the model effectively detects traffic anomalies with high precision and low false positive rates.
  arXiv  Detail & Related papers  (2025-02-03T14:23:23Z)
• NetFlowGen: Leveraging Generative Pre-training for Network Traffic Dynamics [72.95483148058378]
  We propose to pre-train a general-purpose machine learning model to capture traffic dynamics with only traffic data from NetFlow records. We address challenges such as unifying network feature representations, learning from large unlabeled traffic data volume, and testing on real downstream tasks in DDoS attack detection.
  arXiv  Detail & Related papers  (2024-12-30T00:47:49Z)
• Improving Traffic Flow Predictions with SGCN-LSTM: A Hybrid Model for Spatial and Temporal Dependencies [55.2480439325792]
  This paper introduces the Signal-Enhanced Graph Convolutional Network Long Short Term Memory (SGCN-LSTM) model for predicting traffic speeds across road networks. Experiments on the PEMS-BAY road network traffic dataset demonstrate the SGCN-LSTM model's effectiveness.
  arXiv  Detail & Related papers  (2024-11-01T00:37:00Z)
• Strada-LLM: Graph LLM for traffic prediction [62.2015839597764]
  A considerable challenge in traffic prediction lies in handling the diverse data distributions caused by vastly different traffic conditions. We propose a graph-aware LLM for traffic prediction that considers proximal traffic information. We adopt a lightweight approach for efficient domain adaptation when facing new data distributions in few-shot fashion.
  arXiv  Detail & Related papers  (2024-10-28T09:19:29Z)
• RACH Traffic Prediction in Massive Machine Type Communications [5.416701003120508]
  This paper presents a machine learning-based framework tailored for forecasting bursty traffic in ALOHA networks. We develop a new low-complexity online prediction algorithm that updates the states of the LSTM network by leveraging frequently collected data from the mMTC network. We evaluate the performance of the proposed framework in a network with a single base station and thousands of devices organized into groups with distinct traffic-generating characteristics.
  arXiv  Detail & Related papers  (2024-05-08T17:28:07Z)
• Energy-Guided Data Sampling for Traffic Prediction with Mini Training Datasets [13.065729535009925]
  We propose an innovative solution that merges Convolutional Neural Networks (CNNs) with Long Short-Term Memory (LSTM) architecture to enhance the prediction of traffic flow dynamics. A key revelation of our research is the feasibility of sampling training data for large traffic systems from simulations conducted on smaller traffic systems.
  arXiv  Detail & Related papers  (2024-03-27T15:57:42Z)
• Traffic estimation in unobserved network locations using data-driven macroscopic models [2.3543188414616534]
  This paper leverages macroscopic models and multi-source data collected from automatic traffic counters and probe vehicles to accurately estimate traffic flow and travel time in links where these measurements are unavailable. Because MaTE is grounded in macroscopic flow theory, all parameters and variables are interpretable. Experiments on synthetic data show that the model can accurately estimate travel time and traffic flow in out-of-sample links.
  arXiv  Detail & Related papers  (2024-01-30T15:21:50Z)
• Efficient Traffic State Forecasting using Spatio-Temporal Network Dependencies: A Sparse Graph Neural Network Approach [6.203371866342754]
  Traffic prediction in a transportation network is paramount for effective traffic operations and management. Long-term traffic prediction (beyond 30 minutes into the future) remains challenging in current research. We propose sparse training to the training cost, while preserving the prediction accuracy.
  arXiv  Detail & Related papers  (2022-11-06T05:41:39Z)
• Correlating sparse sensing for large-scale traffic speed estimation: A Laplacian-enhanced low-rank tensor kriging approach [76.45949280328838]
  We propose a Laplacian enhanced low-rank tensor (LETC) framework featuring both lowrankness and multi-temporal correlations for large-scale traffic speed kriging. We then design an efficient solution algorithm via several effective numeric techniques to scale up the proposed model to network-wide kriging.
  arXiv  Detail & Related papers  (2022-10-21T07:25:57Z)
• Road Network Guided Fine-Grained Urban Traffic Flow Inference [108.64631590347352]
  Accurate inference of fine-grained traffic flow from coarse-grained one is an emerging yet crucial problem. We propose a novel Road-Aware Traffic Flow Magnifier (RATFM) that exploits the prior knowledge of road networks. Our method can generate high-quality fine-grained traffic flow maps.
  arXiv  Detail & Related papers  (2021-09-29T07:51:49Z)
• DeepFlow: Abnormal Traffic Flow Detection Using Siamese Networks [4.544151613454639]
  We develop a traffic anomaly detection system, referred to as DeepFlow, based on Siamese neural networks. Our model can detect abnormal traffic flows by analyzing the trajectory data collected from the vehicles in a fleet. Our results show that DeepFlow detects abnormal traffic patterns with an F1 score of 78%, while outperforming other existing approaches.
  arXiv  Detail & Related papers  (2021-08-26T19:56:05Z)
• A Graph Convolutional Network with Signal Phasing Information for Arterial Traffic Prediction [63.470149585093665]
  arterial traffic prediction plays a crucial role in the development of modern intelligent transportation systems. Many existing studies on arterial traffic prediction only consider temporal measurements of flow and occupancy from loop sensors and neglect the rich spatial relationships between upstream and downstream detectors. We fill this gap by enhancing a deep learning approach, Diffusion Convolutional Recurrent Neural Network, with spatial information generated from signal timing plans at targeted intersections.
  arXiv  Detail & Related papers  (2020-12-25T01:40:29Z)
• Prediction of Traffic Flow via Connected Vehicles [77.11902188162458]
  We propose a Short-term Traffic flow Prediction framework so that transportation authorities take early actions to control flow and prevent congestion. We anticipate flow at future time frames on a target road segment based on historical flow data and innovative features such as real time feeds and trajectory data provided by Connected Vehicles (CV) technology. We show how this novel approach allows advanced modelling by integrating into the forecasting of flow, the impact of various events that CV realistically encountered on segments along their trajectory.
  arXiv  Detail & Related papers  (2020-07-10T16:00:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.