Individualized Federated Learning for Traffic Prediction with Error Driven Aggregation
- URL: http://arxiv.org/abs/2407.12226v1
- Date: Wed, 17 Jul 2024 00:42:47 GMT
- Title: Individualized Federated Learning for Traffic Prediction with Error Driven Aggregation
- Authors: Hang Chen, Collin Meese, Mark Nejad, Chien-Chung Shen,
- Abstract summary: Federated Learning has emerged as a promising technique for Traffic Prediction.
Current FLTP frameworks lack a real-time model updating scheme.
We propose NeighborFL, an individualized real-time federated learning scheme.
- Score: 8.495633193471853
- License: http://creativecommons.org/licenses/by-nc-sa/4.0/
- Abstract: Low-latency traffic prediction is vital for smart city traffic management. Federated Learning has emerged as a promising technique for Traffic Prediction (FLTP), offering several advantages such as privacy preservation, reduced communication overhead, improved prediction accuracy, and enhanced adaptability to changing traffic conditions. However, majority of the current FLTP frameworks lack a real-time model updating scheme, which hinders their ability to continuously incorporate new incoming traffic data and adapt effectively to the changing dynamics of traffic trends. Another concern with the existing FLTP frameworks is their reliance on the conventional FL model aggregation method, which involves assigning an identical model (i.e., the global model) to all traffic monitoring devices to predict their individual local traffic trends, thereby neglecting the non-IID characteristics of traffic data collected in different locations. Building upon these findings and harnessing insights from reinforcement learning, we propose NeighborFL, an individualized real-time federated learning scheme that introduces a haversine distance-based and error-driven, personalized local models grouping heuristic from the perspective of each individual traffic node. This approach allows NeighborFL to create location-aware and tailored prediction models for each client while fostering collaborative learning. Simulations demonstrate the effectiveness of NeighborFL, offering improved real-time prediction accuracy over three baseline models, with one experimental setting showing a 16.9% reduction in MSE value compared to a naive FL setting.
Related papers
- Strada-LLM: Graph LLM for traffic prediction [62.2015839597764]
A considerable challenge in traffic prediction lies in handling the diverse data distributions caused by vastly different traffic conditions.
We propose a graph-aware LLM for traffic prediction that considers proximal traffic information.
We adopt a lightweight approach for efficient domain adaptation when facing new data distributions in few-shot fashion.
arXiv Detail & Related papers (2024-10-28T09:19:29Z) - Fusion Matrix Prompt Enhanced Self-Attention Spatial-Temporal Interactive Traffic Forecasting Framework [2.9490249935740573]
We propose a Fusion Matrix Prompt Enhanced Self-Attention Spatial-Temporal Interactive Traffic Forecasting Framework (FMPESTF)
FMPESTF is composed of spatial and temporal modules for down-sampling traffic data.
We introduce attention mechanism in time modeling, and design hierarchical spatial-temporal interactive learning to help the model adapt to various traffic scenarios.
arXiv Detail & Related papers (2024-10-12T03:47:27Z) - Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models.
Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML)
We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
arXiv Detail & Related papers (2024-07-18T15:44:23Z) - Deep Learning Methods for Adjusting Global MFD Speed Estimations to Local Link Configurations [4.2185937778110825]
This study introduces a Local Correction Factor (LCF) that integrates MFD-derived network mean speed with network configurations to accurately estimate the individual speed of a link.
We use a novel deep learning framework to capture both spatial configurations and temporal dynamics of the network.
Our model enhances the precision of link-level traffic speed estimations while preserving the computational benefits of aggregate models.
arXiv Detail & Related papers (2024-05-23T07:37:33Z) - A Holistic Framework Towards Vision-based Traffic Signal Control with
Microscopic Simulation [53.39174966020085]
Traffic signal control (TSC) is crucial for reducing traffic congestion that leads to smoother traffic flow, reduced idling time, and mitigated CO2 emissions.
In this study, we explore the computer vision approach for TSC that modulates on-road traffic flows through visual observation.
We introduce a holistic traffic simulation framework called TrafficDojo towards vision-based TSC and its benchmarking.
arXiv Detail & Related papers (2024-03-11T16:42:29Z) - Over-the-Air Federated Learning and Optimization [52.5188988624998]
We focus on Federated learning (FL) via edge-the-air computation (AirComp)
We describe the convergence of AirComp-based FedAvg (AirFedAvg) algorithms under both convex and non- convex settings.
For different types of local updates that can be transmitted by edge devices (i.e., model, gradient, model difference), we reveal that transmitting in AirFedAvg may cause an aggregation error.
In addition, we consider more practical signal processing schemes to improve the communication efficiency and extend the convergence analysis to different forms of model aggregation error caused by these signal processing schemes.
arXiv Detail & Related papers (2023-10-16T05:49:28Z) - Adaptive Model Pruning and Personalization for Federated Learning over
Wireless Networks [72.59891661768177]
Federated learning (FL) enables distributed learning across edge devices while protecting data privacy.
We consider a FL framework with partial model pruning and personalization to overcome these challenges.
This framework splits the learning model into a global part with model pruning shared with all devices to learn data representations and a personalized part to be fine-tuned for a specific device.
arXiv Detail & Related papers (2023-09-04T21:10:45Z) - Newell's theory based feature transformations for spatio-temporal
traffic prediction [0.0]
We propose a traffic flow physics-based transformation feature for Deep learning (DL) models for traffic flow forecasting.
This transformation incorporates Newell's uncongested and congested filters of traffic flows at the target locations, enabling the models to learn broader dynamics of the system.
An important advantage of our framework is its ability to be transferred to new locations where data is unavailable.
arXiv Detail & Related papers (2023-07-12T06:31:43Z) - Online Spatio-Temporal Correlation-Based Federated Learning for Traffic
Flow Forecasting [11.253575460227127]
In this paper, we perform the first study of forecasting traffic flow adopting Online Learning (OL) manner in FL framework.
We then propose a novel prediction method named Online Spatio-Temporal Correlation-based Federated Learning (FedOSTC) to guarantee performance gains regardless of traffic fluctuation.
arXiv Detail & Related papers (2023-02-17T02:37:36Z) - TSSRGCN: Temporal Spectral Spatial Retrieval Graph Convolutional Network
for Traffic Flow Forecasting [41.87633457352356]
This paper proposes a neural network model that focuses on the globality and locality of traffic networks.
Experiments on two real-world datasets show that the model can scrutinize the spatial-temporal correlation of traffic data.
arXiv Detail & Related papers (2020-11-30T09:21:43Z) - Over-the-Air Federated Learning from Heterogeneous Data [107.05618009955094]
Federated learning (FL) is a framework for distributed learning of centralized models.
We develop a Convergent OTA FL (COTAF) algorithm which enhances the common local gradient descent (SGD) FL algorithm.
We numerically show that the precoding induced by COTAF notably improves the convergence rate and the accuracy of models trained via OTA FL.
arXiv Detail & Related papers (2020-09-27T08:28:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.