MoE Enhanced Federated Learning for Spatiotemporal Prediction

• URL: http://arxiv.org/abs/2606.10499v1
• Date: Tue, 09 Jun 2026 07:23:27 GMT
• Title: MoE Enhanced Federated Learning for Spatiotemporal Prediction
• Abstract summary: Cross-city knowledge transfer has attracted increasing attention, enabling data-rich cities to assist data-scarce ones.<n>MoE-FedTP is a personalized cross-citytemporal prediction framework based on lightweight Mixture-of-temporal (MoE) networks.<n>Experiments on four real-world traffic datasets show that MoE-FedTP consistently outperforms state-of-the-art cross-city and federated learning baselines.
• Score: 24.621321837905423
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Traffic prediction is fundamental to intelligent transportation systems and urban computing, yet many cities continue to suffer from traffic data scarcity due to limited sensor deployment and uneven urban development. Cross-city knowledge transfer has thus attracted increasing attention, enabling data-rich cities to assist data-scarce ones. However, centralized approaches raise privacy concerns, while existing federated methods struggle with pronounced spatiotemporal heterogeneity across cities. To address these challenges, we propose MoE-FedTP, a personalized federated cross-city spatiotemporal prediction framework based on lightweight Mixture-of-Experts (MoE) networks. MoE-FedTP first employs spatiotemporal neural networks to extract features from both source and target cities, then introduces a set of expert networks derived from different source cities through partial parameter sharing. A gating mechanism dynamically fuses the experts to capture diverse traffic dynamics, achieving fine-grained modeling of urban heterogeneity while preserving privacy. Experiments on four real-world traffic datasets show that MoE-FedTP consistently outperforms state-of-the-art cross-city and federated learning baselines, demonstrating its effectiveness in enhancing prediction accuracy for data-scarce cities.

Related papers

• Wireless Traffic Prediction with Large Language Model [54.07581399989292]
  TIDES is a novel framework that captures spatial-temporal correlations for wireless traffic prediction.<n> TIDES achieves efficient adaptation to domain-specific patterns without incurring excessive training overhead.<n>Our results indicate that integrating spatial awareness into LLM-based predictors is the key to unlocking scalable and intelligent network management in future 6G systems.
  arXiv  Detail & Related papers  (2025-12-19T04:47:40Z)
• A Pretrained Probabilistic Transformer for City-Scale Traffic Volume Prediction [8.384075654211685]
  City-scale traffic volume prediction plays a pivotal role in intelligent transportation systems.<n>Current models are typically trained in a city-specific manner, which hinders their generalizability.<n>We introduce TrafficPPT, a Pretrained Probabilistic Transformer designed to model traffic volume as a distributional aggregation of trajectories.
  arXiv  Detail & Related papers  (2025-06-03T09:07:29Z)
• Causality Enhanced Origin-Destination Flow Prediction in Data-Scarce Cities [13.436303786475348]
  We propose a novel Causality-Enhanced OD Flow Prediction (CE-OFP) framework to transfer urban knowledge between cities.<n>The proposed CE-OFP remarkably outperforms state-of-the-art baselines, which can reduce the RMSE of OD flow prediction for data-scarce cities by up to 11%.
  arXiv  Detail & Related papers  (2025-03-09T02:36:36Z)
• Collaborative Imputation of Urban Time Series through Cross-city Meta-learning [54.438991949772145]
  We propose a novel collaborative imputation paradigm leveraging meta-learned implicit neural representations (INRs)<n>We then introduce a cross-city collaborative learning scheme through model-agnostic meta learning.<n>Experiments on a diverse urban dataset from 20 global cities demonstrate our model's superior imputation performance and generalizability.
  arXiv  Detail & Related papers  (2025-01-20T07:12:40Z)
• Urban traffic analysis and forecasting through shared Koopman eigenmodes [5.207485728774798]
  Predicting traffic flow in data-scarce cities is challenging due to limited historical data.<n>We leverage transfer learning by identifying periodic patterns common to data-rich cities.<n>This method uncovers common eigenmodes (urban heartbeats) in traffic patterns and transfers them to data-scarce cities.
  arXiv  Detail & Related papers  (2024-09-07T06:24:50Z)
• Harnessing LLMs for Cross-City OD Flow Prediction [5.6685153523382015]
  We introduce a new method for cross-city Origin-Destination (OD) flow prediction using Large Language Models (LLMs) Our approach leverages the advanced semantic understanding and contextual learning capabilities of LLMs to bridge the gap between cities with different characteristics. Our novel framework involves four major components: collecting OD training datasets from a source city, instruction-tuning the LLMs, predicting destination POIs in a target city, and identifying the locations that best match the predicted destination POIs.
  arXiv  Detail & Related papers  (2024-09-05T23:04:28Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Interpretable Cascading Mixture-of-Experts for Urban Traffic Congestion Prediction [24.26429523848735]
  Rapid urbanization has significantly escalated traffic congestion, underscoring the need for advanced congestion prediction services. We introduce a Congestion Prediction Mixture-of-Experts, CP-MoE, to address the challenges. CP-MoE has been deployed in DiDi to improve the accuracy and reliability of the travel time estimation system.
  arXiv  Detail & Related papers  (2024-06-14T12:57:17Z)
• Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach [71.67506068703314]
  Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
  arXiv  Detail & Related papers  (2023-12-04T07:39:05Z)
• Uncertainty Quantification for Image-based Traffic Prediction across Cities [63.136794104678025]
  Uncertainty quantification (UQ) methods provide an approach to induce probabilistic reasoning. We investigate their application to a large-scale image-based traffic dataset spanning multiple cities. We find that our approach can capture both temporal and spatial effects on traffic behaviour in a representative case study for the city of Moscow.
  arXiv  Detail & Related papers  (2023-08-11T13:35:52Z)
• Spatio-Temporal Graph Few-Shot Learning with Cross-City Knowledge Transfer [58.6106391721944]
  Cross-city knowledge has shown its promise, where the model learned from data-sufficient cities is leveraged to benefit the learning process of data-scarce cities. We propose a model-agnostic few-shot learning framework for S-temporal graph called ST-GFSL. We conduct comprehensive experiments on four traffic speed prediction benchmarks and the results demonstrate the effectiveness of ST-GFSL compared with state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-05-27T12:46:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.