ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mobility Prediction

• URL: http://arxiv.org/abs/2410.14099v1
• Date: Fri, 18 Oct 2024 00:32:18 GMT
• Title: ST-MoE-BERT: A Spatial-Temporal Mixture-of-Experts Framework for Long-Term Cross-City Mobility Prediction
• Authors: Haoyu He, Haozheng Luo, Qi R. Wang,
• Abstract summary: We propose a robust approach to predict human mobility patterns called ST-MoE-BERT. Our methodology integrates the Mixture-of-Experts architecture with BERT model to capture complex mobility dynamics. We demonstrate the effectiveness of the proposed model on GEO-BLEU and DTW, comparing it to several state-of-the-art methods.
• Score: 6.0588503913405045
• License:
• Abstract: Predicting human mobility across multiple cities presents significant challenges due to the complex and diverse spatial-temporal dynamics inherent in different urban environments. In this study, we propose a robust approach to predict human mobility patterns called ST-MoE-BERT. Compared to existing methods, our approach frames the prediction task as a spatial-temporal classification problem. Our methodology integrates the Mixture-of-Experts architecture with BERT model to capture complex mobility dynamics and perform the downstream human mobility prediction task. Additionally, transfer learning is integrated to solve the challenge of data scarcity in cross-city prediction. We demonstrate the effectiveness of the proposed model on GEO-BLEU and DTW, comparing it to several state-of-the-art methods. Notably, ST-MoE-BERT achieves an average improvement of 8.29%.

Related papers

• SMA-Hyper: Spatiotemporal Multi-View Fusion Hypergraph Learning for Traffic Accident Prediction [2.807532512532818]
  Current data-driven models often struggle with data sparsity and the integration of diverse urban data sources. We introduce a deep dynamic learning framework designed for traffic accident prediction. It incorporates dual adaptive graph learning mechanisms that enable high-order cross-regional learning. It also employs an advance attention mechanism to fuse multiple views of accident data and urban functional features.
  arXiv  Detail & Related papers  (2024-07-24T21:10:34Z)
• Physics-guided Active Sample Reweighting for Urban Flow Prediction [75.24539704456791]
  Urban flow prediction is a nuanced-temporal modeling that estimates the throughput of transportation services like buses, taxis and ride-driven models. Some recent prediction solutions bring remedies with the notion of physics-guided machine learning (PGML) We develop a atized physics-guided network (PN), and propose a data-aware framework Physics-guided Active Sample Reweighting (P-GASR)
  arXiv  Detail & Related papers  (2024-07-18T15:44:23Z)
• Multi-Modality Spatio-Temporal Forecasting via Self-Supervised Learning [11.19088022423885]
  We propose a novel MoST learning framework via Self-Supervised Learning, namely MoSSL. Results on two real-world MoST datasets verify the superiority of our approach compared with the state-of-the-art baselines.
  arXiv  Detail & Related papers  (2024-05-06T08:24:06Z)
• Mixing Individual and Collective Behaviours to Predict Out-of-Routine Mobility [4.442030973972382]
  This study introduces an approach that dynamically integrates individual and collective mobility behaviours. We demonstrate its superior performance in predicting out-of-routine mobility, surpassing even advanced deep learning methods. By bridging the gap between individual and collective behaviours, our approach offers transparent and accurate predictions.
  arXiv  Detail & Related papers  (2024-04-03T13:38:49Z)
• MobilityGPT: Enhanced Human Mobility Modeling with a GPT model [12.01839817432357]
  We reformat human mobility modeling as an autoregressive generation task to address these issues. We propose a geospatially-aware generative model, MobilityGPT, to ensure its controllable generation. Experiments on real-world datasets demonstrate MobilityGPT's superior performance over state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-05T18:22:21Z)
• Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach [71.67506068703314]
  Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
  arXiv  Detail & Related papers  (2023-12-04T07:39:05Z)
• Contextualizing MLP-Mixers Spatiotemporally for Urban Data Forecast at Scale [54.15522908057831]
  We propose an adapted version of the computationally-Mixer for STTD forecast at scale. Our results surprisingly show that this simple-yeteffective solution can rival SOTA baselines when tested on several traffic benchmarks. Our findings contribute to the exploration of simple-yet-effective models for real-world STTD forecasting.
  arXiv  Detail & Related papers  (2023-07-04T05:19:19Z)
• STORM-GAN: Spatio-Temporal Meta-GAN for Cross-City Estimation of Human Mobility Responses to COVID-19 [17.611056163940404]
  We make the first attempt to tackle the cross-city human mobility estimation problem through a deep meta-generative framework. We propose a S-Temporal Meta-Generative Adrial Network (STORM-GAN) model that estimates dynamic human mobility responses. We show that the proposed approach can greatly improve estimation performance and out-perform baselines.
  arXiv  Detail & Related papers  (2023-01-20T15:55:41Z)
• Continuous Trajectory Generation Based on Two-Stage GAN [50.55181727145379]
  We propose a novel two-stage generative adversarial framework to generate the continuous trajectory on the road network. Specifically, we build the generator under the human mobility hypothesis of the A* algorithm to learn the human mobility behavior. For the discriminator, we combine the sequential reward with the mobility yaw reward to enhance the effectiveness of the generator.
  arXiv  Detail & Related papers  (2023-01-16T09:54:02Z)
• Safety-compliant Generative Adversarial Networks for Human Trajectory Forecasting [95.82600221180415]
  Human forecasting in crowds presents the challenges of modelling social interactions and outputting collision-free multimodal distribution. We introduce SGANv2, an improved safety-compliant SGAN architecture equipped with motion-temporal interaction modelling and a transformer-based discriminator design.
  arXiv  Detail & Related papers  (2022-09-25T15:18:56Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.