COLA: Cross-city Mobility Transformer for Human Trajectory Simulation
- URL: http://arxiv.org/abs/2403.01801v1
- Date: Mon, 4 Mar 2024 07:45:29 GMT
- Title: COLA: Cross-city Mobility Transformer for Human Trajectory Simulation
- Authors: Yu Wang, Tongya Zheng, Yuxuan Liang, Shunyu Liu, Mingli Song
- Abstract summary: We develop a Cross-city mObiLity trAnsformer (COLA) with a dedicated model-agnostic transfer framework.
COLA divides the Transformer into the private modules for city-specific characteristics and the shared modules for city-universal mobility patterns.
Our implemented cross-city baselines have demonstrated its superiority and effectiveness.
- Score: 44.157114416533915
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Human trajectory data produced by daily mobile devices has proven its
usefulness in various substantial fields such as urban planning and epidemic
prevention. In terms of the individual privacy concern, human trajectory
simulation has attracted increasing attention from researchers, targeting at
offering numerous realistic mobility data for downstream tasks. Nevertheless,
the prevalent issue of data scarcity undoubtedly degrades the reliability of
existing deep learning models. In this paper, we are motivated to explore the
intriguing problem of mobility transfer across cities, grasping the universal
patterns of human trajectories to augment the powerful Transformer with
external mobility data. There are two crucial challenges arising in the
knowledge transfer across cities: 1) how to transfer the Transformer to adapt
for domain heterogeneity; 2) how to calibrate the Transformer to adapt for
subtly different long-tail frequency distributions of locations. To address
these challenges, we have tailored a Cross-city mObiLity trAnsformer (COLA)
with a dedicated model-agnostic transfer framework by effectively transferring
cross-city knowledge for human trajectory simulation. Firstly, COLA divides the
Transformer into the private modules for city-specific characteristics and the
shared modules for city-universal mobility patterns. Secondly, COLA leverages a
lightweight yet effective post-hoc adjustment strategy for trajectory
simulation, without disturbing the complex bi-level optimization of
model-agnostic knowledge transfer. Extensive experiments of COLA compared to
state-of-the-art single-city baselines and our implemented cross-city baselines
have demonstrated its superiority and effectiveness. The code is available at
https://github.com/Star607/Cross-city-Mobility-Transformer.
Related papers
- Mitigating Covariate Shift in Imitation Learning for Autonomous Vehicles Using Latent Space Generative World Models [60.87795376541144]
A world model is a neural network capable of predicting an agent's next state given past states and actions.
During end-to-end training, our policy learns how to recover from errors by aligning with states observed in human demonstrations.
We present qualitative and quantitative results, demonstrating significant improvements upon prior state of the art in closed-loop testing.
arXiv Detail & Related papers (2024-09-25T06:48:25Z) - Deep Activity Model: A Generative Approach for Human Mobility Pattern Synthesis [11.90100976089832]
We develop a novel generative deep learning approach for human mobility modeling and synthesis.
It incorporates both activity patterns and location trajectories using open-source data.
The model can be fine-tuned with local data, allowing it to adapt to accurately represent mobility patterns across diverse regions.
arXiv Detail & Related papers (2024-05-24T02:04:10Z) - TransFlower: An Explainable Transformer-Based Model with Flow-to-Flow
Attention for Commuting Flow Prediction [18.232085070775835]
We introduce TransFlower, an explainable, transformer-based model employing flow-to-flow attention to predict commuting patterns.
Our model outperforms existing methods by up to 30.8% Common Part of Commuters.
arXiv Detail & Related papers (2024-02-23T16:00:04Z) - MobilityGPT: Enhanced Human Mobility Modeling with a GPT model [12.01839817432357]
We reformat human mobility modeling as an autoregressive generation task to address these issues.
We propose a geospatially-aware generative model, MobilityGPT, to ensure its controllable generation.
Experiments on real-world datasets demonstrate MobilityGPT's superior performance over state-of-the-art methods.
arXiv Detail & Related papers (2024-02-05T18:22:21Z) - Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series
Forecasting Approach [71.67506068703314]
Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services.
Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels.
In our research, we introduce a fresh perspective on urban mobility prediction.
Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
arXiv Detail & Related papers (2023-12-04T07:39:05Z) - Leveraging the Power of Data Augmentation for Transformer-based Tracking [64.46371987827312]
We propose two data augmentation methods customized for tracking.
First, we optimize existing random cropping via a dynamic search radius mechanism and simulation for boundary samples.
Second, we propose a token-level feature mixing augmentation strategy, which enables the model against challenges like background interference.
arXiv Detail & Related papers (2023-09-15T09:18:54Z) - Emergent Agentic Transformer from Chain of Hindsight Experience [96.56164427726203]
We show that a simple transformer-based model performs competitively with both temporal-difference and imitation-learning-based approaches.
This is the first time that a simple transformer-based model performs competitively with both temporal-difference and imitation-learning-based approaches.
arXiv Detail & Related papers (2023-05-26T00:43:02Z) - Continuous Trajectory Generation Based on Two-Stage GAN [50.55181727145379]
We propose a novel two-stage generative adversarial framework to generate the continuous trajectory on the road network.
Specifically, we build the generator under the human mobility hypothesis of the A* algorithm to learn the human mobility behavior.
For the discriminator, we combine the sequential reward with the mobility yaw reward to enhance the effectiveness of the generator.
arXiv Detail & Related papers (2023-01-16T09:54:02Z) - Sim-to-Real Transfer for Quadrupedal Locomotion via Terrain Transformer [31.581743045813557]
We propose a high-capacity Transformer model for quadrupedal locomotion control on various terrains.
To better leverage Transformer in sim-to-real scenarios, we present a novel two-stage training framework consisting of an offline pretraining stage and an online correction stage.
Experiments in simulation demonstrate that TERT outperforms state-of-the-art baselines on different terrains in terms of return, energy consumption and control smoothness.
arXiv Detail & Related papers (2022-12-15T11:44:11Z) - Online Trajectory Prediction for Metropolitan Scale Mobility Digital
Twin [13.07036447576714]
Knowing "what is happening" and "what will happen" of the mobility in a city is the building block of a data-driven smart city system.
We propose a two-stage human mobility predictor that stratifies the coarse and fine-grained level predictions.
We tested our method using a real-world mobile phone GPS dataset in the Kanto area in Japan.
arXiv Detail & Related papers (2022-06-21T11:34:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.