Pretrained Mobility Transformer: A Foundation Model for Human Mobility

• URL: http://arxiv.org/abs/2406.02578v1
• Date: Wed, 29 May 2024 00:07:22 GMT
• Title: Pretrained Mobility Transformer: A Foundation Model for Human Mobility
• Authors: Xinhua Wu, Haoyu He, Yanchao Wang, Qi Wang,
• Abstract summary: textbfPretrained textbfMobility textbfTransformer (PMT) textbfMobility textbfTransformer (PMT) textbfPretrained textbfMobility textbfTransformer (PMT)
• Score: 11.713796525742405
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Ubiquitous mobile devices are generating vast amounts of location-based service data that reveal how individuals navigate and utilize urban spaces in detail. In this study, we utilize these extensive, unlabeled sequences of user trajectories to develop a foundation model for understanding urban space and human mobility. We introduce the \textbf{P}retrained \textbf{M}obility \textbf{T}ransformer (PMT), which leverages the transformer architecture to process user trajectories in an autoregressive manner, converting geographical areas into tokens and embedding spatial and temporal information within these representations. Experiments conducted in three U.S. metropolitan areas over a two-month period demonstrate PMT's ability to capture underlying geographic and socio-demographic characteristics of regions. The proposed PMT excels across various downstream tasks, including next-location prediction, trajectory imputation, and trajectory generation. These results support PMT's capability and effectiveness in decoding complex patterns of human mobility, offering new insights into urban spatial functionality and individual mobility preferences.

Related papers

• Multimodal Contrastive Learning of Urban Space Representations from POI Data [2.695321027513952]
  CaLLiPer (Contrastive Language-Location Pre-training) is a representation learning model that embeds continuous urban spaces into vector representations. We validate CaLLiPer's effectiveness by applying it to learning urban space representations in London, UK.
  arXiv  Detail & Related papers  (2024-11-09T16:24:07Z)
• Multi-Transmotion: Pre-trained Model for Human Motion Prediction [68.87010221355223]
  Multi-Transmotion is an innovative transformer-based model designed for cross-modality pre-training. Our methodology demonstrates competitive performance across various datasets on several downstream tasks.
  arXiv  Detail & Related papers  (2024-11-04T23:15:21Z)
• Digital Twin Mobility Profiling: A Spatio-Temporal Graph Learning Approach [9.56255685195115]
  Mobility profiling can extract potential patterns in urban traffic from mobility data. Digital twin (DT) technology paves the way for cost-effective and performance-optimised management. We propose a digital twin mobility profiling framework to learn node profiles on a mobilitytemporal network DT model.
  arXiv  Detail & Related papers  (2024-02-06T06:37:43Z)
• MobilityGPT: Enhanced Human Mobility Modeling with a GPT model [12.01839817432357]
  We reformat human mobility modeling as an autoregressive generation task to address these issues. We propose a geospatially-aware generative model, MobilityGPT, to ensure its controllable generation. Experiments on real-world datasets demonstrate MobilityGPT's superior performance over state-of-the-art methods.
  arXiv  Detail & Related papers  (2024-02-05T18:22:21Z)
• Rethinking Urban Mobility Prediction: A Super-Multivariate Time Series Forecasting Approach [71.67506068703314]
  Long-term urban mobility predictions play a crucial role in the effective management of urban facilities and services. Traditionally, urban mobility data has been structured as videos, treating longitude and latitude as fundamental pixels. In our research, we introduce a fresh perspective on urban mobility prediction. Instead of oversimplifying urban mobility data as traditional video data, we regard it as a complex time series.
  arXiv  Detail & Related papers  (2023-12-04T07:39:05Z)
• A generalized vector-field framework for mobility [0.0]
  We propose a general vector-field representation starting from individuals' trajectories valid for any type of mobility. We show how individuals' elections determine the mesoscopic properties of the mobility field. Our framework is an essential tool to capture hidden symmetries in mesoscopic urban mobility.
  arXiv  Detail & Related papers  (2023-09-04T07:50:08Z)
• Unified Data Management and Comprehensive Performance Evaluation for Urban Spatial-Temporal Prediction [Experiment, Analysis & Benchmark] [78.05103666987655]
  This work addresses challenges in accessing and utilizing diverse urban spatial-temporal datasets. We introduceatomic files, a unified storage format designed for urban spatial-temporal big data, and validate its effectiveness on 40 diverse datasets. We conduct extensive experiments using diverse models and datasets, establishing a performance leaderboard and identifying promising research directions.
  arXiv  Detail & Related papers  (2023-08-24T16:20:00Z)
• Adaptive Hierarchical SpatioTemporal Network for Traffic Forecasting [70.66710698485745]
  We propose an Adaptive Hierarchical SpatioTemporal Network (AHSTN) to promote traffic forecasting. AHSTN exploits the spatial hierarchy and modeling multi-scale spatial correlations. Experiments on two real-world datasets show that AHSTN achieves better performance over several strong baselines.
  arXiv  Detail & Related papers  (2023-06-15T14:50:27Z)
• Urban Regional Function Guided Traffic Flow Prediction [117.75679676806296]
  We propose a novel module named POI-MetaBlock, which utilizes the functionality of each region as metadata. Our module significantly improves the performance of traffic flow prediction and outperforms state-of-the-art methods that use metadata.
  arXiv  Detail & Related papers  (2023-03-17T06:03:49Z)
• Multi-Graph Fusion Networks for Urban Region Embedding [40.97361959702485]
  Learning embeddings for urban regions from human mobility data can reveal the functionality of regions, and then enables correlated but distinct tasks such as crime prediction. We propose multi-graph fusion networks (MGFN) to enable the cross domain prediction tasks. Experimental results demonstrate that the proposed MGFN outperforms the state-of-the-art methods by up to 12.35%.
  arXiv  Detail & Related papers  (2022-01-24T15:48:50Z)
• Methodological Foundation of a Numerical Taxonomy of Urban Form [62.997667081978825]
  We present a method for numerical taxonomy of urban form derived from biological systematics. We derive homogeneous urban tissue types and, by determining overall morphological similarity between them, generate a hierarchical classification of urban form. After framing and presenting the method, we test it on two cities - Prague and Amsterdam.
  arXiv  Detail & Related papers  (2021-04-30T12:47:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.