UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces

• URL: http://arxiv.org/abs/2411.03859v3
• Date: Mon, 29 Sep 2025 09:43:00 GMT
• Title: UniTraj: Learning a Universal Trajectory Foundation Model from Billion-Scale Worldwide Traces
• Authors: Yuanshao Zhu, James Jianqiao Yu, Xiangyu Zhao, Xun Zhou, Liang Han, Xuetao Wei, Yuxuan Liang,
• Abstract summary: Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches.<n>We introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations.<n>First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries.
• Score: 64.24594320103066
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Building a universal trajectory foundation model is a promising solution to address the limitations of existing trajectory modeling approaches, such as task specificity, regional dependency, and data sensitivity. Despite its potential, data preparation, pre-training strategy development, and architectural design present significant challenges in constructing this model. Therefore, we introduce UniTraj, a Universal Trajectory foundation model that aims to address these limitations through three key innovations. First, we construct WorldTrace, an unprecedented dataset of 2.45 million trajectories with billions of GPS points spanning 70 countries, providing the diverse geographic coverage essential for region-independent modeling. Second, we develop novel pre-training strategies--Adaptive Trajectory Resampling and Self-supervised Trajectory Masking--that enable robust learning from heterogeneous trajectory data with varying sampling rates and quality. Finally, we tailor a flexible model architecture to accommodate a variety of trajectory tasks, effectively capturing complex movement patterns to support broad applicability. Extensive experiments across multiple tasks and real-world datasets demonstrate that UniTraj consistently outperforms existing methods, exhibiting superior scalability, adaptability, and generalization, with WorldTrace serving as an ideal yet non-exclusive training resource.

Related papers

• SAIL-Embedding Technical Report: Omni-modal Embedding Foundation Model [49.65930977591188]
  Multimodal embedding models aim to yield informative unified representations that empower diverse cross-modal tasks.<n>We introduce SAIL-Embedding, an omni-modal embedding foundation model that addresses these issues through tailored training strategies and architectural design.<n>Specifically, the content-aware progressive training aims to enhance the model's adaptability to diverse downstream tasks and master enriched cross-modal proficiency.<n>The collaboration-aware recommendation enhancement training further adapts multimodal representations for recommendation scenarios by distilling knowledge from sequence-to-item and ID-to-item embeddings.
  arXiv  Detail & Related papers  (2025-10-14T16:43:22Z)
• Universal Retrieval for Multimodal Trajectory Modeling [12.160448446091607]
  Trajectory data holds significant potential for enhancing AI agent capabilities.<n>We introduce Multimodal Trajectory Retrieval, bridging the gap between universal retrieval and agent-centric trajectory modeling.
  arXiv  Detail & Related papers  (2025-06-27T09:50:38Z)
• Generalized and Personalized Federated Learning with Foundation Models via Orthogonal Transformations [4.008780119020479]
  Federated Learning aims to train models across decentralized clients or devices holding local data without the need for centralized data collection.<n>We introduce FedOT, a novel approach that leverages black-box foundation models.<n>FedOT mitigates gradient conflicts across diverse clients, preserves semantic integrity, and achieves robust performance even in the presence of substantial data.
  arXiv  Detail & Related papers  (2025-05-26T12:18:24Z)
• UniSTD: Towards Unified Spatio-Temporal Learning across Diverse Disciplines [64.84631333071728]
  We introduce bfUnistage, a unified Transformer-based framework fortemporal modeling.<n>Our work demonstrates that a task-specific vision-text can build a generalizable model fortemporal learning.<n>We also introduce a temporal module to incorporate temporal dynamics explicitly.
  arXiv  Detail & Related papers  (2025-03-26T17:33:23Z)
• Trajectory World Models for Heterogeneous Environments [67.27233466954814]
  Heterogeneity in sensors and actuators across environments poses a significant challenge to building large-scale pre-trained world models. We introduce UniTraj, a unified dataset comprising over one million trajectories from 80 environments, designed to scale data while preserving critical diversity. We propose TrajWorld, a novel architecture capable of flexibly handling varying sensor and actuator information and capturing environment dynamics in-context.
  arXiv  Detail & Related papers  (2025-02-03T13:59:08Z)
• One Fits All: General Mobility Trajectory Modeling via Masked Conditional Diffusion [11.373845190033297]
  Trajectory data play a crucial role in many applications, ranging from network optimization to urban planning. Existing studies on trajectory data are task-specific, and their applicability is limited to the specific tasks on which they have been trained, such as generation, recovery, or prediction. We propose a general trajectory modeling framework via conditional diffusion (named GenMove) Our model significantly outperforms state-of-the-art baselines, with the highest performance exceeding 13% improvement in generation tasks.
  arXiv  Detail & Related papers  (2025-01-23T03:13:45Z)
• TrajLearn: Trajectory Prediction Learning using Deep Generative Models [4.097342535693401]
  Trajectory prediction aims to estimate an entity's future path using its current position and historical movement data. To address these challenges, we introduce TrajLearn, a novel model for trajectory prediction. TrajLearn predicts the next $k$ steps by integrating a customized beam search for exploring multiple potential paths.
  arXiv  Detail & Related papers  (2024-12-30T23:38:52Z)
• A Wave is Worth 100 Words: Investigating Cross-Domain Transferability in Time Series [13.555837288440946]
  This paper proposes a novel cross-domain pretraining method based on Wave Quantization (termed as WQ4TS) We transfer the time series data from different domains into a common spectral latent space, and enable the model to learn the temporal pattern knowledge of different domains directly from the common space. The proposed WQ4TS achieves the best performance on 87.5% of all tasks, and the average improvement of the metrics on all the tasks is up to 34.7%.
  arXiv  Detail & Related papers  (2024-12-01T11:35:06Z)
• TrajAgent: An LLM-Agent Framework for Trajectory Modeling via Large-and-Small Model Collaboration [10.000248410171269]
  Trajectory modeling has widespread applications in areas such as life services, urban transportation, and public administration.<n>In this paper, we propose TrajAgent, an agent framework powered by large language models, to facilitate robust and efficient trajectory modeling.<n>In experiments on five tasks using four real-world datasets, TrajAgent achieved a performance improvement of 2.38%-69.91% over baseline methods.
  arXiv  Detail & Related papers  (2024-10-27T13:51:09Z)
• Uni$^2$Det: Unified and Universal Framework for Prompt-Guided Multi-dataset 3D Detection [64.08296187555095]
  Uni$2$Det is a framework for unified and universal multi-dataset training on 3D detection. We introduce multi-stage prompting modules for multi-dataset 3D detection. Results on zero-shot cross-dataset transfer validate the generalization capability of our proposed method.
  arXiv  Detail & Related papers  (2024-09-30T17:57:50Z)
• Transferable Unsupervised Outlier Detection Framework for Human Semantic Trajectories [9.816270572121724]
  We propose Transferable Outlier Detection for Human Semantic Trajectories (TOD4Traj) framework. ToD4Traj first introduces a modality feature unification module to align diverse data feature representations. A contrastive learning module is further pro-posed for identifying regular mobility patterns both temporally and across populations.
  arXiv  Detail & Related papers  (2024-09-28T22:31:00Z)
• ControlTraj: Controllable Trajectory Generation with Topology-Constrained Diffusion Model [39.0442700565278]
  ControlTraj is a Controllable Trajectory generation framework with the topology-constrained diffusion model. We develop a novel road segment autoencoder to extract fine-grained road segment embedding. The encoded features, along with trip attributes, are subsequently merged into the proposed geographic denoising UNet architecture.
  arXiv  Detail & Related papers  (2024-04-23T09:42:45Z)
• SilverSight: A Multi-Task Chinese Financial Large Language Model Based on Adaptive Semantic Space Learning [4.540505713937026]
  This study introduces an Adaptive Semantic Space Learning (ASSL) framework to enhance the performance and selection efficacy of multi-expert models. Our research findings demonstrate that our framework can achieve results close to those obtained with full data training using only 10% of the data, while also exhibiting strong generalization capabilities.
  arXiv  Detail & Related papers  (2024-04-07T13:02:21Z)
• AgentOhana: Design Unified Data and Training Pipeline for Effective Agent Learning [98.26836657967162]
  textbfAgentOhana aggregates agent trajectories from distinct environments, spanning a wide array of scenarios. textbfxLAM-v0.1, a large action model tailored for AI agents, demonstrates exceptional performance across various benchmarks.
  arXiv  Detail & Related papers  (2024-02-23T18:56:26Z)
• Federated Learning with Projected Trajectory Regularization [65.6266768678291]
  Federated learning enables joint training of machine learning models from distributed clients without sharing their local data. One key challenge in federated learning is to handle non-identically distributed data across the clients. We propose a novel federated learning framework with projected trajectory regularization (FedPTR) for tackling the data issue.
  arXiv  Detail & Related papers  (2023-12-22T02:12:08Z)
• Towards A Foundation Model For Trajectory Intelligence [0.0]
  We present the results of training a large trajectory model using real-world user check-in data. Our approach follows a pre-train and fine-tune paradigm, where a base model is pre-trained via masked trajectory modeling. Our empirical analysis utilizes a comprehensive dataset of over 2 billion check-ins generated by more than 6 million users.
  arXiv  Detail & Related papers  (2023-11-30T00:34:09Z)
• UnitedHuman: Harnessing Multi-Source Data for High-Resolution Human Generation [59.77275587857252]
  A holistic human dataset inevitably has insufficient and low-resolution information on local parts. We propose to use multi-source datasets with various resolution images to jointly learn a high-resolution human generative model.
  arXiv  Detail & Related papers  (2023-09-25T17:58:46Z)
• Towards Efficient Task-Driven Model Reprogramming with Foundation Models [52.411508216448716]
  Vision foundation models exhibit impressive power, benefiting from the extremely large model capacity and broad training data. However, in practice, downstream scenarios may only support a small model due to the limited computational resources or efficiency considerations. This brings a critical challenge for the real-world application of foundation models: one has to transfer the knowledge of a foundation model to the downstream task.
  arXiv  Detail & Related papers  (2023-04-05T07:28:33Z)
• A General Purpose Neural Architecture for Geospatial Systems [142.43454584836812]
  We present a roadmap towards the construction of a general-purpose neural architecture (GPNA) with a geospatial inductive bias. We envision how such a model may facilitate cooperation between members of the community.
  arXiv  Detail & Related papers  (2022-11-04T09:58:57Z)
• Multi-Level Branched Regularization for Federated Learning [46.771459325434535]
  We propose a novel architectural regularization technique that constructs multiple auxiliary branches in each local model by grafting local and globalworks at several different levels. We demonstrate remarkable performance gains in terms of accuracy and efficiency compared to existing methods.
  arXiv  Detail & Related papers  (2022-07-14T13:59:26Z)
• DRFLM: Distributionally Robust Federated Learning with Inter-client Noise via Local Mixup [58.894901088797376]
  federated learning has emerged as a promising approach for training a global model using data from multiple organizations without leaking their raw data. We propose a general framework to solve the above two challenges simultaneously. We provide comprehensive theoretical analysis including robustness analysis, convergence analysis, and generalization ability.
  arXiv  Detail & Related papers  (2022-04-16T08:08:29Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.