Adaptive Location Hierarchy Learning for Long-Tailed Mobility Prediction
- URL: http://arxiv.org/abs/2505.19965v1
- Date: Mon, 26 May 2025 13:26:35 GMT
- Title: Adaptive Location Hierarchy Learning for Long-Tailed Mobility Prediction
- Authors: Yu Wang, Junshu Dai, Yuchen Ying, Yuxuan Liang, Tongya Zheng, Mingli Song,
- Abstract summary: We propose a plug-and-play framework for long-tailed mobility prediction in an exploitation and exploration manner.<n>First, we construct city-tailored location hierarchy based on Large Language Models (LLMs) by exploiting Maslow's theory of human motivation.<n>Experiments on state-of-the-art models across six datasets demonstrate the framework's consistent effectiveness and generalizability.
- Score: 37.930452438916795
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human mobility prediction is crucial for applications ranging from location-based recommendations to urban planning, which aims to forecast users' next location visits based on historical trajectories. Despite the severe long-tailed distribution of locations, the problem of long-tailed mobility prediction remains largely underexplored. Existing long-tailed learning methods primarily focus on rebalancing the skewed distribution at the data, model, or class level, neglecting to exploit the spatiotemporal semantics of locations. To address this gap, we propose the first plug-and-play framework for long-tailed mobility prediction in an exploitation and exploration manner, named \textbf{A}daptive \textbf{LO}cation \textbf{H}ier\textbf{A}rchy learning (ALOHA). First, we construct city-tailored location hierarchy based on Large Language Models (LLMs) by exploiting Maslow's theory of human motivation to design Chain-of-Thought (CoT) prompts that captures spatiotemporal semantics. Second, we optimize the location hierarchy predictions by Gumbel disturbance and node-wise adaptive weights within the hierarchical tree structure. Experiments on state-of-the-art models across six datasets demonstrate the framework's consistent effectiveness and generalizability, which strikes a well balance between head and tail locations. Weight analysis and ablation studies reveal the optimization differences of each component for head and tail locations. Furthermore, in-depth analyses of hierarchical distance and case study demonstrate the effective semantic guidance from the location hierarchy. Our code will be made publicly available.
Related papers
- On Multi-Step Theorem Prediction via Non-Parametric Structural Priors [50.16583672681106]
In this work, we explore training-free theorem prediction through the lens of in-context learning (ICL)<n>We propose Theorem Precedence Graphs, which encode temporal dependencies from historical solution traces as directed graphs, and impose explicit topological constraints that effectively prune the search space during inference.<n>Experiments on the FormalGeo7k benchmark show that our method achieves 89.29% accuracy, substantially outperforming ICL baselines and matching state-of-the-art supervised models.
arXiv Detail & Related papers (2026-03-05T06:08:50Z) - Wireless Traffic Prediction with Large Language Model [54.07581399989292]
TIDES is a novel framework that captures spatial-temporal correlations for wireless traffic prediction.<n> TIDES achieves efficient adaptation to domain-specific patterns without incurring excessive training overhead.<n>Our results indicate that integrating spatial awareness into LLM-based predictors is the key to unlocking scalable and intelligent network management in future 6G systems.
arXiv Detail & Related papers (2025-12-19T04:47:40Z) - Beyond Regularity: Modeling Chaotic Mobility Patterns for Next Location Prediction [21.810140501429803]
Next location prediction is a key task in human mobility analysis, crucial for applications like smart city resource allocation and personalized navigation services.<n>Existing methods fail to address the dynamic imbalance between periodic and chaotic mobile patterns, leading to inadequate adaptation over trajectories.<n>We introduce a biologically inspired Chaotic Neuraly Attention mechanism to inject adaptive variability into traditional attention, enabling balanced representation of evolving mobility behaviors.
arXiv Detail & Related papers (2025-09-15T09:10:48Z) - UnLoc: Leveraging Depth Uncertainties for Floorplan Localization [80.55849461031879]
UnLoc is an efficient data-driven solution for sequential camera localization within floorplans.<n>We introduce a novel probabilistic model that incorporates uncertainty estimation, modeling depth predictions as explicit probability distributions.<n>We evaluate UnLoc on large-scale synthetic and real-world datasets, demonstrating significant improvements in terms of accuracy and robustness.
arXiv Detail & Related papers (2025-09-14T14:45:43Z) - STRelay: A Universal Spatio-Temporal Relaying Framework for Location Prediction with Future Spatiotemporal Contexts [23.8690122800167]
STRelay consistently improves prediction performance across all cases by 3.19%-1156%.<n>We evaluate STRelay integrated with four state-of-the-art location prediction base models on four real-world trajectory datasets.<n>Results demonstrate that STRelay consistently improves prediction performance across all cases by 3.19%-1156%.
arXiv Detail & Related papers (2025-08-14T02:44:33Z) - Into the Unknown: Applying Inductive Spatial-Semantic Location Embeddings for Predicting Individuals' Mobility Beyond Visited Places [3.131843231859519]
CaLLiPer is a representation learning framework that fuses spatial coordinates and semantic features of points of interest through contrastive learning.<n>Our findings highlight the potential of multimodal, inductive location embeddings to advance the capabilities of human mobility prediction systems.
arXiv Detail & Related papers (2025-06-17T00:00:09Z) - Learning Decision Trees as Amortized Structure Inference [59.65621207449269]
We propose a hybrid amortized structure inference approach to learn predictive decision tree ensembles given data.<n>We show that our approach, DT-GFN, outperforms state-of-the-art decision tree and deep learning methods on standard classification benchmarks.
arXiv Detail & Related papers (2025-03-10T07:05:07Z) - TrajGEOS: Trajectory Graph Enhanced Orientation-based Sequential Network for Mobility Prediction [10.876862361004944]
We propose a textbfTrajectory textbfGraph textbfEnhanced textbfOrientation-based textbfSequential network (TrajGEOS) for next-location prediction tasks.
arXiv Detail & Related papers (2024-12-26T07:18:38Z) - OPUS: Occupancy Prediction Using a Sparse Set [64.60854562502523]
We present a framework to simultaneously predict occupied locations and classes using a set of learnable queries.
OPUS incorporates a suite of non-trivial strategies to enhance model performance.
Our lightest model achieves superior RayIoU on the Occ3D-nuScenes dataset at near 2x FPS, while our heaviest model surpasses previous best results by 6.1 RayIoU.
arXiv Detail & Related papers (2024-09-14T07:44:22Z) - Skeleton2vec: A Self-supervised Learning Framework with Contextualized
Target Representations for Skeleton Sequence [56.092059713922744]
We show that using high-level contextualized features as prediction targets can achieve superior performance.
Specifically, we propose Skeleton2vec, a simple and efficient self-supervised 3D action representation learning framework.
Our proposed Skeleton2vec outperforms previous methods and achieves state-of-the-art results.
arXiv Detail & Related papers (2024-01-01T12:08:35Z) - Consciousness-Inspired Spatio-Temporal Abstractions for Better Generalization in Reinforcement Learning [83.41487567765871]
Skipper is a model-based reinforcement learning framework.
It automatically generalizes the task given into smaller, more manageable subtasks.
It enables sparse decision-making and focused abstractions on the relevant parts of the environment.
arXiv Detail & Related papers (2023-09-30T02:25:18Z) - Context-aware multi-head self-attentional neural network model for next
location prediction [19.640761373993417]
We utilize a multi-head self-attentional (A) neural network that learns location patterns from historical location visits.
We demonstrate that proposed the model outperforms other state-of-the-art prediction models.
We believe that the proposed model is vital for context-aware mobility prediction.
arXiv Detail & Related papers (2022-12-04T23:40:14Z) - How do you go where? Improving next location prediction by learning
travel mode information using transformers [6.003006906852134]
We propose a transformer decoder-based neural network to predict the next location an individual will visit based on historical locations, time, and travel modes.
In particular, the prediction of the next travel mode is designed as an auxiliary task to help guide the network's learning.
Our experiments show that the proposed method significantly outperforms other state-of-the-art next location prediction methods.
arXiv Detail & Related papers (2022-10-08T19:36:58Z) - Aware of the History: Trajectory Forecasting with the Local Behavior
Data [30.90992947135638]
Local behavior data is a new type of input data for trajectory forecasting systems.
We propose a novel local-behavior-aware (LBA) prediction framework that improves forecasting accuracy.
We also employ a local-behavior-free (LBF) prediction framework, which adopts a knowledge-distillation-based architecture to infer the impact of missing data.
arXiv Detail & Related papers (2022-07-20T04:35:38Z) - PGL: Prior-Guided Local Self-supervised Learning for 3D Medical Image
Segmentation [87.50205728818601]
We propose a PriorGuided Local (PGL) self-supervised model that learns the region-wise local consistency in the latent feature space.
Our PGL model learns the distinctive representations of local regions, and hence is able to retain structural information.
arXiv Detail & Related papers (2020-11-25T11:03:11Z) - Long-Horizon Visual Planning with Goal-Conditioned Hierarchical
Predictors [124.30562402952319]
The ability to predict and plan into the future is fundamental for agents acting in the world.
Current learning approaches for visual prediction and planning fail on long-horizon tasks.
We propose a framework for visual prediction and planning that is able to overcome both of these limitations.
arXiv Detail & Related papers (2020-06-23T17:58:56Z) - Learning Geo-Contextual Embeddings for Commuting Flow Prediction [20.600183945696863]
Predicting commuting flows based on infrastructure and land-use information is critical for urban planning and public policy development.
Conventional models, such as gravity model, are mainly derived from physics principles and limited by their predictive power in real-world scenarios.
We propose Geo-contextual Multitask Embedding Learner (GMEL), a model that captures the spatial correlations from geographic contextual information for commuting flow prediction.
arXiv Detail & Related papers (2020-05-04T17:45:18Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.