How do you go where? Improving next location prediction by learning travel mode information using transformers

• URL: http://arxiv.org/abs/2210.04095v1
• Date: Sat, 8 Oct 2022 19:36:58 GMT
• Title: How do you go where? Improving next location prediction by learning travel mode information using transformers
• Authors: Ye Hong, Henry Martin, Martin Raubal
• Abstract summary: We propose a transformer decoder-based neural network to predict the next location an individual will visit based on historical locations, time, and travel modes. In particular, the prediction of the next travel mode is designed as an auxiliary task to help guide the network's learning. Our experiments show that the proposed method significantly outperforms other state-of-the-art next location prediction methods.
• Score: 6.003006906852134
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Predicting the next visited location of an individual is a key problem in human mobility analysis, as it is required for the personalization and optimization of sustainable transport options. Here, we propose a transformer decoder-based neural network to predict the next location an individual will visit based on historical locations, time, and travel modes, which are behaviour dimensions often overlooked in previous work. In particular, the prediction of the next travel mode is designed as an auxiliary task to help guide the network's learning. For evaluation, we apply this approach to two large-scale and long-term GPS tracking datasets involving more than 600 individuals. Our experiments show that the proposed method significantly outperforms other state-of-the-art next location prediction methods by a large margin (8.05% and 5.60% relative increase in F1-score for the two datasets, respectively). We conduct an extensive ablation study that quantifies the influence of considering temporal features, travel mode information, and the auxiliary task on the prediction results. Moreover, we experimentally determine the performance upper bound when including the next mode prediction in our model. Finally, our analysis indicates that the performance of location prediction varies significantly with the chosen next travel mode by the individual. These results show potential for a more systematic consideration of additional dimensions of travel behaviour in human mobility prediction tasks. The source code of our model and experiments is available at https://github.com/mie-lab/location-mode-prediction.

Related papers

• AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving [59.94343412438211]
  We introduce the GPT style next token motion prediction into motion prediction. Different from language data which is composed of homogeneous units -words, the elements in the driving scene could have complex spatial-temporal and semantic relations. We propose to adopt three factorized attention modules with different neighbors for information aggregation and different position encoding styles to capture their relations.
  arXiv  Detail & Related papers  (2024-03-20T06:22:37Z)
• Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction [15.454206825258169]
  Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Recent deep learning-based prediction approaches mainly utilize information like trajectory history and interactions between pedestrians. This paper proposes a graph transformer structure to improve prediction performance.
  arXiv  Detail & Related papers  (2024-01-10T01:50:29Z)
• Context-aware multi-head self-attentional neural network model for next location prediction [19.640761373993417]
  We utilize a multi-head self-attentional (A) neural network that learns location patterns from historical location visits. We demonstrate that proposed the model outperforms other state-of-the-art prediction models. We believe that the proposed model is vital for context-aware mobility prediction.
  arXiv  Detail & Related papers  (2022-12-04T23:40:14Z)
• Meta-Learning over Time for Destination Prediction Tasks [53.12827614887103]
  A need to understand and predict vehicles' behavior underlies both public and private goals in the transportation domain. Recent studies have found, at best, only marginal improvements in predictive performance from incorporating temporal information. We propose an approach based on hypernetworks, in which a neural network learns to change its own weights in response to an input.
  arXiv  Detail & Related papers  (2022-06-29T17:58:12Z)
• MobTCast: Leveraging Auxiliary Trajectory Forecasting for Human Mobility Prediction [5.911865723926626]
  We propose MobTCast, a Transformer-based context-aware network for mobility prediction. We explore the influence of four types of context in the mobility prediction: temporal, semantic, social and geographical contexts. In our experimental results, MobTCast outperforms other state-of-the-art next POI prediction methods.
  arXiv  Detail & Related papers  (2021-09-30T09:42:15Z)
• Online Co-movement Pattern Prediction in Mobility Data [1.5790464310310084]
  We provide an accurate solution to the problem of Online Prediction of Co-movement patterns. In order to calculate the accuracy of our solution, we propose a co-movement pattern similarity measure. The accuracy of our solution is demonstrated experimentally over a real dataset from the maritime domain.
  arXiv  Detail & Related papers  (2021-02-17T17:01:32Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)
• TPNet: Trajectory Proposal Network for Motion Prediction [81.28716372763128]
  Trajectory Proposal Network (TPNet) is a novel two-stage motion prediction framework. TPNet first generates a candidate set of future trajectories as hypothesis proposals, then makes the final predictions by classifying and refining the proposals. Experiments on four large-scale trajectory prediction datasets, show that TPNet achieves the state-of-the-art results both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2020-04-26T00:01:49Z)
• TTDM: A Travel Time Difference Model for Next Location Prediction [14.93730951083916]
  Next location prediction is of great importance for many location-based applications and provides essential intelligence to business and governments. In existing studies, a common approach to next location prediction is to learn the sequential transitions with massive historical trajectories based on conditional probability. We propose a novel method, called Travel Time Difference Model (TTDM), which exploits the difference between the shortest travel time and the actual travel time to predict next locations.
  arXiv  Detail & Related papers  (2020-03-16T05:16:43Z)
• Deep Learning for Content-based Personalized Viewport Prediction of 360-Degree VR Videos [72.08072170033054]
  In this paper, a deep learning network is introduced to leverage position data as well as video frame content to predict future head movement. For optimizing data input into this neural network, data sample rate, reduced data, and long-period prediction length are also explored for this model.
  arXiv  Detail & Related papers  (2020-03-01T07:31:50Z)
• Spatiotemporal Relationship Reasoning for Pedestrian Intent Prediction [57.56466850377598]
  Reasoning over visual data is a desirable capability for robotics and vision-based applications. In this paper, we present a framework on graph to uncover relationships in different objects in the scene for reasoning about pedestrian intent. Pedestrian intent, defined as the future action of crossing or not-crossing the street, is a very crucial piece of information for autonomous vehicles.
  arXiv  Detail & Related papers  (2020-02-20T18:50:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.