Trajectory Test-Train Overlap in Next-Location Prediction Datasets

• URL: http://arxiv.org/abs/2203.03208v1
• Date: Mon, 7 Mar 2022 08:39:45 GMT
• Title: Trajectory Test-Train Overlap in Next-Location Prediction Datasets
• Authors: Massimiliano Luca, Luca Pappalardo, Bruno Lepri, Gianni Barlacchi
• Abstract summary: Next-location prediction has important implications in several fields, such as urban planning, geo-marketing, and disease spreading. This paper tests the generalization capability of these predictors on public mobility datasets. We propose a methodology to rerank the outputs of the next-location predictors based on spatial mobility patterns.
• Score: 5.039138978031649
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Next-location prediction, consisting of forecasting a user's location given their historical trajectories, has important implications in several fields, such as urban planning, geo-marketing, and disease spreading. Several predictors have been proposed in the last few years to address it, including last-generation ones based on deep learning. This paper tests the generalization capability of these predictors on public mobility datasets, stratifying the datasets by whether the trajectories in the test set also appear fully or partially in the training set. We consistently discover a severe problem of trajectory overlapping in all analyzed datasets, highlighting that predictors memorize trajectories while having limited generalization capacities. We thus propose a methodology to rerank the outputs of the next-location predictors based on spatial mobility patterns. With these techniques, we significantly improve the predictors' generalization capability, with a relative improvement on the accuracy up to 96.15% on the trajectories that cannot be memorized (i.e., low overlap with the training set).

Related papers

• Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking [7.9449756510822915]
  TrajImpute is a pedestrian trajectory prediction dataset that simulates missing coordinates in the observed trajectory. In this work, we examine several imputation methods to reconstruct the missing coordinates and benchmark them for imputing pedestrian trajectories. Our dataset provides a foundational resource for future research on imputation-aware pedestrian trajectory prediction.
  arXiv  Detail & Related papers  (2024-10-31T19:42:42Z)
• Certified Human Trajectory Prediction [66.1736456453465]
  Tray prediction plays an essential role in autonomous vehicles. We propose a certification approach tailored for the task of trajectory prediction. We address the inherent challenges associated with trajectory prediction, including unbounded outputs, and mutli-modality.
  arXiv  Detail & Related papers  (2024-03-20T17:41:35Z)
• Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction [15.454206825258169]
  Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles. Recent deep learning-based prediction approaches mainly utilize information like trajectory history and interactions between pedestrians. This paper proposes a graph transformer structure to improve prediction performance.
  arXiv  Detail & Related papers  (2024-01-10T01:50:29Z)
• JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds [79.00975648564483]
  Trajectory forecasting models, employed in fields such as robotics, autonomous vehicles, and navigation, face challenges in real-world scenarios. This dataset provides comprehensive data, including the locations of all agents, scene images, and point clouds, all from the robot's perspective. The objective is to predict the future positions of agents relative to the robot using raw sensory input data.
  arXiv  Detail & Related papers  (2023-11-05T18:59:31Z)
• Pre-training on Synthetic Driving Data for Trajectory Prediction [61.520225216107306]
  We propose a pipeline-level solution to mitigate the issue of data scarcity in trajectory forecasting. We adopt HD map augmentation and trajectory synthesis for generating driving data, and then we learn representations by pre-training on them. We conduct extensive experiments to demonstrate the effectiveness of our data expansion and pre-training strategies.
  arXiv  Detail & Related papers  (2023-09-18T19:49:22Z)
• Uncertainty estimation for Cross-dataset performance in Trajectory prediction [1.9399281609371257]
  We study the performance of a state-of-the-art trajectory prediction method across four different datasets. We highlight which datasets work best on others, and study how uncertainty estimation allows for a better transferable performance.
  arXiv  Detail & Related papers  (2022-05-15T15:28:02Z)
• PreTraM: Self-Supervised Pre-training via Connecting Trajectory and Map [58.53373202647576]
  We propose PreTraM, a self-supervised pre-training scheme for trajectory forecasting. It consists of two parts: 1) Trajectory-Map Contrastive Learning, where we project trajectories and maps to a shared embedding space with cross-modal contrastive learning, and 2) Map Contrastive Learning, where we enhance map representation with contrastive learning on large quantities of HD-maps. On top of popular baselines such as AgentFormer and Trajectron++, PreTraM boosts their performance by 5.5% and 6.9% relatively in FDE-10 on the challenging nuScenes dataset.
  arXiv  Detail & Related papers  (2022-04-21T23:01:21Z)
• Improved Fine-tuning by Leveraging Pre-training Data: Theory and Practice [52.11183787786718]
  Fine-tuning a pre-trained model on the target data is widely used in many deep learning applications. Recent studies have empirically shown that training from scratch has the final performance that is no worse than this pre-training strategy. We propose a novel selection strategy to select a subset from pre-training data to help improve the generalization on the target task.
  arXiv  Detail & Related papers  (2021-11-24T06:18:32Z)
• MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error Propagation [39.41917241231786]
  This paper addresses the problem of cascading errors by focusing on the coupling between the tracking and prediction modules. By using state-of-the-art tracking and prediction tools, we conduct a comprehensive experimental evaluation of how severely errors stemming from tracking can impact prediction performance. We show that this framework improves overall prediction performance over the standard single-hypothesis tracking-prediction pipeline by up to 34.2% on the nuScenes dataset.
  arXiv  Detail & Related papers  (2021-10-18T17:30:59Z)
• Adaptive Selection of Informative Path Planning Strategies via Reinforcement Learning [6.015556590955814]
  "Local planning" approaches adopt various spatial ranges within which next sampling locations are prioritized to investigate their effects on the prediction performance as well as incurred travel distance. Experiments on use cases of temperature monitoring robots demonstrate that the dynamic mixtures of planners can not only generate sophisticated, informative plans but also ensure significantly reduced distances at no cost of prediction reliability.
  arXiv  Detail & Related papers  (2021-08-14T21:32:33Z)
• SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
  We propose advances that address two key challenges in future trajectory prediction. multimodality in both training data and predictions and constant time inference regardless of number of agents.
  arXiv  Detail & Related papers  (2020-07-26T08:17:10Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.