Pre-training on Synthetic Driving Data for Trajectory Prediction
- URL: http://arxiv.org/abs/2309.10121v2
- Date: Wed, 20 Sep 2023 03:46:22 GMT
- Title: Pre-training on Synthetic Driving Data for Trajectory Prediction
- Authors: Yiheng Li, Seth Z. Zhao, Chenfeng Xu, Chen Tang, Chenran Li, Mingyu
Ding, Masayoshi Tomizuka, Wei Zhan
- Abstract summary: We aim to tackle the challenge of learning general trajectory forecasting representations under limited data availability.
We take advantage of graph representations of HD-map and apply vector transformations to reshape the maps.
We employ a rule-based model to generate trajectories based on augmented scenes.
- Score: 64.16991399882477
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Accumulating substantial volumes of real-world driving data proves pivotal in
the realm of trajectory forecasting for autonomous driving. Given the heavy
reliance of current trajectory forecasting models on data-driven methodologies,
we aim to tackle the challenge of learning general trajectory forecasting
representations under limited data availability. We propose to augment both HD
maps and trajectories and apply pre-training strategies on top of them.
Specifically, we take advantage of graph representations of HD-map and apply
vector transformations to reshape the maps, to easily enrich the limited number
of scenes. Additionally, we employ a rule-based model to generate trajectories
based on augmented scenes; thus enlarging the trajectories beyond the collected
real ones. To foster the learning of general representations within this
augmented dataset, we comprehensively explore the different pre-training
strategies, including extending the concept of a Masked AutoEncoder (MAE) for
trajectory forecasting. Extensive experiments demonstrate the effectiveness of
our data expansion and pre-training strategies, which outperform the baseline
prediction model by large margins, e.g. 5.04%, 3.84% and 8.30% in terms of
$MR_6$, $minADE_6$ and $minFDE_6$.
Related papers
- Data-efficient Trajectory Prediction via Coreset Selection [4.682090083225856]
Training trajectory prediction models is challenging in two ways.
Easy-medium driving scenarios often overwhelmingly dominate the dataset.
We propose a novel data-efficient training method based on coreset selection.
arXiv Detail & Related papers (2024-09-25T22:00:11Z) - OPUS: Occupancy Prediction Using a Sparse Set [64.60854562502523]
We present a framework to simultaneously predict occupied locations and classes using a set of learnable queries.
OPUS incorporates a suite of non-trivial strategies to enhance model performance.
Our lightest model achieves superior RayIoU on the Occ3D-nuScenes dataset at near 2x FPS, while our heaviest model surpasses previous best results by 6.1 RayIoU.
arXiv Detail & Related papers (2024-09-14T07:44:22Z) - Valeo4Cast: A Modular Approach to End-to-End Forecasting [93.86257326005726]
Our solution ranks first in the Argoverse 2 End-to-end Forecasting Challenge, with 63.82 mAPf.
We depart from the current trend of tackling this task via end-to-end training from perception to forecasting, and instead use a modular approach.
We surpass forecasting results by +17.1 points over last year's winner and by +13.3 points over this year's runner-up.
arXiv Detail & Related papers (2024-06-12T11:50:51Z) - SPOT: Scalable 3D Pre-training via Occupancy Prediction for Learning Transferable 3D Representations [76.45009891152178]
Pretraining-finetuning approach can alleviate the labeling burden by fine-tuning a pre-trained backbone across various downstream datasets as well as tasks.
We show, for the first time, that general representations learning can be achieved through the task of occupancy prediction.
Our findings will facilitate the understanding of LiDAR points and pave the way for future advancements in LiDAR pre-training.
arXiv Detail & Related papers (2023-09-19T11:13:01Z) - Interaction-Aware Personalized Vehicle Trajectory Prediction Using
Temporal Graph Neural Networks [8.209194305630229]
Existing methods mainly rely on generic trajectory predictions from large datasets.
We propose an approach for interaction-aware personalized vehicle trajectory prediction that incorporates temporal graph neural networks.
arXiv Detail & Related papers (2023-08-14T20:20:26Z) - PreTraM: Self-Supervised Pre-training via Connecting Trajectory and Map [58.53373202647576]
We propose PreTraM, a self-supervised pre-training scheme for trajectory forecasting.
It consists of two parts: 1) Trajectory-Map Contrastive Learning, where we project trajectories and maps to a shared embedding space with cross-modal contrastive learning, and 2) Map Contrastive Learning, where we enhance map representation with contrastive learning on large quantities of HD-maps.
On top of popular baselines such as AgentFormer and Trajectron++, PreTraM boosts their performance by 5.5% and 6.9% relatively in FDE-10 on the challenging nuScenes dataset.
arXiv Detail & Related papers (2022-04-21T23:01:21Z) - Injecting Knowledge in Data-driven Vehicle Trajectory Predictors [82.91398970736391]
Vehicle trajectory prediction tasks have been commonly tackled from two perspectives: knowledge-driven or data-driven.
In this paper, we propose to learn a "Realistic Residual Block" (RRB) which effectively connects these two perspectives.
Our proposed method outputs realistic predictions by confining the residual range and taking into account its uncertainty.
arXiv Detail & Related papers (2021-03-08T16:03:09Z) - The Importance of Balanced Data Sets: Analyzing a Vehicle Trajectory
Prediction Model based on Neural Networks and Distributed Representations [0.0]
We investigate the composition of training data in vehicle trajectory prediction.
We show that the models employing our semantic vector representation outperform the numerical model when trained on an adequate data set.
arXiv Detail & Related papers (2020-09-30T20:00:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.