Self-Discovered Intention-aware Transformer for Multi-modal Vehicle Trajectory Prediction

• URL: http://arxiv.org/abs/2604.07126v1
• Date: Wed, 08 Apr 2026 14:20:09 GMT
• Title: Self-Discovered Intention-aware Transformer for Multi-modal Vehicle Trajectory Prediction
• Abstract summary: We propose a pure Transformer-based network with multiple modals considering neighboring vehicles.<n>One track focuses on predicting the trajectories while the other focuses on predicting the likelihood of each intention considering neighboring vehicles.<n>Study finds that the two track design can increase the performance by separating spatial module from the trajectory generating module.
• Score: 1.2103718443991303
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Predicting vehicle trajectories plays an important role in autonomous driving and ITS applications. Although multiple deep learning algorithms are devised to predict vehicle trajectories, their reliant on specific graph structure (e.g., Graph Neural Network) or explicit intention labeling limit their flexibilities. In this study, we propose a pure Transformer-based network with multiple modals considering their neighboring vehicles. Two separate tracks are employed. One track focuses on predicting the trajectories while the other focuses on predicting the likelihood of each intention considering neighboring vehicles. Study finds that the two track design can increase the performance by separating spatial module from the trajectory generating module. Also, we find the the model can learn an ordered group of trajectories by predicting residual offsets among K trajectories.

Related papers

• TrajMoE: Scene-Adaptive Trajectory Planning with Mixture of Experts and Reinforcement Learning [24.158051656957166]
  Current autonomous driving systems often favor end-to-end frameworks, which take sensor inputs like images and learn to map them into trajectory space via neural networks.<n>Previous work has demonstrated that models can achieve better planning performance when provided with a prior distribution of possible trajectories.
  arXiv  Detail & Related papers  (2025-12-08T03:40:10Z)
• ParkDiffusion: Heterogeneous Multi-Agent Multi-Modal Trajectory Prediction for Automated Parking using Diffusion Models [6.58562706945347]
  ParkDiffusion is a novel approach that predicts the trajectories of both vehicles and pedestrians in automated parking scenarios.<n>ParkDiffusion employs diffusion models to capture the inherent uncertainty and multi-modality of future trajectories.<n>We evaluate ParkDiffusion on the Dragon Lake Parking dataset and the Intersections Drone dataset.
  arXiv  Detail & Related papers  (2025-05-01T15:16:59Z)
• A Multi-Loss Strategy for Vehicle Trajectory Prediction: Combining Off-Road, Diversity, and Directional Consistency Losses [68.68514648185828]
  Trajectory prediction is essential for the safety and efficiency of planning in autonomous vehicles.<n>Current models often fail to fully capture complex traffic rules and the complete range of potential vehicle movements.<n>This study introduces three novel loss functions: Offroad Loss, Direction Consistency Error, and Diversity Loss.
  arXiv  Detail & Related papers  (2024-11-29T14:47:08Z)
• VeTraSS: Vehicle Trajectory Similarity Search Through Graph Modeling and Representation Learning [9.325787573209201]
  Trajectory similarity search plays an essential role in autonomous driving. We propose VeTraSS -- an end-to-end pipeline for Vehicle Trajectory Similarity Search.
  arXiv  Detail & Related papers  (2024-04-11T06:19:55Z)
• Pre-training on Synthetic Driving Data for Trajectory Prediction [61.520225216107306]
  We propose a pipeline-level solution to mitigate the issue of data scarcity in trajectory forecasting. We adopt HD map augmentation and trajectory synthesis for generating driving data, and then we learn representations by pre-training on them. We conduct extensive experiments to demonstrate the effectiveness of our data expansion and pre-training strategies.
  arXiv  Detail & Related papers  (2023-09-18T19:49:22Z)
• An End-to-End Framework of Road User Detection, Tracking, and Prediction from Monocular Images [11.733622044569486]
  We build an end-to-end framework for detection, tracking, and trajectory prediction called ODTP. It adopts the state-of-the-art online multi-object tracking model, QD-3DT, for perception and trains the trajectory predictor, DCENet++, directly based on the detection results. We evaluate the performance of ODTP on the widely used nuScenes dataset for autonomous driving.
  arXiv  Detail & Related papers  (2023-08-09T15:46:25Z)
• Multi-Vehicle Trajectory Prediction at Intersections using State and Intention Information [50.40632021583213]
  Traditional approaches to prediction of future trajectory of road agents rely on knowing information about their past trajectory. This work instead relies on having knowledge of the current state and intended direction to make predictions for multiple vehicles at intersections. Message passing of this information between the vehicles provides each one of them a more holistic overview of the environment.
  arXiv  Detail & Related papers  (2023-01-06T15:13:23Z)
• Control-Aware Prediction Objectives for Autonomous Driving [78.19515972466063]
  We present control-aware prediction objectives (CAPOs) to evaluate the downstream effect of predictions on control without requiring the planner be differentiable. We propose two types of importance weights that weight the predictive likelihood: one using an attention model between agents, and another based on control variation when exchanging predicted trajectories for ground truth trajectories.
  arXiv  Detail & Related papers  (2022-04-28T07:37:21Z)
• Adaptive Trajectory Prediction via Transferable GNN [74.09424229172781]
  We propose a novel Transferable Graph Neural Network (T-GNN) framework, which jointly conducts trajectory prediction as well as domain alignment in a unified framework. Specifically, a domain invariant GNN is proposed to explore the structural motion knowledge where the domain specific knowledge is reduced. An attention-based adaptive knowledge learning module is further proposed to explore fine-grained individual-level feature representation for knowledge transfer.
  arXiv  Detail & Related papers  (2022-03-09T21:08:47Z)
• Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction [71.97877759413272]
  Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions. Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many. Our work addresses two key challenges in trajectory prediction, learning outputs, and better predictions by imposing constraints using driving knowledge.
  arXiv  Detail & Related papers  (2021-04-16T17:58:56Z)
• Multi-Head Attention based Probabilistic Vehicle Trajectory Prediction [10.905596145969223]
  We propose a simple encoder-decoder architecture based on multi-head attention. The proposed model generates the distribution of the predicted trajectories for multiple vehicles in parallel.
  arXiv  Detail & Related papers  (2020-04-08T06:58:51Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.