Trajectory Prediction with Graph-based Dual-scale Context Fusion
- URL: http://arxiv.org/abs/2111.01592v1
- Date: Tue, 2 Nov 2021 13:42:16 GMT
- Title: Trajectory Prediction with Graph-based Dual-scale Context Fusion
- Authors: Lu Zhang, Peiliang Li, Jing Chen and Shaojie Shen
- Abstract summary: We present a graph-based trajectory prediction network named the Dual Scale Predictor.
It encodes both the static and dynamical driving context in a hierarchical manner.
Thanks to the proposed dual-scale context fusion network, our DSP is able to generate accurate and human-like multi-modal trajectories.
- Score: 43.51107329748957
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Motion prediction for traffic participants is essential for a safe and robust
automated driving system, especially in cluttered urban environments. However,
it is highly challenging due to the complex road topology as well as the
uncertain intentions of the other agents. In this paper, we present a
graph-based trajectory prediction network named the Dual Scale Predictor (DSP),
which encodes both the static and dynamical driving context in a hierarchical
manner. Different from methods based on a rasterized map or sparse lane graph,
we consider the driving context as a graph with two layers, focusing on both
geometrical and topological features. Graph neural networks (GNNs) are applied
to extract features with different levels of granularity, and features are
subsequently aggregated with attention-based inter-layer networks, realizing
better local-global feature fusion. Following the recent goal-driven trajectory
prediction pipeline, goal candidates with high likelihood for the target agent
are extracted, and predicted trajectories are generated conditioned on these
goals. Thanks to the proposed dual-scale context fusion network, our DSP is
able to generate accurate and human-like multi-modal trajectories. We evaluate
the proposed method on the large-scale Argoverse motion forecasting benchmark,
and it achieves promising results, outperforming the recent state-of-the-art
methods.
Related papers
- SemanticFormer: Holistic and Semantic Traffic Scene Representation for Trajectory Prediction using Knowledge Graphs [3.733790302392792]
Tray prediction in autonomous driving relies on accurate representation of all relevant contexts of the driving scene.
We present SemanticFormer, an approach for predicting multimodal trajectories by reasoning over a traffic scene graph.
arXiv Detail & Related papers (2024-04-30T09:11:04Z) - EPG-MGCN: Ego-Planning Guided Multi-Graph Convolutional Network for
Heterogeneous Agent Trajectory Prediction [0.0]
This paper proposes a ego-planning guided multi-graph convolutional network (EPG-MGCN) to predict the trajectories of heterogeneous agents.
EPG-MGCN first models the social interactions by employing four graph topologies.
Finally, a category-specific gated recurrent unit (CS-GRU) encoder-decoder is designed to generate future trajectories for each specific type of agents.
arXiv Detail & Related papers (2023-03-29T21:14:05Z) - D2-TPred: Discontinuous Dependency for Trajectory Prediction under
Traffic Lights [68.76631399516823]
We present a trajectory prediction approach with respect to traffic lights, D2-TPred, using a spatial dynamic interaction graph (SDG) and a behavior dependency graph (BDG)
Our experimental results show that our model achieves more than 20.45% and 20.78% in terms of ADE and FDE, respectively, on VTP-TL.
arXiv Detail & Related papers (2022-07-21T10:19:07Z) - RSG-Net: Towards Rich Sematic Relationship Prediction for Intelligent
Vehicle in Complex Environments [72.04891523115535]
We propose RSG-Net (Road Scene Graph Net): a graph convolutional network designed to predict potential semantic relationships from object proposals.
The experimental results indicate that this network, trained on Road Scene Graph dataset, could efficiently predict potential semantic relationships among objects around the ego-vehicle.
arXiv Detail & Related papers (2022-07-16T12:40:17Z) - Graph-Based Spatial-Temporal Convolutional Network for Vehicle
Trajectory Prediction in Autonomous Driving [2.6774008509841005]
This paper proposes a graph-based spatial-temporal convolutional network ( GSTCN) to predict future trajectory distributions of all neighbor vehicles.
The spatial-temporal features are encoded and decoded by a gated recurrent unit (GRU) network to generate future trajectory distributions.
Our network is evaluated on two real-world freeway trajectory datasets: I-80 and US-101 in the Next Generation Simulation (NGSIM)
arXiv Detail & Related papers (2021-09-27T02:20:38Z) - SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory
Prediction [64.16212996247943]
We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction.
Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians.
visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
arXiv Detail & Related papers (2021-04-04T03:17:42Z) - VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized
Representation [74.56282712099274]
This paper introduces VectorNet, a hierarchical graph neural network that exploits the spatial locality of individual road components represented by vectors.
By operating on the vectorized high definition (HD) maps and agent trajectories, we avoid lossy rendering and computationally intensive ConvNet encoding steps.
We evaluate VectorNet on our in-house behavior prediction benchmark and the recently released Argoverse forecasting dataset.
arXiv Detail & Related papers (2020-05-08T19:07:03Z) - Constructing Geographic and Long-term Temporal Graph for Traffic
Forecasting [88.5550074808201]
We propose Geographic and Long term Temporal Graph Convolutional Recurrent Neural Network (GLT-GCRNN) for traffic forecasting.
In this work, we propose a novel framework for traffic forecasting that learns the rich interactions between roads sharing similar geographic or longterm temporal patterns.
arXiv Detail & Related papers (2020-04-23T03:50:46Z) - Improving Movement Predictions of Traffic Actors in Bird's-Eye View
Models using GANs and Differentiable Trajectory Rasterization [12.652210024012374]
One of the most critical pieces of the self-driving puzzle is the task of predicting future movement of surrounding traffic actors.
Methods based on top-down sceneization on one side and Generative Adrial Networks (GANs) on the other have shown to be particularly successful.
In this paper we build upon these two directions and propose aversa-based conditional GAN architecture.
We evaluate the proposed method on a large-scale, real-world data set, showing that it outperforms state-of-the-art GAN-based baselines.
arXiv Detail & Related papers (2020-04-14T00:41:17Z) - Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein
Graph Double-Attention Network [29.289670231364788]
In this paper, we propose a generic generative neural system for multi-agent trajectory prediction.
We also employ an efficient kinematic constraint layer applied to vehicle trajectory prediction.
The proposed system is evaluated on three public benchmark datasets for trajectory prediction.
arXiv Detail & Related papers (2020-02-14T20:11:13Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.