PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation

• URL: http://arxiv.org/abs/2109.11094v1
• Date: Thu, 23 Sep 2021 01:23:47 GMT
• Title: PredictionNet: Real-Time Joint Probabilistic Traffic Prediction for Planning, Control, and Simulation
• Authors: Alexey Kamenev, Lirui Wang, Ollin Boer Bohan, Ishwar Kulkarni, Bilal Kartal, Artem Molchanov, Stan Birchfield, David Nist\'er, Nikolai Smolyanskiy
• Abstract summary: PredictionNet is a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with the ego-vehicle's motion. The network can be used to simulate realistic traffic, and it produces competitive results on popular benchmarks. It has been used to successfully control a real-world vehicle for hundreds of kilometers, by combining it with a motion planning/control subsystem.
• Score: 9.750094897470447
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Predicting the future motion of traffic agents is crucial for safe and efficient autonomous driving. To this end, we present PredictionNet, a deep neural network (DNN) that predicts the motion of all surrounding traffic agents together with the ego-vehicle's motion. All predictions are probabilistic and are represented in a simple top-down rasterization that allows an arbitrary number of agents. Conditioned on a multilayer map with lane information, the network outputs future positions, velocities, and backtrace vectors jointly for all agents including the ego-vehicle in a single pass. Trajectories are then extracted from the output. The network can be used to simulate realistic traffic, and it produces competitive results on popular benchmarks. More importantly, it has been used to successfully control a real-world vehicle for hundreds of kilometers, by combining it with a motion planning/control subsystem. The network runs faster than real-time on an embedded GPU, and the system shows good generalization (across sensory modalities and locations) due to the choice of input representation. Furthermore, we demonstrate that by extending the DNN with reinforcement learning (RL), it can better handle rare or unsafe events like aggressive maneuvers and crashes.

Related papers

• Planning with Adaptive World Models for Autonomous Driving [50.4439896514353]
  Motion planners (MPs) are crucial for safe navigation in complex urban environments. nuPlan, a recently released MP benchmark, addresses this limitation by augmenting real-world driving logs with closed-loop simulation logic. We present AdaptiveDriver, a model-predictive control (MPC) based planner that unrolls different world models conditioned on BehaviorNet's predictions.
  arXiv  Detail & Related papers  (2024-06-15T18:53:45Z)
• Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving [68.95178518732965]
  A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
  arXiv  Detail & Related papers  (2023-08-02T23:39:24Z)
• TSGN: Temporal Scene Graph Neural Networks with Projected Vectorized Representation for Multi-Agent Motion Prediction [2.5780349894383807]
  TSGN can predict multimodal future trajectories for all agents simultaneously, plausibly, and accurately. We propose a Hierarchical Lane Transformer for capturing interactions between agents and road network. Experiments show TSGN achieves state-of-the-art performance on the Argoverse motion forecasting benchmar.
  arXiv  Detail & Related papers  (2023-05-14T15:58:55Z)
• TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction [149.5716746789134]
  We show data-driven traffic simulation can be formulated as a world model. We present TrafficBots, a multi-agent policy built upon motion prediction and end-to-end driving. Experiments on the open motion dataset show TrafficBots can simulate realistic multi-agent behaviors.
  arXiv  Detail & Related papers  (2023-03-07T18:28:41Z)
• Exploring Attention GAN for Vehicle Motion Prediction [2.887073662645855]
  We study the influence of attention in generative models for motion prediction, considering both physical and social context. We validate our method using the Argoverse Motion Forecasting Benchmark 1.1, achieving competitive unimodal results.
  arXiv  Detail & Related papers  (2022-09-26T13:18:32Z)
• Testing the Safety of Self-driving Vehicles by Simulating Perception and Prediction [88.0416857308144]
  We propose an alternative to sensor simulation, as sensor simulation is expensive and has large domain gaps. We directly simulate the outputs of the self-driving vehicle's perception and prediction system, enabling realistic motion planning testing.
  arXiv  Detail & Related papers  (2020-08-13T17:20:02Z)
• Probabilistic Crowd GAN: Multimodal Pedestrian Trajectory Prediction using a Graph Vehicle-Pedestrian Attention Network [12.070251470948772]
  We show how Probabilistic Crowd GAN can output probabilistic multimodal predictions. We also propose the use of Graph Vehicle-Pedestrian Attention Network (GVAT), which models social interactions. We demonstrate improvements on the existing state of the art methods for trajectory prediction and illustrate how the true multimodal and uncertain nature of crowd interactions can be directly modelled.
  arXiv  Detail & Related papers  (2020-06-23T11:25:16Z)
• Traffic Flow Forecast of Road Networks with Recurrent Neural Networks [0.0]
  The forecast of traffic flow is indispensable for an efficient intelligent transportation system. In our work, this prediction is performed with various recurrent neural networks. Most often the vector output model with gated recurrent units achieved the smallest error on the test set.
  arXiv  Detail & Related papers  (2020-06-08T15:17:58Z)
• VectorNet: Encoding HD Maps and Agent Dynamics from Vectorized Representation [74.56282712099274]
  This paper introduces VectorNet, a hierarchical graph neural network that exploits the spatial locality of individual road components represented by vectors. By operating on the vectorized high definition (HD) maps and agent trajectories, we avoid lossy rendering and computationally intensive ConvNet encoding steps. We evaluate VectorNet on our in-house behavior prediction benchmark and the recently released Argoverse forecasting dataset.
  arXiv  Detail & Related papers  (2020-05-08T19:07:03Z)
• TPNet: Trajectory Proposal Network for Motion Prediction [81.28716372763128]
  Trajectory Proposal Network (TPNet) is a novel two-stage motion prediction framework. TPNet first generates a candidate set of future trajectories as hypothesis proposals, then makes the final predictions by classifying and refining the proposals. Experiments on four large-scale trajectory prediction datasets, show that TPNet achieves the state-of-the-art results both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2020-04-26T00:01:49Z)
• SCALE-Net: Scalable Vehicle Trajectory Prediction Network under Random Number of Interacting Vehicles via Edge-enhanced Graph Convolutional Neural Network [15.916040656243858]
  The first fully scalable trajectory prediction network, SCALE-Net, is proposed. It can ensure both higher prediction performance and consistent computational load regardless of the number of vehicles.
  arXiv  Detail & Related papers  (2020-02-28T09:25:01Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.