An End-to-End Vehicle Trajcetory Prediction Framework

• URL: http://arxiv.org/abs/2304.09764v1
• Date: Wed, 19 Apr 2023 15:42:03 GMT
• Title: An End-to-End Vehicle Trajcetory Prediction Framework
• Authors: Fuad Hasan and Hailong Huang
• Abstract summary: An accurate prediction of a future trajectory does not just rely on the previous trajectory, but also a simulation of the complex interactions between other vehicles nearby. Most state-of-the-art networks built to tackle the problem assume readily available past trajectory points. We propose a novel end-to-end architecture that takes raw video inputs and outputs future trajectory predictions.
• Score: 3.7311680121118345
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Anticipating the motion of neighboring vehicles is crucial for autonomous driving, especially on congested highways where even slight motion variations can result in catastrophic collisions. An accurate prediction of a future trajectory does not just rely on the previous trajectory, but also, more importantly, a simulation of the complex interactions between other vehicles nearby. Most state-of-the-art networks built to tackle the problem assume readily available past trajectory points, hence lacking a full end-to-end pipeline with direct video-to-output mechanism. In this article, we thus propose a novel end-to-end architecture that takes raw video inputs and outputs future trajectory predictions. It first extracts and tracks the 3D location of the nearby vehicles via multi-head attention-based regression networks as well as non-linear optimization. This provides the past trajectory points which then feeds into the trajectory prediction algorithm consisting of an attention-based LSTM encoder-decoder architecture, which allows it to model the complicated interdependence between the vehicles and make an accurate prediction of the future trajectory points of the surrounding vehicles. The proposed model is evaluated on the large-scale BLVD dataset, and has also been implemented on CARLA. The experimental results demonstrate that our approach outperforms various state-of-the-art models.

Related papers

• Multi-scale Temporal Fusion Transformer for Incomplete Vehicle Trajectory Prediction [23.72022120344089]
  Motion prediction plays an essential role in autonomous driving systems. We propose a novel end-to-end framework for incomplete vehicle trajectory prediction. We evaluate the proposed model on four datasets derived from highway and urban traffic scenarios.
  arXiv  Detail & Related papers  (2024-09-02T02:36:18Z)
• HPNet: Dynamic Trajectory Forecasting with Historical Prediction Attention [76.37139809114274]
  HPNet is a novel dynamic trajectory forecasting method. We propose a Historical Prediction Attention module to automatically encode the dynamic relationship between successive predictions. Our code is available at https://github.com/XiaolongTang23/HPNet.
  arXiv  Detail & Related papers  (2024-04-09T14:42:31Z)
• A Novel Deep Neural Network for Trajectory Prediction in Automated Vehicles Using Velocity Vector Field [12.067838086415833]
  This paper proposes a novel technique for trajectory prediction that combines a data-driven learning-based method with a velocity vector field (VVF) generated from a nature-inspired concept. The accuracy remains consistent with decreasing observation windows which alleviates the requirement of a long history of past observations for accurate trajectory prediction.
  arXiv  Detail & Related papers  (2023-09-19T22:14:52Z)
• Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving [68.95178518732965]
  A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
  arXiv  Detail & Related papers  (2023-08-02T23:39:24Z)
• Navigating Uncertainty: The Role of Short-Term Trajectory Prediction in Autonomous Vehicle Safety [3.3659635625913564]
  We have developed a dataset for short-term trajectory prediction tasks using the CARLA simulator. This dataset is extensive and incorporates what is considered complex scenarios - pedestrians crossing the road, vehicles overtaking. An end-to-end short-term trajectory prediction model using convolutional neural networks (CNN) and long short-term memory (LSTM) networks has also been developed.
  arXiv  Detail & Related papers  (2023-07-11T14:28:33Z)
• Self-Supervised Action-Space Prediction for Automated Driving [0.0]
  We present a novel learned multi-modal trajectory prediction architecture for automated driving. It achieves kinematically feasible predictions by casting the learning problem into the space of accelerations and steering angles. The proposed methods are evaluated on real-world datasets containing urban intersections and roundabouts.
  arXiv  Detail & Related papers  (2021-09-21T08:27:56Z)
• Ellipse Loss for Scene-Compliant Motion Prediction [12.446392441065065]
  We propose a novel ellipse loss that allows the models to better reason about scene compliance and predict more realistic trajectories. Ellipse loss penalizes off-road predictions directly in a supervised manner, by projecting the output trajectories into the top-down map frame. It takes into account actor dimensions and orientation, providing more direct training signals to the model.
  arXiv  Detail & Related papers  (2020-11-05T23:33:56Z)
• What-If Motion Prediction for Autonomous Driving [58.338520347197765]
  Viable solutions must account for both the static geometric context, such as road lanes, and dynamic social interactions arising from multiple actors. We propose a recurrent graph-based attentional approach with interpretable geometric (actor-lane) and social (actor-actor) relationships. Our model can produce diverse predictions conditioned on hypothetical or "what-if" road lanes and multi-actor interactions.
  arXiv  Detail & Related papers  (2020-08-24T17:49:30Z)
• The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
  Roads have well defined geometries, topologies, and traffic rules. In this paper we propose to incorporate structured priors as a loss function. We demonstrate the effectiveness of our approach on real-world self-driving datasets.
  arXiv  Detail & Related papers  (2020-06-04T03:56:11Z)
• PnPNet: End-to-End Perception and Prediction with Tracking in the Loop [82.97006521937101]
  We tackle the problem of joint perception and motion forecasting in the context of self-driving vehicles. We propose Net, an end-to-end model that takes as input sensor data, and outputs at each time step object tracks and their future level.
  arXiv  Detail & Related papers  (2020-05-29T17:57:25Z)
• TPNet: Trajectory Proposal Network for Motion Prediction [81.28716372763128]
  Trajectory Proposal Network (TPNet) is a novel two-stage motion prediction framework. TPNet first generates a candidate set of future trajectories as hypothesis proposals, then makes the final predictions by classifying and refining the proposals. Experiments on four large-scale trajectory prediction datasets, show that TPNet achieves the state-of-the-art results both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2020-04-26T00:01:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.