Context-Aware Scene Prediction Network (CASPNet)

• URL: http://arxiv.org/abs/2201.06933v1
• Date: Tue, 18 Jan 2022 12:52:01 GMT
• Title: Context-Aware Scene Prediction Network (CASPNet)
• Authors: Maximilian Sch\"afer, Kun Zhao, Markus B\"uhren and Anton Kummert
• Abstract summary: We jointly learn and predict the motion of all road users in a scene using a novel convolutional neural network (CNN) and recurrent neural network (RNN) based architecture. Our approach reaches state-of-the-art results in the prediction benchmark.
• Score: 3.390468002706074
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Predicting the future motion of surrounding road users is a crucial and challenging task for autonomous driving (AD) and various advanced driver-assistance systems (ADAS). Planning a safe future trajectory heavily depends on understanding the traffic scene and anticipating its dynamics. The challenges do not only lie in understanding the complex driving scenarios but also the numerous possible interactions among road users and environments, which are practically not feasible for explicit modeling. In this work, we tackle the above challenges by jointly learning and predicting the motion of all road users in a scene, using a novel convolutional neural network (CNN) and recurrent neural network (RNN) based architecture. Moreover, by exploiting grid-based input and output data structures, the computational cost is independent of the number of road users and multi-modal predictions become inherent properties of our proposed method. Evaluation on the nuScenes dataset shows that our approach reaches state-of-the-art results in the prediction benchmark.

Related papers

• CASPNet++: Joint Multi-Agent Motion Prediction [2.041875623674907]
  We present CASPNet++, an improved Context-Aware Scene Prediction Network (ASPNet) In this work, we focus on further enhancing the interaction modeling and scene understanding to support the joint prediction of all road users in a scene. We demonstrate the scalability of CASPNet++ in utilizing diverse environmental input sources such as HD maps, Radar detection, and Lidar segmentation.
  arXiv  Detail & Related papers  (2023-08-15T13:09:33Z)
• Interpretable Goal-Based model for Vehicle Trajectory Prediction in Interactive Scenarios [4.1665957033942105]
  Social interaction between a vehicle and its surroundings is critical for road safety in autonomous driving. We propose a neural network-based model for the task of vehicle trajectory prediction in an interactive environment. We implement and evaluate our model using the INTERACTION dataset and demonstrate the effectiveness of our proposed architecture.
  arXiv  Detail & Related papers  (2023-08-08T15:00:12Z)
• Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving [68.95178518732965]
  A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
  arXiv  Detail & Related papers  (2023-08-02T23:39:24Z)
• Exploring Attention GAN for Vehicle Motion Prediction [2.887073662645855]
  We study the influence of attention in generative models for motion prediction, considering both physical and social context. We validate our method using the Argoverse Motion Forecasting Benchmark 1.1, achieving competitive unimodal results.
  arXiv  Detail & Related papers  (2022-09-26T13:18:32Z)
• RSG-Net: Towards Rich Sematic Relationship Prediction for Intelligent Vehicle in Complex Environments [72.04891523115535]
  We propose RSG-Net (Road Scene Graph Net): a graph convolutional network designed to predict potential semantic relationships from object proposals. The experimental results indicate that this network, trained on Road Scene Graph dataset, could efficiently predict potential semantic relationships among objects around the ego-vehicle.
  arXiv  Detail & Related papers  (2022-07-16T12:40:17Z)
• Federated Deep Learning Meets Autonomous Vehicle Perception: Design and Verification [168.67190934250868]
  Federated learning empowered connected autonomous vehicle (FLCAV) has been proposed. FLCAV preserves privacy while reducing communication and annotation costs. It is challenging to determine the network resources and road sensor poses for multi-stage training.
  arXiv  Detail & Related papers  (2022-06-03T23:55:45Z)
• Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learning [63.25627328308978]
  We propose a-temporal prediction network pipeline to generate future occupancy predictions. Compared to current SOTA, our approach predicts occupancy for a longer horizon of 3 seconds. We publicly release our grid occupancy dataset based on nulis to support further research.
  arXiv  Detail & Related papers  (2022-05-06T13:45:32Z)
• Multi-modal Trajectory Prediction for Autonomous Driving with Semantic Map and Dynamic Graph Attention Network [12.791191495432829]
  There are several challenges in trajectory prediction in real-world traffic scenarios. Inspired by people's natural habit of navigating traffic with attention to their goals and surroundings, this paper presents a unique graph attention network. The network is designed to model the dynamic social interactions among agents and conform to traffic rules with a semantic map.
  arXiv  Detail & Related papers  (2021-03-30T11:53:12Z)
• DSDNet: Deep Structured self-Driving Network [92.9456652486422]
  We propose the Deep Structured self-Driving Network (DSDNet), which performs object detection, motion prediction, and motion planning with a single neural network. We develop a deep structured energy based model which considers the interactions between actors and produces socially consistent multimodal future predictions.
  arXiv  Detail & Related papers  (2020-08-13T17:54:06Z)
• Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for Online Collision Avoidance [95.86944752753564]
  We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties. Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates. The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
  arXiv  Detail & Related papers  (2020-07-28T07:34:30Z)
• Pedestrian Action Anticipation using Contextual Feature Fusion in Stacked RNNs [19.13270454742958]
  We propose a solution for the problem of pedestrian action anticipation at the point of crossing. Our approach uses a novel stacked RNN architecture in which information collected from various sources, both scene dynamics and visual features, is gradually fused into the network.
  arXiv  Detail & Related papers  (2020-05-13T20:59:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.