Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks

• URL: http://arxiv.org/abs/2301.04454v1
• Date: Wed, 11 Jan 2023 13:23:21 GMT
• Title: Allo-centric Occupancy Grid Prediction for Urban Traffic Scene Using Video Prediction Networks
• Authors: Rabbia Asghar, Lukas Rummelhard, Anne Spalanzani, Christian Laugier
• Abstract summary: We propose a novel framework to make long-term predictions by representing the traffic scene in a fixed frame. We study the allo-centric grid prediction with different video prediction networks and validate the approach on the real-world Nuscenes dataset.
• Score: 7.639067237772287
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Prediction of dynamic environment is crucial to safe navigation of an autonomous vehicle. Urban traffic scenes are particularly challenging to forecast due to complex interactions between various dynamic agents, such as vehicles and vulnerable road users. Previous approaches have used egocentric occupancy grid maps to represent and predict dynamic environments. However, these predictions suffer from blurriness, loss of scene structure at turns, and vanishing of agents over longer prediction horizon. In this work, we propose a novel framework to make long-term predictions by representing the traffic scene in a fixed frame, referred as allo-centric occupancy grid. This allows for the static scene to remain fixed and to represent motion of the ego-vehicle on the grid like other agents'. We study the allo-centric grid prediction with different video prediction networks and validate the approach on the real-world Nuscenes dataset. The results demonstrate that the allo-centric grid representation significantly improves scene prediction, in comparison to the conventional ego-centric grid approach.

Related papers

• Flow-guided Motion Prediction with Semantics and Dynamic Occupancy Grid Maps [5.9803668726235575]
  Occupancy Grid Maps (OGMs) are commonly employed for scene prediction. Recent studies have successfully combined OGMs with deep learning methods to predict the evolution of scene. We propose a novel multi-task framework that leverages dynamic OGMs and semantic information to predict both future vehicle semantic grids and the future flow of the scene.
  arXiv  Detail & Related papers  (2024-07-22T14:42:34Z)
• PIP-Net: Pedestrian Intention Prediction in the Wild [11.799731429829603]
  PIP-Net is a novel framework designed to predict pedestrian crossing intentions by AVs in real-world urban scenarios. We offer two variants of PIP-Net designed for different camera mounts and setups. The proposed model employs a recurrent and temporal attention-based solution, outperforming state-of-the-art performance. For the first time, we present the Urban-PIP dataset, a customised pedestrian intention prediction dataset.
  arXiv  Detail & Related papers  (2024-02-20T08:28:45Z)
• Implicit Occupancy Flow Fields for Perception and Prediction in Self-Driving [68.95178518732965]
  A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants. Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene. This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
  arXiv  Detail & Related papers  (2023-08-02T23:39:24Z)
• LOPR: Latent Occupancy PRediction using Generative Models [49.15687400958916]
  LiDAR generated occupancy grid maps (L-OGMs) offer a robust bird's eye-view scene representation. We propose a framework that decouples occupancy prediction into: representation learning and prediction within the learned latent space.
  arXiv  Detail & Related papers  (2022-10-03T22:04:00Z)
• Predicting Future Occupancy Grids in Dynamic Environment with Spatio-Temporal Learning [63.25627328308978]
  We propose a-temporal prediction network pipeline to generate future occupancy predictions. Compared to current SOTA, our approach predicts occupancy for a longer horizon of 3 seconds. We publicly release our grid occupancy dataset based on nulis to support further research.
  arXiv  Detail & Related papers  (2022-05-06T13:45:32Z)
• Predicting Vehicles Trajectories in Urban Scenarios with Transformer Networks and Augmented Information [0.0]
  This paper exploits simple structures for predicting pedestrian trajectories, based on Transformer Networks. We adapt their use to the problem of vehicle trajectory prediction in urban scenarios in prediction horizons up to 5 seconds. Our model achieves state-of-the-art results and proves to be flexible and adaptable to different types of urban contexts.
  arXiv  Detail & Related papers  (2021-06-01T15:18:55Z)
• Safety-Oriented Pedestrian Motion and Scene Occupancy Forecasting [91.69900691029908]
  We advocate for predicting both the individual motions as well as the scene occupancy map. We propose a Scene-Actor Graph Neural Network (SA-GNN) which preserves the relative spatial information of pedestrians. On two large-scale real-world datasets, we showcase that our scene-occupancy predictions are more accurate and better calibrated than those from state-of-the-art motion forecasting methods.
  arXiv  Detail & Related papers  (2021-01-07T06:08:21Z)
• Implicit Latent Variable Model for Scene-Consistent Motion Forecasting [78.74510891099395]
  In this paper, we aim to learn scene-consistent motion forecasts of complex urban traffic directly from sensor data. We model the scene as an interaction graph and employ powerful graph neural networks to learn a distributed latent representation of the scene.
  arXiv  Detail & Related papers  (2020-07-23T14:31:25Z)
• TPNet: Trajectory Proposal Network for Motion Prediction [81.28716372763128]
  Trajectory Proposal Network (TPNet) is a novel two-stage motion prediction framework. TPNet first generates a candidate set of future trajectories as hypothesis proposals, then makes the final predictions by classifying and refining the proposals. Experiments on four large-scale trajectory prediction datasets, show that TPNet achieves the state-of-the-art results both quantitatively and qualitatively.
  arXiv  Detail & Related papers  (2020-04-26T00:01:49Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.