JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds
- URL: http://arxiv.org/abs/2311.02736v1
- Date: Sun, 5 Nov 2023 18:59:31 GMT
- Title: JRDB-Traj: A Dataset and Benchmark for Trajectory Forecasting in Crowds
- Authors: Saeed Saadatnejad, Yang Gao, Hamid Rezatofighi, Alexandre Alahi
- Abstract summary: Trajectory forecasting models, employed in fields such as robotics, autonomous vehicles, and navigation, face challenges in real-world scenarios.
This dataset provides comprehensive data, including the locations of all agents, scene images, and point clouds, all from the robot's perspective.
The objective is to predict the future positions of agents relative to the robot using raw sensory input data.
- Score: 79.00975648564483
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predicting future trajectories is critical in autonomous navigation,
especially in preventing accidents involving humans, where a predictive agent's
ability to anticipate in advance is of utmost importance. Trajectory
forecasting models, employed in fields such as robotics, autonomous vehicles,
and navigation, face challenges in real-world scenarios, often due to the
isolation of model components. To address this, we introduce a novel dataset
for end-to-end trajectory forecasting, facilitating the evaluation of models in
scenarios involving less-than-ideal preceding modules such as tracking. This
dataset, an extension of the JRDB dataset, provides comprehensive data,
including the locations of all agents, scene images, and point clouds, all from
the robot's perspective. The objective is to predict the future positions of
agents relative to the robot using raw sensory input data. It bridges the gap
between isolated models and practical applications, promoting a deeper
understanding of navigation dynamics. Additionally, we introduce a novel metric
for assessing trajectory forecasting models in real-world scenarios where
ground-truth identities are inaccessible, addressing issues related to
undetected or over-detected agents. Researchers are encouraged to use our
benchmark for model evaluation and benchmarking.
Related papers
- Navigation under uncertainty: Trajectory prediction and occlusion reasoning with switching dynamical systems [36.18758962312406]
We propose a conceptual framework unifying trajectory prediction and occlusion reasoning under the same class of structured probabilistic generative model.
We then present some initial experiments illustrating its capabilities using the open dataset.
arXiv Detail & Related papers (2024-10-14T16:03:41Z) - Vectorized Representation Dreamer (VRD): Dreaming-Assisted Multi-Agent Motion-Forecasting [2.2020053359163305]
We introduce VRD, a vectorized world model-inspired approach to the multi-agent motion forecasting problem.
Our method combines a traditional open-loop training regime with a novel dreamed closed-loop training pipeline.
Our model achieves state-of-the-art performance on the single prediction miss rate metric.
arXiv Detail & Related papers (2024-06-20T15:34:17Z) - Conditioned Human Trajectory Prediction using Iterative Attention Blocks [70.36888514074022]
We present a simple yet effective pedestrian trajectory prediction model aimed at pedestrians positions prediction in urban-like environments.
Our model is a neural-based architecture that can run several layers of attention blocks and transformers in an iterative sequential fashion.
We show that without explicit introduction of social masks, dynamical models, social pooling layers, or complicated graph-like structures, it is possible to produce on par results with SoTA models.
arXiv Detail & Related papers (2022-06-29T07:49:48Z) - Predicting Future Occupancy Grids in Dynamic Environment with
Spatio-Temporal Learning [63.25627328308978]
We propose a-temporal prediction network pipeline to generate future occupancy predictions.
Compared to current SOTA, our approach predicts occupancy for a longer horizon of 3 seconds.
We publicly release our grid occupancy dataset based on nulis to support further research.
arXiv Detail & Related papers (2022-05-06T13:45:32Z) - Goal-driven Self-Attentive Recurrent Networks for Trajectory Prediction [31.02081143697431]
Human trajectory forecasting is a key component of autonomous vehicles, social-aware robots and video-surveillance applications.
We propose a lightweight attention-based recurrent backbone that acts solely on past observed positions.
We employ a common goal module, based on a U-Net architecture, which additionally extracts semantic information to predict scene-compliant destinations.
arXiv Detail & Related papers (2022-04-25T11:12:37Z) - TRiPOD: Human Trajectory and Pose Dynamics Forecasting in the Wild [77.59069361196404]
TRiPOD is a novel method for predicting body dynamics based on graph attentional networks.
To incorporate a real-world challenge, we learn an indicator representing whether an estimated body joint is visible/invisible at each frame.
Our evaluation shows that TRiPOD outperforms all prior work and state-of-the-art specifically designed for each of the trajectory and pose forecasting tasks.
arXiv Detail & Related papers (2021-04-08T20:01:00Z) - Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction
and Tracking [23.608125748229174]
We propose a generic generative neural system for multi-agent trajectory prediction involving heterogeneous agents.
The proposed system is evaluated on three public benchmark datasets for trajectory prediction.
arXiv Detail & Related papers (2021-02-18T02:25:35Z) - Risk-Averse MPC via Visual-Inertial Input and Recurrent Networks for
Online Collision Avoidance [95.86944752753564]
We propose an online path planning architecture that extends the model predictive control (MPC) formulation to consider future location uncertainties.
Our algorithm combines an object detection pipeline with a recurrent neural network (RNN) which infers the covariance of state estimates.
The robustness of our methods is validated on complex quadruped robot dynamics and can be generally applied to most robotic platforms.
arXiv Detail & Related papers (2020-07-28T07:34:30Z) - Spatiotemporal Relationship Reasoning for Pedestrian Intent Prediction [57.56466850377598]
Reasoning over visual data is a desirable capability for robotics and vision-based applications.
In this paper, we present a framework on graph to uncover relationships in different objects in the scene for reasoning about pedestrian intent.
Pedestrian intent, defined as the future action of crossing or not-crossing the street, is a very crucial piece of information for autonomous vehicles.
arXiv Detail & Related papers (2020-02-20T18:50:44Z) - Trajectron++: Dynamically-Feasible Trajectory Forecasting With
Heterogeneous Data [37.176411554794214]
Reasoning about human motion is an important prerequisite to safe and socially-aware robotic navigation.
We present Trajectron++, a modular, graph-structured recurrent model that forecasts the trajectories of a general number of diverse agents.
We demonstrate its performance on several challenging real-world trajectory forecasting datasets.
arXiv Detail & Related papers (2020-01-09T16:47:17Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.