Towards Robust Human Trajectory Prediction in Raw Videos
- URL: http://arxiv.org/abs/2108.08259v1
- Date: Wed, 18 Aug 2021 17:27:26 GMT
- Title: Towards Robust Human Trajectory Prediction in Raw Videos
- Authors: Rui Yu and Zihan Zhou
- Abstract summary: We study the problem of human trajectory forecasting in raw videos.
We show that the prediction accuracy can be severely affected by various types of tracking errors.
We propose a simple yet effective strategy to correct the tracking failures by enforcing prediction consistency over time.
- Score: 8.301214274565819
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human trajectory prediction has received increased attention lately due to
its importance in applications such as autonomous vehicles and indoor robots.
However, most existing methods make predictions based on human-labeled
trajectories and ignore the errors and noises in detection and tracking. In
this paper, we study the problem of human trajectory forecasting in raw videos,
and show that the prediction accuracy can be severely affected by various types
of tracking errors. Accordingly, we propose a simple yet effective strategy to
correct the tracking failures by enforcing prediction consistency over time.
The proposed "re-tracking" algorithm can be applied to any existing tracking
and prediction pipelines. Experiments on public benchmark datasets demonstrate
that the proposed method can improve both tracking and prediction performance
in challenging real-world scenarios. The code and data are available at
https://git.io/retracking-prediction.
Related papers
- Pedestrian Trajectory Prediction with Missing Data: Datasets, Imputation, and Benchmarking [7.9449756510822915]
TrajImpute is a pedestrian trajectory prediction dataset that simulates missing coordinates in the observed trajectory.
In this work, we examine several imputation methods to reconstruct the missing coordinates and benchmark them for imputing pedestrian trajectories.
Our dataset provides a foundational resource for future research on imputation-aware pedestrian trajectory prediction.
arXiv Detail & Related papers (2024-10-31T19:42:42Z) - Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles [8.398221841050349]
Trajectory prediction describes the motions of surrounding moving obstacles for an autonomous vehicle.
In this paper, we aim to establish real-time awareness of out-of-distribution in trajectory prediction for autonomous vehicles.
Our solutions are lightweight and can handle the occurrence of out-of-distribution at any time during trajectory prediction inference.
arXiv Detail & Related papers (2024-09-25T18:43:58Z) - Certified Human Trajectory Prediction [66.1736456453465]
Tray prediction plays an essential role in autonomous vehicles.
We propose a certification approach tailored for the task of trajectory prediction.
We address the inherent challenges associated with trajectory prediction, including unbounded outputs, and mutli-modality.
arXiv Detail & Related papers (2024-03-20T17:41:35Z) - Adaptive Human Trajectory Prediction via Latent Corridors [49.13061580045407]
We formalize the problem of scene-specific adaptive trajectory prediction.
We propose a new adaptation approach inspired by prompt tuning called latent corridors.
With less than 0.1% additional model parameters, we see up to 23.9% ADE improvement in MOT Synth simulated data and 16.4% ADE in MOT and Wildtrack real pedestrian data.
arXiv Detail & Related papers (2023-12-11T18:59:12Z) - Pre-training on Synthetic Driving Data for Trajectory Prediction [61.520225216107306]
We propose a pipeline-level solution to mitigate the issue of data scarcity in trajectory forecasting.
We adopt HD map augmentation and trajectory synthesis for generating driving data, and then we learn representations by pre-training on them.
We conduct extensive experiments to demonstrate the effectiveness of our data expansion and pre-training strategies.
arXiv Detail & Related papers (2023-09-18T19:49:22Z) - Graph-based Spatial Transformer with Memory Replay for Multi-future
Pedestrian Trajectory Prediction [13.466380808630188]
We propose a model to forecast multiple paths based on a historical trajectory.
Our method can exploit the spatial information as well as correct the temporally inconsistent trajectories.
Our experiments show that the proposed model achieves state-of-the-art performance on multi-future prediction and competitive results for single-future prediction.
arXiv Detail & Related papers (2022-06-12T10:25:12Z) - Trajectory Forecasting from Detection with Uncertainty-Aware Motion
Encoding [121.66374635092097]
Trajectories obtained from object detection and tracking are inevitably noisy.
We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
arXiv Detail & Related papers (2022-02-03T09:09:56Z) - MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error
Propagation [39.41917241231786]
This paper addresses the problem of cascading errors by focusing on the coupling between the tracking and prediction modules.
By using state-of-the-art tracking and prediction tools, we conduct a comprehensive experimental evaluation of how severely errors stemming from tracking can impact prediction performance.
We show that this framework improves overall prediction performance over the standard single-hypothesis tracking-prediction pipeline by up to 34.2% on the nuScenes dataset.
arXiv Detail & Related papers (2021-10-18T17:30:59Z) - Human Trajectory Prediction via Counterfactual Analysis [87.67252000158601]
Forecasting human trajectories in complex dynamic environments plays a critical role in autonomous vehicles and intelligent robots.
Most existing methods learn to predict future trajectories by behavior clues from history trajectories and interaction clues from environments.
We propose a counterfactual analysis method for human trajectory prediction to investigate the causality between the predicted trajectories and input clues.
arXiv Detail & Related papers (2021-07-29T17:41:34Z) - SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory
Prediction [64.16212996247943]
We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction.
Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians.
visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
arXiv Detail & Related papers (2021-04-04T03:17:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.