Towards Robust Human Trajectory Prediction in Raw Videos
- URL: http://arxiv.org/abs/2108.08259v1
- Date: Wed, 18 Aug 2021 17:27:26 GMT
- Title: Towards Robust Human Trajectory Prediction in Raw Videos
- Authors: Rui Yu and Zihan Zhou
- Abstract summary: We study the problem of human trajectory forecasting in raw videos.
We show that the prediction accuracy can be severely affected by various types of tracking errors.
We propose a simple yet effective strategy to correct the tracking failures by enforcing prediction consistency over time.
- Score: 8.301214274565819
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human trajectory prediction has received increased attention lately due to
its importance in applications such as autonomous vehicles and indoor robots.
However, most existing methods make predictions based on human-labeled
trajectories and ignore the errors and noises in detection and tracking. In
this paper, we study the problem of human trajectory forecasting in raw videos,
and show that the prediction accuracy can be severely affected by various types
of tracking errors. Accordingly, we propose a simple yet effective strategy to
correct the tracking failures by enforcing prediction consistency over time.
The proposed "re-tracking" algorithm can be applied to any existing tracking
and prediction pipelines. Experiments on public benchmark datasets demonstrate
that the proposed method can improve both tracking and prediction performance
in challenging real-world scenarios. The code and data are available at
https://git.io/retracking-prediction.
Related papers
- Certified Human Trajectory Prediction [66.1736456453465]
Tray prediction plays an essential role in autonomous vehicles.
We propose a certification approach tailored for the task of trajectory prediction.
We address the inherent challenges associated with trajectory prediction, including unbounded outputs, and mutli-modality.
arXiv Detail & Related papers (2024-03-20T17:41:35Z) - Adaptive Human Trajectory Prediction via Latent Corridors [49.13061580045407]
We formalize the problem of scene-specific adaptive trajectory prediction.
We propose a new adaptation approach inspired by prompt tuning called latent corridors.
With less than 0.1% additional model parameters, we see up to 23.9% ADE improvement in MOT Synth simulated data and 16.4% ADE in MOT and Wildtrack real pedestrian data.
arXiv Detail & Related papers (2023-12-11T18:59:12Z) - Comparison of Pedestrian Prediction Models from Trajectory and
Appearance Data for Autonomous Driving [13.126949982768505]
The ability to anticipate pedestrian motion changes is a critical capability for autonomous vehicles.
In urban environments, pedestrians may enter the road area and create a high risk for driving.
This work presents a comparative evaluation of trajectory-only and appearance-based methods for pedestrian prediction.
arXiv Detail & Related papers (2023-05-25T11:24:38Z) - Graph-based Spatial Transformer with Memory Replay for Multi-future
Pedestrian Trajectory Prediction [13.466380808630188]
We propose a model to forecast multiple paths based on a historical trajectory.
Our method can exploit the spatial information as well as correct the temporally inconsistent trajectories.
Our experiments show that the proposed model achieves state-of-the-art performance on multi-future prediction and competitive results for single-future prediction.
arXiv Detail & Related papers (2022-06-12T10:25:12Z) - Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion [88.45326906116165]
We present a new framework to formulate the trajectory prediction task as a reverse process of motion indeterminacy diffusion (MID)
We encode the history behavior information and the social interactions as a state embedding and devise a Transformer-based diffusion model to capture the temporal dependencies of trajectories.
Experiments on the human trajectory prediction benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the superiority of our method.
arXiv Detail & Related papers (2022-03-25T16:59:08Z) - Trajectory Forecasting from Detection with Uncertainty-Aware Motion
Encoding [121.66374635092097]
Trajectories obtained from object detection and tracking are inevitably noisy.
We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
arXiv Detail & Related papers (2022-02-03T09:09:56Z) - MTP: Multi-Hypothesis Tracking and Prediction for Reduced Error
Propagation [39.41917241231786]
This paper addresses the problem of cascading errors by focusing on the coupling between the tracking and prediction modules.
By using state-of-the-art tracking and prediction tools, we conduct a comprehensive experimental evaluation of how severely errors stemming from tracking can impact prediction performance.
We show that this framework improves overall prediction performance over the standard single-hypothesis tracking-prediction pipeline by up to 34.2% on the nuScenes dataset.
arXiv Detail & Related papers (2021-10-18T17:30:59Z) - Human Trajectory Prediction via Counterfactual Analysis [87.67252000158601]
Forecasting human trajectories in complex dynamic environments plays a critical role in autonomous vehicles and intelligent robots.
Most existing methods learn to predict future trajectories by behavior clues from history trajectories and interaction clues from environments.
We propose a counterfactual analysis method for human trajectory prediction to investigate the causality between the predicted trajectories and input clues.
arXiv Detail & Related papers (2021-07-29T17:41:34Z) - SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory
Prediction [64.16212996247943]
We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction.
Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians.
visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
arXiv Detail & Related papers (2021-04-04T03:17:42Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.