Human Trajectory Prediction via Counterfactual Analysis

• URL: http://arxiv.org/abs/2107.14202v1
• Date: Thu, 29 Jul 2021 17:41:34 GMT
• Title: Human Trajectory Prediction via Counterfactual Analysis
• Authors: Guangyi Chen, Junlong Li, Jiwen Lu, Jie Zhou
• Abstract summary: Forecasting human trajectories in complex dynamic environments plays a critical role in autonomous vehicles and intelligent robots. Most existing methods learn to predict future trajectories by behavior clues from history trajectories and interaction clues from environments. We propose a counterfactual analysis method for human trajectory prediction to investigate the causality between the predicted trajectories and input clues.
• Score: 87.67252000158601
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Forecasting human trajectories in complex dynamic environments plays a critical role in autonomous vehicles and intelligent robots. Most existing methods learn to predict future trajectories by behavior clues from history trajectories and interaction clues from environments. However, the inherent bias between training and deployment environments is ignored. Hence, we propose a counterfactual analysis method for human trajectory prediction to investigate the causality between the predicted trajectories and input clues and alleviate the negative effects brought by environment bias. We first build a causal graph for trajectory forecasting with history trajectory, future trajectory, and the environment interactions. Then, we cut off the inference from environment to trajectory by constructing the counterfactual intervention on the trajectory itself. Finally, we compare the factual and counterfactual trajectory clues to alleviate the effects of environment bias and highlight the trajectory clues. Our counterfactual analysis is a plug-and-play module that can be applied to any baseline prediction methods including RNN- and CNN-based ones. We show that our method achieves consistent improvement for different baselines and obtains the state-of-the-art results on public pedestrian trajectory forecasting benchmarks.

Related papers

• Building Real-time Awareness of Out-of-distribution in Trajectory Prediction for Autonomous Vehicles [8.398221841050349]
  Trajectory prediction describes the motions of surrounding moving obstacles for an autonomous vehicle. In this paper, we aim to establish real-time awareness of out-of-distribution in trajectory prediction for autonomous vehicles. Our solutions are lightweight and can handle the occurrence of out-of-distribution at any time during trajectory prediction inference.
  arXiv  Detail & Related papers  (2024-09-25T18:43:58Z)
• Forecasting Human Trajectory from Scene History [51.72069374835107]
  We propose to forecast a person's future trajectory by learning from the implicit scene regularities. We categorize scene history information into two types: historical group trajectory and individual-surroundings interaction. We propose a novel framework Scene History Excavating Network (SHENet), where the scene history is leveraged in a simple yet effective approach.
  arXiv  Detail & Related papers  (2022-10-17T03:56:02Z)
• Action-based Contrastive Learning for Trajectory Prediction [4.675212251005813]
  Trajectory prediction is an essential task for successful human robot interaction, such as in autonomous driving. In this work, we address the problem of predicting future pedestrian trajectories in a first person view setting with a moving camera. We propose a novel action-based contrastive learning loss, that utilizes pedestrian action information to improve the learned trajectory embeddings.
  arXiv  Detail & Related papers  (2022-07-18T15:02:27Z)
• Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion [88.45326906116165]
  We present a new framework to formulate the trajectory prediction task as a reverse process of motion indeterminacy diffusion (MID) We encode the history behavior information and the social interactions as a state embedding and devise a Transformer-based diffusion model to capture the temporal dependencies of trajectories. Experiments on the human trajectory prediction benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the superiority of our method.
  arXiv  Detail & Related papers  (2022-03-25T16:59:08Z)
• Trajectory Forecasting from Detection with Uncertainty-Aware Motion Encoding [121.66374635092097]
  Trajectories obtained from object detection and tracking are inevitably noisy. We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
  arXiv  Detail & Related papers  (2022-02-03T09:09:56Z)
• You Mostly Walk Alone: Analyzing Feature Attribution in Trajectory Prediction [52.442129609979794]
  Recent deep learning approaches for trajectory prediction show promising performance. It remains unclear which features such black-box models actually learn to use for making predictions. This paper proposes a procedure that quantifies the contributions of different cues to model performance.
  arXiv  Detail & Related papers  (2021-10-11T14:24:15Z)
• Towards Robust Human Trajectory Prediction in Raw Videos [8.301214274565819]
  We study the problem of human trajectory forecasting in raw videos. We show that the prediction accuracy can be severely affected by various types of tracking errors. We propose a simple yet effective strategy to correct the tracking failures by enforcing prediction consistency over time.
  arXiv  Detail & Related papers  (2021-08-18T17:27:26Z)
• SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory Prediction [64.16212996247943]
  We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction. Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians. visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
  arXiv  Detail & Related papers  (2021-04-04T03:17:42Z)
• Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction and Tracking [23.608125748229174]
  We propose a generic generative neural system for multi-agent trajectory prediction involving heterogeneous agents. The proposed system is evaluated on three public benchmark datasets for trajectory prediction.
  arXiv  Detail & Related papers  (2021-02-18T02:25:35Z)
• Social-WaGDAT: Interaction-aware Trajectory Prediction via Wasserstein Graph Double-Attention Network [29.289670231364788]
  In this paper, we propose a generic generative neural system for multi-agent trajectory prediction. We also employ an efficient kinematic constraint layer applied to vehicle trajectory prediction. The proposed system is evaluated on three public benchmark datasets for trajectory prediction.
  arXiv  Detail & Related papers  (2020-02-14T20:11:13Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.