Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion
- URL: http://arxiv.org/abs/2203.13777v1
- Date: Fri, 25 Mar 2022 16:59:08 GMT
- Title: Stochastic Trajectory Prediction via Motion Indeterminacy Diffusion
- Authors: Tianpei Gu, Guangyi Chen, Junlong Li, Chunze Lin, Yongming Rao, Jie
Zhou, Jiwen Lu
- Abstract summary: We present a new framework to formulate the trajectory prediction task as a reverse process of motion indeterminacy diffusion (MID)
We encode the history behavior information and the social interactions as a state embedding and devise a Transformer-based diffusion model to capture the temporal dependencies of trajectories.
Experiments on the human trajectory prediction benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the superiority of our method.
- Score: 88.45326906116165
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human behavior has the nature of indeterminacy, which requires the pedestrian
trajectory prediction system to model the multi-modality of future motion
states. Unlike existing stochastic trajectory prediction methods which usually
use a latent variable to represent multi-modality, we explicitly simulate the
process of human motion variation from indeterminate to determinate. In this
paper, we present a new framework to formulate the trajectory prediction task
as a reverse process of motion indeterminacy diffusion (MID), in which we
progressively discard indeterminacy from all the walkable areas until reaching
the desired trajectory. This process is learned with a parameterized Markov
chain conditioned by the observed trajectories. We can adjust the length of the
chain to control the degree of indeterminacy and balance the diversity and
determinacy of the predictions. Specifically, we encode the history behavior
information and the social interactions as a state embedding and devise a
Transformer-based diffusion model to capture the temporal dependencies of
trajectories. Extensive experiments on the human trajectory prediction
benchmarks including the Stanford Drone and ETH/UCY datasets demonstrate the
superiority of our method. Code is available at
https://github.com/gutianpei/MID.
Related papers
- AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving [59.94343412438211]
We introduce the GPT style next token motion prediction into motion prediction.
Different from language data which is composed of homogeneous units -words, the elements in the driving scene could have complex spatial-temporal and semantic relations.
We propose to adopt three factorized attention modules with different neighbors for information aggregation and different position encoding styles to capture their relations.
arXiv Detail & Related papers (2024-03-20T06:22:37Z) - Mixed Gaussian Flow for Diverse Trajectory Prediction [78.00204650749453]
We propose a flow-based model to transform a mixed Gaussian prior into the future trajectory manifold.
The model shows a better capacity for generating diverse trajectory patterns.
We also demonstrate that it can generate diverse, controllable, and out-of-distribution trajectories.
arXiv Detail & Related papers (2024-02-19T15:48:55Z) - Uncovering the human motion pattern: Pattern Memory-based Diffusion
Model for Trajectory Prediction [45.77348842004666]
Motion Pattern Priors Memory Network is a memory-based method to uncover latent motion patterns in human behavior.
We introduce an addressing mechanism to retrieve the matched pattern and the potential target distributions for each prediction from the memory bank.
Experiments validate the effectiveness of our approach, achieving state-of-the-art trajectory prediction accuracy.
arXiv Detail & Related papers (2024-01-05T17:39:52Z) - Improving Trajectory Prediction in Dynamic Multi-Agent Environment by
Dropping Waypoints [9.385936248154987]
Motion prediction systems must learn spatial and temporal information from the past to forecast the future trajectories of the agent.
We propose Temporal Waypoint Dropping (TWD) that explicitly incorporates temporal dependencies during the training of a trajectory prediction model.
We evaluate our proposed approach on three datasets: NBA Sports VU, ETH-UCY, and TrajNet++.
arXiv Detail & Related papers (2023-09-29T15:48:35Z) - STGlow: A Flow-based Generative Framework with Dual Graphormer for
Pedestrian Trajectory Prediction [22.553356096143734]
We propose a novel generative flow based framework with dual graphormer for pedestrian trajectory prediction (STGlow)
Our method can more precisely model the underlying data distribution by optimizing the exact log-likelihood of motion behaviors.
Experimental results on several benchmarks demonstrate that our method achieves much better performance compared to previous state-of-the-art approaches.
arXiv Detail & Related papers (2022-11-21T07:29:24Z) - Human Joint Kinematics Diffusion-Refinement for Stochastic Motion
Prediction [22.354538952573158]
MotionDiff is a diffusion probabilistic model to treat the kinematics of human joints as heated particles.
MotionDiff consists of two parts: a spatial-temporal transformer-based diffusion network to generate diverse yet plausible motions, and a graph convolutional network to further refine the outputs.
arXiv Detail & Related papers (2022-10-12T07:38:33Z) - Graph-based Spatial Transformer with Memory Replay for Multi-future
Pedestrian Trajectory Prediction [13.466380808630188]
We propose a model to forecast multiple paths based on a historical trajectory.
Our method can exploit the spatial information as well as correct the temporally inconsistent trajectories.
Our experiments show that the proposed model achieves state-of-the-art performance on multi-future prediction and competitive results for single-future prediction.
arXiv Detail & Related papers (2022-06-12T10:25:12Z) - Weakly-supervised Action Transition Learning for Stochastic Human Motion
Prediction [81.94175022575966]
We introduce the task of action-driven human motion prediction.
It aims to predict multiple plausible future motions given a sequence of action labels and a short motion history.
arXiv Detail & Related papers (2022-05-31T08:38:07Z) - SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory
Prediction [64.16212996247943]
We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction.
Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians.
visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
arXiv Detail & Related papers (2021-04-04T03:17:42Z) - SMART: Simultaneous Multi-Agent Recurrent Trajectory Prediction [72.37440317774556]
We propose advances that address two key challenges in future trajectory prediction.
multimodality in both training data and predictions and constant time inference regardless of number of agents.
arXiv Detail & Related papers (2020-07-26T08:17:10Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.