FFINet: Future Feedback Interaction Network for Motion Forecasting
- URL: http://arxiv.org/abs/2311.04512v1
- Date: Wed, 8 Nov 2023 07:57:29 GMT
- Title: FFINet: Future Feedback Interaction Network for Motion Forecasting
- Authors: Miao Kang, Shengqi Wang, Sanping Zhou, Ke Ye, Jingjing Jiang, Nanning
Zheng
- Abstract summary: We propose a novel Future Feedback Interaction Network (FFINet) to aggregate features the current observations and potential future interactions for trajectory prediction.
Our FFINet achieves the state-of-the-art performance on Argoverse 1 and Argoverse 2 motion forecasting benchmarks.
- Score: 46.247396728154904
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Motion forecasting plays a crucial role in autonomous driving, with the aim
of predicting the future reasonable motions of traffic agents. Most existing
methods mainly model the historical interactions between agents and the
environment, and predict multi-modal trajectories in a feedforward process,
ignoring potential trajectory changes caused by future interactions between
agents. In this paper, we propose a novel Future Feedback Interaction Network
(FFINet) to aggregate features the current observations and potential future
interactions for trajectory prediction. Firstly, we employ different
spatial-temporal encoders to embed the decomposed position vectors and the
current position of each scene, providing rich features for the subsequent
cross-temporal aggregation. Secondly, the relative interaction and
cross-temporal aggregation strategies are sequentially adopted to integrate
features in the current fusion module, observation interaction module, future
feedback module and global fusion module, in which the future feedback module
can enable the understanding of pre-action by feeding the influence of preview
information to feedforward prediction. Thirdly, the comprehensive interaction
features are further fed into final predictor to generate the joint predicted
trajectories of multiple agents. Extensive experimental results show that our
FFINet achieves the state-of-the-art performance on Argoverse 1 and Argoverse 2
motion forecasting benchmarks.
Related papers
- Multi-Agent Trajectory Prediction with Difficulty-Guided Feature Enhancement Network [1.5888246742280365]
Trajectory prediction is crucial for autonomous driving as it aims to forecast future movements of traffic participants.
Traditional methods usually perform holistic inference on trajectories of agents, neglecting the differences in difficulty among agents.
This paper proposes a novel DifficultyGuided Feature Enhancement (DGFNet), which leverages the prediction difficulty differences among agents.
arXiv Detail & Related papers (2024-07-26T07:04:30Z) - Bidirectional Progressive Transformer for Interaction Intention Anticipation [20.53329698350243]
We introduce a Bidirectional Progressive mechanism into the anticipation of interaction intention.
We employ a Trajectory Unit and a C-VAE to introduce appropriate uncertainty to trajectories and interaction hotspots.
Our method achieves state-of-the-art results on three benchmark datasets.
arXiv Detail & Related papers (2024-05-09T05:22:18Z) - Neural Interaction Energy for Multi-Agent Trajectory Prediction [55.098754835213995]
We introduce a framework called Multi-Agent Trajectory prediction via neural interaction Energy (MATE)
MATE assesses the interactive motion of agents by employing neural interaction energy.
To bolster temporal stability, we introduce two constraints: inter-agent interaction constraint and intra-agent motion constraint.
arXiv Detail & Related papers (2024-04-25T12:47:47Z) - AMP: Autoregressive Motion Prediction Revisited with Next Token Prediction for Autonomous Driving [59.94343412438211]
We introduce the GPT style next token motion prediction into motion prediction.
Different from language data which is composed of homogeneous units -words, the elements in the driving scene could have complex spatial-temporal and semantic relations.
We propose to adopt three factorized attention modules with different neighbors for information aggregation and different position encoding styles to capture their relations.
arXiv Detail & Related papers (2024-03-20T06:22:37Z) - FIMP: Future Interaction Modeling for Multi-Agent Motion Prediction [18.10147252674138]
We propose Future Interaction modeling for Motion Prediction (FIMP), which captures potential future interactions in an end-to-end manner.
Experiments show that our future interaction modeling improves the performance remarkably, leading to superior performance on the Argoverse motion forecasting benchmark.
arXiv Detail & Related papers (2024-01-29T14:41:55Z) - ProspectNet: Weighted Conditional Attention for Future Interaction
Modeling in Behavior Prediction [5.520507323174275]
We formulate the end-to-end joint prediction problem as a sequential learning process of marginal learning and joint learning of vehicle behaviors.
We propose ProspectNet, a joint learning block that adopts the weighted attention score to model the mutual influence between interactive agent pairs.
We show that ProspectNet outperforms the Cartesian product of two marginal predictions, and achieves comparable performance on the Interactive Motion Prediction benchmarks.
arXiv Detail & Related papers (2022-08-29T19:29:49Z) - You Mostly Walk Alone: Analyzing Feature Attribution in Trajectory
Prediction [52.442129609979794]
Recent deep learning approaches for trajectory prediction show promising performance.
It remains unclear which features such black-box models actually learn to use for making predictions.
This paper proposes a procedure that quantifies the contributions of different cues to model performance.
arXiv Detail & Related papers (2021-10-11T14:24:15Z) - RAIN: Reinforced Hybrid Attention Inference Network for Motion
Forecasting [34.54878390622877]
We propose a generic motion forecasting framework with dynamic key information selection and ranking based on a hybrid attention mechanism.
The framework is instantiated to handle multi-agent trajectory prediction and human motion forecasting tasks.
We validate the framework on both synthetic simulations and motion forecasting benchmarks in different domains.
arXiv Detail & Related papers (2021-08-03T06:30:30Z) - Instance-Aware Predictive Navigation in Multi-Agent Environments [93.15055834395304]
We propose an Instance-Aware Predictive Control (IPC) approach, which forecasts interactions between agents as well as future scene structures.
We adopt a novel multi-instance event prediction module to estimate the possible interaction among agents in the ego-centric view.
We design a sequential action sampling strategy to better leverage predicted states on both scene-level and instance-level.
arXiv Detail & Related papers (2021-01-14T22:21:25Z) - End-to-end Contextual Perception and Prediction with Interaction
Transformer [79.14001602890417]
We tackle the problem of detecting objects in 3D and forecasting their future motion in the context of self-driving.
To capture their spatial-temporal dependencies, we propose a recurrent neural network with a novel Transformer architecture.
Our model can be trained end-to-end, and runs in real-time.
arXiv Detail & Related papers (2020-08-13T14:30:12Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.