Adaptive Trajectory Prediction via Transferable GNN
- URL: http://arxiv.org/abs/2203.05046v1
- Date: Wed, 9 Mar 2022 21:08:47 GMT
- Title: Adaptive Trajectory Prediction via Transferable GNN
- Authors: Yi Xu, Lichen Wang, Yizhou Wang, Yun Fu
- Abstract summary: We propose a novel Transferable Graph Neural Network (T-GNN) framework, which jointly conducts trajectory prediction as well as domain alignment in a unified framework.
Specifically, a domain invariant GNN is proposed to explore the structural motion knowledge where the domain specific knowledge is reduced.
An attention-based adaptive knowledge learning module is further proposed to explore fine-grained individual-level feature representation for knowledge transfer.
- Score: 74.09424229172781
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Pedestrian trajectory prediction is an essential component in a wide range of
AI applications such as autonomous driving and robotics. Existing methods
usually assume the training and testing motions follow the same pattern while
ignoring the potential distribution differences (e.g., shopping mall and
street). This issue results in inevitable performance decrease. To address this
issue, we propose a novel Transferable Graph Neural Network (T-GNN) framework,
which jointly conducts trajectory prediction as well as domain alignment in a
unified framework. Specifically, a domain invariant GNN is proposed to explore
the structural motion knowledge where the domain specific knowledge is reduced.
Moreover, an attention-based adaptive knowledge learning module is further
proposed to explore fine-grained individual-level feature representation for
knowledge transfer. By this way, disparities across different trajectory
domains will be better alleviated. More challenging while practical trajectory
prediction experiments are designed, and the experimental results verify the
superior performance of our proposed model. To the best of our knowledge, our
work is the pioneer which fills the gap in benchmarks and techniques for
practical pedestrian trajectory prediction across different domains.
Related papers
- Recurrent Aligned Network for Generalized Pedestrian Trajectory
Prediction [43.98749443981923]
Pedestrian trajectory prediction is a crucial component in computer vision and robotics.
Previous studies have tried to tackle this problem by leveraging a portion of the trajectory data from the target domain to adapt the model.
We introduce a Recurrent Aligned Network(RAN) to minimize the domain gap through domain alignment.
arXiv Detail & Related papers (2024-03-09T06:17:09Z) - Knowledge-aware Graph Transformer for Pedestrian Trajectory Prediction [15.454206825258169]
Predicting pedestrian motion trajectories is crucial for path planning and motion control of autonomous vehicles.
Recent deep learning-based prediction approaches mainly utilize information like trajectory history and interactions between pedestrians.
This paper proposes a graph transformer structure to improve prediction performance.
arXiv Detail & Related papers (2024-01-10T01:50:29Z) - Towards Full-scene Domain Generalization in Multi-agent Collaborative
Bird's Eye View Segmentation for Connected and Autonomous Driving [54.60458503590669]
We propose a unified domain generalization framework applicable in both training and inference stages of collaborative perception.
We employ an Amplitude Augmentation (AmpAug) method to augment low-frequency image variations, broadening the model's ability to learn.
In the inference phase, we introduce an intra-system domain alignment mechanism to reduce or potentially eliminate the domain discrepancy.
arXiv Detail & Related papers (2023-11-28T12:52:49Z) - Learning Representative Trajectories of Dynamical Systems via
Domain-Adaptive Imitation [0.0]
We propose DATI, a deep reinforcement learning agent designed for domain-adaptive trajectory imitation.
Our experiments show that DATI outperforms baseline methods for imitation learning and optimal control in this setting.
Its generalization to a real-world scenario is shown through the discovery of abnormal motion patterns in maritime traffic.
arXiv Detail & Related papers (2023-04-19T15:53:48Z) - Visualizing Transferred Knowledge: An Interpretive Model of Unsupervised
Domain Adaptation [70.85686267987744]
Unsupervised domain adaptation problems can transfer knowledge from a labeled source domain to an unlabeled target domain.
We propose an interpretive model of unsupervised domain adaptation, as the first attempt to visually unveil the mystery of transferred knowledge.
Our method provides an intuitive explanation for the base model's predictions and unveils transfer knowledge by matching the image patches with the same semantics across both source and target domains.
arXiv Detail & Related papers (2023-03-04T03:02:12Z) - Trajectory Forecasting from Detection with Uncertainty-Aware Motion
Encoding [121.66374635092097]
Trajectories obtained from object detection and tracking are inevitably noisy.
We propose a trajectory predictor directly based on detection results without relying on explicitly formed trajectories.
arXiv Detail & Related papers (2022-02-03T09:09:56Z) - CTP-Net For Cross-Domain Trajectory Prediction [32.71173331555378]
Deep learning based trajectory prediction methods rely on large amount of annotated future trajectories.
It is desirable to adapt the model trained with the annotated source domain trajectories to the target domain.
We propose a Cross-domain Trajectory Prediction Network (CTP-Net), in which LSTMs are used to encode the observed trajectories of both domain.
arXiv Detail & Related papers (2021-10-22T08:18:31Z) - Divide-and-Conquer for Lane-Aware Diverse Trajectory Prediction [71.97877759413272]
Trajectory prediction is a safety-critical tool for autonomous vehicles to plan and execute actions.
Recent methods have achieved strong performances using Multi-Choice Learning objectives like winner-takes-all (WTA) or best-of-many.
Our work addresses two key challenges in trajectory prediction, learning outputs, and better predictions by imposing constraints using driving knowledge.
arXiv Detail & Related papers (2021-04-16T17:58:56Z) - Spatio-Temporal Graph Dual-Attention Network for Multi-Agent Prediction
and Tracking [23.608125748229174]
We propose a generic generative neural system for multi-agent trajectory prediction involving heterogeneous agents.
The proposed system is evaluated on three public benchmark datasets for trajectory prediction.
arXiv Detail & Related papers (2021-02-18T02:25:35Z) - Off-Dynamics Reinforcement Learning: Training for Transfer with Domain
Classifiers [138.68213707587822]
We propose a simple, practical, and intuitive approach for domain adaptation in reinforcement learning.
We show that we can achieve this goal by compensating for the difference in dynamics by modifying the reward function.
Our approach is applicable to domains with continuous states and actions and does not require learning an explicit model of the dynamics.
arXiv Detail & Related papers (2020-06-24T17:47:37Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.