Collaborative Trajectory Prediction via Late Fusion
- URL: http://arxiv.org/abs/2604.22973v1
- Date: Fri, 24 Apr 2026 19:34:56 GMT
- Title: Collaborative Trajectory Prediction via Late Fusion
- Abstract summary: Collaborative vehicle-to-vehicle approaches help reduce uncertainty by sharing complementary information.<n>We introduce a late-fusion framework for shared forecasts.<n>We evaluate the approach on the OPV2V, V2V4Real, and DeepAccident datasets.
- Score: 17.045815575131915
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Predicting future trajectories of surrounding traffic agents is critical for safe autonomous navigation and collision avoidance. Despite all advances in the trajectory forecasting realm, the prediction models remains vulnerable to uncertainty caused by occlusions, limited sensing range, and perception errors. Collaborative vehicle-to-vehicle (V2V) approaches help reduce this uncertainty by sharing complementary information. Existing collaborative trajectory prediction methods typically fuse feature maps at the perception stage to construct a holistic scene view. Further this holistic representation is decoded into the future trajectories. Such design incurs substantial communication overhead due to the exchange of high-dimensional feature representations and often assumes idealized bandwidth and synchronization, limiting practical deployment. We address these limitations by shifting collaboration from perception to the prediction module and introducing a late-fusion framework for shared forecasts. The framework is model-agnostic and treats collaborating vehicles as independent asynchronous agents. We evaluate the approach on the OPV2V, V2V4Real, and DeepAccident datasets, comparing individual and collaborative forecasting. Across all datasets, late fusion consistently reduces miss rate and improves trajectory success rate ($\mathrm{TSR}_{0.5}$), defined as the fraction of ground-truth agents with final displacement error below 0.5 m. On the real-world V2V4Real dataset, collaborative prediction improves the success rate by $1.69\%$ and $1.22\%$ for both intelligent vehicles, respectively, compared with individual forecasting.
Related papers
- Uncertainty-Aware Trajectory Prediction: A Unified Framework Harnessing Positional and Semantic Uncertainties [18.530958966955847]
Trajectory prediction seeks to forecast the future motion of dynamic entities, such as vehicles and pedestrians, given a temporal horizon of historical movement data.<n>A central challenge in this domain is the inherent uncertainty in real-time maps, arising from two primary sources.<n>We propose a novel unified framework that jointly models positional and semantic uncertainties and explicitly integrates them into the trajectory prediction pipeline.
arXiv Detail & Related papers (2026-03-31T07:35:55Z) - Don't double it: Efficient Agent Prediction in Occlusions [1.1338062042380708]
Occluded traffic agents pose a significant challenge for autonomous vehicles, as hidden pedestrians or vehicles can appear unexpectedly.<n>Existing learning-based methods often produce redundant occupancy predictions where a single agent is identified multiple times.<n>We introduce MatchInformer, a novel transformer-based approach that builds on the state-of-the-art SceneInformer architecture.
arXiv Detail & Related papers (2026-01-29T10:22:38Z) - Improving Consistency in Vehicle Trajectory Prediction Through Preference Optimization [4.506411269983418]
Trajectory prediction is an essential step in the pipeline of an autonomous vehicle.<n>Current deep-learning-based trajectory prediction models can achieve excellent accuracy on public datasets.<n>This work fine-tunes trajectory prediction models in multi-agent settings using preference optimization.
arXiv Detail & Related papers (2025-07-03T07:59:49Z) - MAP-Former: Multi-Agent-Pair Gaussian Joint Prediction [6.110153599741102]
There is a gap in risk assessment of trajectories between the trajectory information coming from a traffic motion prediction module and what is actually needed.
Existing prediction models yield joint predictions of agents' future trajectories with uncertainty weights or marginal Gaussian probability density functions (PDFs) for single agents.
This paper introduces a novel approach to motion prediction, focusing on predicting agent-pair covariance matrices in a scene-centric'' manner.
arXiv Detail & Related papers (2024-04-30T06:21:42Z) - Streaming Motion Forecasting for Autonomous Driving [71.7468645504988]
We introduce a benchmark that queries future trajectories on streaming data and we refer to it as "streaming forecasting"
Our benchmark inherently captures the disappearance and re-appearance of agents, which is a safety-critical problem yet overlooked by snapshot-based benchmarks.
We propose a plug-and-play meta-algorithm called "Predictive Streamer" that can adapt any snapshot-based forecaster into a streaming forecaster.
arXiv Detail & Related papers (2023-10-02T17:13:16Z) - Towards Motion Forecasting with Real-World Perception Inputs: Are
End-to-End Approaches Competitive? [93.10694819127608]
We propose a unified evaluation pipeline for forecasting methods with real-world perception inputs.
Our in-depth study uncovers a substantial performance gap when transitioning from curated to perception-based data.
arXiv Detail & Related papers (2023-06-15T17:03:14Z) - Leveraging Future Relationship Reasoning for Vehicle Trajectory
Prediction [27.614778027454417]
We propose a novel approach that uses lane information to predict a future relationship among agents.
To obtain a coarse future motion of agents, our method first predicts the probability of lane-level waypoint occupancy of vehicles.
We then utilize the temporal probability of passing adjacent lanes for each agent pair, assuming that agents passing adjacent lanes will highly interact.
arXiv Detail & Related papers (2023-05-24T04:33:28Z) - AdvDO: Realistic Adversarial Attacks for Trajectory Prediction [87.96767885419423]
Trajectory prediction is essential for autonomous vehicles to plan correct and safe driving behaviors.
We devise an optimization-based adversarial attack framework to generate realistic adversarial trajectories.
Our attack can lead an AV to drive off road or collide into other vehicles in simulation.
arXiv Detail & Related papers (2022-09-19T03:34:59Z) - Collaborative Uncertainty Benefits Multi-Agent Multi-Modal Trajectory Forecasting [61.02295959343446]
This work first proposes a novel concept, collaborative uncertainty (CU), which models the uncertainty resulting from interaction modules.<n>We build a general CU-aware regression framework with an original permutation-equivariant uncertainty estimator to do both tasks of regression and uncertainty estimation.<n>We apply the proposed framework to current SOTA multi-agent trajectory forecasting systems as a plugin module.
arXiv Detail & Related papers (2022-07-11T21:17:41Z) - SGCN:Sparse Graph Convolution Network for Pedestrian Trajectory
Prediction [64.16212996247943]
We present a Sparse Graph Convolution Network(SGCN) for pedestrian trajectory prediction.
Specifically, the SGCN explicitly models the sparse directed interaction with a sparse directed spatial graph to capture adaptive interaction pedestrians.
visualizations indicate that our method can capture adaptive interactions between pedestrians and their effective motion tendencies.
arXiv Detail & Related papers (2021-04-04T03:17:42Z) - The Importance of Prior Knowledge in Precise Multimodal Prediction [71.74884391209955]
Roads have well defined geometries, topologies, and traffic rules.
In this paper we propose to incorporate structured priors as a loss function.
We demonstrate the effectiveness of our approach on real-world self-driving datasets.
arXiv Detail & Related papers (2020-06-04T03:56:11Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.