Cooperative Probabilistic Trajectory Forecasting under Occlusion
- URL: http://arxiv.org/abs/2312.03296v1
- Date: Wed, 6 Dec 2023 05:36:52 GMT
- Title: Cooperative Probabilistic Trajectory Forecasting under Occlusion
- Abstract summary: Occlusion-aware planning often requires communicating the information of the occluded object to the ego agent for safe navigation.
In this paper, we design an end-to-end network that cooperatively estimates the current states of occluded pedestrian in the reference frame of ego agent.
We show that the uncertainty-aware trajectory prediction of occluded pedestrian by the ego agent is almost similar to the ground truth trajectory assuming no occlusion.
- Score: 110.4960878651584
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Perception and planning under occlusion is essential for safety-critical
tasks. Occlusion-aware planning often requires communicating the information of
the occluded object to the ego agent for safe navigation. However,
communicating rich sensor information under adverse conditions during
communication loss and limited bandwidth may not be always feasible. Further,
in GPS denied environments and indoor navigation, localizing and sharing of
occluded objects can be challenging. To overcome this, relative pose estimation
between connected agents sharing a common field of view can be a
computationally effective way of communicating information about surrounding
objects. In this paper, we design an end-to-end network that cooperatively
estimates the current states of occluded pedestrian in the reference frame of
ego agent and then predicts the trajectory with safety guarantees.
Experimentally, we show that the uncertainty-aware trajectory prediction of
occluded pedestrian by the ego agent is almost similar to the ground truth
trajectory assuming no occlusion. The current research holds promise for
uncertainty-aware navigation among multiple connected agents under occlusion.
Related papers
- Task-Oriented Sensing and Covert Transmissions for Collaborative Multi-AUV Systems [67.63956000297922]
This paper proposes a Sensed Information Value Realization Multi-Agent Reinforcement Learning (SVR-MARL) framework to characterize the utility of information for cooperative tasks.<n>The potential of the proposed framework to improve collaborative task efficiency while reducing unnecessary communication and exposure risks is demonstrated.
arXiv Detail & Related papers (2026-07-15T14:29:25Z) - The Cost of Consensus: Malignant Epistemic Herding and Adaptive Gating in Distributed Multi-Agent Search [2.435326482104274]
Coordination is necessary to share beliefs to aid in task completion, but communication costs bandwidth, introduces latency, and if done poorly, can degrade collective reasoning.<n>This tension is especially acute in bandwidth-constrained deployments such as distributed sensing networks, autonomous reconnaissance, and collaborative cyber defense.<n>We formalize this distinction and show it is not detectable from coordination metrics alone such as Jensen-Shannon Divergence or rate to consensus.
arXiv Detail & Related papers (2026-05-07T22:07:25Z) - Prediction and Empowerment: A Theory of Agency through Bridge Interfaces [0.10152838128195464]
We study agency under partial observability in deterministic physical or simulated worlds.<n>We prove a separation between prediction, compression, and empowerment.<n>For modern AI agents, the results suggest a design principle rather than a theorem of inevitability.
arXiv Detail & Related papers (2026-05-07T14:30:46Z) - Multi-Agent Off-World Exploration for Sparse Evidence Discovery via Gaussian Belief Mapping and Dual-Domain Coverage [15.524614683513834]
We propose a multi-agent informative path planning framework for sparse evidence discovery based on Gaussian belief mapping and dual-domain coverage.<n> Experimental results in simulated lunar environments show that the proposed method consistently outperforms sampling-based and greedy baselines under different budgets and communication ranges.
arXiv Detail & Related papers (2026-03-08T14:27:41Z) - Towards Efficient 3D Object Detection for Vehicle-Infrastructure Collaboration via Risk-Intent Selection [23.186947629238233]
Risk-intent Selective detection (RiSe) is an interaction-aware framework that shifts the paradigm from identifying visible regions to prioritizing risk-critical ones.<n>RiSe implements a semantic-selective fusion scheme that transmits high-fidelity features only from high-interaction regions.<n>Our method reduces communication volume to 0.71% of full feature sharing while maintaining state-of-the-art detection accuracy.
arXiv Detail & Related papers (2026-01-06T13:25:23Z) - Multi-Agent-Driven Cognitive Secure Communications in Satellite-Terrestrial Networks [58.70163955407538]
Malicious eavesdroppers pose a serious threat to private information via satellite-terrestrial networks (STNs)<n>We propose a cognitive secure communication framework driven by multiple agents that coordinates spectrum scheduling and protection through real-time sensing.<n>We exploit generative adversarial networks to produce adversarial matrices, and employ learning-aided power control to set real and adversarial signal powers for protection layer.
arXiv Detail & Related papers (2026-01-06T10:30:41Z) - Privacy Preserving Semi-Decentralized Mean Estimation over Intermittently-Connected Networks [59.43433767253956]
We consider the problem of privately estimating the mean of vectors distributed across different nodes of an unreliable wireless network.
In a semi-decentralized setup, nodes can collaborate with their neighbors to compute a local consensus, which they relay to a central server.
We study the tradeoff between collaborative relaying and privacy leakage due to the data sharing among nodes.
arXiv Detail & Related papers (2024-06-06T06:12:15Z) - Edge-Assisted ML-Aided Uncertainty-Aware Vehicle Collision Avoidance at Urban Intersections [12.812518632907771]
We present a novel framework that detects preemptively collisions at urban crossroads.
We exploit the Multi-access Edge Computing platform of 5G networks.
arXiv Detail & Related papers (2024-04-22T18:45:40Z) - OOSTraj: Out-of-Sight Trajectory Prediction With Vision-Positioning Denoising [49.86409475232849]
Trajectory prediction is fundamental in computer vision and autonomous driving.
Existing approaches in this field often assume precise and complete observational data.
We present a novel method for out-of-sight trajectory prediction that leverages a vision-positioning technique.
arXiv Detail & Related papers (2024-04-02T18:30:29Z) - QuAD: Query-based Interpretable Neural Motion Planning for Autonomous Driving [33.609780917199394]
Self-driving vehicles must understand its environment to determine appropriate action.
Traditional systems rely on object detection to find agents in the scene.
We present a unified, interpretable, and efficient autonomy framework that moves away from cascading modules that first perceive occupancy relevant-temporal autonomy.
arXiv Detail & Related papers (2024-04-01T21:11:43Z) - Collaborative Optimization of the Age of Information under Partial
Observability [34.43476648472727]
Age of Information (AoI) is the freshness of sensor and control data at the receiver side.
We devise a decentralized AoI-minimizing transmission policy for a number of sensor agents sharing capacity-limited, non-FIFO duplex channels.
We also leverage mean-field control approximations and reinforcement learning to derive scalable and optimal solutions.
arXiv Detail & Related papers (2023-12-20T12:34:54Z) - Implicit Occupancy Flow Fields for Perception and Prediction in
Self-Driving [68.95178518732965]
A self-driving vehicle (SDV) must be able to perceive its surroundings and predict the future behavior of other traffic participants.
Existing works either perform object detection followed by trajectory of the detected objects, or predict dense occupancy and flow grids for the whole scene.
This motivates our unified approach to perception and future prediction that implicitly represents occupancy and flow over time with a single neural network.
arXiv Detail & Related papers (2023-08-02T23:39:24Z) - Over-the-Air Federated Learning with Privacy Protection via Correlated
Additive Perturbations [57.20885629270732]
We consider privacy aspects of wireless federated learning with Over-the-Air (OtA) transmission of gradient updates from multiple users/agents to an edge server.
Traditional perturbation-based methods provide privacy protection while sacrificing the training accuracy.
In this work, we aim at minimizing privacy leakage to the adversary and the degradation of model accuracy at the edge server.
arXiv Detail & Related papers (2022-10-05T13:13:35Z) - Learning Uncertainty For Safety-Oriented Semantic Segmentation In
Autonomous Driving [77.39239190539871]
We show how uncertainty estimation can be leveraged to enable safety critical image segmentation in autonomous driving.
We introduce a new uncertainty measure based on disagreeing predictions as measured by a dissimilarity function.
We show experimentally that our proposed approach is much less computationally intensive at inference time than competing methods.
arXiv Detail & Related papers (2021-05-28T09:23:05Z) - Learning-based 3D Occupancy Prediction for Autonomous Navigation in
Occluded Environments [7.825273522024438]
We propose a method based on deep neural network to predict occupancy distribution of unknown space reliably.
We use unlabeled and no-ground-truth data to train our network and successfully apply it to real-time navigation in unseen environments without any refinement.
arXiv Detail & Related papers (2020-11-08T13:51:34Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.