Bandwidth-Adaptive Feature Sharing for Cooperative LIDAR Object
Detection
- URL: http://arxiv.org/abs/2010.11353v1
- Date: Thu, 22 Oct 2020 00:12:58 GMT
- Title: Bandwidth-Adaptive Feature Sharing for Cooperative LIDAR Object
Detection
- Authors: Ehsan Emad Marvasti, Arash Raftari, Amir Emad Marvasti, Yaser P.
Fallah
- Abstract summary: Situational awareness as a necessity in the connected and autonomous vehicles (CAV) domain.
Cooperative mechanisms have provided a solution to improve situational awareness by utilizing high speed wireless vehicular networks.
We propose a mechanism to add flexibility in adapting to communication channel capacity and a novel decentralized shared data alignment method.
- Score: 2.064612766965483
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Situational awareness as a necessity in the connected and autonomous vehicles
(CAV) domain is the subject of a significant number of researches in recent
years. The driver's safety is directly dependent on the robustness,
reliability, and scalability of such systems. Cooperative mechanisms have
provided a solution to improve situational awareness by utilizing high speed
wireless vehicular networks. These mechanisms mitigate problems such as
occlusion and sensor range limitation. However, the network capacity is a
factor determining the maximum amount of information being shared among
cooperative entities. The notion of feature sharing, proposed in our previous
work, aims to address these challenges by maintaining a balance between
computation and communication load. In this work, we propose a mechanism to add
flexibility in adapting to communication channel capacity and a novel
decentralized shared data alignment method to further improve cooperative
object detection performance. The performance of the proposed framework is
verified through experiments on Volony dataset. The results confirm that our
proposed framework outperforms our previous cooperative object detection method
(FS-COD) in terms of average precision.
Related papers
- Towards Interactive and Learnable Cooperative Driving Automation: a Large Language Model-Driven Decision-Making Framework [79.088116316919]
Connected Autonomous Vehicles (CAVs) have begun to open road testing around the world, but their safety and efficiency performance in complex scenarios is still not satisfactory.
This paper proposes CoDrivingLLM, an interactive and learnable LLM-driven cooperative driving framework.
arXiv Detail & Related papers (2024-09-19T14:36:00Z) - Semantic Communication for Cooperative Perception using HARQ [51.148203799109304]
We leverage an importance map to distill critical semantic information, introducing a cooperative perception semantic communication framework.
To counter the challenges posed by time-varying multipath fading, our approach incorporates the use of frequency-division multiplexing (OFDM) along with channel estimation and equalization strategies.
We introduce a novel semantic error detection method that is integrated with our semantic communication framework in the spirit of hybrid automatic repeated request (HARQ)
arXiv Detail & Related papers (2024-08-29T08:53:26Z) - On the Federated Learning Framework for Cooperative Perception [28.720571541022245]
Federated learning offers a promising solution by enabling data privacy-preserving collaborative enhancements in perception, decision-making, and planning among connected and autonomous vehicles.
This study introduces a specialized federated learning framework for CP, termed the federated dynamic weighted aggregation (FedDWA) algorithm.
This framework employs dynamic client weighting to direct model convergence and integrates a novel loss function that utilizes Kullback-Leibler divergence (KLD) to counteract detrimental effects of non-independently and identically distributed (Non-IID) and unbalanced data.
arXiv Detail & Related papers (2024-04-26T04:34:45Z) - Integrated Sensing, Computation, and Communication for UAV-assisted
Federated Edge Learning [52.7230652428711]
Federated edge learning (FEEL) enables privacy-preserving model training through periodic communication between edge devices and the server.
Unmanned Aerial Vehicle (UAV)mounted edge devices are particularly advantageous for FEEL due to their flexibility and mobility in efficient data collection.
arXiv Detail & Related papers (2023-06-05T16:01:33Z) - Attention Based Feature Fusion For Multi-Agent Collaborative Perception [4.120288148198388]
We propose an intermediate collaborative perception solution in the form of a graph attention network (GAT)
The proposed approach develops an attention-based aggregation strategy to fuse intermediate representations exchanged among multiple connected agents.
This approach adaptively highlights important regions in the intermediate feature maps at both the channel and spatial levels, resulting in improved object detection precision.
arXiv Detail & Related papers (2023-05-03T12:06:11Z) - Collaborative Mean Estimation over Intermittently Connected Networks
with Peer-To-Peer Privacy [86.61829236732744]
This work considers the problem of Distributed Mean Estimation (DME) over networks with intermittent connectivity.
The goal is to learn a global statistic over the data samples localized across distributed nodes with the help of a central server.
We study the tradeoff between collaborative relaying and privacy leakage due to the additional data sharing among nodes.
arXiv Detail & Related papers (2023-02-28T19:17:03Z) - Task-Oriented Sensing, Computation, and Communication Integration for
Multi-Device Edge AI [108.08079323459822]
This paper studies a new multi-intelligent edge artificial-latency (AI) system, which jointly exploits the AI model split inference and integrated sensing and communication (ISAC)
We measure the inference accuracy by adopting an approximate but tractable metric, namely discriminant gain.
arXiv Detail & Related papers (2022-07-03T06:57:07Z) - Online V2X Scheduling for Raw-Level Cooperative Perception [21.099819062731463]
Cooperative perception of connected vehicles comes to the rescue when the field of view restricts stand-alone intelligence.
We present a model of raw-level cooperative perception and formulate the energy minimization problem of sensor sharing scheduling.
We propose an online learning-based algorithm with logarithmic performance loss, achieving a decent trade-off between exploration and exploitation.
arXiv Detail & Related papers (2022-02-12T15:16:45Z) - Vehicular Cooperative Perception Through Action Branching and Federated
Reinforcement Learning [101.64598586454571]
A novel framework is proposed to allow reinforcement learning-based vehicular association, resource block (RB) allocation, and content selection of cooperative perception messages (CPMs)
A federated RL approach is introduced in order to speed up the training process across vehicles.
Results show that federated RL improves the training process, where better policies can be achieved within the same amount of time compared to the non-federated approach.
arXiv Detail & Related papers (2020-12-07T02:09:15Z) - Feature Sharing and Integration for Cooperative Cognition and Perception
with Volumetric Sensors [11.737037965090535]
We present an in-depth analysis of the notion of Deep Feature Sharing (DFS)
We explore different cooperative object detection designs and evaluate their performance in terms of average precision.
The results confirm that the DFS methods are significantly less sensitive to the localization error caused by GPS noise.
arXiv Detail & Related papers (2020-11-16T22:43:44Z) - Cooperative LIDAR Object Detection via Feature Sharing in Deep Networks [11.737037965090535]
We introduce the concept of feature sharing for cooperative object detection (FS-COD)
In our proposed approach, a better understanding of the environment is achieved by sharing partially processed data between cooperative vehicles.
It is shown that the proposed approach has significant performance superiority over the conventional single-vehicle object detection approaches.
arXiv Detail & Related papers (2020-02-19T20:47:09Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.