Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration

• URL: http://arxiv.org/abs/2508.07092v1
• Date: Sat, 09 Aug 2025 20:33:37 GMT
• Title: Communication-Efficient Multi-Agent 3D Detection via Hybrid Collaboration
• Authors: Yue Hu, Juntong Peng, Yunqiao Yang, Siheng Chen,
• Abstract summary: Collaborative 3D detection can substantially boost detection performance by allowing agents to exchange complementary information.<n>We propose a novel hybrid collaboration that adaptively integrates two types of communication messages.<n>We present textttHyComm, a communication-efficient LiDAR-based collaborative 3D detection system.
• Score: 34.67157102711333
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Collaborative 3D detection can substantially boost detection performance by allowing agents to exchange complementary information. It inherently results in a fundamental trade-off between detection performance and communication bandwidth. To tackle this bottleneck issue, we propose a novel hybrid collaboration that adaptively integrates two types of communication messages: perceptual outputs, which are compact, and raw observations, which offer richer information. This approach focuses on two key aspects: i) integrating complementary information from two message types and ii) prioritizing the most critical data within each type. By adaptively selecting the most critical set of messages, it ensures optimal perceptual information and adaptability, effectively meeting the demands of diverse communication scenarios.Building on this hybrid collaboration, we present \texttt{HyComm}, a communication-efficient LiDAR-based collaborative 3D detection system. \texttt{HyComm} boasts two main benefits: i) it facilitates adaptable compression rates for messages, addressing various communication requirements, and ii) it uses standardized data formats for messages. This ensures they are independent of specific detection models, fostering adaptability across different agent configurations. To evaluate HyComm, we conduct experiments on both real-world and simulation datasets: DAIR-V2X and OPV2V. HyComm consistently outperforms previous methods and achieves a superior performance-bandwidth trade-off regardless of whether agents use the same or varied detection models. It achieves a lower communication volume of more than 2,006$\times$ and still outperforms Where2comm on DAIR-V2X in terms of AP50. The related code will be released.

Related papers

• Rate-Distortion Optimized Communication for Collaborative Perception [47.737814518681326]
  We introduce a pragmatic rate-distortion theory for multi-agent collaboration, specifically formulated to analyze performance-communication trade-off.<n>We propose RDcomm, a communication-efficient collaborative perception framework that introduces two key innovations.<n>Experiments on 3D object detection and BEV segmentation demonstrate that RDcomm achieves state-of-the-art accuracy on DAIR-V2X and OPV2V, while reducing communication volume by up to 108 times.
  arXiv  Detail & Related papers  (2025-09-26T07:21:32Z)
• AnyMAC: Cascading Flexible Multi-Agent Collaboration via Next-Agent Prediction [70.60422261117816]
  We propose a new framework that rethinks multi-agent coordination through a sequential structure rather than a graph structure.<n>Our method focuses on two key directions: (1) Next-Agent Prediction, which selects the most suitable agent role at each step, and (2) Next-Context Selection, which enables each agent to selectively access relevant information from any previous step.
  arXiv  Detail & Related papers  (2025-06-21T18:34:43Z)
• Prototype-Based Information Compensation Network for Multi-Source Remote Sensing Data Classification [56.065032039986725]
  Multi-source remote sensing data joint classification aims to provide accuracy and reliability of land cover classification.<n>Existing methods confront two challenges: inter-frequency multi-source feature coupling and inconsistency of complementary information exploration.<n>We present a Prototype-based Information Compensation Network (PICNet) for land cover classification based on HSI and SAR/LiDAR data.
  arXiv  Detail & Related papers  (2025-05-06T22:30:23Z)
• CoCMT: Communication-Efficient Cross-Modal Transformer for Collaborative Perception [14.619784179608361]
  Multi-agent collaborative perception enhances each agent's capabilities by sharing sensing information to cooperatively perform robot perception tasks.<n>Existing representative collaborative perception systems transmit intermediate feature maps, which contain significant amount of non-critical information.<n>We introduce CoCMT, an object-query-based collaboration framework that maximizes communication bandwidth by selectively extracting and transmitting essential features.
  arXiv  Detail & Related papers  (2025-03-13T06:41:25Z)
• Communication-Efficient Collaborative Perception via Information Filling with Codebook [48.087934650038044]
  Collaborative perception empowers each agent to improve its perceptual ability through the exchange of perceptual messages with other agents. To address this bottleneck issue, our core idea is to optimize the collaborative messages from two key aspects: representation and selection. By integrating these two designs, we propose CodeFilling, a novel communication-efficient collaborative perception system.
  arXiv  Detail & Related papers  (2024-05-08T11:12:37Z)
• Pragmatic Communication in Multi-Agent Collaborative Perception [80.14322755297788]
  Collaborative perception results in a trade-off between perception ability and communication costs. We propose PragComm, a multi-agent collaborative perception system with two key components. PragComm consistently outperforms previous methods with more than 32.7K times lower communication volume.
  arXiv  Detail & Related papers  (2024-01-23T11:58:08Z)
• Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Maps [24.47241495415147]
  Multi-agent collaborative perception could significantly upgrade the perception performance. It inevitably results in a fundamental trade-off between perception performance and communication bandwidth. We propose a spatial confidence map, which reflects the spatial heterogeneity of perceptual information. We propose Where2comm, a communication-efficient collaborative perception framework.
  arXiv  Detail & Related papers  (2022-09-26T16:41:18Z)
• Multi-agent Communication with Graph Information Bottleneck under Limited Bandwidth (a position paper) [92.11330289225981]
  In many real-world scenarios, communication can be expensive and the bandwidth of the multi-agent system is subject to certain constraints. Redundant messages who occupy the communication resources can block the transmission of informative messages and thus jeopardize the performance. We propose a novel multi-agent communication module, CommGIB, which effectively compresses the structure information and node information in the communication graph to deal with bandwidth-constrained settings.
  arXiv  Detail & Related papers  (2021-12-20T07:53:44Z)
• A Co-Interactive Transformer for Joint Slot Filling and Intent Detection [61.109486326954205]
  Intent detection and slot filling are two main tasks for building a spoken language understanding (SLU) system. Previous studies either model the two tasks separately or only consider the single information flow from intent to slot. We propose a Co-Interactive Transformer to consider the cross-impact between the two tasks simultaneously.
  arXiv  Detail & Related papers  (2020-10-08T10:16:52Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.