Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning

• URL: http://arxiv.org/abs/2511.01554v1
• Date: Mon, 03 Nov 2025 13:16:57 GMT
• Title: Learning what to say and how precisely: Efficient Communication via Differentiable Discrete Communication Learning
• Abstract summary: We develop a framework for end-to-end optimization of discrete messages.<n>We show it reduces bandwidth by over an order of magnitude while matching or exceeding task performance.
• Score: 14.221641613518633
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Effective communication in multi-agent reinforcement learning (MARL) is critical for success but constrained by bandwidth, yet past approaches have been limited to complex gating mechanisms that only decide \textit{whether} to communicate, not \textit{how precisely}. Learning to optimize message precision at the bit-level is fundamentally harder, as the required discretization step breaks gradient flow. We address this by generalizing Differentiable Discrete Communication Learning (DDCL), a framework for end-to-end optimization of discrete messages. Our primary contribution is an extension of DDCL to support unbounded signals, transforming it into a universal, plug-and-play layer for any MARL architecture. We verify our approach with three key results. First, through a qualitative analysis in a controlled environment, we demonstrate \textit{how} agents learn to dynamically modulate message precision according to the informational needs of the task. Second, we integrate our variant of DDCL into four state-of-the-art MARL algorithms, showing it reduces bandwidth by over an order of magnitude while matching or exceeding task performance. Finally, we provide direct evidence for the \enquote{Bitter Lesson} in MARL communication: a simple Transformer-based policy leveraging DDCL matches the performance of complex, specialized architectures, questioning the necessity of bespoke communication designs.

Related papers

• From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity [94.51565447227847]
  6G networks are driving communication systems from reliable bit delivery toward meaning-aware and task-oriented connectivity.<n>Large models (LMs) with strong multimodal understanding and generation capabilities have accelerated this shift.<n>Current LM-driven semantic communication (SemCom) remains fragmented.<n>We argue that tokens provide a natural candidate for this missing abstraction.
  arXiv  Detail & Related papers  (2026-09-09T18:11:38Z)
• MOC: Multi-Order Communication in LLM-based Multi-Agent Systems [7.468643378553509]
  We propose the Multi-Order Communication scheme, which reconstructs the inter-agent communication to capture multi-hop dependencies and incorporates a structural message consolidation strategy to ensure efficiency.<n>Specifically, we formalize the communication mechanism to construct a structured multi-order evidence stream, and subsequently design a Semantic-Topological Merging algorithm to optimize semantic fidelity within token constraints.
  arXiv  Detail & Related papers  (2026-06-01T15:06:38Z)
• Modality-Agnostic Prompt Learning for Multi-Modal Camouflaged Object Detection [61.36976558603528]
  We propose a novel framework that generates modality-agnostic multi-modal prompts for the Segment Anything Model (SAM)<n>Specifically, we model multi-modal learning through interactions between a data-driven content domain and a knowledge-driven prompt domain.<n>We further introduce a lightweight Mask Refine Module to calibrate coarse predictions by incorporating fine-grained prompt cues.
  arXiv  Detail & Related papers  (2026-04-14T07:13:28Z)
• Multi-Agent Decision-Focused Learning via Value-Aware Sequential Communication [0.0]
  We introduce textbfSeqComm-DFL, unifying the sequential communication with decision-focused learning for task performance.<n>Our approach features emphvalue-aware message generation with sequential Stackelberg conditioning.<n>On collaborative healthcare and StarCraft Multi-Agent Challenge benchmarks, SeqComm-DFL achieves four to six times higher cumulative rewards and over 13% win rate improvements.
  arXiv  Detail & Related papers  (2026-04-10T04:23:29Z)
• SC-GIR: Goal-oriented Semantic Communication via Invariant Representation Learning [59.45312293893698]
  Goal-oriented semantic communication (SC) aims to revolutionize communication systems by transmitting only task-essential information.<n>We propose a novel framework called Goal-oriented Invariant Representation-based SC (SC-GIR) for image transmission.
  arXiv  Detail & Related papers  (2025-09-01T04:29:43Z)
• Latent Space Alignment for AI-Native MIMO Semantic Communications [11.185200213307208]
  We propose a novel approach to address semantic mismatches in semantic communications.<n>A neural network-based model learns semantic precoder/decoder under power budget and complexity constraints.<n>Results demonstrate the effectiveness of the proposed approach in a goal-oriented semantic communication scenario.
  arXiv  Detail & Related papers  (2025-07-22T15:16:18Z)
• Communication-Efficient Module-Wise Federated Learning for Grasp Pose Detection in Cluttered Environments [10.63791848873399]
  We propose a module-wise Federated Learning (FL) framework for Grasp pose detection.<n>FL offers a privacy-preserving solution, but its application to GPD is hindered by the substantial communication overhead of large models.<n>Our work presents a communication-efficient framework for training robust, generalized GPD models in a decentralized manner.
  arXiv  Detail & Related papers  (2025-07-08T10:40:49Z)
• Semantic Communication in Dynamic Channel Scenarios: Collaborative Optimization of Dual-Pipeline Joint Source-Channel Coding and Personalized Federated Learning [11.830276582141096]
  In complex network topologies with multiple users, the combinations of client data and channel state information (CSI) pose significant challenges for existing semantic communication models.<n>We propose a novel personalized semantic communication models based on channel awareness model.<n>Within this framework, we present a framework that achieves the zero optimization gap for non bandwidth-related loss functions.
  arXiv  Detail & Related papers  (2025-03-18T10:02:22Z)
• Harnessing Large Language Models for Knowledge Graph Question Answering via Adaptive Multi-Aspect Retrieval-Augmentation [81.18701211912779]
  We introduce an Adaptive Multi-Aspect Retrieval-augmented over KGs (Amar) framework.<n>This method retrieves knowledge including entities, relations, and subgraphs, and converts each piece of retrieved text into prompt embeddings.<n>Our method has achieved state-of-the-art performance on two common datasets.
  arXiv  Detail & Related papers  (2024-12-24T16:38:04Z)
• Multi-Level Optimal Transport for Universal Cross-Tokenizer Knowledge Distillation on Language Models [81.74999702045339]
  Multi-Level Optimal Transport (MultiLevelOT) is a novel approach that advances the optimal transport for universal cross-tokenizer knowledge distillation.<n>Our method aligns the logit distributions of the teacher and the student at both token and sequence levels.<n>At the token level, MultiLevelOT integrates both global and local information by jointly optimizing all tokens within a sequence to enhance robustness.
  arXiv  Detail & Related papers  (2024-12-19T04:51:06Z)
• Text-Video Retrieval with Global-Local Semantic Consistent Learning [122.15339128463715]
  We propose a simple yet effective method, Global-Local Semantic Consistent Learning (GLSCL) GLSCL capitalizes on latent shared semantics across modalities for text-video retrieval. Our method achieves comparable performance with SOTA as well as being nearly 220 times faster in terms of computational cost.
  arXiv  Detail & Related papers  (2024-05-21T11:59:36Z)
• Context-aware Communication for Multi-agent Reinforcement Learning [6.109127175562235]
  We develop a context-aware communication scheme for multi-agent reinforcement learning (MARL) In the first stage, agents exchange coarse representations in a broadcast fashion, providing context for the second stage. Following this, agents utilize attention mechanisms in the second stage to selectively generate messages personalized for the receivers. To evaluate the effectiveness of CACOM, we integrate it with both actor-critic and value-based MARL algorithms.
  arXiv  Detail & Related papers  (2023-12-25T03:33:08Z)
• USER: Unified Semantic Enhancement with Momentum Contrast for Image-Text Retrieval [115.28586222748478]
  Image-Text Retrieval (ITR) aims at searching for the target instances that are semantically relevant to the given query from the other modality. Existing approaches typically suffer from two major limitations.
  arXiv  Detail & Related papers  (2023-01-17T12:42:58Z)
• Multi-agent Communication with Graph Information Bottleneck under Limited Bandwidth (a position paper) [92.11330289225981]
  In many real-world scenarios, communication can be expensive and the bandwidth of the multi-agent system is subject to certain constraints. Redundant messages who occupy the communication resources can block the transmission of informative messages and thus jeopardize the performance. We propose a novel multi-agent communication module, CommGIB, which effectively compresses the structure information and node information in the communication graph to deal with bandwidth-constrained settings.
  arXiv  Detail & Related papers  (2021-12-20T07:53:44Z)
• CosSGD: Nonlinear Quantization for Communication-efficient Federated Learning [62.65937719264881]
  Federated learning facilitates learning across clients without transferring local data on these clients to a central server. We propose a nonlinear quantization for compressed gradient descent, which can be easily utilized in federated learning. Our system significantly reduces the communication cost by up to three orders of magnitude, while maintaining convergence and accuracy of the training process.
  arXiv  Detail & Related papers  (2020-12-15T12:20:28Z)
• Communication-Efficient and Distributed Learning Over Wireless Networks: Principles and Applications [55.65768284748698]
  Machine learning (ML) is a promising enabler for the fifth generation (5G) communication systems and beyond. This article aims to provide a holistic overview of relevant communication and ML principles, and thereby present communication-efficient and distributed learning frameworks with selected use cases.
  arXiv  Detail & Related papers  (2020-08-06T12:37:14Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.