Context-Aware Wireless Token Communication via Joint Token Masking and Detection

• URL: http://arxiv.org/abs/2605.02123v1
• Date: Mon, 04 May 2026 01:06:04 GMT
• Title: Context-Aware Wireless Token Communication via Joint Token Masking and Detection
• Abstract summary: We propose a context-aware token communication framework that leverages a masked language model (MLM) as a shared contextual model between the transmitter (Tx) and receiver (Rx)<n>We develop a context-aware token detection method that integrates channel likelihoods with contextual priors under a Bayesian formulation, enabling robust token inference over noisy channels.<n>We show that the proposed framework significantly improves reconstruction performance compared to conventional and existing token communication schemes.
• Score: 23.50554014275582
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The increasing use of token-based representations in language-driven applications has motivated wireless token communication, where tokens are treated as fundamental units for transmission. However, conventional communication systems overlook dependencies among tokens and allocate transmission resources uniformly, leading to inefficient use of limited wireless resources under channel impairments. In this paper, we propose a context-aware token communication framework that leverages a masked language model (MLM) as a shared contextual model between the transmitter (Tx) and receiver (Rx). At the Rx, we develop a context-aware token detection method that integrates channel likelihoods with MLM-based contextual priors under a Bayesian formulation, enabling robust token inference over noisy channels. At the Tx, we propose a context-aware token masking strategy that selectively omits tokens that can be reliably inferred at the Rx, allowing the available power budget to be concentrated on more informative tokens. These components are jointly designed through a shared MLM, establishing a unified Tx-Rx framework for efficient token transmission and detection. Simulation results demonstrate that the proposed framework significantly improves reconstruction performance compared to conventional and existing token communication schemes, achieving up to 1.77X and 1.63X performance gains on the Europarl corpus and WikiText-103 datasets, respectively.

Related papers

• From Semantic to Token Communication: The Next Paradigm for Large-Model-Driven 6G Intelligent Connectivity [94.51565447227847]
  6G networks are driving communication systems from reliable bit delivery toward meaning-aware and task-oriented connectivity.<n>Large models (LMs) with strong multimodal understanding and generation capabilities have accelerated this shift.<n>Current LM-driven semantic communication (SemCom) remains fragmented.<n>We argue that tokens provide a natural candidate for this missing abstraction.
  arXiv  Detail & Related papers  (2026-09-09T18:11:38Z)
• Ada-TokenCom: Rate-Adaptive Token Communications via Large-Model-Driven Token Compression and Generation [52.99258064220833]
  Ada-TokenCom is a rate-adaptive TokenCom framework based on large autoregressive models.<n>We propose a mixed reconstruction/generation scheme, where the transmitter encodes and transmits the highly informative tokens.<n>We show that our proposed Ada-TokenCom framework outperforms both digital and deep joint source-channel coding-based semantic communication baselines.
  arXiv  Detail & Related papers  (2026-08-28T08:54:28Z)
• Token-Oriented Semantic Communication with Pretrained Vision Transformers [19.377096772248418]
  We propose a emphtoken-oriented semantic communication framework.<n>In this framework, token-level task relevance determines which compressed image latents are transmitted.<n>Experiments on ImageNet show that the proposed framework achieves a more favorable rate--accuracy trade-off than recent semantic communication schemes.
  arXiv  Detail & Related papers  (2026-08-26T06:13:45Z)
• Wireless TokenCom: RL-Based Tokenizer Agreement for Multi-User Wireless Token Communications [59.84545048095092]
  Token Communications (TokenCom) has recently emerged as an effective new paradigm, where tokens are the unified units of communications computations.<n>We investigate a multi-user downlink wireless TokenCom scenario, where the base station transmits multiple users.
  arXiv  Detail & Related papers  (2026-02-12T19:00:33Z)
• Context-Aware Iterative Token Detection and Masked Transmission for Wireless Token Communication [20.850802765685145]
  We propose a context-aware token communication framework that uses a shared contextual probability model between the transmitter (Tx) and receiver (Rx)<n>We introduce a context-aware masking strategy which skips highly predictable token transmission to reduce transmission rate.
  arXiv  Detail & Related papers  (2026-01-25T10:10:51Z)
• Token Communication in the Era of Large Models: An Information Bottleneck-Based Approach [55.861432910722186]
  UniToCom is a unified token communication paradigm that treats tokens as the fundamental units for both processing and wireless transmission.<n>We propose a generative information bottleneck (GenIB) principle, which facilitates the learning of tokens that preserve essential information.<n>We employ a causal Transformer-based multimodal large language model (MLLM) at the receiver to unify the processing of both discrete and continuous tokens.
  arXiv  Detail & Related papers  (2025-07-02T14:03:01Z)
• Token Communications: A Large Model-Driven Framework for Cross-modal Context-aware Semantic Communications [78.80966346820553]
  We introduce token communications (TokCom), a large model-driven framework to leverage cross-modal context information in generative semantic communications (GenSC)<n>In this paper, we introduce the potential opportunities and challenges of leveraging context in GenSC, explore how to integrate GFM/MLLMs-based token processing into semantic communication systems, present the key principles for efficient TokCom at various layers in future wireless networks.
  arXiv  Detail & Related papers  (2025-02-17T18:14:18Z)
• Reasoning with the Theory of Mind for Pragmatic Semantic Communication [62.87895431431273]
  A pragmatic semantic communication framework is proposed in this paper. It enables effective goal-oriented information sharing between two-intelligent agents. Numerical evaluations demonstrate the framework's ability to achieve efficient communication with a reduced amount of bits.
  arXiv  Detail & Related papers  (2023-11-30T03:36:19Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.