Hierarchical Wireless Foundation Model for Multi-Task Optimization

• URL: http://arxiv.org/abs/2607.16877v1
• Date: Sat, 18 Jul 2026 16:30:23 GMT
• Title: Hierarchical Wireless Foundation Model for Multi-Task Optimization
• Abstract summary: We propose a hierarchical wireless foundation model (WFM) for multi-task optimization.<n>We show that the proposed WFM learns high-fidelity channel representations and achieves competitive multi-task optimization performance.
• Score: 34.759246067039705
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The increasing complexity of next-generation wireless networks has driven the integration of artificial intelligence (AI) into wireless communications. However, most existing studies focus on developing task-specific deep learning techniques for single scenarios, which limits their ability to generalize across diverse tasks, channel conditions, and system configurations. To address this generalization bottleneck, we propose a hierarchical wireless foundation model (WFM) for multi-task optimization. The proposed WFM couples an upstream foundation channel encoder (FCE) with a downstream foundation optimization decoder (FOD) via geometry-aware cross-attention. Specifically, the FCE extracts task-agnostic channel representations via self-supervised masked reconstruction while the FOD generates multi-task optimization decisions through differentiable output heads. Moreover, a hybrid supervised-to-unsupervised training strategy is employed to overcome the performance ceiling of purely supervised learning, and the modular architecture of the WFM enables efficient adaptation to unseen communication tasks with minimal parameter overhead. Simulation results show that the proposed WFM learns high-fidelity channel representations and achieves competitive multi-task optimization performance while substantially reducing optimization inference latency relative to numerical baselines. Furthermore, it exhibits robust generalization to unseen propagation environments, varying constraint parameters, and heterogeneous system configurations.

Related papers

• A Unified Adaptive Feature Composition Framework for Multi-Task Generalization in Wireless Foundation Models [19.520699593557357]
  We propose a unified adaptive feature composition framework for generalization in wireless foundation models (WFMs)<n>Instead of extracting only the final-layer output, this router treats the hidden states from different Transformer depths as a reusable pool of multi-level hidden features.<n>Experiments on four representative wireless tasks demonstrate that RAFC consistently outperforms conventional adaptation baselines.
  arXiv  Detail & Related papers  (2026-06-09T00:57:56Z)
• DIFFRACT: Neuralized Utility Maximization for Wireless Networks by Differentiable Programming [3.2370789091289005]
  DIFFRACT is a neuralized framework that integrates differentiable programming with optimization in wireless networks.<n>It supports real-time adaptation to interference in both terrestrial and non-terrestrial environments.<n>Results confirm the framework's theoretical soundness and practical effectiveness.
  arXiv  Detail & Related papers  (2026-06-05T10:09:09Z)
• Generalizable Multi-Task Learning for Wireless Networks Using Prompt Decision Transformers [3.8613477927967614]
  We propose a Prompt Decision Transformer (PromptDT) based multi-task learning framework capable of learning across diverse network configurations.<n>PromptDT improves QoE by up to 49% in multi-task settings compared to baselines, with performance scaling positively alongside model capacity.
  arXiv  Detail & Related papers  (2026-06-03T01:03:38Z)
• Joint Channel Estimation and Computation Offloading in Fluid Antenna-assisted MEC Networks [81.36647816787713]
  We propose an FA-assisted offloading framework to minimize the delay of channel estimation.<n>We show that the proposed system significantly reduces the accuracy under efficient communication.
  arXiv  Detail & Related papers  (2025-09-16T08:48:44Z)
• Generative Diffusion Models for Resource Allocation in Wireless Networks [74.84410305593006]
  We train a policy to imitate an expert and generate new samples from the optimal distribution.<n>We achieve near-optimal performance through the sequential execution of the generated samples.<n>We present numerical results in a case study of power control.
  arXiv  Detail & Related papers  (2025-04-28T21:44:31Z)
• Deep Learning Based Uplink Multi-User SIMO Beamforming Design [32.00286337259923]
  5G wireless communication networks offer high data rates, extensive coverage, minimal latency and energy-efficient performance. Traditional approaches have shortcomings when it comes to computational complexity and their ability to adapt to dynamic conditions. We propose a novel unsupervised deep learning framework, which is called NNBF, for the design of uplink receive multi-user single input multiple output (MU-SIMO) beamforming.
  arXiv  Detail & Related papers  (2023-09-28T17:04:41Z)
• Multi-Resource Allocation for On-Device Distributed Federated Learning Systems [79.02994855744848]
  This work poses a distributed multi-resource allocation scheme for minimizing the weighted sum of latency and energy consumption in the on-device distributed federated learning (FL) system. Each mobile device in the system engages the model training process within the specified area and allocates its computation and communication resources for deriving and uploading parameters, respectively.
  arXiv  Detail & Related papers  (2022-11-01T14:16:05Z)
• Over-the-Air Federated Multi-Task Learning via Model Sparsification and Turbo Compressed Sensing [48.19771515107681]
  We propose an over-the-air FMTL framework, where multiple learning tasks deployed on edge devices share a non-orthogonal fading channel under the coordination of an edge server. In OA-FMTL, the local updates of edge devices are sparsified, compressed, and then sent over the uplink channel in a superimposed fashion. We analyze the performance of the proposed OA-FMTL framework together with the M-Turbo-CS algorithm.
  arXiv  Detail & Related papers  (2022-05-08T08:03:52Z)
• Pervasive Machine Learning for Smart Radio Environments Enabled by Reconfigurable Intelligent Surfaces [56.35676570414731]
  The emerging technology of Reconfigurable Intelligent Surfaces (RISs) is provisioned as an enabler of smart wireless environments. RISs offer a highly scalable, low-cost, hardware-efficient, and almost energy-neutral solution for dynamic control of the propagation of electromagnetic signals over the wireless medium. One of the major challenges with the envisioned dense deployment of RISs in such reconfigurable radio environments is the efficient configuration of multiple metasurfaces.
  arXiv  Detail & Related papers  (2022-05-08T06:21:33Z)
• Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks [82.33619654835348]
  Intelligent surface (IRS) has been employed to reshape the wireless channels by controlling individual scattering elements' phase shifts. Due to the large size of scattering elements, the passive beamforming is typically challenged by the high computational complexity. In this article, we focus on machine learning (ML) approaches for performance in IRS-assisted wireless networks.
  arXiv  Detail & Related papers  (2020-08-29T08:39:43Z)
• Deep Multi-Task Learning for Cooperative NOMA: System Design and Principles [52.79089414630366]
  We develop a novel deep cooperative NOMA scheme, drawing upon the recent advances in deep learning (DL) We develop a novel hybrid-cascaded deep neural network (DNN) architecture such that the entire system can be optimized in a holistic manner.
  arXiv  Detail & Related papers  (2020-07-27T12:38:37Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.