Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey

• URL: http://arxiv.org/abs/2601.03181v1
• Date: Tue, 06 Jan 2026 16:59:29 GMT
• Title: Multi-Modal Data-Enhanced Foundation Models for Prediction and Control in Wireless Networks: A Survey
• Authors: Han Zhang, Mohammad Farzanullah, Mohammad Ghassemi, Akram Bin Sediq, Ali Afana, Melike Erol-Kantarci,
• Abstract summary: Foundation models (FMs) are recognized as a transformative breakthrough that has started to reshape the future of artificial intelligence (AI)<n>This work discusses the utilization of FMs, especially multi-modal FMs in wireless networks.
• Score: 9.762879334040566
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Foundation models (FMs) are recognized as a transformative breakthrough that has started to reshape the future of artificial intelligence (AI) across both academia and industry. The integration of FMs into wireless networks is expected to enable the development of general-purpose AI agents capable of handling diverse network management requests and highly complex wireless-related tasks involving multi-modal data. Inspired by these ideas, this work discusses the utilization of FMs, especially multi-modal FMs in wireless networks. We focus on two important types of tasks in wireless network management: prediction tasks and control tasks. In particular, we first discuss FMs-enabled multi-modal contextual information understanding in wireless networks. Then, we explain how FMs can be applied to prediction and control tasks, respectively. Following this, we introduce the development of wireless-specific FMs from two perspectives: available datasets for development and the methodologies used. Finally, we conclude with a discussion of the challenges and future directions for FM-enhanced wireless networks.

Related papers

• Multimodal Wireless Foundation Models [7.397099215417549]
  We build the first multimodal wireless foundation model capable of processing both raw IQ streams and image-like wireless modalities.<n>We evaluate the model on five tasks across both modality families: image-based (human activity sensing, RF signal classification, 5G NR positioning) and IQ-based (RF device fingerprinting, interference detection/classification)
  arXiv  Detail & Related papers  (2025-11-19T06:26:49Z)
• Sensing and Understanding the World over Air: A Large Multimodal Model for Mobile Networks [59.23869884913339]
  Wireless-native multi-modal large models (WMLMs) can sense and understand the physical world through multi-modal data.<n>We constructed a GPT-style WMLM model and trained it on a real-world large-scale dataset, leveraging wireless signals as an anchor modality for contrastive learning.
  arXiv  Detail & Related papers  (2025-11-17T07:33:46Z)
• Hierarchical Federated Foundation Models over Wireless Networks for Multi-Modal Multi-Task Intelligence: Integration of Edge Learning with D2D/P2P-Enabled Fog Learning Architectures [58.72593025539547]
  In this paper, we unveil an unexplored variation of M3T FFMs by proposing hierarchical federated foundation models (HF-FMs)<n>HF-FMs strategically align the modular structure of M3T FMs, comprising modality encoders, prompts, mixture-of-experts (MoEs), adapters, and task heads.<n>To demonstrate their potential, we prototype HF-FMs in a wireless network setting and release the open-source code for the development of HF-FMs.
  arXiv  Detail & Related papers  (2025-09-03T20:23:19Z)
• Diffusion Models for Future Networks and Communications: A Comprehensive Survey [65.97057929688499]
  The rise of Generative AI (GenAI) in recent years has catalyzed transformative advances in wireless communications and networks.<n>Among the members of the GenAI family, Diffusion Models (DMs) have risen to prominence as a powerful option.<n>We aim to provide a comprehensive overview of the theoretical foundations and practical applications of DMs across future communication systems.
  arXiv  Detail & Related papers  (2025-08-03T04:59:58Z)
• Telecom Foundation Models: Applications, Challenges, and Future Trends [0.5249805590164903]
  Foundation Models (FMs) show effective generalization capabilities in various domains in language, vision, and decision-making tasks. FMs can be trained on multiple data modalities generated from the telecom ecosystem and leverage specialized domain knowledge. This paper investigates the potential opportunities of using FMs to shape the future of telecom technologies and standards.
  arXiv  Detail & Related papers  (2024-08-02T21:09:13Z)
• WirelessLLM: Empowering Large Language Models Towards Wireless Intelligence [16.722524706176767]
  Large Language Models (LLMs) have sparked interest in their potential to revolutionize wireless communication systems. Existing studies on LLMs for wireless systems are limited to a direct application for telecom language understanding. This paper proposes WirelessLLM, a comprehensive framework for adapting and enhancing LLMs to address the unique challenges and requirements of wireless communication networks.
  arXiv  Detail & Related papers  (2024-05-27T11:18:25Z)
• The Role of Federated Learning in a Wireless World with Foundation Models [59.8129893837421]
  Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications. Currently, the exploration of the interplay between FMs and federated learning (FL) is still in its nascent stage. This article explores the extent to which FMs are suitable for FL over wireless networks, including a broad overview of research challenges and opportunities.
  arXiv  Detail & Related papers  (2023-10-06T04:13:10Z)
• Deep Generative Model and Its Applications in Efficient Wireless Network Management: A Tutorial and Case Study [71.8330148641267]
  Deep generation models (DGMs) have been experiencing explosive growth from 2022. In this article, we explore the applications of DGMs in improving the efficiency of wireless network management.
  arXiv  Detail & Related papers  (2023-03-30T02:59:51Z)
• Distributed Learning in Wireless Networks: Recent Progress and Future Challenges [170.35951727508225]
  Next-generation wireless networks will enable many machine learning (ML) tools and applications to analyze various types of data collected by edge devices. Distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges. This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks.
  arXiv  Detail & Related papers  (2021-04-05T20:57:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.