SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction
- URL: http://arxiv.org/abs/2606.00120v1
- Date: Thu, 28 May 2026 03:27:09 GMT
- Title: SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction
- Abstract summary: SpikeWFM is a novel hybrid architecture that integrates spiking neural networks (SNNs) with conventional artificial neural network (ANN)-based transformers for wireless foundation models (WFMs)<n>Inspired by the noise-robust and energy-efficient information processing in the human brain, SpikeWFM aims to enhance the resilience of WFMs against noise and interference.<n> Experimental results show that SpikeWFM consistently outperforms conventional ANN-based WFMs in both pre-training convergence and channel prediction accuracy.
- Score: 17.965155267466127
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: This paper proposes SpikeWFM, a novel hybrid architecture that integrates spiking neural networks (SNNs) with conventional artificial neural network (ANN)-based transformers for wireless foundation models (WFMs). Inspired by the noise-robust and energy-efficient information processing in the human brain, SpikeWFM aims to enhance the resilience of WFMs against noise and interference while maintaining strong generalization capabilities across diverse wireless scenarios. Drawing from the success of large language models, WFMs leverage self-supervised pre-training on large-scale datasets spanning various wireless environments to learn a unified embedding that supports a wide range of downstream tasks, including channel prediction, channel estimation, beam predition, positioning and etc. Such models typically outperform task-specific designs and exhibit superior adaptability to unseen conditions. However, existing WFMs remain vulnerable to realistic noise and interference in practical wireless systems. To address this limitation, we incorporate spiking neurons into the transformer-based WFM architecture. We provide a brief theoretical analysis demonstrating how the SNN-ANN hybrid effectively mitigates noise and interference through temporal sparsity and event-driven processing. Experimental results show that SpikeWFM consistently outperforms conventional ANN-based WFMs in both pre-training convergence and channel prediction accuracy. Additional results on communication and sensing tasks will be presented in the full journal version of this work.
Related papers
- Physical-AI: From Channel Awareness to Environmental Intelligence in 6G Wireless Networks [100.92510794177822]
Conventional wireless networks rely on instantaneous channel state information (CSI) and react to channel variations without explicitly modeling the physical environment.<n>We propose Physical-AI: a new architecture for environment-aware wireless networking, where radio signals enable sensing, modeling, and interaction with the environment.<n>We show that the proposed framework reduces outage probability and blockage-response latency, particularly under increasing beam-switching delays.
arXiv Detail & Related papers (2026-05-12T09:02:20Z) - An Explainable Failure Prediction Framework for Neural Networks in Radio Access Networks [10.654909628583079]
5G networks continue to evolve to deliver high speed, low latency, and reliable communications.<n>While millimeter wave frequencies enable gigabit data rates, they are highly susceptible to environmental factors, often leading to radio link failures (RLF)<n>This work introduces a framework that combines explainability based feature pruning with model refinement.
arXiv Detail & Related papers (2026-01-28T19:19:46Z) - Neural Beamforming with Doppler-Aware Sparse Attention for High Mobility Environments [35.90167049594104]
Deep learning-based beamforming offers an alternative with nonlinear mappings from channel state information to beamforming weights.<n> Transformer-based models are particularly effective due to their ability to model long-range dependencies across time and frequency.<n>Recent studies address this issue through sparse attention mechanisms that reduce complexity while maintaining, yet often employ patterns that disregard channel dynamics.
arXiv Detail & Related papers (2025-11-05T16:51:26Z) - Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons [69.73249913506042]
This paper investigates a wireless split computing architecture that employs resonate-and-fire (RF) neurons to process time-domain signals directly.<n>By resonating at tunable frequencies, RF neurons extract time-localized spectral features while maintaining low spiking activity.<n> Experimental results show that the proposed RF-SNN architecture achieves comparable accuracy to conventional LIF-SNNs and ANNs.
arXiv Detail & Related papers (2025-06-24T21:14:59Z) - Latent Diffusion Model Based Denoising Receiver for 6G Semantic Communication: From Stochastic Differential Theory to Application [11.385703484113552]
We propose a novel semantic communication framework empowered by generative artificial intelligence (GAI)<n>A latent diffusion model (LDM)-based semantic communication framework is proposed that combines a variational autoencoder for semantic features extraction.<n>The proposed system is a training-free framework that supports zero-shot generalization, and achieves superior performance under low-SNR and out-of-distribution conditions.
arXiv Detail & Related papers (2025-06-06T03:20:32Z) - RadioDiff-$k^2$: Helmholtz Equation Informed Generative Diffusion Model for Multi-Path Aware Radio Map Construction [76.24833675757033]
We propose a physics-informed generative learning approach, named RadioDiff-$k2$, for accurate and efficient multipath-aware radio map (RM) construction.<n>We show that the proposed RadioDiff-$k2$ framework achieves state-of-the-art (SOTA) performance in both image-level RM construction and localization tasks.
arXiv Detail & Related papers (2025-04-22T06:28:13Z) - 6G WavesFM: A Foundation Model for Sensing, Communication, and Localization [6.70088826174291]
This paper introduces a novel Wireless Foundation Model (WFM) framework, capable of supporting a wide array of communication, sensing, and localization tasks.<n>Our proposed architecture combines a shared Vision Transformer (ViT) backbone with task-specific multi-layer perceptron heads and incorporates Low-Rank Adaptation (LoRA) for parameter-efficient fine-tuning.<n>We show that our unified WFM can support diverse tasks and deliver significant gains in both performance and efficiency.
arXiv Detail & Related papers (2025-04-18T22:51:35Z) - RadioDiff: An Effective Generative Diffusion Model for Sampling-Free Dynamic Radio Map Construction [42.596399621642234]
Radio map (RM) is a promising technology that can obtain pathloss based on only location.
In this paper, a sampling-free RM construction is modeled as a conditional generative problem, where a denoised diffusion-based method, named RadioDiff, is proposed to achieve high-quality RM construction.
Experimental results show that the proposed RadioDiff achieves state-of-the-art performance in all three metrics of accuracy, structural similarity, and peak signal-to-noise ratio.
arXiv Detail & Related papers (2024-08-16T08:02:00Z) - The Role of Federated Learning in a Wireless World with Foundation Models [59.8129893837421]
Foundation models (FMs) are general-purpose artificial intelligence (AI) models that have recently enabled multiple brand-new generative AI applications.
Currently, the exploration of the interplay between FMs and federated learning (FL) is still in its nascent stage.
This article explores the extent to which FMs are suitable for FL over wireless networks, including a broad overview of research challenges and opportunities.
arXiv Detail & Related papers (2023-10-06T04:13:10Z) - Interference Cancellation GAN Framework for Dynamic Channels [74.22393885274728]
We introduce an online training framework that can adapt to any changes in the channel.
Our framework significantly outperforms recent neural network models on highly dynamic channels.
arXiv Detail & Related papers (2022-08-17T02:01:18Z) - ChaRRNets: Channel Robust Representation Networks for RF Fingerprinting [0.0]
We present complex-valued Convolutional Neural Networks (CNNs) for RF fingerprinting.
We focus on the problem of fingerprinting wireless IoT devices in-the-wild using Deep Learning (DL) techniques.
arXiv Detail & Related papers (2021-05-08T03:03:21Z) - Harnessing Wireless Channels for Scalable and Privacy-Preserving
Federated Learning [56.94644428312295]
Wireless connectivity is instrumental in enabling federated learning (FL)
Channel randomnessperturbs each worker inversions model update while multiple workers updates incur significant interference on bandwidth.
In A-FADMM, all workers upload their model updates to the parameter server using a single channel via analog transmissions.
This not only saves communication bandwidth, but also hides each worker's exact model update trajectory from any eavesdropper.
arXiv Detail & Related papers (2020-07-03T16:31:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.