Fast Adaptive Anti-Jamming Channel Access via Deep Q Learning and Coarse-Grained Spectrum Prediction

• URL: http://arxiv.org/abs/2502.04963v1
• Date: Fri, 07 Feb 2025 14:25:28 GMT
• Title: Fast Adaptive Anti-Jamming Channel Access via Deep Q Learning and Coarse-Grained Spectrum Prediction
• Authors: Jianshu Zhang, Xiaofu Wu, Junquan Hu,
• Abstract summary: This paper investigates the anti-jamming channel access problem in complex and unknown jamming environments. Traditional channel hopping anti-jamming approaches using fixed patterns are ineffective against dynamic jamming attacks. We propose a fast adaptive anti-jamming channel access approach guided by the intuition of learning faster than the jammer'
• Score: 13.4498936010732
• License:
• Abstract: This paper investigates the anti-jamming channel access problem in complex and unknown jamming environments, where the jammer could dynamically adjust its strategies to target different channels. Traditional channel hopping anti-jamming approaches using fixed patterns are ineffective against such dynamic jamming attacks. Although the emerging deep reinforcement learning (DRL) based dynamic channel access approach could achieve the Nash equilibrium under fast-changing jamming attacks, it requires extensive training episodes. To address this issue, we propose a fast adaptive anti-jamming channel access approach guided by the intuition of ``learning faster than the jammer", where a synchronously updated coarse-grained spectrum prediction serves as an auxiliary task for the deep Q learning (DQN) based anti-jamming model. This helps the model identify a superior Q-function compared to standard DRL while significantly reducing the number of training episodes. Numerical results indicate that the proposed approach significantly accelerates the rate of convergence in model training, reducing the required training episodes by up to 70% compared to standard DRL. Additionally, it also achieves a 10% improvement in throughput over NE strategies, owing to the effective use of coarse-grained spectrum prediction.

Related papers

• Advanced deep-reinforcement-learning methods for flow control: group-invariant and positional-encoding networks improve learning speed and quality [0.7421845364041001]
  This study advances deep-reinforcement-learning (DRL) methods for flow control. We focus on integrating group-invariant networks and positional encoding into DRL architectures. The proposed methods are verified using a case study of Rayleigh-B'enard convection.
  arXiv  Detail & Related papers  (2024-07-25T07:24:41Z)
• Adaptive Federated Learning Over the Air [108.62635460744109]
  We propose a federated version of adaptive gradient methods, particularly AdaGrad and Adam, within the framework of over-the-air model training. Our analysis shows that the AdaGrad-based training algorithm converges to a stationary point at the rate of $mathcalO( ln(T) / T 1 - frac1alpha ).
  arXiv  Detail & Related papers  (2024-03-11T09:10:37Z)
• Recurrent Neural Network-based Anti-jamming Framework for Defense Against Multiple Jamming Policies [77.53658708277409]
  This paper proposes an anti-jamming method that can adapt its policy to the current jamming attack. In both single and multiple jammers scenarios, the interaction between the users and jammers is modeled using recurrent neural networks (RNNs)
  arXiv  Detail & Related papers  (2022-08-19T19:12:38Z)
• Learning to Perform Downlink Channel Estimation in Massive MIMO Systems [72.76968022465469]
  We study downlink (DL) channel estimation in a Massive multiple-input multiple-output (MIMO) system. A common approach is to use the mean value as the estimate, motivated by channel hardening. We propose two novel estimation methods.
  arXiv  Detail & Related papers  (2021-09-06T13:42:32Z)
• Reinforcement Learning for Deceiving Reactive Jammers in Wireless Networks [76.82565500647323]
  A novel anti-jamming strategy is proposed based on the idea of deceiving the jammer into attacking a victim channel. Since the jammer's channel information is not known to the users, an optimal channel selection scheme and a sub optimal power allocation are proposed. Simulation results show that the proposed anti-jamming method outperforms the compared RL based anti-jamming methods and random search method.
  arXiv  Detail & Related papers  (2021-03-25T18:12:41Z)
• A Simple Cooperative Diversity Method Based on Deep-Learning-Aided Relay Selection [10.199674137417796]
  We develop and analyze a deep-learning-aided cooperative method coined predictive relay selection (PRS) in this article. It can remarkably improve the quality of CSI through fading channel prediction while retaining the simplicity of ORS. PRS achieves full diversity gain in slow fading wireless environments and substantially outperforms the existing schemes in fast fading channels.
  arXiv  Detail & Related papers  (2021-02-05T20:20:27Z)
• Reinforcement Learning for Efficient and Tuning-Free Link Adaptation [0.9176056742068812]
  Wireless links adapt the data transmission parameters to the dynamic channel state -- this is called link adaptation. We propose a latent learning model for link adaptation that exploits the correlation between data transmission parameters. We extend LTS to fading wireless channels through a tuning-free mechanism that automatically tracks the channel dynamics.
  arXiv  Detail & Related papers  (2020-10-16T22:20:58Z)
• Meta-Reinforcement Learning for Trajectory Design in Wireless UAV Networks [151.65541208130995]
  A drone base station (DBS) is dispatched to provide uplink connectivity to ground users whose demand is dynamic and unpredictable. In this case, the DBS's trajectory must be adaptively adjusted to satisfy the dynamic user access requests. A meta-learning algorithm is proposed in order to adapt the DBS's trajectory when it encounters novel environments.
  arXiv  Detail & Related papers  (2020-05-25T20:43:59Z)
• Millimeter Wave Communications with an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning [119.97450366894718]
  A novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station. A channel estimation approach is developed to measure the channel state information (CSI) in real-time. A distributional reinforcement learning (DRL) approach is proposed to learn the optimal IR reflection and maximize the expectation of downlink capacity.
  arXiv  Detail & Related papers  (2020-02-24T22:18:54Z)
• Accumulated Polar Feature-based Deep Learning for Efficient and Lightweight Automatic Modulation Classification with Channel Compensation Mechanism [6.915743897443897]
  In next-generation communications, massive machine-type communications (mMTC) induce severe burden on base stations. Deep learning (DL) technique stores intelligence in the network, resulting in superior performance over traditional approaches. In this work, an accumulated polar feature-based DL with a channel compensation mechanism is proposed to cope with the aforementioned issues.
  arXiv  Detail & Related papers  (2020-01-06T04:56:56Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.