Deep Q-Network Based Resilient Drone Communication:Neutralizing First-Order Markov Jammers

• URL: http://arxiv.org/abs/2601.06095v1
• Date: Thu, 01 Jan 2026 14:16:40 GMT
• Title: Deep Q-Network Based Resilient Drone Communication:Neutralizing First-Order Markov Jammers
• Authors: Andrii Grekhov, Volodymyr Kharchenko, Vasyl Kondratiuk,
• Abstract summary: Deep Q Network based transmitter continuously selects the next frequency hopping channel while facing first order reactive jamming.<n>Through self training, the proposed agent learns a uniform random frequency hopping policy that effectively neutralizes the predictive advantage of the jamming.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Deep Reinforcement Learning based solution for jamming communications using Frequency Hopping Spread Spectrum technology in a 16 channel radio environment is presented. Deep Q Network based transmitter continuously selects the next frequency hopping channel while facing first order reactive jamming, which uses observed transition statistics to predict and interrupt transmissions. Through self training, the proposed agent learns a uniform random frequency hopping policy that effectively neutralizes the predictive advantage of the jamming. In the presence of Rayleigh fading and additive noise, the impact of forward error correction Bose Chaudhuri Hocquenghem type codes is systematically evaluated, demonstrating that even moderate redundancy significantly reduces packet loss. Extensive visualization of the learning dynamics, channel utilization distribution, epsilon greedy decay, cumulative reward, BER and SNR evolution, and detailed packet loss tables confirms convergence to a near optimal jamming strategy. The results provide a practical framework for autonomous resilient communications in modern electronic warfare scenarios.

Related papers

• Coordinated Anti-Jamming Resilience in Swarm Networks via Multi-Agent Reinforcement Learning [8.533838668681737]
  Reactive jammers pose a severe security threat to robotic-swarm networks by selectively disrupting inter-agent communications.<n>Conventional countermeasures such as fixed power control or static channel hopping are largely ineffective against such adaptive adversaries.<n>This paper presents a multi-agent reinforcement learning framework based on the QMIX algorithm to improve the resilience of swarm communications under reactive jamming.
  arXiv  Detail & Related papers  (2025-12-18T17:54:20Z)
• SecDiff: Diffusion-Aided Secure Deep Joint Source-Channel Coding Against Adversarial Attacks [73.41290017870097]
  SecDiff is a plug-and-play, diffusion-aided decoding framework.<n>It significantly enhances the security and robustness of deep J SCC under adversarial wireless environments.
  arXiv  Detail & Related papers  (2025-11-03T11:24:06Z)
• How to Combat Reactive and Dynamic Jamming Attacks with Reinforcement Learning [7.510555203834326]
  This paper studies the problem of mitigating reactive jamming, where a jammer adopts a dynamic policy of selecting channels and sensing thresholds to detect and jam ongoing transmissions.<n>The transmitter-receiver pair learns to avoid jamming and optimize throughput over time by using reinforcement learning (RL) to adapt transmit power, modulation, and channel selection.
  arXiv  Detail & Related papers  (2025-10-02T17:44:38Z)
• Prediction-Powered Communication with Distortion Guarantees [65.37485275954224]
  We study a prediction-powered communication setting, in which devices communicate under zero-delay constraints with strict distortion guarantees.<n>We propose two zero-delay compression algorithms leveraging online conformal prediction to provide per-sequence guarantees on the distortion of reconstructed sequences.<n>Experiments on semantic text compression validate the approach, showing significant bit rate reductions.
  arXiv  Detail & Related papers  (2025-09-29T07:19:39Z)
• Robust Channel Estimation for Optical Wireless Communications Using Neural Network [0.44816207812864195]
  This paper presents a robust channel estimation framework with low-complexity to mitigate frequency-selective effects.<n>A neural network can estimate general optical wireless channels without prior channel information about the environment.<n> Simulation results demonstrate that the proposed method has improved and robust normalized mean square error (NMSE) and bit error rate (BER) performance.
  arXiv  Detail & Related papers  (2025-04-02T21:16:34Z)
• Fast Adaptive Anti-Jamming Channel Access via Deep Q Learning and Coarse-Grained Spectrum Prediction [13.4498936010732]
  This paper investigates the anti-jamming channel access problem in complex and unknown jamming environments.<n>Traditional channel hopping anti-jamming approaches using fixed patterns are ineffective against dynamic jamming attacks.<n>We propose a fast adaptive anti-jamming channel access approach guided by the intuition of learning faster than the jammer'
  arXiv  Detail & Related papers  (2025-02-07T14:25:28Z)
• An Efficient Machine Learning-based Channel Prediction Technique for OFDM Sub-Bands [0.0]
  We propose an efficient machine learning (ML)-based technique for channel prediction in OFDM sub-bands. The novelty of the proposed approach lies in the training of channel fading samples used to estimate future channel behaviour in selective fading.
  arXiv  Detail & Related papers  (2023-05-31T09:41:27Z)
• Deep Learning-Based Synchronization for Uplink NB-IoT [72.86843435313048]
  We propose a neural network (NN)-based algorithm for device detection and time of arrival (ToA) estimation for the narrowband physical random-access channel (NPRACH) of narrowband internet of things (NB-IoT) The introduced NN architecture leverages residual convolutional networks as well as knowledge of the preamble structure of the 5G New Radio (5G NR) specifications.
  arXiv  Detail & Related papers  (2022-05-22T12:16:43Z)
• FedRec: Federated Learning of Universal Receivers over Fading Channels [92.15358738530037]
  We propose a neural network-based symbol detection technique for downlink fading channels. Multiple users collaborate to jointly learn a universal data-driven detector, hence the name FedRec. The performance of the resulting receiver is shown to approach the MAP performance in diverse channel conditions without requiring knowledge of the fading statistics.
  arXiv  Detail & Related papers  (2020-11-14T11:29:55Z)
• Distributional Reinforcement Learning for mmWave Communications with Intelligent Reflectors on a UAV [119.97450366894718]
  A novel communication framework that uses an unmanned aerial vehicle (UAV)-carried intelligent reflector (IR) is proposed. In order to maximize the downlink sum-rate, the optimal precoding matrix (at the base station) and reflection coefficient (at the IR) are jointly derived.
  arXiv  Detail & Related papers  (2020-11-03T16:50:37Z)
• Millimeter Wave Communications with an Intelligent Reflector: Performance Optimization and Distributional Reinforcement Learning [119.97450366894718]
  A novel framework is proposed to optimize the downlink multi-user communication of a millimeter wave base station. A channel estimation approach is developed to measure the channel state information (CSI) in real-time. A distributional reinforcement learning (DRL) approach is proposed to learn the optimal IR reflection and maximize the expectation of downlink capacity.
  arXiv  Detail & Related papers  (2020-02-24T22:18:54Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.