Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications

• URL: http://arxiv.org/abs/2108.02892v1
• Date: Fri, 6 Aug 2021 00:02:37 GMT
• Title: Deep Reinforcement Learning for Intelligent Reflecting Surface-assisted D2D Communications
• Authors: Khoi Khac Nguyen, Antonino Masaracchia, Cheng Yin, Long D. Nguyen, Octavia A. Dobre, and Trung Q. Duong
• Abstract summary: We propose a deep reinforcement learning (DRL) approach for solving the optimisation problem of the network's sum-rate in device-to-device (D2D) communications supported by an intelligent reflecting surface (IRS) IRS is deployed to mitigate interference and enhance the signal between the D2D transmitter and the associated D2D receiver. We formulate a Markov decision process and then propose the proximal policy optimisation for solving the maximisation game.
• Score: 33.9975494305404
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we propose a deep reinforcement learning (DRL) approach for solving the optimisation problem of the network's sum-rate in device-to-device (D2D) communications supported by an intelligent reflecting surface (IRS). The IRS is deployed to mitigate the interference and enhance the signal between the D2D transmitter and the associated D2D receiver. Our objective is to jointly optimise the transmit power at the D2D transmitter and the phase shift matrix at the IRS to maximise the network sum-rate. We formulate a Markov decision process and then propose the proximal policy optimisation for solving the maximisation game. Simulation results show impressive performance in terms of the achievable rate and processing time.

Related papers

• Dynamic Spectrum Access for Ambient Backscatter Communication-assisted D2D Systems with Quantum Reinforcement Learning [68.63990729719369]
  The wireless spectrum is becoming scarce, resulting in low spectral efficiency for D2D communications. This paper aims to integrate the ambient backscatter communication technology into D2D devices to allow them to backscatter ambient RF signals. We develop a novel quantum reinforcement learning (RL) algorithm that can achieve a faster convergence rate with fewer training parameters.
  arXiv  Detail & Related papers  (2024-10-23T15:36:43Z)
• The R2D2 deep neural network series paradigm for fast precision imaging in radio astronomy [1.7249361224827533]
  Recent image reconstruction techniques have remarkable capability for imaging precision, well beyond CLEAN's capability. We introduce a novel deep learning approach, dubbed "Residual-to-Residual DNN series for high-Dynamic range imaging" R2D2's capability to deliver high precision is demonstrated in simulation, across a variety image observation settings using the Very Large Array (VLA)
  arXiv  Detail & Related papers  (2024-03-08T16:57:54Z)
• Coded Matrix Computations for D2D-enabled Linearized Federated Learning [26.086036387834866]
  Federated learning (FL) is a popular technique for training a global model on data distributed across client devices. Recent work has proposed to address this through device-to-device (D2D) offloading, which introduces privacy concerns. We propose a novel straggler-optimal approach for coded matrix computations which can significantly reduce the communication delay and privacy issues.
  arXiv  Detail & Related papers  (2023-02-23T20:01:46Z)
• Collaborative Intelligent Reflecting Surface Networks with Multi-Agent Reinforcement Learning [63.83425382922157]
  Intelligent reflecting surface (IRS) is envisioned to be widely applied in future wireless networks. In this paper, we investigate a multi-user communication system assisted by cooperative IRS devices with the capability of energy harvesting.
  arXiv  Detail & Related papers  (2022-03-26T20:37:14Z)
• Dynamic Network-Assisted D2D-Aided Coded Distributed Learning [59.29409589861241]
  We propose a novel device-to-device (D2D)-aided coded federated learning method (D2D-CFL) for load balancing across devices. We derive an optimal compression rate for achieving minimum processing time and establish its connection with the convergence time. Our proposed method is beneficial for real-time collaborative applications, where the users continuously generate training data.
  arXiv  Detail & Related papers  (2021-11-26T18:44:59Z)
• LoRD-Net: Unfolded Deep Detection Network with Low-Resolution Receivers [104.01415343139901]
  We propose a deep detector entitled LoRD-Net for recovering information symbols from one-bit measurements. LoRD-Net has a task-based architecture dedicated to recovering the underlying signal of interest. We evaluate the proposed receiver architecture for one-bit signal recovery in wireless communications.
  arXiv  Detail & Related papers  (2021-02-05T04:26:05Z)
• Optimization-driven Machine Learning for Intelligent Reflecting Surfaces Assisted Wireless Networks [82.33619654835348]
  Intelligent surface (IRS) has been employed to reshape the wireless channels by controlling individual scattering elements' phase shifts. Due to the large size of scattering elements, the passive beamforming is typically challenged by the high computational complexity. In this article, we focus on machine learning (ML) approaches for performance in IRS-assisted wireless networks.
  arXiv  Detail & Related papers  (2020-08-29T08:39:43Z)
• Optimization-driven Deep Reinforcement Learning for Robust Beamforming in IRS-assisted Wireless Communications [54.610318402371185]
  Intelligent reflecting surface (IRS) is a promising technology to assist downlink information transmissions from a multi-antenna access point (AP) to a receiver. We minimize the AP's transmit power by a joint optimization of the AP's active beamforming and the IRS's passive beamforming. We propose a deep reinforcement learning (DRL) approach that can adapt the beamforming strategies from past experiences.
  arXiv  Detail & Related papers  (2020-05-25T01:42:55Z)
• Reconfigurable Intelligent Surface Assisted Multiuser MISO Systems Exploiting Deep Reinforcement Learning [21.770491711632832]
  The reconfigurable intelligent surface (RIS) has been speculated as one of the key enabling technologies for the future six generation (6G) wireless communication systems. In this paper, we investigate the joint design of transmit beamforming matrix at the base station and the phase shift matrix at the RIS, by leveraging recent advances in deep reinforcement learning (DRL) The proposed algorithm is not only able to learn from the environment and gradually improve its behavior, but also obtains the comparable performance compared with two state-of-the-art benchmarks.
  arXiv  Detail & Related papers  (2020-02-24T04:28:44Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.