Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems

• URL: http://arxiv.org/abs/2304.01210v1
• Date: Sat, 25 Mar 2023 04:39:59 GMT
• Title: Distributed Multi-Agent Deep Q-Learning for Fast Roaming in IEEE 802.11ax Wi-Fi Systems
• Authors: Ting-Hui Wang, Li-Hsiang Shen, Kai-Ten Feng
• Abstract summary: Wi-Fi 6, IEEE 802.11ax, was be approved as the next sixth-generation (6G) technology of wireless local area networks (WLANs) In this paper, we propose a multi-agent deep Q-learning for fast roaming (MADAR) algorithm to effectively minimize the latency during the station roaming for Smart Warehouse in Wi-Fi 6 system.
• Score: 8.057006406834466
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The innovation of Wi-Fi 6, IEEE 802.11ax, was be approved as the next sixth-generation (6G) technology of wireless local area networks (WLANs) by improving the fundamental performance of latency, throughput, and so on. The main technical feature of orthogonal frequency division multiple access (OFDMA) supports multi-users to transmit respective data concurrently via the corresponding access points (APs). However, the conventional IEEE 802.11 protocol for Wi-Fi roaming selects the target AP only depending on received signal strength indication (RSSI) which is obtained by the received Response frame from the APs. In the long term, it may lead to congestion in a single channel under the scenarios of dense users further increasing the association delay and packet drop rate, even reducing the quality of service (QoS) of the overall system. In this paper, we propose a multi-agent deep Q-learning for fast roaming (MADAR) algorithm to effectively minimize the latency during the station roaming for Smart Warehouse in Wi-Fi 6 system. The MADAR algorithm considers not only RSSI but also channel state information (CSI), and through online neural network learning and weighting adjustments to maximize the reward of the action selected from Epsilon-Greedy. Compared to existing benchmark methods, the MADAR algorithm has been demonstrated for improved roaming latency by analyzing the simulation result and realistic dataset.

Related papers

• ENGNN: A General Edge-Update Empowered GNN Architecture for Radio Resource Management in Wireless Networks [29.23937571816269]
  A key task is to efficiently manage the radio resource by judicious beamforming and power allocation. We propose an edge-update mechanism, which enables GNNs to handle both node and edge variables. The proposed method achieves higher sum rate but with much shorter time than state-of-the-art methods.
  arXiv  Detail & Related papers  (2022-12-14T14:04:25Z)
• Federated Meta-Learning for Traffic Steering in O-RAN [1.400970992993106]
  We propose an algorithm for RAT allocation based on federated meta-learning (FML) We have designed a simulation environment which contains LTE and 5G NR service technologies.
  arXiv  Detail & Related papers  (2022-09-13T10:39:41Z)
• Deep Learning-Based Synchronization for Uplink NB-IoT [72.86843435313048]
  We propose a neural network (NN)-based algorithm for device detection and time of arrival (ToA) estimation for the narrowband physical random-access channel (NPRACH) of narrowband internet of things (NB-IoT) The introduced NN architecture leverages residual convolutional networks as well as knowledge of the preamble structure of the 5G New Radio (5G NR) specifications.
  arXiv  Detail & Related papers  (2022-05-22T12:16:43Z)
• INSPIRE: Distributed Bayesian Optimization for ImproviNg SPatIal REuse in Dense WLANs [0.10878040851637999]
  IEEE 802.11ax aims at increasing the reuse of a radio channel by allowing the dynamic update of two key parameters in wireless transmission. In this paper, we present INSPIRE, a distributed solution performing local optimizations based on Bayesian processes. In only a few seconds, INSPIRE is able to drastically increase the quality of service of operational spatials by improving their fairness and throughput.
  arXiv  Detail & Related papers  (2022-03-30T14:48:26Z)
• Federated Spatial Reuse Optimization in Next-Generation Decentralized IEEE 802.11 WLANs [14.954710245070343]
  We explore the feasibility of applying machine learning (ML) in next-generation wireless local area networks (WLANs) More specifically, we focus on the IEEE 802.11ax spatial reuse problem and predict its performance through federated learning (FL) models. The set of FL solutions overviewed in this work is part of the 2021 International Telecommunication Union (ITU) AI for 5G Challenge.
  arXiv  Detail & Related papers  (2022-03-20T06:58:31Z)
• IoV Scenario: Implementation of a Bandwidth Aware Algorithm in Wireless Network Communication Mode [49.734868032441625]
  This paper proposes a bandwidth aware multi domain virtual network embedding algorithm (BA-VNE) The algorithm is mainly aimed at the problem that users need a lot of bandwidth in wireless communication mode. In order to improve the performance of the algorithm, we introduce particle swarm optimization (PSO) algorithm.
  arXiv  Detail & Related papers  (2022-02-03T03:34:06Z)
• Real-Time GPU-Accelerated Machine Learning Based Multiuser Detection for 5G and Beyond [70.81551587109833]
  nonlinear beamforming filters can significantly outperform linear approaches in stationary scenarios with massive connectivity. One of the main challenges comes from the real-time implementation of these algorithms. This paper explores the acceleration of APSM-based algorithms through massive parallelization.
  arXiv  Detail & Related papers  (2022-01-13T15:20:45Z)
• ML-based Handover Prediction and AP Selection in Cognitive Wi-Fi Networks [9.96238107493626]
  Two well-known problems related to device mobility are handover prediction and access point selection. We propose a data-driven machine learning (ML) schemes to efficiently solve these problems in networks. The proposed schemes are evaluated and results are compared with traditional approaches to the aforementioned problems.
  arXiv  Detail & Related papers  (2021-11-27T12:28:09Z)
• Data-Driven Random Access Optimization in Multi-Cell IoT Networks with NOMA [78.60275748518589]
  Non-orthogonal multiple access (NOMA) is a key technology to enable massive machine type communications (mMTC) in 5G networks and beyond. In this paper, NOMA is applied to improve the random access efficiency in high-density spatially-distributed multi-cell wireless IoT networks. A novel formulation of random channel access management is proposed, in which the transmission probability of each IoT device is tuned to maximize the geometric mean of users' expected capacity.
  arXiv  Detail & Related papers  (2021-01-02T15:21:08Z)
• Multi-Agent Reinforcement Learning in NOMA-aided UAV Networks for Cellular Offloading [59.32570888309133]
  A novel framework is proposed for cellular offloading with the aid of multiple unmanned aerial vehicles (UAVs) Non-orthogonal multiple access (NOMA) technique is employed at each UAV to further improve the spectrum efficiency of the wireless network. A mutual deep Q-network (MDQN) algorithm is proposed to jointly determine the optimal 3D trajectory and power allocation of UAVs.
  arXiv  Detail & Related papers  (2020-10-18T20:22:05Z)
• Cognitive Radio Network Throughput Maximization with Deep Reinforcement Learning [58.44609538048923]
  Radio Frequency powered Cognitive Radio Networks (RF-CRN) are likely to be the eyes and ears of upcoming modern networks such as Internet of Things (IoT) To be considered autonomous, the RF-powered network entities need to make decisions locally to maximize the network throughput under the uncertainty of any network environment. In this paper, deep reinforcement learning is proposed to overcome the shortcomings and allow a wireless gateway to derive an optimal policy to maximize network throughput.
  arXiv  Detail & Related papers  (2020-07-07T01:49:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.