A Survey on Reinforcement Learning-Aided Caching in Mobile Edge Networks
- URL: http://arxiv.org/abs/2105.05564v2
- Date: Thu, 13 May 2021 09:04:15 GMT
- Title: A Survey on Reinforcement Learning-Aided Caching in Mobile Edge Networks
- Authors: Nikolaos Nomikos, Spyros Zoupanos, Themistoklis Charalambous, Ioannis
Krikidis, Athina Petropulu
- Abstract summary: Mobile networks are experiencing tremendous increase in data volume and user density.
An efficient technique to alleviate this issue is to bring the data closer to the users by exploiting the caches of edge network nodes.
The fusion of machine learning and wireless networks offers a viable way for network optimization.
- Score: 12.470038211838363
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Mobile networks are experiencing tremendous increase in data volume and user
density. An efficient technique to alleviate this issue is to bring the data
closer to the users by exploiting the caches of edge network nodes, such as
fixed or mobile access points and even user devices. Meanwhile, the fusion of
machine learning and wireless networks offers a viable way for network
optimization as opposed to traditional optimization approaches which incur high
complexity, or fail to provide optimal solutions. Among the various machine
learning categories, reinforcement learning operates in an online and
autonomous manner without relying on large sets of historical data for
training. In this survey, reinforcement learning-aided mobile edge caching is
presented, aiming at highlighting the achieved network gains over conventional
caching approaches. Taking into account the heterogeneity of sixth generation
(6G) networks in various wireless settings, such as fixed, vehicular and flying
networks, learning-aided edge caching is presented, departing from traditional
architectures. Furthermore, a categorization according to the desirable
performance metric, such as spectral, energy and caching efficiency, average
delay, and backhaul and fronthaul offloading is provided. Finally, several open
issues are discussed, targeting to stimulate further interest in this important
research field.
Related papers
- Edge-device Collaborative Computing for Multi-view Classification [9.047284788663776]
We explore collaborative inference at the edge, in which edge nodes and end devices share correlated data and the inference computational burden.
We introduce selective schemes that decrease bandwidth resource consumption by effectively reducing data redundancy.
Experimental results highlight that selective collaborative schemes can achieve different trade-offs between the above performance metrics.
arXiv Detail & Related papers (2024-09-24T11:07:33Z) - Multi-agent Reinforcement Learning with Graph Q-Networks for Antenna
Tuning [60.94661435297309]
The scale of mobile networks makes it challenging to optimize antenna parameters using manual intervention or hand-engineered strategies.
We propose a new multi-agent reinforcement learning algorithm to optimize mobile network configurations globally.
We empirically demonstrate the performance of the algorithm on an antenna tilt tuning problem and a joint tilt and power control problem in a simulated environment.
arXiv Detail & Related papers (2023-01-20T17:06:34Z) - Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge
Intelligence [76.96698721128406]
Mobile edge computing (MEC) considered a novel paradigm for computation and delay-sensitive tasks in fifth generation (5G) networks and beyond.
This paper provides a comprehensive research review on free-enabled RL and offers insight for development.
arXiv Detail & Related papers (2022-01-27T10:02:54Z) - TEDGE-Caching: Transformer-based Edge Caching Towards 6G Networks [30.160404936777947]
Mobile Edge Caching (MEC) in the 6G networks has been evolved as an efficient solution to meet the phenomenal growth of the global mobile data traffic.
Recent advancements in Deep Neural Networks (DNNs) have drawn much research attention to predict the content popularity in proactive caching schemes.
We propose an edge caching framework incorporated with the attention-based Vision Transformer (ViT) neural network, referred to as the Transformer-based Edge (TEDGE) caching.
arXiv Detail & Related papers (2021-12-01T16:38:18Z) - Offline Contextual Bandits for Wireless Network Optimization [107.24086150482843]
In this paper, we investigate how to learn policies that can automatically adjust the configuration parameters of every cell in the network in response to the changes in the user demand.
Our solution combines existent methods for offline learning and adapts them in a principled way to overcome crucial challenges arising in this context.
arXiv Detail & Related papers (2021-11-11T11:31:20Z) - Cellular traffic offloading via Opportunistic Networking with
Reinforcement Learning [0.5758073912084364]
We propose an adaptive offloading solution based on the Reinforcement Learning framework.
We evaluate and compare the performance of two well-known learning algorithms: Actor-Critic and Q-Learning.
Our solution achieves a higher level of offloading with respect to other state-of-the-art approaches.
arXiv Detail & Related papers (2021-10-01T13:34:12Z) - Distributed Learning in Wireless Networks: Recent Progress and Future
Challenges [170.35951727508225]
Next-generation wireless networks will enable many machine learning (ML) tools and applications to analyze various types of data collected by edge devices.
Distributed learning and inference techniques have been proposed as a means to enable edge devices to collaboratively train ML models without raw data exchanges.
This paper provides a comprehensive study of how distributed learning can be efficiently and effectively deployed over wireless edge networks.
arXiv Detail & Related papers (2021-04-05T20:57:56Z) - All at Once Network Quantization via Collaborative Knowledge Transfer [56.95849086170461]
We develop a novel collaborative knowledge transfer approach for efficiently training the all-at-once quantization network.
Specifically, we propose an adaptive selection strategy to choose a high-precision enquoteteacher for transferring knowledge to the low-precision student.
To effectively transfer knowledge, we develop a dynamic block swapping method by randomly replacing the blocks in the lower-precision student network with the corresponding blocks in the higher-precision teacher network.
arXiv Detail & Related papers (2021-03-02T03:09:03Z) - Sparsity in Deep Learning: Pruning and growth for efficient inference
and training in neural networks [78.47459801017959]
Sparsity can reduce the memory footprint of regular networks to fit mobile devices.
We describe approaches to remove and add elements of neural networks, different training strategies to achieve model sparsity, and mechanisms to exploit sparsity in practice.
arXiv Detail & Related papers (2021-01-31T22:48:50Z) - A Survey of Deep Learning for Data Caching in Edge Network [1.9798034349981157]
This paper summarizes the utilization of deep learning for data caching in edge network.
We first outline the typical research topics in content caching and formulate a taxonomy based on network hierarchical structure.
Then, a number of key types of deep learning algorithms are presented, ranging from supervised learning to unsupervised learning as well as reinforcement learning.
arXiv Detail & Related papers (2020-08-17T12:02:32Z) - Applying Machine Learning Techniques for Caching in Edge Networks: A
Comprehensive Survey [3.985352415162327]
Machine learning techniques can be applied to predict content popularity based on user preferences.
These applications of machine learning can help identify relevant content for an edge network.
This article investigates the application of machine learning techniques for in-network caching in edge networks.
arXiv Detail & Related papers (2020-06-21T09:31:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.