Using Reinforcement Learning to Allocate and Manage Service Function Chains in Cellular Networks

• URL: http://arxiv.org/abs/2006.07349v3
• Date: Tue, 20 Oct 2020 00:12:50 GMT
• Title: Using Reinforcement Learning to Allocate and Manage Service Function Chains in Cellular Networks
• Authors: Guto Leoni Santos, Patricia Takako Endo
• Abstract summary: We propose the use of reinforcement learning to deploy a service function chain (SFC) of cellular network service and manage the network virtual functions (VNFs) The main purpose is to reduce the number of lost packets taking into account the energy consumption of the servers. Preliminary results show that the agent is able to allocate the SFC and manage the VNFs, reducing the number of lost packets.
• Score: 0.456877715768796
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: It is expected that the next generation cellular networks provide a connected society with fully mobility to empower the socio-economic transformation. Several other technologies will benefits of this evolution, such as Internet of Things, smart cities, smart agriculture, vehicular networks, healthcare applications, and so on. Each of these scenarios presents specific requirements and demands different network configurations. To deal with this heterogeneity, virtualization technology is key technology. Indeed, the network function virtualization (NFV) paradigm provides flexibility for the network manager, allocating resources according to the demand, and reduces acquisition and operational costs. In addition, it is possible to specify an ordered set of network virtual functions (VNFs) for a given service, which is called as service function chain (SFC). However, besides the advantages from service virtualization, it is expected that network performance and availability do not be affected by its usage. In this paper, we propose the use of reinforcement learning to deploy a SFC of cellular network service and manage the VNFs operation. We consider that the SFC is deployed by the reinforcement learning agent considering a scenarios with distributed data centers, where the VNFs are deployed in virtual machines in commodity servers. The NFV management is related to create, delete, and restart the VNFs. The main purpose is to reduce the number of lost packets taking into account the energy consumption of the servers. We use the Proximal Policy Optimization (PPO) algorithm to implement the agent and preliminary results show that the agent is able to allocate the SFC and manage the VNFs, reducing the number of lost packets.

Related papers

• A Learning-based Incentive Mechanism for Mobile AIGC Service in Decentralized Internet of Vehicles [49.86094523878003]
  We propose a decentralized incentive mechanism for mobile AIGC service allocation. We employ multi-agent deep reinforcement learning to find the balance between the supply of AIGC services on RSUs and user demand for services within the IoV context.
  arXiv  Detail & Related papers  (2024-03-29T12:46:07Z)
• Adaptive Services Function Chain Orchestration For Digital Health Twin Use Cases: Heuristic-boosted Q-Learning Approach [2.3513645401551333]
  Digital Twin (DT) is a prominent technology to utilise and deploy within the healthcare sector. Yet, the main challenges facing such applications are: Strict health data-sharing policies, high-performance network requirements, and possible infrastructure resource limitations. We define a Cloud-Native Network orchestrator on top of a multi-node cluster mesh infrastructure for flexible and dynamic container scheduling.
  arXiv  Detail & Related papers  (2023-04-25T14:25:08Z)
• Neighbor Auto-Grouping Graph Neural Networks for Handover Parameter Configuration in Cellular Network [47.29123145759976]
  We propose a learning-based framework for handover parameter configuration. First, we introduce a novel approach to imitate how the network responds to different network states and parameter values. During the parameter configuration stage, instead of solving the global optimization problem, we design a local multi-objective optimization strategy.
  arXiv  Detail & Related papers  (2022-12-29T18:51:36Z)
• AI in 6G: Energy-Efficient Distributed Machine Learning for Multilayer Heterogeneous Networks [7.318997639507269]
  We propose a novel layer-based HetNet architecture which distributes tasks associated with different machine learning approaches across network layers and entities. Such a HetNet boasts multiple access schemes as well as device-to-device (D2D) communications to enhance energy efficiency.
  arXiv  Detail & Related papers  (2022-06-04T22:03:19Z)
• Machine Learning-Based User Scheduling in Integrated Satellite-HAPS-Ground Networks [82.58968700765783]
  Integrated space-air-ground networks promise to offer a valuable solution space for empowering the sixth generation of communication networks (6G) This paper showcases the prospects of machine learning in the context of user scheduling in integrated space-air-ground communications.
  arXiv  Detail & Related papers  (2022-05-27T13:09:29Z)
• Federated Learning over Wireless IoT Networks with Optimized Communication and Resources [98.18365881575805]
  Federated learning (FL) as a paradigm of collaborative learning techniques has obtained increasing research attention. It is of interest to investigate fast responding and accurate FL schemes over wireless systems. We show that the proposed communication-efficient federated learning framework converges at a strong linear rate.
  arXiv  Detail & Related papers  (2021-10-22T13:25:57Z)
• Will bots take over the supply chain? Revisiting Agent-based supply chain automation [71.77396882936951]
  Agent-based supply chains have been proposed since early 2000; industrial uptake has been lagging. We find that agent-based technology has matured, and other supporting technologies that are penetrating supply chains are filling in gaps. For example, the ubiquity of IoT technology helps agents "sense" the state of affairs in a supply chain and opens up new possibilities for automation.
  arXiv  Detail & Related papers  (2021-09-03T18:44:26Z)
• The Greatest Teacher, Failure is: Using Reinforcement Learning for SFC Placement Based on Availability and Energy Consumption [0.3441021278275805]
  Telecommunication operators are deploying increasingly complex service function chains (SFCs) This paper proposes an availability- and energy-aware solution based on reinforcement learning (RL) Two policy-aware RL algorithms, Advantage Actor-Critic (A2C) and Proximal Policy optimisation (PPO2), are compared using simulations of a ground truth network topology based on the Rede Nacional de Ensino e Pesquisa (RNP) Network, Brazil's National Teaching and Research Network backbone.
  arXiv  Detail & Related papers  (2020-10-12T13:45:30Z)
• Methods and Techniques for Dynamic Deployability of Software-Defined Security Services [0.0]
  This thesis investigates the challenges of provisioning network security services in "softwarised" networks. The study is approached from the perspective of the telecom operator, whose goal is to protect the customers from network threats. The overall aim of the research presented in this thesis is proposing novel techniques for optimising the resource usage of software-based security services.
  arXiv  Detail & Related papers  (2020-04-04T16:04:18Z)
• Deep Learning for Radio Resource Allocation with Diverse Quality-of-Service Requirements in 5G [53.23237216769839]
  We develop a deep learning framework to approximate the optimal resource allocation policy for base stations. We find that a fully-connected neural network (NN) cannot fully guarantee the requirements due to the approximation errors and quantization errors of the numbers of subcarriers. Considering that the distribution of wireless channels and the types of services in the wireless networks are non-stationary, we apply deep transfer learning to update NNs in non-stationary wireless networks.
  arXiv  Detail & Related papers  (2020-03-29T04:48:22Z)
• Machine Learning for Performance-Aware Virtual Network Function Placement [3.5558885788605323]
  We develop a machine learning decision tree model that learns from the effective placement of the various Virtual Network Function instances forming a Service Function Chain (SFC) The model takes several performance-related features from the network as an input and selects the placement of the various VNF instances on network servers with the objective of minimizing the delay between dependent VNF instances.
  arXiv  Detail & Related papers  (2020-01-13T14:08:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.