Application of Machine Learning Optimization in Cloud Computing Resource Scheduling and Management

• URL: http://arxiv.org/abs/2402.17216v1
• Date: Tue, 27 Feb 2024 05:14:27 GMT
• Title: Application of Machine Learning Optimization in Cloud Computing Resource Scheduling and Management
• Authors: Yifan Zhang, Bo Liu, Yulu Gong, Jiaxin Huang, Jingyu Xu, Weixiang Wan
• Abstract summary: The scale of cloud computing in China has reached 209.1 billion yuan. This paper proposes an innovative approach to solve complex problems in cloud computing resource scheduling and management.
• Score: 18.462300407761873
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: In recent years, cloud computing has been widely used. Cloud computing refers to the centralized computing resources, users through the access to the centralized resources to complete the calculation, the cloud computing center will return the results of the program processing to the user. Cloud computing is not only for individual users, but also for enterprise users. By purchasing a cloud server, users do not have to buy a large number of computers, saving computing costs. According to a report by China Economic News Network, the scale of cloud computing in China has reached 209.1 billion yuan. At present, the more mature cloud service providers in China are Ali Cloud, Baidu Cloud, Huawei Cloud and so on. Therefore, this paper proposes an innovative approach to solve complex problems in cloud computing resource scheduling and management using machine learning optimization techniques. Through in-depth study of challenges such as low resource utilization and unbalanced load in the cloud environment, this study proposes a comprehensive solution, including optimization methods such as deep learning and genetic algorithm, to improve system performance and efficiency, and thus bring new breakthroughs and progress in the field of cloud computing resource management.Rational allocation of resources plays a crucial role in cloud computing. In the resource allocation of cloud computing, the cloud computing center has limited cloud resources, and users arrive in sequence. Each user requests the cloud computing center to use a certain number of cloud resources at a specific time.

Related papers

• The intelligent prediction and assessment of financial information risk in the cloud computing model [8.381780312169049]
  This report explores the intersection of cloud computing and financial information processing. It discusses the need for intelligent solutions to enhance data processing efficiency and accuracy while addressing security and privacy concerns. It proposes policy recommendations to mitigate concentration risks associated with cloud computing in the financial industry.
  arXiv  Detail & Related papers  (2024-04-14T18:42:20Z)
• Dynamic Resource Allocation for Virtual Machine Migration Optimization using Machine Learning [17.423579410846695]
  The paragraph is grammatically correct and logically coherent. It emphasizes the need for efficient data access and storage, as well as the utilization of cloud computing migration technology to prevent additional time delays.
  arXiv  Detail & Related papers  (2024-03-20T14:13:44Z)
• Computing in the Era of Large Generative Models: From Cloud-Native to AI-Native [46.7766555589807]
  We describe an AI-native computing paradigm that harnesses the power of both cloudnative technologies and advanced machine learning inference. These joint efforts aim to optimize costs-of-goods-sold (COGS) and improve resource accessibility.
  arXiv  Detail & Related papers  (2024-01-17T20:34:11Z)
• Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach [48.18355658448509]
  Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy consumption. Scheduling training jobs among geographically distributed cloud data centers unveils the opportunity to optimize the usage of computing capacity powered by inexpensive and low-carbon energy. We propose an algorithm based on multi-agent reinforcement learning and actor-critic methods to learn the optimal collaborative scheduling strategy through interacting with a cloud system built with real-life workload patterns, energy prices, and carbon intensities.
  arXiv  Detail & Related papers  (2023-04-17T02:12:30Z)
• Managing Cold-start in The Serverless Cloud with Temporal Convolutional Networks [0.0]
  Serverless cloud is an innovative cloud service model that frees customers from most cloud management duties. A big threat to the serverless cloud's performance is cold-start, which is when the time of provisioning the needed cloud resource to serve customers' requests incurs unacceptable costs to the service providers and/or the customers. This paper proposes a novel low-coupling, high-cohesion ensemble policy that addresses the cold-start problem at infrastructure- and function-levels of the serverless cloud stack.
  arXiv  Detail & Related papers  (2023-04-01T21:54:22Z)
• Measuring the Carbon Intensity of AI in Cloud Instances [91.28501520271972]
  We provide a framework for measuring software carbon intensity, and propose to measure operational carbon emissions. We evaluate a suite of approaches for reducing emissions on the Microsoft Azure cloud compute platform.
  arXiv  Detail & Related papers  (2022-06-10T17:04:04Z)
• Unsupervised Point Cloud Representation Learning with Deep Neural Networks: A Survey [104.71816962689296]
  Unsupervised point cloud representation learning has attracted increasing attention due to the constraint in large-scale point cloud labelling. This paper provides a comprehensive review of unsupervised point cloud representation learning using deep neural networks.
  arXiv  Detail & Related papers  (2022-02-28T07:46:05Z)
• Edge-Cloud Polarization and Collaboration: A Comprehensive Survey [61.05059817550049]
  We conduct a systematic review for both cloud and edge AI. We are the first to set up the collaborative learning mechanism for cloud and edge modeling. We discuss potentials and practical experiences of some on-going advanced edge AI topics.
  arXiv  Detail & Related papers  (2021-11-11T05:58:23Z)
• Auto-Split: A General Framework of Collaborative Edge-Cloud AI [49.750972428032355]
  This paper describes the techniques and engineering practice behind Auto-Split, an edge-cloud collaborative prototype of Huawei Cloud. To the best of our knowledge, there is no existing industry product that provides the capability of Deep Neural Network (DNN) splitting.
  arXiv  Detail & Related papers  (2021-08-30T08:03:29Z)
• Machine Learning (ML)-Centric Resource Management in Cloud Computing: A Review and Future Directions [22.779373079539713]
  Infrastructure as a Service (I) is one of the most important and rapidly growing fields. One of the most important aspects of cloud computing for I is resource management. Machine learning is being used to handle a variety of resource management tasks.
  arXiv  Detail & Related papers  (2021-05-09T08:03:58Z)
• Cloud Computing Concept and Roots [0.0]
  Cloud computing is a particular implementation of distributed computing. It inherited many properties of distributed computing such as scalability, reliability and distribution transparency. New processing and storage resources can be added into the Cloud resource pool seamlessly.
  arXiv  Detail & Related papers  (2021-01-28T17:42:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.