LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations

• URL: http://arxiv.org/abs/2608.18503v1
• Date: Wed, 19 Aug 2026 03:50:32 GMT
• Title: LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations
• Abstract summary: This work introduces a novel predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers.<n>Our system utilizes an LLM to predict key metrics such as execution time and energy consumption from source code, and it has the potential to extend to other sustainability-focused metrics like water usage for cooling and carbon emissions.
• Score: 9.857318694890429
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The growing demand for AI-driven workloads, particularly from Large Language Models (LLMs), has raised concerns about the significant energy and resource consumption in data centers. This work introduces a novel LLM-based predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers. Our system utilizes an LLM to predict key metrics such as execution time and energy consumption from source code, and it has the potential to extend to other sustainability-focused metrics like water usage for cooling and carbon emissions, provided the data center can track such data. The predictive model is followed by a real-time scheduling algorithm that allocates GPU resources, aiming to improve sustainability by optimizing both energy consumption and queuing delays. With fast inference times, the ability to generalize across diverse task types, and minimal data requirements for training, our approach offers a practical solution for data center scheduling. This framework demonstrates strong potential for advancing sustainability objectives in AI-driven infrastructure. Through our collaboration with a data center, we achieved a 32% reduction in energy consumption and a 30% decrease in waiting time.

Related papers

• Edge-AI-Driven Learning-to-Rank for Decentralized Task Allocation in Circular Smart Manufacturing [54.4933359656657]
  This work proposes an Edge-AI-driven decentralized task allocation framework based on ranking-aware negotiation.<n>A ranking-aware formulation finally reshapes the learning objective to align with the ordering-based nature of winner selection.<n>Results show improved delay and deadline adherence under high load, and enhanced energy efficiency under tighter constraints.
  arXiv  Detail & Related papers  (2026-05-14T20:38:25Z)
• A Scalable Digital Twin Framework for Energy Optimization in Data Centers [0.0]
  This study proposes a scalable Digital Twin framework for energy optimization in data centers.<n>The framework integrates IoT-based data acquisition, cloud computing, and machine learning techniques to enable real-time monitoring, forecasting, and intelligent energy management.
  arXiv  Detail & Related papers  (2026-05-07T02:00:49Z)
• DCcluster-Opt: Benchmarking Dynamic Multi-Objective Optimization for Geo-Distributed Data Center Workloads [14.834687262955585]
  We present DCcluster-Opt: an open-source, high-fidelity simulation benchmark for sustainable, geo-temporal task scheduling.<n>It combines curated real-world datasets, including AI workload traces, grid carbon intensity, electricity markets, weather across 20 global regions, cloud transmission costs, and empirical network delay parameters.<n>A modular reward system enables an explicit study of trade-offs among carbon emissions, energy costs, service level agreements, and water use.
  arXiv  Detail & Related papers  (2025-10-31T03:07:12Z)
• Improving AI Efficiency in Data Centres by Power Dynamic Response [74.12165648170894]
  The steady growth of artificial intelligence (AI) has accelerated in the recent years, facilitated by the development of sophisticated models.<n> Ensuring robust and reliable power infrastructures is fundamental to take advantage of the full potential of AI.<n>However, AI data centres are extremely hungry for power, putting the problem of their power management in the spotlight.
  arXiv  Detail & Related papers  (2025-10-13T08:08:21Z)
• Towards Carbon-Aware Container Orchestration: Predicting Workload Energy Consumption with Federated Learning [8.968986043976532]
  We propose a federated learning approach for energy consumption prediction that preserves data privacy by keeping sensitive operational data within individual enterprises.<n>Our framework trains XGBoost models collaboratively across distributed clients using Flower's FedXgbBagging aggregation.<n>This work addresses the unresolved trade-off between data privacy and energy prediction efficiency in prior systems such as Kepler and CASPER.
  arXiv  Detail & Related papers  (2025-10-04T23:01:59Z)
• Hybrid Heterogeneous Clusters Can Lower the Energy Consumption of LLM Inference Workloads [0.2389598109913753]
  Training and using Large Language Models (LLMs) require large amounts of energy. This paper addresses the challenge of reducing energy consumption in data centers running LLMs. We propose a hybrid data center model that uses a cost-based scheduling framework to dynamically allocate tasks across hardware accelerators.
  arXiv  Detail & Related papers  (2024-04-25T11:24:08Z)
• Dynamic Scheduling for Federated Edge Learning with Streaming Data [56.91063444859008]
  We consider a Federated Edge Learning (FEEL) system where training data are randomly generated over time at a set of distributed edge devices with long-term energy constraints. Due to limited communication resources and latency requirements, only a subset of devices is scheduled for participating in the local training process in every iteration.
  arXiv  Detail & Related papers  (2023-05-02T07:41:16Z)
• Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A Multi-Agent Reinforcement Learning Approach [48.18355658448509]
  Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy consumption. Scheduling training jobs among geographically distributed cloud data centers unveils the opportunity to optimize the usage of computing capacity powered by inexpensive and low-carbon energy. We propose an algorithm based on multi-agent reinforcement learning and actor-critic methods to learn the optimal collaborative scheduling strategy through interacting with a cloud system built with real-life workload patterns, energy prices, and carbon intensities.
  arXiv  Detail & Related papers  (2023-04-17T02:12:30Z)
• HUNTER: AI based Holistic Resource Management for Sustainable Cloud Computing [26.48962351761643]
  We propose an artificial intelligence (AI) based holistic resource management technique for sustainable cloud computing called HUNTER. The proposed model formulates the goal of optimizing energy efficiency in data centers as a multi-objective scheduling problem. Experiments on simulated and physical cloud environments show that HUNTER outperforms state-of-the-art baselines in terms of energy consumption, SLA violation, scheduling time, cost and temperature by up to 12, 35, 43, 54 and 3 percent respectively.
  arXiv  Detail & Related papers  (2021-10-11T18:11:26Z)
• A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning [48.63610479916003]
  This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies. It models both vanilla and decentralized FL policies driven by consensus. Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
  arXiv  Detail & Related papers  (2021-03-18T16:04:42Z)
• Risk-Aware Energy Scheduling for Edge Computing with Microgrid: A Multi-Agent Deep Reinforcement Learning Approach [82.6692222294594]
  We study a risk-aware energy scheduling problem for a microgrid-powered MEC network. We derive the solution by applying a multi-agent deep reinforcement learning (MADRL)-based advantage actor-critic (A3C) algorithm with shared neural networks.
  arXiv  Detail & Related papers  (2020-02-21T02:14:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.