Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning

• URL: http://arxiv.org/abs/2604.07345v1
• Date: Wed, 08 Apr 2026 17:56:41 GMT
• Title: Measurement of Generative AI Workload Power Profiles for Whole-Facility Data Center Infrastructure Planning
• Abstract summary: We present a methodology that bridges the gap by linking high-resolution workload power measurements to whole-facility energy demand.<n>We measure power consumption of AI workloads at 0.1-second resolution for AI training, fine-tuning and inference jobs.<n>The resulting whole-facility energy profiles capture realistic temporal fluctuations driven by AI workloads and user-behavior.
• Score: 1.2396819107017578
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: The rapid growth of generative artificial intelligence (AI) has introduced unprecedented computational demands, driving significant increases in the energy footprint of data centers. However, existing power consumption data is largely proprietary and reported at varying resolutions, creating challenges for estimating whole-facility energy use and planning infrastructure. In this work, we present a methodology that bridges this gap by linking high-resolution workload power measurements to whole-facility energy demand. Using NLR's high-performance computing data center equipped with NVIDIA H100 GPUs, we measure power consumption of AI workloads at 0.1-second resolution for AI training, fine-tuning and inference jobs. Workloads are characterized using MLCommons benchmarks for model training and fine-tuning, and vLLM benchmarks for inference, enabling reproducible and standardized workload profiling. The dataset of power consumption profiles is made publicly available. These power profiles are then scaled to the whole-facility-level using a bottom-up, event-driven, data center energy model. The resulting whole-facility energy profiles capture realistic temporal fluctuations driven by AI workloads and user-behavior, and can be used to inform infrastructure planning for grid connection, on-site energy generation, and distributed microgrids.

Related papers

• LLM-Powered Predictive Decision-Making for Sustainable Data Center Operations [9.857318694890429]
  This work introduces a novel predictive scheduling system designed to enhance operational efficiency while reducing the environmental impact of data centers.<n>Our system utilizes an LLM to predict key metrics such as execution time and energy consumption from source code, and it has the potential to extend to other sustainability-focused metrics like water usage for cooling and carbon emissions.
  arXiv  Detail & Related papers  (2026-08-19T03:50:32Z)
• Power-Flexible AI Data Centers: A New Paradigm for Grid-Responsive Compute [0.7399816551817894]
  Traditional power-system planning treats large computing facilities as inflexible peak loads, leading to costly infrastructure upgrades and long delays in grid interconnection.<n>Recent work has shown that AI clusters can reduce electricity consumption during peak demand through software-based workload orchestration.<n>We describe an architecture integrating grid signals, workload scheduling, and power telemetry for fine-grained cluster power control.<n> Experimental results from a real-world deployment on a 130 kW GPU cluster demonstrate multiple forms of flexibility, including rapid load reduction, sustained curtailment, and carbon-aware operation while preserving service levels for priority jobs.
  arXiv  Detail & Related papers  (2026-06-23T19:13:19Z)
• Networking-Aware Energy Efficiency in Agentic AI Inference: A Survey [64.20429885919701]
  We propose an energy accounting framework identifying computational and communication costs across the Perception-Reasoning-Action cycle.<n>We establish a unified taxonomy spanning model simplification, computation control, input and attention optimization, and hardware-aware inference.<n>We identify open challenges of federated green learning, carbon-aware agency, 6th generation mobile communication (6G)-native Agentic AI, and self-sustaining systems.
  arXiv  Detail & Related papers  (2026-04-09T06:13:59Z)
• From Prompts to Power: Measuring the Energy Footprint of LLM Inference [1.9116784879310027]
  We present a large-scale measurement-based study comprising over 32,500 measurements across 21 GPU configurations and 155 model architectures.<n>Using the vLLM inference engine, we quantify energy usage at the prompt level and identify how architectural and operational factors shape energy demand.<n>We develop a predictive model that accurately estimates inference energy consumption across unseen architectures and hardware, and implement it as a browser extension to raise awareness of the environmental impact of generative AI.
  arXiv  Detail & Related papers  (2025-11-05T15:06:46Z)
• Improving AI Efficiency in Data Centres by Power Dynamic Response [74.12165648170894]
  The steady growth of artificial intelligence (AI) has accelerated in the recent years, facilitated by the development of sophisticated models.<n> Ensuring robust and reliable power infrastructures is fundamental to take advantage of the full potential of AI.<n>However, AI data centres are extremely hungry for power, putting the problem of their power management in the spotlight.
  arXiv  Detail & Related papers  (2025-10-13T08:08:21Z)
• Energy-Efficient Federated Learning for Edge Real-Time Vision via Joint Data, Computation, and Communication Design [43.89869891417806]
  Real-time computer vision (CV) applications on wireless edge devices demand energy-efficient and privacy-preserving learning.<n>We propose FedDPQ, an ultra energy-efficient FL framework for real-time CV over unreliable wireless networks.
  arXiv  Detail & Related papers  (2025-08-03T13:05:11Z)
• THOR: A Generic Energy Estimation Approach for On-Device Training [34.57867978862375]
  THOR is a generic approach for energy consumption estimation in deep neural network (DNN) training.<n>We conduct extensive experiments with various types of models across different real-world platforms.<n>The results demonstrate that THOR has effectively reduced the Mean Absolute Percentage Error (MAPE) by up to 30%.
  arXiv  Detail & Related papers  (2025-01-27T03:29:02Z)
• Filling the Missing: Exploring Generative AI for Enhanced Federated Learning over Heterogeneous Mobile Edge Devices [72.61177465035031]
  We propose a generative AI-empowered federated learning to address these challenges by leveraging the idea of FIlling the MIssing (FIMI) portion of local data. Experiment results demonstrate that FIMI can save up to 50% of the device-side energy to achieve the target global test accuracy.
  arXiv  Detail & Related papers  (2023-10-21T12:07:04Z)
• Bringing AI to the edge: A formal M&S specification to deploy effective IoT architectures [0.0]
  The Internet of Things is transforming our society, providing new services that improve the quality of life and resource management. These applications are based on ubiquitous networks of multiple distributed devices, with limited computing resources and power. New architectures such as fog computing are emerging to bring computing infrastructure closer to data sources.
  arXiv  Detail & Related papers  (2023-05-11T21:29:58Z)
• Precise Energy Consumption Measurements of Heterogeneous Artificial Intelligence Workloads [0.534434568021034]
  We present measurements of the energy consumption of two typical applications of deep learning models on different types of compute nodes. One advantage of our approach is that the information on energy consumption is available to all users of the supercomputer.
  arXiv  Detail & Related papers  (2022-12-03T21:40:55Z)
• Power Modeling for Effective Datacenter Planning and Compute Management [53.41102502425513]
  We discuss two classes of statistical power models designed and validated to be accurate, simple, interpretable and applicable to all hardware configurations and workloads. We demonstrate that the proposed statistical modeling techniques, while simple and scalable, predict power with less than 5% Mean Absolute Percent Error (MAPE) for more than 95% diverse Power Distribution Units (more than 2000) using only 4 features.
  arXiv  Detail & Related papers  (2021-03-22T21:22:51Z)
• A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning [48.63610479916003]
  This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies. It models both vanilla and decentralized FL policies driven by consensus. Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
  arXiv  Detail & Related papers  (2021-03-18T16:04:42Z)
• Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems [87.4519172058185]
  An effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. A novel multi-agent meta-reinforcement learning (MAMRL) framework is proposed to solve the formulated problem. Experimental results show that the proposed MAMRL model can reduce up to 11% non-renewable energy usage and by 22.4% the energy cost.
  arXiv  Detail & Related papers  (2020-02-20T04:58:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.