Treehouse: A Case For Carbon-Aware Datacenter Software
- URL: http://arxiv.org/abs/2201.02120v1
- Date: Thu, 6 Jan 2022 16:00:53 GMT
- Title: Treehouse: A Case For Carbon-Aware Datacenter Software
- Authors: Thomas Anderson, Adam Belay, Mosharaf Chowdhury, Asaf Cidon, and Irene
Zhang
- Abstract summary: The end of Dennard scaling and the slowing of Moore's Law has put the energy use of datacenters on an unsustainable path.
We argue that substantial reductions in the carbon intensity of datacenter computing are possible with a software-centric approach.
- Score: 4.7521372297013365
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The end of Dennard scaling and the slowing of Moore's Law has put the energy
use of datacenters on an unsustainable path. Datacenters are already a
significant fraction of worldwide electricity use, with application demand
scaling at a rapid rate. We argue that substantial reductions in the carbon
intensity of datacenter computing are possible with a software-centric
approach: by making energy and carbon visible to application developers on a
fine-grained basis, by modifying system APIs to make it possible to make
informed trade offs between performance and carbon emissions, and by raising
the level of application programming to allow for flexible use of more energy
efficient means of compute and storage. We also lay out a research agenda for
systems software to reduce the carbon footprint of datacenter computing.
Related papers
- Generative AI for Low-Carbon Artificial Intelligence of Things with Large Language Models [67.0243099823109]
Generative AI (GAI) holds immense potential to reduce carbon emissions of Artificial Intelligence of Things (AIoT)
In this article, we explore the potential of GAI for carbon emissions reduction and propose a novel GAI-enabled solution for low-carbon AIoT.
We propose a Large Language Model (LLM)-enabled carbon emission optimization framework, in which we design pluggable LLM and Retrieval Augmented Generation (RAG) modules.
arXiv Detail & Related papers (2024-04-28T05:46:28Z) - LACS: Learning-Augmented Algorithms for Carbon-Aware Resource Scaling with Uncertain Demand [1.423958951481749]
This paper studies the online carbon-aware resource scaling problem with unknown job lengths (OCSU)
We propose LACS, a theoretically robust learning-augmented algorithm that solves OCSU.
LACS achieves a 32% reduction in carbon footprint compared to the deadline-aware carbon-agnostic execution of the job.
arXiv Detail & Related papers (2024-03-29T04:54:22Z) - Spatio-temporal load shifting for truly clean computing [0.5857582826810999]
We study the impact of shifting computing jobs and associated power loads both in time and between locations.
We isolate three signals relevant for informed use of loadblity.
The costs of 24/7 CFE are reduced by 1.29$pm$0.07 EUR/MWh for every additional percentage of flexible load.
arXiv Detail & Related papers (2024-03-26T13:36:42Z) - WattScope: Non-intrusive Application-level Power Disaggregation in
Datacenters [0.6086160084025234]
WattScope is a system for non-intrusive estimating the power consumption of individual applications.
WattScope adapts and extends a machine learning-based technique for disaggregating building power.
arXiv Detail & Related papers (2023-09-22T04:13:46Z) - SHIELD: Sustainable Hybrid Evolutionary Learning Framework for Carbon,
Wastewater, and Energy-Aware Data Center Management [2.9699290794642366]
Geo-distributed data centers (GDDCs) have a significant associated environmental impact.
This paper proposes a novel framework to co-optimize carbon emissions, water footprint, and energy costs of GDDCs.
arXiv Detail & Related papers (2023-08-24T21:11:55Z) - Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A
Multi-Agent Reinforcement Learning Approach [48.18355658448509]
Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy consumption.
Scheduling training jobs among geographically distributed cloud data centers unveils the opportunity to optimize the usage of computing capacity powered by inexpensive and low-carbon energy.
We propose an algorithm based on multi-agent reinforcement learning and actor-critic methods to learn the optimal collaborative scheduling strategy through interacting with a cloud system built with real-life workload patterns, energy prices, and carbon intensities.
arXiv Detail & Related papers (2023-04-17T02:12:30Z) - Implementing Reinforcement Learning Datacenter Congestion Control in NVIDIA NICs [64.26714148634228]
congestion control (CC) algorithms become extremely difficult to design.
It is currently not possible to deploy AI models on network devices due to their limited computational capabilities.
We build a computationally-light solution based on a recent reinforcement learning CC algorithm.
arXiv Detail & Related papers (2022-07-05T20:42:24Z) - Measuring the Carbon Intensity of AI in Cloud Instances [91.28501520271972]
We provide a framework for measuring software carbon intensity, and propose to measure operational carbon emissions.
We evaluate a suite of approaches for reducing emissions on the Microsoft Azure cloud compute platform.
arXiv Detail & Related papers (2022-06-10T17:04:04Z) - A Framework for Energy and Carbon Footprint Analysis of Distributed and
Federated Edge Learning [48.63610479916003]
This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies.
It models both vanilla and decentralized FL policies driven by consensus.
Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
arXiv Detail & Related papers (2021-03-18T16:04:42Z) - Towards the Systematic Reporting of the Energy and Carbon Footprints of
Machine Learning [68.37641996188133]
We introduce a framework for tracking realtime energy consumption and carbon emissions.
We create a leaderboard for energy efficient reinforcement learning algorithms.
We propose strategies for mitigation of carbon emissions and reduction of energy consumption.
arXiv Detail & Related papers (2020-01-31T05:12:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.