Treehouse: A Case For Carbon-Aware Datacenter Software
- URL: http://arxiv.org/abs/2201.02120v1
- Date: Thu, 6 Jan 2022 16:00:53 GMT
- Title: Treehouse: A Case For Carbon-Aware Datacenter Software
- Authors: Thomas Anderson, Adam Belay, Mosharaf Chowdhury, Asaf Cidon, and Irene
Zhang
- Abstract summary: The end of Dennard scaling and the slowing of Moore's Law has put the energy use of datacenters on an unsustainable path.
We argue that substantial reductions in the carbon intensity of datacenter computing are possible with a software-centric approach.
- Score: 4.7521372297013365
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: The end of Dennard scaling and the slowing of Moore's Law has put the energy
use of datacenters on an unsustainable path. Datacenters are already a
significant fraction of worldwide electricity use, with application demand
scaling at a rapid rate. We argue that substantial reductions in the carbon
intensity of datacenter computing are possible with a software-centric
approach: by making energy and carbon visible to application developers on a
fine-grained basis, by modifying system APIs to make it possible to make
informed trade offs between performance and carbon emissions, and by raising
the level of application programming to allow for flexible use of more energy
efficient means of compute and storage. We also lay out a research agenda for
systems software to reduce the carbon footprint of datacenter computing.
Related papers
- The Sunk Carbon Fallacy: Rethinking Carbon Footprint Metrics for Effective Carbon-Aware Scheduling [2.562727244613512]
We evaluate carbon-aware job scheduling and placement on a given set of servers for a number of carbon accounting metrics.
We study the factors that affect the added carbon cost of such suboptimal decision-making.
arXiv Detail & Related papers (2024-10-19T12:23:59Z) - I've Got 99 Problems But FLOPS Ain't One [70.3084616806354]
We take an unconventional approach to find relevant research directions, starting from public plans to build a $100 billion datacenter for machine learning applications.
We discover what workloads such a datacenter might carry and explore the challenges one may encounter in doing so, with a focus on networking research.
We conclude that building the datacenter and training such models is technically possible, but this requires novel wide-area transports for inter-DC communication, a multipath transport and novel datacenter topologies.
arXiv Detail & Related papers (2024-07-01T10:33:46Z) - Generative AI for Low-Carbon Artificial Intelligence of Things with Large Language Models [67.0243099823109]
Generative AI (GAI) holds immense potential to reduce carbon emissions of Artificial Intelligence of Things (AIoT)
In this article, we explore the potential of GAI for carbon emissions reduction and propose a novel GAI-enabled solution for low-carbon AIoT.
We propose a Large Language Model (LLM)-enabled carbon emission optimization framework, in which we design pluggable LLM and Retrieval Augmented Generation (RAG) modules.
arXiv Detail & Related papers (2024-04-28T05:46:28Z) - Spatio-temporal load shifting for truly clean computing [0.5857582826810999]
We study the impact of shifting computing jobs and associated power loads both in time and between locations.
We isolate three signals relevant for informed use of loadblity.
The costs of 24/7 CFE are reduced by 1.29$pm$0.07 EUR/MWh for every additional percentage of flexible load.
arXiv Detail & Related papers (2024-03-26T13:36:42Z) - WattScope: Non-intrusive Application-level Power Disaggregation in
Datacenters [0.6086160084025234]
WattScope is a system for non-intrusive estimating the power consumption of individual applications.
WattScope adapts and extends a machine learning-based technique for disaggregating building power.
arXiv Detail & Related papers (2023-09-22T04:13:46Z) - SHIELD: Sustainable Hybrid Evolutionary Learning Framework for Carbon,
Wastewater, and Energy-Aware Data Center Management [2.9699290794642366]
Geo-distributed data centers (GDDCs) have a significant associated environmental impact.
This paper proposes a novel framework to co-optimize carbon emissions, water footprint, and energy costs of GDDCs.
arXiv Detail & Related papers (2023-08-24T21:11:55Z) - Sustainable AIGC Workload Scheduling of Geo-Distributed Data Centers: A
Multi-Agent Reinforcement Learning Approach [48.18355658448509]
Recent breakthroughs in generative artificial intelligence have triggered a surge in demand for machine learning training, which poses significant cost burdens and environmental challenges due to its substantial energy consumption.
Scheduling training jobs among geographically distributed cloud data centers unveils the opportunity to optimize the usage of computing capacity powered by inexpensive and low-carbon energy.
We propose an algorithm based on multi-agent reinforcement learning and actor-critic methods to learn the optimal collaborative scheduling strategy through interacting with a cloud system built with real-life workload patterns, energy prices, and carbon intensities.
arXiv Detail & Related papers (2023-04-17T02:12:30Z) - Measuring the Carbon Intensity of AI in Cloud Instances [91.28501520271972]
We provide a framework for measuring software carbon intensity, and propose to measure operational carbon emissions.
We evaluate a suite of approaches for reducing emissions on the Microsoft Azure cloud compute platform.
arXiv Detail & Related papers (2022-06-10T17:04:04Z) - A Framework for Energy and Carbon Footprint Analysis of Distributed and
Federated Edge Learning [48.63610479916003]
This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies.
It models both vanilla and decentralized FL policies driven by consensus.
Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
arXiv Detail & Related papers (2021-03-18T16:04:42Z) - Towards the Systematic Reporting of the Energy and Carbon Footprints of
Machine Learning [68.37641996188133]
We introduce a framework for tracking realtime energy consumption and carbon emissions.
We create a leaderboard for energy efficient reinforcement learning algorithms.
We propose strategies for mitigation of carbon emissions and reduction of energy consumption.
arXiv Detail & Related papers (2020-01-31T05:12:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.