Compute at Scale: A Broad Investigation into the Data Center Industry

• URL: http://arxiv.org/abs/2311.02651v4
• Date: Wed, 22 Nov 2023 23:02:32 GMT
• Title: Compute at Scale: A Broad Investigation into the Data Center Industry
• Authors: Konstantin Pilz and Lennart Heim
• Abstract summary: The global industry is valued at approximately $250B and is expected to double over the next seven years. There are likely about 500 large (above 10 MW) data centers globally, with the US, Europe, and China constituting the most important markets.
• Score: 0.8547032097715571
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: This report characterizes the data center industry and its importance for AI development. Data centers are industrial facilities that efficiently provide compute at scale and thus constitute the engine rooms of today's digital economy. As large-scale AI training and inference become increasingly computationally expensive, they are dominantly executed from this designated infrastructure. Key features of data centers include large-scale compute clusters that require extensive cooling and consume large amounts of power, the need for fast connectivity both within the data center and to the internet, and an emphasis on security and reliability. The global industry is valued at approximately $250B and is expected to double over the next seven years. There are likely about 500 large (above 10 MW) data centers globally, with the US, Europe, and China constituting the most important markets. The report further covers important actors, business models, main inputs, and typical locations of data centers.

Related papers

• Improving AI Efficiency in Data Centres by Power Dynamic Response [74.12165648170894]
  The steady growth of artificial intelligence (AI) has accelerated in the recent years, facilitated by the development of sophisticated models.<n> Ensuring robust and reliable power infrastructures is fundamental to take advantage of the full potential of AI.<n>However, AI data centres are extremely hungry for power, putting the problem of their power management in the spotlight.
  arXiv  Detail & Related papers  (2025-10-13T08:08:21Z)
• How Sovereign Is Sovereign Compute? A Review of 775 Non-U.S. Data Centers [0.0]
  This paper estimates how often data centers could be subject to foreign legal authorities due to the nationality of the data center operators.<n>We find that U.S. companies operate 48% of all non-U.S. data center projects in our dataset when weighted by investment value.
  arXiv  Detail & Related papers  (2025-07-30T22:58:42Z)
• The Cloud Next Door: Investigating the Environmental and Socioeconomic Strain of Datacenters on Local Communities [0.5025737475817937]
  Datacenters have become the backbone of modern digital infrastructure.<n>This expansion has brought growing tensions in the local communities where datacenters are already situated or being proposed.<n>Our goal is to bring visibility to these impacts and prompt more equitable and informed decisions about the future of digital infrastructure.
  arXiv  Detail & Related papers  (2025-06-03T20:21:53Z)
• I've Got 99 Problems But FLOPS Ain't One [70.3084616806354]
  We take an unconventional approach to find relevant research directions, starting from public plans to build a $100 billion datacenter for machine learning applications. We discover what workloads such a datacenter might carry and explore the challenges one may encounter in doing so, with a focus on networking research. We conclude that building the datacenter and training such models is technically possible, but this requires novel wide-area transports for inter-DC communication, a multipath transport and novel datacenter topologies.
  arXiv  Detail & Related papers  (2024-07-01T10:33:46Z)
• Multi-Tier Computing-Enabled Digital Twin in 6G Networks [50.236861239246835]
  In Industry 4.0, industries such as manufacturing, automotive, and healthcare are rapidly adopting DT-based development. The main challenges to date have been the high demands on communication and computing resources, as well as privacy and security concerns. To achieve low latency and high security services in the emerging DT, multi-tier computing has been proposed by combining edge/fog computing and cloud computing.
  arXiv  Detail & Related papers  (2023-12-28T13:02:53Z)
• Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future [130.87142103774752]
  This review systematically assesses over seventy open-source autonomous driving datasets. It offers insights into various aspects, such as the principles underlying the creation of high-quality datasets. It also delves into the scientific and technical challenges that warrant resolution.
  arXiv  Detail & Related papers  (2023-12-06T10:46:53Z)
• Data-centric AI: Perspectives and Challenges [51.70828802140165]
  Data-centric AI (DCAI) advocates a fundamental shift from model advancements to ensuring data quality and reliability. We bring together three general missions: training data development, inference data development, and data maintenance.
  arXiv  Detail & Related papers  (2023-01-12T05:28:59Z)
• An IoT Cloud and Big Data Architecture for the Maintenance of Home Appliances [0.0722732388409495]
  This work introduces a distributed and scalable platform architecture that can be deployed for efficient big data collection and analytics. The proposed system was tested with a case study for Predictive Maintenance of Home Appliances. The experimental results demonstrated that the presented system could be advantageous for tackling real-world IoT scenarios in a cost-effective and local approach.
  arXiv  Detail & Related papers  (2022-10-25T13:25:00Z)
• Future Computer Systems and Networking Research in the Netherlands: A Manifesto [137.47124933818066]
  We draw attention to CompSys as a vital part of ICT. Each of the Top Sectors of the Dutch Economy, each route in the National Research Agenda, and each of the UN Sustainable Development Goals pose challenges that cannot be addressed without CompSys advances.
  arXiv  Detail & Related papers  (2022-05-26T11:02:29Z)
• Collection and harmonization of system logs and prototypal Analytics services with the Elastic (ELK) suite at the INFN-CNAF computing centre [0.0]
  The distributed Grid infrastructure for High Energy Physics experiments at the Large Hadron Collider (LHC) in Geneva comprises a set of computing centres, spread all over the world. In Italy, the Tier-1 functionalities are served by the INFN-CNAF data center, which provides also computing and storage resources to more than twenty non-LHC experiments. A working implementation of a system that collects, parses and displays the log information from CNAF data sources is presented.
  arXiv  Detail & Related papers  (2021-05-13T10:21:55Z)
• Power Modeling for Effective Datacenter Planning and Compute Management [53.41102502425513]
  We discuss two classes of statistical power models designed and validated to be accurate, simple, interpretable and applicable to all hardware configurations and workloads. We demonstrate that the proposed statistical modeling techniques, while simple and scalable, predict power with less than 5% Mean Absolute Percent Error (MAPE) for more than 95% diverse Power Distribution Units (more than 2000) using only 4 features.
  arXiv  Detail & Related papers  (2021-03-22T21:22:51Z)
• A robust modeling framework for energy analysis of data centers [0.0]
  Data centers are energy-intensive with significant and growing electricity demand. Current models fail to provide consistent and high dimensional energy analysis for data centers. This research aims to provide policy makers and data center energy analysts with comprehensive understanding of data center energy use and efficiency opportunities.
  arXiv  Detail & Related papers  (2020-06-11T21:05:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.