Life Cycle Assessment of Pre-training the Lucie 7B Open-Source Large Language Model on the Jean Zay Supercomputer

• URL: http://arxiv.org/abs/2607.05408v1
• Date: Tue, 09 Jun 2026 13:44:21 GMT
• Title: Life Cycle Assessment of Pre-training the Lucie 7B Open-Source Large Language Model on the Jean Zay Supercomputer
• Abstract summary: We present a life cycle assessment (LCA) of the pre-training of Lucie 7B, an open-source multilingual Foundation Model developed by the OpenLLM-France consortium.<n>The study scope extends from data preparation to model validation, and integrates the full life cycle of the hardware infrastructure.<n>We report an annual footprint of 417.5 tCO2eq for the Jean Zay H100 partition, split almost equally between manufacturing and operation.
• Score: 0.038233569758620044
• License: http://creativecommons.org/licenses/by-sa/4.0/
• Abstract: The environmental impact of training large language models (LLMs) is increasingly scrutinised, yet most published estimates focus on operational energy and disclose little about manufacturing (embodied) emissions, water consumption, or the underlying highperformance computing (HPC) infrastructure. We present a life cycle assessment (LCA) of the pre-training of Lucie 7B, an open-source multilingual Foundation Model developed by the OpenLLM-France consortium and trained on the NVIDIA H100 partition of the Jean Zay supercomputer operated by IDRIS (CNRS). The assessment is framed by the AFNOR SPEC 2314 "Frugal AI" reference and applies the Labos 1point5 methodology for greenhouse gas(GHG) accounting in computing. The study scope extends from data preparation to model validation, and integrates the full life cycle of the hardware infrastructure: manufacturing (including raw-material extraction), use (compute, temporary storage, system administration, cooling), and end-of-life. We report (i) an annual footprint of 417.5 tCO2eq for the Jean Zay H100 partition, split almost equally between manufacturing and operation; (ii) an effective intensity of 36.7 gCO2eq per H100 GPU-hour; (iii) a total training footprint of 21 tCO2eq for Lucie 7B (574 564 H100 GPU-hours), inclusive of amortised hardware manufacturing; (iv) on-site water consumption of approximately 76m3 for the training campaign and an annual Water Usage Effectiveness (WUE) of 0.07 L/kWh for IDRIS; (v) a heat-reuse factor (ERF) of 0.37 thanks to waste-heat recovery into the urban heating network. The study contributes one of the few publicly documented LCAs of an LLM training campaign that explicitly couples operational data with embodied emissions decomposed by subsystem (compute, storage, power chain, cooling), and discusses the implications for the design of frugal-by-construction AI systems in Europe.

Related papers

• JD Oxygen AI Item Center (Oxygen AIIC) V1: An Industrial-Scale LLM/VLM-Centric Solution for Item Understanding, Management, and Applications [52.23546815210647]
  We present the JD Oxygen AI Item Center (Oxygen AIIC) for item-knowledge production and service.<n>Oxygen AIIC is built around four core pillars: (i) engineering driven by efficient human-AI collaboration, (ii) a "Semantic Search then Discrimination"(S2D) knowledge identification architecture, and (iii) self-evolving item-understanding LLMs/VLMs.<n>Oxygen AIIC now covers tens of thousands of JD categories and processes hundreds of millions of item updates per day on Huawei Ascend NPUs.
  arXiv  Detail & Related papers  (2026-06-26T13:33:27Z)
• Accounting for AI Inference in Corporate GHG Inventories: A Four-Tier Methodology for Scope 3 Category 1 Reporting [0.0]
  AI inference services fall under Scope 3 Category 1 under the Corporate Sustainability Reporting Directive (CSRD)<n>Current practice either omits the category entirely or applies a generic economic input-output factor calibrated to the ICT sector as a whole.<n>We propose a four-tier framework that matches estimation precision to the data organisations can realistically obtain.
  arXiv  Detail & Related papers  (2026-06-09T10:08:36Z)
• The Hidden Cost of Thinking: Energy Use and Environmental Impact of LMs Beyond Pretraining [59.27959962602072]
  Olmo 3 is a family of 7 billion and 32 billion parameter models in both instruction-following and reasoning variants.<n>We estimate our model development process consumed 12.3 GWh of datacenter energy, emitted 4,251 tCO2eq, and consumed 15,887 kL of water, with water consumption driven entirely by power generation infrastructure rather than data center cooling.
  arXiv  Detail & Related papers  (2026-05-01T23:24:23Z)
• From FLOPs to Footprints: The Resource Cost of Artificial Intelligence [4.315953541684344]
  This study quantifies the material footprint of AI training by linking computational workloads to physical hardware needs.<n>The elemental composition of the Nvidia A100 SXM 40 GB graphics processing unit ( GPU) was analyzed using inductively coupled plasma optical emission spectroscopy, which identified 32 elements.<n>The results show that AI hardware consists of about 90% heavy metals and only trace amounts of precious metals.
  arXiv  Detail & Related papers  (2025-12-03T17:01:46Z)
• How Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inference [0.0]
  This paper introduces a novel infrastructure-aware benchmarking framework for quantifying the environmental footprint of AI inference across 30 state-of-the-art models as deployed in commercial data centers.<n>Our results show that o3 and DeepSeek-R1 emerge as the most energy-intensive models, consuming over 33 Wh per long prompt, more than 70 times the consumption of GPT-4.1 nano, and that Claude-3.7 Sonnet ranks highest in eco-efficiency.<n>These findings illustrate a growing paradox: Although AI is becoming cheaper and faster, its global adoption drives disproportionate resource consumption.
  arXiv  Detail & Related papers  (2025-05-14T17:47:00Z)
• Holistically Evaluating the Environmental Impact of Creating Language Models [26.846990296567267]
  We estimate the real-world environmental impact of developing a series of language models, ranging from 20 million to 13 billion active parameters, trained on up to 5.6 trillion tokens each.<n>We find that our series of models released 493 metric tons of carbon emissions, equivalent to powering about 98 homes in the United States for one year.<n>We also find that power usage throughout training is not consistent, fluctuating between 15% and 85% of our hardware's maximum power draw.
  arXiv  Detail & Related papers  (2025-03-03T22:16:15Z)
• Green Federated Learning [7.003870178055125]
  Federated Learning (FL) is a machine learning technique for training a centralized model using data of decentralized entities. FL may leverage as many as hundreds of millions of globally distributed end-user devices with diverse energy sources. We propose the concept of Green FL, which involves optimizing FL parameters and making design choices to minimize carbon emissions.
  arXiv  Detail & Related papers  (2023-03-26T02:23:38Z)
• Counting Carbon: A Survey of Factors Influencing the Emissions of Machine Learning [77.62876532784759]
  Machine learning (ML) requires using energy to carry out computations during the model training process. The generation of this energy comes with an environmental cost in terms of greenhouse gas emissions, depending on quantity used and the energy source. We present a survey of the carbon emissions of 95 ML models across time and different tasks in natural language processing and computer vision.
  arXiv  Detail & Related papers  (2023-02-16T18:35:00Z)
• Estimating the Carbon Footprint of BLOOM, a 176B Parameter Language Model [72.65502770895417]
  We quantify the carbon footprint of BLOOM, a 176-billion parameter language model, across its life cycle. We estimate that BLOOM's final training emitted approximately 24.7 tonnes ofcarboneqif we consider only the dynamic power consumption. We conclude with a discussion regarding the difficulty of precisely estimating the carbon footprint of machine learning models.
  arXiv  Detail & Related papers  (2022-11-03T17:13:48Z)
• Low Emission Building Control with Zero-Shot Reinforcement Learning [70.70479436076238]
  Control via Reinforcement Learning (RL) has been shown to significantly improve building energy efficiency. We show it is possible to obtain emission-reducing policies without a priori--a paradigm we call zero-shot building control.
  arXiv  Detail & Related papers  (2022-08-12T17:13:25Z)
• A Framework for Energy and Carbon Footprint Analysis of Distributed and Federated Edge Learning [48.63610479916003]
  This article breaks down and analyzes the main factors that influence the environmental footprint of distributed learning policies. It models both vanilla and decentralized FL policies driven by consensus. Results show that FL allows remarkable end-to-end energy savings (30%-40%) for wireless systems characterized by low bit/Joule efficiency.
  arXiv  Detail & Related papers  (2021-03-18T16:04:42Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.