A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges

• URL: http://arxiv.org/abs/2412.04782v2
• Date: Sat, 18 Jan 2025 15:46:42 GMT
• Title: A Survey of Sustainability in Large Language Models: Applications, Economics, and Challenges
• Authors: Aditi Singh, Nirmal Prakashbhai Patel, Abul Ehtesham, Saket Kumar, Tala Talaei Khoei,
• Abstract summary: Large Language Models (LLMs) have transformed numerous domains by providing advanced capabilities in natural language understanding, generation, and reasoning. Despite their groundbreaking applications across industries such as research, healthcare, and creative media, their rapid adoption raises critical concerns regarding sustainability. This survey paper examines the environmental, economic, and computational challenges associated with LLMs, focusing on energy consumption, carbon emissions, and resource utilization in data centers.
• Score: 0.7889270818022226
• License:
• Abstract: Large Language Models (LLMs) have transformed numerous domains by providing advanced capabilities in natural language understanding, generation, and reasoning. Despite their groundbreaking applications across industries such as research, healthcare, and creative media, their rapid adoption raises critical concerns regarding sustainability. This survey paper comprehensively examines the environmental, economic, and computational challenges associated with LLMs, focusing on energy consumption, carbon emissions, and resource utilization in data centers. By synthesizing insights from existing literature, this work explores strategies such as resource-efficient training, sustainable deployment practices, and lifecycle assessments to mitigate the environmental impacts of LLMs. Key areas of emphasis include energy optimization, renewable energy integration, and balancing performance with sustainability. The findings aim to guide researchers, practitioners, and policymakers in developing actionable strategies for sustainable AI systems, fostering a responsible and environmentally conscious future for artificial intelligence.

Related papers

• From Efficiency Gains to Rebound Effects: The Problem of Jevons' Paradox in AI's Polarized Environmental Debate [69.05573887799203]
  Much of this debate has concentrated on direct impact without addressing the significant indirect effects. This paper examines how the problem of Jevons' Paradox applies to AI, whereby efficiency gains may paradoxically spur increased consumption. We argue that understanding these second-order impacts requires an interdisciplinary approach, combining lifecycle assessments with socio-economic analyses.
  arXiv  Detail & Related papers  (2025-01-27T22:45:06Z)
• Addressing the sustainable AI trilemma: a case study on LLM agents and RAG [7.6212949300713015]
  Large language models (LLMs) have demonstrated significant capabilities, but their widespread deployment and more advanced applications raise critical sustainability challenges. We propose the concept of the Sustainable AI Trilemma, highlighting the tensions between AI capability, digital equity, and environmental sustainability.
  arXiv  Detail & Related papers  (2025-01-14T17:21:16Z)
• Architectural Tactics to Improve the Environmental Sustainability of Microservices: A Rapid Review [0.0]
  This rapid review gathers 22 peer-reviewed studies and synthesizes architectural tactics that improve the environmental sustainability of systems. We list 6 tactics that are presented in an actionable way and categorized according to their sustainability aspects and context.
  arXiv  Detail & Related papers  (2024-07-19T22:44:58Z)
• The Responsible Foundation Model Development Cheatsheet: A Review of Tools & Resources [100.23208165760114]
  Foundation model development attracts a rapidly expanding body of contributors, scientists, and applications. To help shape responsible development practices, we introduce the Foundation Model Development Cheatsheet.
  arXiv  Detail & Related papers  (2024-06-24T15:55:49Z)
• Recommendations for public action towards sustainable generative AI systems [0.0]
  This paper presents the components of the environmental footprint of generative AI. It highlights the massive CO2 emissions and water consumption associated with training large language models. The paper also explores the factors and characteristics of models that have an influence on their environmental footprint.
  arXiv  Detail & Related papers  (2024-01-04T08:55:53Z)
• Beyond Efficiency: A Systematic Survey of Resource-Efficient Large Language Models [32.774929826684854]
  Large Language Models (LLMs) bring forth challenges in the high consumption of computational, memory, energy, and financial resources. This survey aims to systematically address these challenges by reviewing a broad spectrum of techniques designed to enhance the resource efficiency of LLMs.
  arXiv  Detail & Related papers  (2024-01-01T01:12:42Z)
• On the Opportunities of Green Computing: A Survey [80.21955522431168]
  Artificial Intelligence (AI) has achieved significant advancements in technology and research with the development over several decades. The needs for high computing power brings higher carbon emission and undermines research fairness. To tackle the challenges of computing resources and environmental impact of AI, Green Computing has become a hot research topic.
  arXiv  Detail & Related papers  (2023-11-01T11:16:41Z)
• A Comparative Study of Machine Learning Algorithms for Anomaly Detection in Industrial Environments: Performance and Environmental Impact [62.997667081978825]
  This study seeks to address the demands of high-performance machine learning models with environmental sustainability. Traditional machine learning algorithms, such as Decision Trees and Random Forests, demonstrate robust efficiency and performance. However, superior outcomes were obtained with optimised configurations, albeit with a commensurate increase in resource consumption.
  arXiv  Detail & Related papers  (2023-07-01T15:18:00Z)
• GreenDB -- A Dataset and Benchmark for Extraction of Sustainability Information of Consumer Goods [58.31888171187044]
  We present GreenDB, a database that collects products from European online shops on a weekly basis. As proxy for the products' sustainability, it relies on sustainability labels, which are evaluated by experts. We present initial results demonstrating that ML models trained with our data can reliably predict the sustainability label of products.
  arXiv  Detail & Related papers  (2022-07-21T19:59:42Z)
• Artificial intelligence for Sustainable Energy: A Contextual Topic Modeling and Content Analysis [0.0]
  We offer a novel contextual topic modeling combining LDA, BERT, and Clustering. We then combined these computational analyses with content analysis of related scientific publications to identify the main scholarly topics, sub-themes, and cross-topic themes within scientific research on sustainable AI in energy. Our research identified eight dominant topics including sustainable buildings, AI-based DSSs for urban water management, climate artificial intelligence, Agriculture 4, the convergence of AI with IoT, and AI-based evaluation of renewable technologies.
  arXiv  Detail & Related papers  (2021-10-02T15:51:51Z)
• Leveraging traditional ecological knowledge in ecosystem restoration projects utilizing machine learning [77.34726150561087]
  Community engagement throughout the stages of ecosystem restoration projects could contribute to improved community well-being. We suggest that adaptive and scalable practices could incentivize interdisciplinary collaboration during all stages of ecosystemic ML restoration projects.
  arXiv  Detail & Related papers  (2020-06-22T16:17:48Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.