LLeMpower: Understanding Disparities in the Control and Access of Large Language Models

• URL: http://arxiv.org/abs/2404.09356v1
• Date: Sun, 14 Apr 2024 20:49:53 GMT
• Title: LLeMpower: Understanding Disparities in the Control and Access of Large Language Models
• Authors: Vishwas Sathish, Hannah Lin, Aditya K Kamath, Anish Nyayachavadi,
• Abstract summary: Large Language Models (LLMs) are powerful technology that augment human skill to create new opportunities. LLMs require significant computing resources and energy to train and serve. Inequity in their control and access has led to concentration of ownership and power to a small collection of corporations.
• Score: 0.6749750044497731
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Large Language Models (LLMs) are a powerful technology that augment human skill to create new opportunities, akin to the development of steam engines and the internet. However, LLMs come with a high cost. They require significant computing resources and energy to train and serve. Inequity in their control and access has led to concentration of ownership and power to a small collection of corporations. In our study, we collect training and inference requirements for various LLMs. We then analyze the economic strengths of nations and organizations in the context of developing and serving these models. Additionally, we also look at whether individuals around the world can access and use this emerging technology. We compare and contrast these groups to show that these technologies are monopolized by a surprisingly few entities. We conclude with a qualitative study on the ethical implications of our findings and discuss future directions towards equity in LLM access.

Related papers

• Federated Large Language Models: Current Progress and Future Directions [63.68614548512534]
  This paper surveys Federated learning for LLMs (FedLLM), highlighting recent advances and future directions. We focus on two key aspects: fine-tuning and prompt learning in a federated setting, discussing existing work and associated research challenges.
  arXiv  Detail & Related papers  (2024-09-24T04:14:33Z)
• MAP-Neo: Highly Capable and Transparent Bilingual Large Language Model Series [86.31735321970481]
  We open-source MAP-Neo, a bilingual language model with 7B parameters trained from scratch on 4.5T high-quality tokens. Our MAP-Neo is the first fully open-sourced bilingual LLM with comparable performance compared to existing state-of-the-art LLMs.
  arXiv  Detail & Related papers  (2024-05-29T17:57:16Z)
• Large Language Models for Education: A Survey [32.42330148200439]
  Large language models (LLMs) have been increasingly used in various applications. The use of LLMs for smart education (LLMEdu) has been a significant strategic direction for countries worldwide. While LLMs have shown great promise in improving teaching quality, changing education models, and modifying teacher roles, the technologies are still facing several challenges.
  arXiv  Detail & Related papers  (2024-05-12T01:50:01Z)
• Large Language Models as Instruments of Power: New Regimes of Autonomous Manipulation and Control [0.0]
  Large language models (LLMs) can reproduce a wide variety of rhetorical styles and generate text that expresses a broad spectrum of sentiments. We consider a set of underestimated societal harms made possible by the rapid and largely unregulated adoption of LLMs.
  arXiv  Detail & Related papers  (2024-05-06T19:52:57Z)
• Large Language Models for Education: A Survey and Outlook [69.02214694865229]
  We systematically review the technological advancements in each perspective, organize related datasets and benchmarks, and identify the risks and challenges associated with deploying LLMs in education. Our survey aims to provide a comprehensive technological picture for educators, researchers, and policymakers to harness the power of LLMs to revolutionize educational practices and foster a more effective personalized learning environment.
  arXiv  Detail & Related papers  (2024-03-26T21:04:29Z)
• Rethinking Machine Unlearning for Large Language Models [85.92660644100582]
  We explore machine unlearning in the domain of large language models (LLMs) This initiative aims to eliminate undesirable data influence (e.g., sensitive or illegal information) and the associated model capabilities.
  arXiv  Detail & Related papers  (2024-02-13T20:51:58Z)
• Rethinking Interpretability in the Era of Large Language Models [76.1947554386879]
  Large language models (LLMs) have demonstrated remarkable capabilities across a wide array of tasks. The capability to explain in natural language allows LLMs to expand the scale and complexity of patterns that can be given to a human. These new capabilities raise new challenges, such as hallucinated explanations and immense computational costs.
  arXiv  Detail & Related papers  (2024-01-30T17:38:54Z)
• BC4LLM: Trusted Artificial Intelligence When Blockchain Meets Large Language Models [6.867309936992639]
  Large language models (LLMs) serve people in the form of AI-generated content (AIGC) It is difficult to guarantee the authenticity and reliability of AIGC learning data. There are also hidden dangers of privacy disclosure in distributed AI training.
  arXiv  Detail & Related papers  (2023-10-10T03:18:26Z)
• Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly [62.473245910234304]
  This paper takes a hardware-centric approach to explore how Large Language Models can be brought to modern edge computing systems. We provide a micro-level hardware benchmark, compare the model FLOP utilization to a state-of-the-art data center GPU, and study the network utilization in realistic conditions.
  arXiv  Detail & Related papers  (2023-10-04T20:27:20Z)
• Large Language Models for Telecom: Forthcoming Impact on the Industry [13.456882619578707]
  Large Language Models (LLMs), AI-driven models that can achieve general-purpose language understanding and generation, have emerged as a transformative force. We delve into the inner workings of LLMs, providing insights into their current capabilities and limitations. We uncover essential research directions that deal with the distinctive challenges of utilizing the LLMs within the telecom domain.
  arXiv  Detail & Related papers  (2023-08-11T08:41:00Z)
• Large Language Models Humanize Technology [6.127963013089406]
  Large Language Models (LLMs) have made rapid progress in recent months and weeks. This has sparked concerns about aligning these models with human values, their impact on labor markets, and the potential need for regulation. We argue that LLMs exhibit emergent abilities to humanize technology more effectively than previous technologies.
  arXiv  Detail & Related papers  (2023-05-09T16:05:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.