Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models

• URL: http://arxiv.org/abs/2102.02503v1
• Date: Thu, 4 Feb 2021 09:27:04 GMT
• Title: Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models
• Abstract summary: GPT-3 was the largest publicly-disclosed dense language model at the time. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy. Here, we provide a detailed summary of the discussion organized by the two themes above.
• Score: 4.828761458451239
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: On October 14th, 2020, researchers from OpenAI, the Stanford Institute for Human-Centered Artificial Intelligence, and other universities convened to discuss open research questions surrounding GPT-3, the largest publicly-disclosed dense language model at the time. The meeting took place under Chatham House Rules. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy, and more. Broadly, the discussion centered around two main questions: 1) What are the technical capabilities and limitations of large language models? 2) What are the societal effects of widespread use of large language models? Here, we provide a detailed summary of the discussion organized by the two themes above.

Related papers

• How Large Language Models Are Changing MOOC Essay Answers: A Comparison of Pre- and Post-LLM Responses [2.681175517296992]
  We analyze essay responses from a free university-level MOOC on AI ethics. We find that the launch of ChatGPT coincided with significant changes in both the length and style of student essays. We also observe -- as expected based on related public discourse -- changes in prevalence of key content words related to AI and LLMs.
  arXiv  Detail & Related papers  (2025-04-17T15:51:59Z)
• Grandes modelos de lenguaje: de la predicción de palabras a la comprensión? [15.183932022078041]
  Large language models, such as the well-known ChatGPT, have brought about an unexpected revolution in the field of artificial intelligence. We describe how this technology has been developed and the fundamentals of its operation.
  arXiv  Detail & Related papers  (2025-02-25T13:44:49Z)
• WavChat: A Survey of Spoken Dialogue Models [66.82775211793547]
  Recent advancements in spoken dialogue models, exemplified by systems like GPT-4o, have captured significant attention in the speech domain. These advanced spoken dialogue models not only comprehend audio, music, and other speech-related features, but also capture stylistic and timbral characteristics in speech. Despite the progress in spoken dialogue systems, there is a lack of comprehensive surveys that systematically organize and analyze these systems.
  arXiv  Detail & Related papers  (2024-11-15T04:16:45Z)
• A Philosophical Introduction to Language Models -- Part I: Continuity With Classic Debates [0.05657375260432172]
  This article serves both as a primer on language models for philosophers, and as an opinionated survey of their significance. We argue that the success of language models challenges several long-held assumptions about artificial neural networks. This sets the stage for the companion paper (Part II), which turns to novel empirical methods for probing the inner workings of language models.
  arXiv  Detail & Related papers  (2024-01-08T14:12:31Z)
• Language Models: A Guide for the Perplexed [51.88841610098437]
  This tutorial aims to help narrow the gap between those who study language models and those who are intrigued and want to learn more. We offer a scientific viewpoint that focuses on questions amenable to study through experimentation. We situate language models as they are today in the context of the research that led to their development.
  arXiv  Detail & Related papers  (2023-11-29T01:19:02Z)
• DiPlomat: A Dialogue Dataset for Situated Pragmatic Reasoning [89.92601337474954]
  Pragmatic reasoning plays a pivotal role in deciphering implicit meanings that frequently arise in real-life conversations. We introduce a novel challenge, DiPlomat, aiming at benchmarking machines' capabilities on pragmatic reasoning and situated conversational understanding.
  arXiv  Detail & Related papers  (2023-06-15T10:41:23Z)
• ChatGPT and a New Academic Reality: Artificial Intelligence-Written Research Papers and the Ethics of the Large Language Models in Scholarly Publishing [6.109522330180625]
  ChatGPT is a generative pre-trained transformer, which uses natural language processing to fulfill text-based user requests. Potential ethical issues that could arise with the emergence of large language models like GPT-3 are discussed.
  arXiv  Detail & Related papers  (2023-03-21T14:35:07Z)
• Commonsense Reasoning for Conversational AI: A Survey of the State of the Art [0.76146285961466]
  The paper lists relevant training datasets and describes the primary approaches to include commonsense in conversational AI. The paper presents preliminary observations of the limited commonsense capabilities of two state-of-the-art open dialogue models, BlenderBot3 and LaMDA.
  arXiv  Detail & Related papers  (2023-02-15T19:55:57Z)
• The Debate Over Understanding in AI's Large Language Models [0.18275108630751835]
  We survey a current, heated debate in the AI research community on whether large pre-trained language models can be said to "understand" language. We argue that a new science of intelligence can be developed that will provide insight into distinct modes of understanding.
  arXiv  Detail & Related papers  (2022-10-14T17:04:29Z)
• Solving Quantitative Reasoning Problems with Language Models [53.53969870599973]
  We introduce Minerva, a large language model pretrained on general natural language data and further trained on technical content. The model achieves state-of-the-art performance on technical benchmarks without the use of external tools. We also evaluate our model on over two hundred undergraduate-level problems in physics, biology, chemistry, economics, and other sciences.
  arXiv  Detail & Related papers  (2022-06-29T18:54:49Z)
• Crossing the Conversational Chasm: A Primer on Multilingual Task-Oriented Dialogue Systems [51.328224222640614]
  Current state-of-the-art ToD models based on large pretrained neural language models are data hungry. Data acquisition for ToD use cases is expensive and tedious.
  arXiv  Detail & Related papers  (2021-04-17T15:19:56Z)
• KdConv: A Chinese Multi-domain Dialogue Dataset Towards Multi-turn Knowledge-driven Conversation [66.99734491847076]
  We propose a Chinese multi-domain knowledge-driven conversation dataset, KdConv, which grounds the topics in multi-turn conversations to knowledge graphs. Our corpus contains 4.5K conversations from three domains (film, music, and travel), and 86K utterances with an average turn number of 19.0.
  arXiv  Detail & Related papers  (2020-04-08T16:25:39Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.