Regulating Large Language Models: A Roundtable Report

• URL: http://arxiv.org/abs/2403.15397v1
• Date: Fri, 16 Feb 2024 21:49:17 GMT
• Title: Regulating Large Language Models: A Roundtable Report
• Abstract summary: The roundtable convened to discuss how law and policy can help address some of the larger societal problems posed by large language models (LLMs) We provide a detailed summary of the day's proceedings.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: On July 20, 2023, a group of 27 scholars and digital rights advocates with expertise in law, computer science, political science, and other disciplines gathered for the Large Language Models, Law and Policy Roundtable, co-hosted by the NYU School of Law's Information Law Institute and the Center for Democracy & Technology. The roundtable convened to discuss how law and policy can help address some of the larger societal problems posed by large language models (LLMs). The discussion focused on three policy topic areas in particular: 1. Truthfulness: What risks do LLMs pose in terms of generating mis- and disinformation? How can these risks be mitigated from a technical and/or regulatory perspective? 2. Privacy: What are the biggest privacy risks involved in the creation, deployment, and use of LLMs? How can these risks be mitigated from a technical and/or regulatory perspective? 3. Market concentration: What threats do LLMs pose concerning market/power concentration? How can these risks be mitigated from a technical and/or regulatory perspective? In this paper, we provide a detailed summary of the day's proceedings. We first recap what we deem to be the most important contributions made during the issue framing discussions. We then provide a list of potential legal and regulatory interventions generated during the brainstorming discussions.

Related papers

• LexGenius: An Expert-Level Benchmark for Large Language Models in Legal General Intelligence [74.05988707492058]
  Legal general intelligence (GI) refers to artificial intelligence (AI) that encompasses legal understanding, reasoning, and decision-making.<n>Existing benchmarks are result-oriented and fail to systematically evaluate the legal intelligence of large language models (LLMs)<n>We propose LexGenius, an expert-level Chinese legal benchmark for evaluating legal GI in LLMs.
  arXiv  Detail & Related papers  (2025-12-04T08:48:02Z)
• Bringing legal knowledge to the public by constructing a legal question bank using large-scale pre-trained language model [5.4204929130712145]
  We formulate a three-step approach for bringing legal knowledge to laypersons.<n>First, we translate selected sections of the law into snippets (called CLIC-pages)<n>Second, we construct a Legal Question Bank (LQB), which is a collection of legal questions whose answers can be found in the CLIC-pages.<n>Third, we design an interactive CLIC Recommender (CRec)
  arXiv  Detail & Related papers  (2025-05-07T05:07:38Z)
• AnnoCaseLaw: A Richly-Annotated Dataset For Benchmarking Explainable Legal Judgment Prediction [56.797874973414636]
  AnnoCaseLaw is a first-of-its-kind dataset of 471 meticulously annotated U.S. Appeals Court negligence cases. Our dataset lays the groundwork for more human-aligned, explainable Legal Judgment Prediction models. Results demonstrate that LJP remains a formidable task, with application of legal precedent proving particularly difficult.
  arXiv  Detail & Related papers  (2025-02-28T19:14:48Z)
• Generative AI regulation can learn from social media regulation [0.0]
  I argue that the debates on generative AI regulation can be informed by the debates and evidence on social media regulation. I compare and contrast the affordances of generative AI and social media to highlight their similarities and differences. I discuss specific policy recommendations based on the evolution of social media and their regulation.
  arXiv  Detail & Related papers  (2024-12-15T23:00:29Z)
• InternLM-Law: An Open Source Chinese Legal Large Language Model [72.2589401309848]
  InternLM-Law is a specialized LLM tailored for addressing diverse legal queries related to Chinese laws. We meticulously construct a dataset in the Chinese legal domain, encompassing over 1 million queries. InternLM-Law achieves the highest average performance on LawBench, outperforming state-of-the-art models, including GPT-4, on 13 out of 20 subtasks.
  arXiv  Detail & Related papers  (2024-06-21T06:19:03Z)
• Securing the Future of GenAI: Policy and Technology [50.586585729683776]
  Governments globally are grappling with the challenge of regulating GenAI, balancing innovation against safety. A workshop co-organized by Google, University of Wisconsin, Madison, and Stanford University aimed to bridge this gap between GenAI policy and technology. This paper summarizes the discussions during the workshop which addressed questions, such as: How regulation can be designed without hindering technological progress?
  arXiv  Detail & Related papers  (2024-05-21T20:30:01Z)
• AI Language Models Could Both Help and Harm Equity in Marine Policymaking: The Case Study of the BBNJ Question-Answering Bot [3.643615070316831]
  Large Language Models (LLMs) like ChatGPT are set to reshape some aspects of policymaking processes. We are cautiously hopeful that LLMs could be used to promote a marginally more balanced footing among decision makers in policy negotiations. However, the risks are particularly concerning for environmental and marine policy uses.
  arXiv  Detail & Related papers  (2024-03-04T06:21:02Z)
• How should the advent of large language models affect the practice of science? [51.62881233954798]
  How should the advent of large language models affect the practice of science? We have invited four diverse groups of scientists to reflect on this query, sharing their perspectives and engaging in debate.
  arXiv  Detail & Related papers  (2023-12-05T10:45:12Z)
• Report of the 1st Workshop on Generative AI and Law [78.62063815165968]
  This report presents the takeaways of the inaugural Workshop on Generative AI and Law (GenLaw) A cross-disciplinary group of practitioners and scholars from computer science and law convened to discuss the technical, doctrinal, and policy challenges presented by law for Generative AI.
  arXiv  Detail & Related papers  (2023-11-11T04:13:37Z)
• A Comprehensive Evaluation of Large Language Models on Legal Judgment Prediction [60.70089334782383]
  Large language models (LLMs) have demonstrated great potential for domain-specific applications. Recent disputes over GPT-4's law evaluation raise questions concerning their performance in real-world legal tasks. We design practical baseline solutions based on LLMs and test on the task of legal judgment prediction.
  arXiv  Detail & Related papers  (2023-10-18T07:38:04Z)
• Regulation and NLP (RegNLP): Taming Large Language Models [51.41095330188972]
  We argue how NLP research can benefit from proximity to regulatory studies and adjacent fields. We advocate for the development of a new multidisciplinary research space on regulation and NLP.
  arXiv  Detail & Related papers  (2023-10-09T09:22:40Z)
• A Short Survey of Viewing Large Language Models in Legal Aspect [0.0]
  Large language models (LLMs) have transformed many fields, including natural language processing, computer vision, and reinforcement learning. The integration of LLMs into the legal field has also raised several legal problems, including privacy concerns, bias, and explainability.
  arXiv  Detail & Related papers  (2023-03-16T08:01:22Z)
• Ethical and social risks of harm from Language Models [22.964941107198023]
  This paper aims to help structure the risk landscape associated with large-scale Language Models (LMs) A wide range of established and anticipated risks are analysed in detail, drawing on multidisciplinary expertise and literature from computer science, linguistics, and social sciences.
  arXiv  Detail & Related papers  (2021-12-08T16:09:48Z)
• On the Ethical Limits of Natural Language Processing on Legal Text [9.147707153504117]
  We argue that researchers struggle when it comes to identifying ethical limits to using natural language processing systems. We place emphasis on three crucial normative parameters which have, to the best of our knowledge, been underestimated by current debates. For each of these three parameters we provide specific recommendations for the legal NLP community.
  arXiv  Detail & Related papers  (2021-05-06T15:22:24Z)
• Understanding the Capabilities, Limitations, and Societal Impact of Large Language Models [4.828761458451239]
  GPT-3 was the largest publicly-disclosed dense language model at the time. Discussants came from a variety of research backgrounds including computer science, linguistics, philosophy, political science, communications, cyber policy. Here, we provide a detailed summary of the discussion organized by the two themes above.
  arXiv  Detail & Related papers  (2021-02-04T09:27:04Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.