An Uncommon Task: Participatory Design in Legal AI
- URL: http://arxiv.org/abs/2203.06246v1
- Date: Tue, 8 Mar 2022 15:46:52 GMT
- Title: An Uncommon Task: Participatory Design in Legal AI
- Authors: Fernando Delgado, Solon Barocas, and Karen Levy
- Abstract summary: We examine a notable yet understudied AI design process in the legal domain that took place over a decade ago.
We show how an interactive simulation methodology allowed computer scientists and lawyers to become co-designers.
- Score: 64.54460979588075
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Despite growing calls for participation in AI design, there are to date few
empirical studies of what these processes look like and how they can be
structured for meaningful engagement with domain experts. In this paper, we
examine a notable yet understudied AI design process in the legal domain that
took place over a decade ago, the impact of which still informs legal
automation efforts today. Specifically, we examine the design and evaluation
activities that took place from 2006 to 2011 within the TeXT Retrieval
Conference's (TREC) Legal Track, a computational research venue hosted by the
National Institute of Standards and Technologies. The Legal Track of TREC is
notable in the history of AI research and practice because it relied on a range
of participatory approaches to facilitate the design and evaluation of new
computational techniques--in this case, for automating attorney document review
for civil litigation matters. Drawing on archival research and interviews with
coordinators of the Legal Track of TREC, our analysis reveals how an
interactive simulation methodology allowed computer scientists and lawyers to
become co-designers and helped bridge the chasm between computational research
and real-world, high-stakes litigation practice. In analyzing this case from
the recent past, our aim is to empirically ground contemporary critiques of AI
development and evaluation and the calls for greater participation as a means
to address them.
Related papers
- AI in Archival Science -- A Systematic Review [0.9749638953163389]
This study underscores the benefits of integrating artificial intelligence (AI) within the broad realm of archival science.
Our findings highlight key AI driven strategies that promise to streamline record-keeping processes and enhance data retrieval efficiency.
arXiv Detail & Related papers (2024-10-07T14:39:12Z) - Report of the 1st Workshop on Generative AI and Law [78.62063815165968]
This report presents the takeaways of the inaugural Workshop on Generative AI and Law (GenLaw)
A cross-disciplinary group of practitioners and scholars from computer science and law convened to discuss the technical, doctrinal, and policy challenges presented by law for Generative AI.
arXiv Detail & Related papers (2023-11-11T04:13:37Z) - The Participatory Turn in AI Design: Theoretical Foundations and the
Current State of Practice [64.29355073494125]
This article aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation.
We articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners.
arXiv Detail & Related papers (2023-10-02T05:30:42Z) - Recentering Validity Considerations through Early-Stage Deliberations
Around AI and Policy Design [20.158252022235104]
A growing body of research has called for increased scrutiny around the validity of AI system designs.
In real-world settings, it is often not possible to fully address questions around the validity of an AI tool without also considering the design of associated organizational and public policies.
arXiv Detail & Related papers (2023-03-26T01:50:40Z) - Towards Automated Process Planning and Mining [77.34726150561087]
We present a research project in which researchers from the AI and BPM field work jointly together.
We discuss the overall research problem, the relevant fields of research and our overall research framework to automatically derive process models.
arXiv Detail & Related papers (2022-08-18T16:41:22Z) - Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and
Stir" [76.44130385507894]
This paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices.
Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design.
arXiv Detail & Related papers (2021-11-01T17:57:04Z) - How Does NLP Benefit Legal System: A Summary of Legal Artificial
Intelligence [81.04070052740596]
Legal Artificial Intelligence (LegalAI) focuses on applying the technology of artificial intelligence, especially natural language processing, to benefit tasks in the legal domain.
This paper introduces the history, the current state, and the future directions of research in LegalAI.
arXiv Detail & Related papers (2020-04-25T14:45:15Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.