Recommendations for Government Development and Use of Advanced Automated Systems to Make Decisions about Individuals

• URL: http://arxiv.org/abs/2403.01649v1
• Date: Mon, 4 Mar 2024 00:03:00 GMT
• Title: Recommendations for Government Development and Use of Advanced Automated Systems to Make Decisions about Individuals
• Authors: Susan Landau, James X. Dempsey, Ece Kamar, Steven M. Bellovin
• Abstract summary: Contestability is often constitutionally required as an element of due process. We convened a workshop on advanced automated decision making, contestability, and the law.
• Score: 14.957989495850935
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Contestability -- the ability to effectively challenge a decision -- is critical to the implementation of fairness. In the context of governmental decision making about individuals, contestability is often constitutionally required as an element of due process; specific procedures may be required by state or federal law relevant to a particular program. In addition, contestability can be a valuable way to discover systemic errors, contributing to ongoing assessments and system improvement. On January 24-25, 2024, with support from the National Science Foundation and the William and Flora Hewlett Foundation, we convened a diverse group of government officials, representatives of leading technology companies, technology and policy experts from academia and the non-profit sector, advocates, and stakeholders for a workshop on advanced automated decision making, contestability, and the law. Informed by the workshop's rich and wide-ranging discussion, we offer these recommendations. A full report summarizing the discussion is in preparation.

Related papers

• From Experts to the Public: Governing Multimodal Language Models in Politically Sensitive Video Analysis [48.14390493099495]
  This paper examines the governance of large language models (MM-LLMs) through individual and collective deliberation. We conducted a two-step study: first, interviews with 10 journalists established a baseline understanding of expert video interpretation; second, 114 individuals from the general public engaged in deliberation using Inclusive.AI.
  arXiv  Detail & Related papers  (2024-09-15T03:17:38Z)
• Challenging the Machine: Contestability in Government AI Systems [13.157925465480405]
  The January 24-25, 2024 workshop was to transform aspirations regarding artificial intelligence into actionable guidance. The requirements for contestability of advanced decision-making systems are not yet fully defined or implemented. This document is a report of that workshop, along with recommendations and explanatory material.
  arXiv  Detail & Related papers  (2024-06-14T22:22:17Z)
• Analysing and Organising Human Communications for AI Fairness-Related Decisions: Use Cases from the Public Sector [0.0]
  Communication issues between diverse stakeholders can lead to misinterpretation and misuse of AI algorithms. We conduct interviews with practitioners working on algorithmic systems in the public sector. We identify key elements of communication processes that underlie fairness-related human decisions.
  arXiv  Detail & Related papers  (2024-03-20T14:20:42Z)
• (Beyond) Reasonable Doubt: Challenges that Public Defenders Face in Scrutinizing AI in Court [7.742399489996169]
  We study efforts to contest AI systems in practice by studying how public defenders scrutinize AI in court. We present findings from interviews with 17 people in the U.S. public defense community.
  arXiv  Detail & Related papers  (2024-03-13T23:19:46Z)
• Causal Fairness for Outcome Control [68.12191782657437]
  We study a specific decision-making task called outcome control in which an automated system aims to optimize an outcome variable $Y$ while being fair and equitable. In this paper, we first analyze through causal lenses the notion of benefit, which captures how much a specific individual would benefit from a positive decision. We then note that the benefit itself may be influenced by the protected attribute, and propose causal tools which can be used to analyze this.
  arXiv  Detail & Related papers  (2023-06-08T09:31:18Z)
• A Survey on Fairness-aware Recommender Systems [59.23208133653637]
  We present concepts of fairness in different recommendation scenarios, comprehensively categorize current advances, and introduce typical methods to promote fairness in different stages of recommender systems. Next, we delve into the significant influence that fairness-aware recommender systems exert on real-world industrial applications.
  arXiv  Detail & Related papers  (2023-06-01T07:08:22Z)
• Tackling problems, harvesting benefits -- A systematic review of the regulatory debate around AI [0.0]
  How to integrate an emerging and all-pervasive technology such as AI into the structures and operations of our society is a question of contemporary politics, science and public debate. This article analyzes the academic debate around the regulation of artificial intelligence (AI) The analysis concentrates on societal risks and harms, questions of regulatory responsibility, and possible adequate policy frameworks.
  arXiv  Detail & Related papers  (2022-09-07T11:29:30Z)
• Causal Fairness Analysis [68.12191782657437]
  We introduce a framework for understanding, modeling, and possibly solving issues of fairness in decision-making settings. The main insight of our approach will be to link the quantification of the disparities present on the observed data with the underlying, and often unobserved, collection of causal mechanisms. Our effort culminates in the Fairness Map, which is the first systematic attempt to organize and explain the relationship between different criteria found in the literature.
  arXiv  Detail & Related papers  (2022-07-23T01:06:34Z)
• Decision Rule Elicitation for Domain Adaptation [93.02675868486932]
  Human-in-the-loop machine learning is widely used in artificial intelligence (AI) to elicit labels from experts. In this work, we allow experts to additionally produce decision rules describing their decision-making. We show that decision rule elicitation improves domain adaptation of the algorithm and helps to propagate expert's knowledge to the AI model.
  arXiv  Detail & Related papers  (2021-02-23T08:07:22Z)
• "A cold, technical decision-maker": Can AI provide explainability, negotiability, and humanity? [47.36687555570123]
  We present results of a qualitative study of algorithmic decision-making, comprised of five workshops conducted with a total of 60 participants. We discuss participants' consideration of humanity in decision-making, and introduce the concept of 'negotiability,' the ability to go beyond formal criteria and work flexibly around the system.
  arXiv  Detail & Related papers  (2020-12-01T22:36:54Z)
• Contestable Black Boxes [10.552465253379134]
  This paper investigates the type of assurances that are needed in the contesting process when algorithmic black-boxes are involved. We argue that specialised complementary methodologies to evaluate automated decision-making in the case of a particular decision being contested need to be developed.
  arXiv  Detail & Related papers  (2020-06-09T09:09:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.