The illusion of artificial inclusion
- URL: http://arxiv.org/abs/2401.08572v3
- Date: Mon, 5 Feb 2024 12:36:01 GMT
- Title: The illusion of artificial inclusion
- Authors: William Agnew, A. Stevie Bergman, Jennifer Chien, Mark D\'iaz, Seliem
El-Sayed, Jaylen Pittman, Shakir Mohamed, Kevin R. McKee
- Abstract summary: Human participants play a central role in the development of modern artificial intelligence technology.
Recent advances in generative AI have attracted growing interest to the possibility of replacing human participants with AI surrogates.
- Score: 5.721091784293226
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Human participants play a central role in the development of modern
artificial intelligence (AI) technology, in psychological science, and in user
research. Recent advances in generative AI have attracted growing interest to
the possibility of replacing human participants in these domains with AI
surrogates. We survey several such "substitution proposals" to better
understand the arguments for and against substituting human participants with
modern generative AI. Our scoping review indicates that the recent wave of
these proposals is motivated by goals such as reducing the costs of research
and development work and increasing the diversity of collected data. However,
these proposals ignore and ultimately conflict with foundational values of work
with human participants: representation, inclusion, and understanding. This
paper critically examines the principles and goals underlying human
participation to help chart out paths for future work that truly centers and
empowers participants.
Related papers
- Measuring Human Contribution in AI-Assisted Content Generation [68.03658922067487]
This study raises the research question of measuring human contribution in AI-assisted content generation.
By calculating mutual information between human input and AI-assisted output relative to self-information of AI-assisted output, we quantify the proportional information contribution of humans in content generation.
arXiv Detail & Related papers (2024-08-27T05:56:04Z) - Now, Later, and Lasting: Ten Priorities for AI Research, Policy, and Practice [63.20307830884542]
Next several decades may well be a turning point for humanity, comparable to the industrial revolution.
Launched a decade ago, the project is committed to a perpetual series of studies by multidisciplinary experts.
We offer ten recommendations for action that collectively address both the short- and long-term potential impacts of AI technologies.
arXiv Detail & Related papers (2024-04-06T22:18:31Z) - Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making [47.33241893184721]
In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole.
We propose Human-AI Deliberation, a novel framework to promote human reflection and discussion on conflicting human-AI opinions in decision-making.
Based on theories in human deliberation, this framework engages humans and AI in dimension-level opinion elicitation, deliberative discussion, and decision updates.
arXiv Detail & Related papers (2024-03-25T14:34:06Z) - Human participants in AI research: Ethics and transparency in practice [0.9608936085613567]
Research involving human participants has been critical to advances in artificial intelligence (AI) and machine learning (ML)
Yet AI and participatory researchers lack guidelines for ethical research with human participants in AI and ML.
This paper seeks to address these concerns and position technical researchers with practical knowledge for their work.
arXiv Detail & Related papers (2023-11-02T14:12:21Z) - The Participatory Turn in AI Design: Theoretical Foundations and the
Current State of Practice [64.29355073494125]
This article aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation.
We articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners.
arXiv Detail & Related papers (2023-10-02T05:30:42Z) - Next Steps for Human-Centered Generative AI: A Technical Perspective [107.74614586614224]
We propose next-steps for Human-centered Generative AI (HGAI)
By identifying these next-steps, we intend to draw interdisciplinary research teams to pursue a coherent set of emergent ideas in HGAI.
arXiv Detail & Related papers (2023-06-27T19:54:30Z) - Human-Centered Responsible Artificial Intelligence: Current & Future
Trends [76.94037394832931]
In recent years, the CHI community has seen significant growth in research on Human-Centered Responsible Artificial Intelligence.
All of this work is aimed at developing AI that benefits humanity while being grounded in human rights and ethics, and reducing the potential harms of AI.
In this special interest group, we aim to bring together researchers from academia and industry interested in these topics to map current and future research trends.
arXiv Detail & Related papers (2023-02-16T08:59:42Z) - Stakeholder Participation in AI: Beyond "Add Diverse Stakeholders and
Stir" [76.44130385507894]
This paper aims to ground what we dub a 'participatory turn' in AI design by synthesizing existing literature on participation and through empirical analysis of its current practices.
Based on our literature synthesis and empirical research, this paper presents a conceptual framework for analyzing participatory approaches to AI design.
arXiv Detail & Related papers (2021-11-01T17:57:04Z) - AI in society and culture: decision making and values [0.0]
Several academic debates, social consultations and impact studies are available to reveal the key aspects of the changing human-machine ecosystem.
In details, sociocultural filters, taxonomy of human-machine decisions and perspectives of value-based AI are in the focus of this literature review.
For better understanding, it is proposed to invite stakeholders in the prepared large-scale survey about the next generation AI that investigates issues that go beyond the technology.
arXiv Detail & Related papers (2020-04-29T07:09:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.