Appearing Legitimate is Not Enough: Interrogating Synthetic Agents in Representational Processes through a Participatory Design Lens
- URL: http://arxiv.org/abs/2608.17099v1
- Date: Mon, 17 Aug 2026 20:14:34 GMT
- Title: Appearing Legitimate is Not Enough: Interrogating Synthetic Agents in Representational Processes through a Participatory Design Lens
- Abstract summary: We argue that legitimacy and personhood are integral and mutually while identifying the ethical, representational, and methodological risks of using synthetic agents in representational processes.
- Score: 0.7583052519127081
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Synthetic agents built atop LLM-based foundation models are gaining popularity as substitutes for human participants across research contexts, including user-testing, market-research, computational social science, surveys, and qualitative research. We are also witnessing an extension of synthetic agents into experimental implementations of policy consultation, jury deliberation, humanitarian diplomacy, and similar contexts where human participation and representation are central to the perceived legitimacy of the institutional processes. The value of participation extends beyond informational contributions and consensus generation; participation is a necessary, legitimizing condition for democratic political institutions and processes. Treating synthetic agents as human substitutes raises serious political, representational, and ethical concerns. Participatory Design's modes of engagement --- probing, priming, understanding, and generating --- offer helpful tools for engaging with representational questions of personhood. We apply the lens to three case studies of synthetic agents substituting for personhood at varying representational scales: local policy, enterprise jury deliberation, and global diplomacy. We argue that legitimacy and personhood are integral and mutually constitutive while identifying the ethical, representational, and methodological risks of using synthetic agents in representational processes. We conclude by proposing soft and hard boundaries for designing oversight on LLMs and synthetic agents in representational processes.
Related papers
- "Taking Stock at FAccT": Using Participatory Design to Co-Create a Vision for the Fairness, Accountability and Transparency Community [1.3126858950459552]
We report a large-scale participatory design (PD) process for reflexive conference governance at ACM FAccT.<n>Our endeavors represent one of the the first instances of applying PD to a venue that critically interrogates the societal impacts of AI.
arXiv Detail & Related papers (2026-04-17T16:37:41Z) - The Rise of AI Agent Communities: Large-Scale Analysis of Discourse and Interaction on Moltbook [62.2627874717318]
Moltbook is a Reddit-like social platform where AI agents create posts and interact with other agents through comments and replies.<n>Using a public API snapshot collected about five days after launch, we address three research questions: what AI agents discuss, how they post, and how they interact.<n>We show that agents' writing is predominantly neutral, with positivity appearing in community engagement and assistance-oriented content.
arXiv Detail & Related papers (2026-02-13T05:28:31Z) - Operationalizing Human Values in the Requirements Engineering Process of Ethics-Aware Autonomous Systems [3.535946769391712]
We propose a requirements engineering approach for ethics-aware autonomous systems.<n>We capture human values as normative goals and align them with functional and adaptation goals.<n>We demonstrate the feasibility of the approach through a medical Body Sensor Network case study.
arXiv Detail & Related papers (2026-02-10T15:54:25Z) - Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents [63.03252293761656]
This paper systematically reviews the technologies, applications, and evaluation methods of industry agents based on large language models (LLMs)<n>We examine the three key technological pillars that support the advancement of agent capabilities: Memory, Planning, and Tool Use.<n>We provide an overview of the application of industry agents in real-world domains such as digital engineering, scientific discovery, embodied intelligence, collaborative business execution, and complex system simulation.
arXiv Detail & Related papers (2025-10-20T12:46:55Z) - The Emergence of Social Science of Large Language Models [0.8582203861502194]
The social science of large language models (LLMs) examines how these systems evoke mind attributions, interact with one another, and transform human activity and institutions.<n>LLMs as Social Minds examines whether and when models display behaviors that elicit attributions of cognition, morality and bias, while addressing challenges such as test leakage and surface cues.<n>LLMs as Human Interactions examines how LLMs reshape tasks, learning, trust, work and governance, and how risks arise at the human-AI interface.
arXiv Detail & Related papers (2025-09-29T14:55:14Z) - Evolving Collective Cognition in Human-Agent Hybrid Societies: How Agents Form Stances and Boundaries [12.68373270583966]
We investigate how group stance differentiation and social boundary formation emerge in human-agent hybrid societies.<n>We find that agents exhibit endogenous stances, independent of their preset identities.<n>Our findings suggest that preset identities do not rigidly determine the agents' social structures.
arXiv Detail & Related papers (2025-08-24T13:50:18Z) - NomicLaw: Emergent Trust and Strategic Argumentation in LLMs During Collaborative Law-Making [6.56837855642886]
We introduce NomicLaw, a structured multi-agent simulation where LLMs engage in collaborative law-making.<n>We quantitatively measure trust and reciprocity via voting patterns and qualitatively assess how agents use strategic language to justify proposals.<n>Our results highlight the latent social reasoning and persuasive capabilities of ten open-source LLMs and provide insights into the design of future AI systems.
arXiv Detail & Related papers (2025-08-07T12:49:44Z) - Language Agents as Digital Representatives in Collective Decision-Making [22.656601943922066]
"representation" is the activity of making an individual's preferences present in the process via participation by a proxy agent.<n>We investigate the possibility of training textitlanguage agents to behave in the capacity of representatives of human agents.
arXiv Detail & Related papers (2025-02-13T14:35:40Z) - PersLLM: A Personified Training Approach for Large Language Models [66.16513246245401]
We propose PersLLM, a framework for better data construction and model tuning.<n>For insufficient data usage, we incorporate strategies such as Chain-of-Thought prompting and anti-induction.<n>For rigid behavior patterns, we design the tuning process and introduce automated DPO to enhance the specificity and dynamism of the models' personalities.
arXiv Detail & Related papers (2024-07-17T08:13:22Z) - Exploring Collaboration Mechanisms for LLM Agents: A Social Psychology View [60.80731090755224]
This paper probes the collaboration mechanisms among contemporary NLP systems by practical experiments with theoretical insights.
We fabricate four unique societies' comprised of LLM agents, where each agent is characterized by a specific trait' (easy-going or overconfident) and engages in collaboration with a distinct thinking pattern' (debate or reflection)
Our results further illustrate that LLM agents manifest human-like social behaviors, such as conformity and consensus reaching, mirroring social psychology theories.
arXiv Detail & Related papers (2023-10-03T15:05:52Z) - The Participatory Turn in AI Design: Theoretical Foundations and the
Current State of Practice [64.29355073494125]
This article aims to ground what we dub the "participatory turn" in AI design by synthesizing existing theoretical literature on participation.
We articulate empirical findings concerning the current state of participatory practice in AI design based on an analysis of recently published research and semi-structured interviews with 12 AI researchers and practitioners.
arXiv Detail & Related papers (2023-10-02T05:30:42Z) - Entity Graph Extraction from Legal Acts -- a Prototype for a Use Case in
Policy Design Analysis [52.77024349608834]
This paper presents a prototype developed to serve the quantitative study of public policy design.
Our system aims to automate the process of gathering legal documents, annotating them with Institutional Grammar, and using hypergraphs to analyse inter-relations between crucial entities.
arXiv Detail & Related papers (2022-09-02T10:57:47Z) - Towards Socially Intelligent Agents with Mental State Transition and
Human Utility [97.01430011496576]
We propose to incorporate a mental state and utility model into dialogue agents.
The hybrid mental state extracts information from both the dialogue and event observations.
The utility model is a ranking model that learns human preferences from a crowd-sourced social commonsense dataset.
arXiv Detail & Related papers (2021-03-12T00:06:51Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.