Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning
- URL: http://arxiv.org/abs/2512.11276v1
- Date: Fri, 12 Dec 2025 04:39:34 GMT
- Title: Words to Describe What I'm Feeling: Exploring the Potential of AI Agents for High Subjectivity Decisions in Advance Care Planning
- Abstract summary: The need for reliable support in Advance Care Planning (ACP) grows as populations age and caregiver networks shrink.<n>We built an experience prototype (acpagent) and asked 15 participants in 4 workshops to train it to be their personal proxy in ACP decisions.<n>Our findings argue for a potential new role of AI in ACP where agents act as personal advocates for individuals, building mutual intelligibility over time.
- Score: 7.273122595358839
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Serious illness can deprive patients of the capacity to speak for themselves. As populations age and caregiver networks shrink, the need for reliable support in Advance Care Planning (ACP) grows. To probe this fraught design space of using proxy agents for high-risk, high-subjectivity decisions, we built an experience prototype (\acpagent{}) and asked 15 participants in 4 workshops to train it to be their personal proxy in ACP decisions. We analysed their coping strategies and feature requests and mapped the results onto axes of agent autonomy and human control. Our findings argue for a potential new role of AI in ACP where agents act as personal advocates for individuals, building mutual intelligibility over time. We conclude with design recommendations to balance the risks and benefits of such an agent.
Related papers
- ComBodied Agents: a New Paradigm of Human-Centric Agentic AI [121.60938707072069]
We introduce Combodied Agents, a human-centered paradigm that perceives, models, predicts, and supports individual human-state trajectories over time.<n>We unify fragmented capabilities across personal assistants, health agents, AI companions, and adaptive human--AI systems into a closed loop.
arXiv Detail & Related papers (2026-08-11T13:35:58Z) - CoPlan: A Trustworthy Co-Intelligence Interface for Care Planning through Role-Based Contestable Argument Graphs [1.0558934832874713]
We present CoPlan - a Co-Intelligent and Contestable Interface for Human-AI Care Planning.<n>CoPlan combines co-intelligence, in which humans and AI agents contribute complementary expertise, with contestability, where recommendations remain open to inspection, revision, and justification.<n>The system supports adaptive care team recruitment, role-based argument review, final care plan generation, and practical follow-up through scheduling agents.
arXiv Detail & Related papers (2026-08-05T17:43:51Z) - AI Agents as Policymakers in Simulated Epidemics [0.0]
We develop a generative AI agent to study repetitive policy decisions during an epidemic.<n>We embed the agent, prompted to act as a city mayor, within a simulated SEIR environment.<n>The results illustrate how theory-informed prompting can shape emergent policy behavior in AI agents.
arXiv Detail & Related papers (2026-01-06T03:19:49Z) - A Framework for Studying AI Agent Behavior: Evidence from Consumer Choice Experiments [24.983925189624816]
We introduce a framework for probing agentic choice through controlled manipulations of option attributes and persuasive cues.<n>We find that agent decisions shift predictably and substantially in response, revealing that agents are strongly biased choosers.<n>This susceptibility reveals both risk and opportunity: risk, because agentic consumers may inherit and amplify human biases; opportunity, because consumer choice provides a powerful testbed for a behavioral science of AI agents.
arXiv Detail & Related papers (2025-09-30T00:05:23Z) - Can an Individual Manipulate the Collective Decisions of Multi-Agents? [53.01767232004823]
M-Spoiler is a framework that simulates agent interactions within a multi-agent system to generate adversarial samples.<n>M-Spoiler introduces a stubborn agent that actively aids in optimizing adversarial samples.<n>Our findings confirm the risks posed by the knowledge of an individual agent in multi-agent systems.
arXiv Detail & Related papers (2025-09-20T01:54:20Z) - Using AI to Optimize Patient Transfer and Resource Utilization During Mass-Casualty Incidents: A Simulation Platform [0.014285185279360277]
Mass incidents (MCIs) overwhelm healthcare systems and demand rapid patient-hospital allocation decisions.<n>We developed and validated a deep reinforcement learning-based decision-support AI agent to optimize patient transfer decisions.<n>MasTER is a web-accessible command dashboard for MCI management simulations.
arXiv Detail & Related papers (2025-09-10T16:46:54Z) - Redefining Elderly Care with Agentic AI: Challenges and Opportunities [1.6502857150914574]
We explore the potential for transformation in elderly care through Agentic Artificial Intelligence (AI)<n>We discuss the proactive and autonomous decision-making facilitated by Agentic AI in elderly care.<n>With a potential for significant transformation of elderly care, Agentic AI also raises profound concerns about data privacy and security, decision independence, and access.
arXiv Detail & Related papers (2025-07-20T10:53:01Z) - Agentic Enterprise: AI-Centric User to User-Centric AI [13.788858905752935]
We take a closer look at the potential of AI for Enterprises, where decision-making plays a crucial and repeated role across functions, tasks, and operations.<n>We highlight six tenets for Agentic success in enterprises, by drawing attention to what the current, AI-Centric User paradigm misses.<n>In underscoring a shift to User-Centric AI, we offer six tenets and promote market mechanisms for platforms.
arXiv Detail & Related papers (2025-06-28T14:05:59Z) - Robot-Gated Interactive Imitation Learning with Adaptive Intervention Mechanism [48.41735416075536]
Interactive Imitation Learning (IIL) allows agents to acquire desired behaviors through human interventions.<n>We propose the Adaptive Intervention Mechanism (AIM), a novel robot-gated IIL algorithm that learns an adaptive criterion for requesting human demonstrations.
arXiv Detail & Related papers (2025-06-10T18:43:26Z) - PreCare: Designing AI Assistants for Advance Care Planning (ACP) to Enhance Personal Value Exploration, Patient Knowledge, and Decisional Confidence [5.458688374520092]
PreCare is a website with 3 AI-driven assistants designed to guide users through exploring personal values, gaining ACP knowledge, and supporting informed decision-making.<n>A comparative evaluation showed that PreCare's AI assistants significantly improved exploration of personal values, knowledge, and decisional confidence, and was preferred by 92% of participants.
arXiv Detail & Related papers (2025-05-14T03:53:35Z) - AgentDAM: Privacy Leakage Evaluation for Autonomous Web Agents [66.29263282311258]
We introduce a new benchmark AgentDAM that measures if AI web-navigation agents follow the privacy principle of data minimization''<n>Our benchmark simulates realistic web interaction scenarios end-to-end and is adaptable to all existing web navigation agents.
arXiv Detail & Related papers (2025-03-12T19:30:31Z) - Human Decision-making is Susceptible to AI-driven Manipulation [87.24007555151452]
AI systems may exploit users' cognitive biases and emotional vulnerabilities to steer them toward harmful outcomes.<n>This study examined human susceptibility to such manipulation in financial and emotional decision-making contexts.
arXiv Detail & Related papers (2025-02-11T15:56:22Z) - Fully Autonomous AI Agents Should Not be Developed [50.61667544399082]
This paper argues that fully autonomous AI agents should not be developed.<n>In support of this position, we build from prior scientific literature and current product marketing to delineate different AI agent levels.<n>Our analysis reveals that risks to people increase with the autonomy of a system.
arXiv Detail & Related papers (2025-02-04T19:00:06Z) - Towards Next-Generation Medical Agent: How o1 is Reshaping Decision-Making in Medical Scenarios [46.729092855387165]
We study the choice of the backbone LLM for medical AI agents, which is the foundation for the agent's overall reasoning and action generation.<n>Our findings demonstrate o1's ability to enhance diagnostic accuracy and consistency, paving the way for smarter, more responsive AI tools.
arXiv Detail & Related papers (2024-11-16T18:19:53Z) - ProAgent: Building Proactive Cooperative Agents with Large Language
Models [89.53040828210945]
ProAgent is a novel framework that harnesses large language models to create proactive agents.
ProAgent can analyze the present state, and infer the intentions of teammates from observations.
ProAgent exhibits a high degree of modularity and interpretability, making it easily integrated into various coordination scenarios.
arXiv Detail & Related papers (2023-08-22T10:36:56Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.