ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions

• URL: http://arxiv.org/abs/2310.01331v3
• Date: Wed, 22 Jan 2025 06:13:41 GMT
• Title: ChoiceMates: Supporting Unfamiliar Online Decision-Making with Multi-Agent Conversational Interactions
• Authors: Jeongeon Park, Bryan Min, Kihoon Son, Jean Y. Song, Xiaojuan Ma, Juho Kim,
• Abstract summary: We present ChoiceMates, an interactive multi-agent system designed to address these needs.<n>Unlike existing multi-agent systems that automate tasks with agents, the user orchestrates agents to assist their decision-making process.
• Score: 53.07022684941739
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: From deciding on a PhD program to buying a new camera, unfamiliar decisions--decisions without domain knowledge--are frequent and significant. The complexity and uncertainty of such decisions demand unique approaches to information seeking, understanding, and decision-making. Our formative study highlights that users want to start by discovering broad and relevant domain information evenly and simultaneously, quickly address emerging inquiries, and gain personalized standards to assess information found. We present ChoiceMates, an interactive multi-agent system designed to address these needs by enabling users to engage with a dynamic set of LLM agents each presenting a unique experience in the domain. Unlike existing multi-agent systems that automate tasks with agents, the user orchestrates agents to assist their decision-making process. Our user evaluation (n=12) shows that ChoiceMates enables a more confident, satisfactory decision-making with better situation understanding than web search, and higher decision quality and confidence than a commercial multi-agent framework. This work provides insights into designing a more controllable and collaborative multi-agent system.

Related papers

• A Desideratum for Conversational Agents: Capabilities, Challenges, and Future Directions [51.96890647837277]
  Large Language Models (LLMs) have propelled conversational AI from traditional dialogue systems into sophisticated agents capable of autonomous actions, contextual awareness, and multi-turn interactions with users. This survey paper presents a desideratum for next-generation Conversational Agents - what has been achieved, what challenges persist, and what must be done for more scalable systems that approach human-level intelligence.
  arXiv  Detail & Related papers  (2025-04-07T21:01:25Z)
• Towards Agentic Recommender Systems in the Era of Multimodal Large Language Models [75.4890331763196]
  Recent breakthroughs in Large Language Models (LLMs) have led to the emergence of agentic AI systems. LLM-based Agentic RS (LLM-ARS) can offer more interactive, context-aware, and proactive recommendations.
  arXiv  Detail & Related papers  (2025-03-20T22:37:15Z)
• RoundTable: Investigating Group Decision-Making Mechanism in Multi-Agent Collaboration [15.2119694237099]
  This study investigates the efficacy of Multi-Agent Systems in eliciting cross-agent communication and enhancing collective intelligence. By applying different voting rules in various environments, we find that moderate decision flexibility yields better outcomes.
  arXiv  Detail & Related papers  (2024-11-11T17:37:47Z)
• Agent-Oriented Planning in Multi-Agent Systems [54.429028104022066]
  We propose AOP, a novel framework for agent-oriented planning in multi-agent systems. In this study, we identify three critical design principles of agent-oriented planning, including solvability, completeness, and non-redundancy. Extensive experiments demonstrate the advancement of AOP in solving real-world problems compared to both single-agent systems and existing planning strategies for multi-agent systems.
  arXiv  Detail & Related papers  (2024-10-03T04:07:51Z)
• A Learnable Agent Collaboration Network Framework for Personalized Multimodal AI Search Engine [14.123823081267336]
  This paper proposes a novel AI Search Engine framework called the Agent Collaboration Network (ACN) The ACN framework consists of multiple specialized agents working collaboratively, each with distinct roles such as Account Manager, Solution Strategist, Information Manager, and Content Creator. A highlight of the ACN is the introduction of a Reflective Forward Optimization method (RFO), which supports the online synergistic adjustment among agents.
  arXiv  Detail & Related papers  (2024-09-01T07:01:22Z)
• ADESSE: Advice Explanations in Complex Repeated Decision-Making Environments [14.105935964906976]
  This work considers a problem setup where an intelligent agent provides advice to a human decision-maker. We develop an approach named ADESSE to generate explanations about the adviser agent to improve human trust and decision-making.
  arXiv  Detail & Related papers  (2024-05-31T08:59:20Z)
• Information That Matters: Exploring Information Needs of People Affected by Algorithmic Decisions [11.421963387588864]
  "XAI Novice Question Bank" is an extension of the XAI Question Bank containing a catalog of information needs from AI novices. "XAI Novice Question Bank" contains a catalog of information needs from AI novices in two use cases: employment prediction and health monitoring. Our work aims to support the inclusion of AI novices in explainability efforts by highlighting their information needs, aims, and challenges.
  arXiv  Detail & Related papers  (2024-01-24T09:39:39Z)
• Online Decision Mediation [72.80902932543474]
  Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior. In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
  arXiv  Detail & Related papers  (2023-10-28T05:59:43Z)
• AVIS: Autonomous Visual Information Seeking with Large Language Model Agent [123.75169211547149]
  We propose an autonomous information seeking visual question answering framework, AVIS. Our method leverages a Large Language Model (LLM) to dynamically strategize the utilization of external tools. AVIS achieves state-of-the-art results on knowledge-intensive visual question answering benchmarks such as Infoseek and OK-VQA.
  arXiv  Detail & Related papers  (2023-06-13T20:50:22Z)
• Decision-Oriented Dialogue for Human-AI Collaboration [62.367222979251444]
  We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions. We formalize three domains in which users face everyday decisions: (1) choosing an assignment of reviewers to conference papers, (2) planning a multi-step itinerary in a city, and (3) negotiating travel plans for a group of friends. For each task, we build a dialogue environment where agents receive a reward based on the quality of the final decision they reach.
  arXiv  Detail & Related papers  (2023-05-31T17:50:02Z)
• Toward Policy Explanations for Multi-Agent Reinforcement Learning [18.33682005623418]
  We present novel methods to generate two types of policy explanations for MARL. Experimental results on three MARL domains demonstrate the scalability of our methods. A user study shows that the generated explanations significantly improve user performance and increase subjective ratings on metrics such as user satisfaction.
  arXiv  Detail & Related papers  (2022-04-26T20:07:08Z)
• Inverse Online Learning: Understanding Non-Stationary and Reactionary Policies [79.60322329952453]
  We show how to develop interpretable representations of how agents make decisions. By understanding the decision-making processes underlying a set of observed trajectories, we cast the policy inference problem as the inverse to this online learning problem. We introduce a practical algorithm for retrospectively estimating such perceived effects, alongside the process through which agents update them. Through application to the analysis of UNOS organ donation acceptance decisions, we demonstrate that our approach can bring valuable insights into the factors that govern decision processes and how they change over time.
  arXiv  Detail & Related papers  (2022-03-14T17:40:42Z)
• Difference-aware Knowledge Selection for Knowledge-grounded Conversation Generation [101.48602006200409]
  We propose a difference-aware knowledge selection method for multi-turn knowledge-grounded dialogs. It first computes the difference between the candidate knowledge sentences provided at the current turn and those chosen in the previous turns. Then, the differential information is fused with or disentangled from the contextual information to facilitate final knowledge selection.
  arXiv  Detail & Related papers  (2020-09-20T07:47:26Z)
• Tradeoff-Focused Contrastive Explanation for MDP Planning [7.929642367937801]
  In real-world applications of planning, planning agents' decisions can involve complex tradeoffs among competing objectives. It can be difficult for the end-users to understand why an agent decides on a particular planning solution on the basis of its objective values. We propose an approach, based on contrastive explanation, that enables a multi-objective MDP planning agent to explain its decisions in a way that communicates its tradeoff rationale.
  arXiv  Detail & Related papers  (2020-04-27T17:17:58Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.