ChoiceMates: Supporting Unfamiliar Online Decision-Making with
Multi-Agent Conversational Interactions
- URL: http://arxiv.org/abs/2310.01331v2
- Date: Tue, 14 Nov 2023 06:02:15 GMT
- Title: ChoiceMates: Supporting Unfamiliar Online Decision-Making with
Multi-Agent Conversational Interactions
- Authors: Jeongeon Park, Bryan Min, Xiaojuan Ma, Juho Kim
- Abstract summary: We present ChoiceMates, a system that enables conversations with a dynamic set of LLM-powered agents.
Agents, as opinionated personas, flexibly join the conversation, not only providing responses but also conversing among themselves to elicit each agent's preferences.
Our study (n=36) comparing ChoiceMates to conventional web search and single-agent showed that ChoiceMates was more helpful in discovering, diving deeper, and managing information compared to Web with higher confidence.
- Score: 58.71970923420007
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Unfamiliar decisions -- decisions where people lack adequate domain knowledge
or expertise -- specifically increase the complexity and uncertainty of the
process of searching for, understanding, and making decisions with online
information. Through our formative study (n=14), we observed users' challenges
in accessing diverse perspectives, identifying relevant information, and
deciding the right moment to make the final decision. We present ChoiceMates, a
system that enables conversations with a dynamic set of LLM-powered agents for
a holistic domain understanding and efficient discovery and management of
information to make decisions. Agents, as opinionated personas, flexibly join
the conversation, not only providing responses but also conversing among
themselves to elicit each agent's preferences. Our between-subjects study
(n=36) comparing ChoiceMates to conventional web search and single-agent showed
that ChoiceMates was more helpful in discovering, diving deeper, and managing
information compared to Web with higher confidence. We also describe how
participants utilized multi-agent conversations in their decision-making
process.
Related papers
- ADESSE: Advice Explanations in Complex Repeated Decision-Making Environments [14.105935964906976]
This work considers a problem setup where an intelligent agent provides advice to a human decision-maker.
We develop an approach named ADESSE to generate explanations about the adviser agent to improve human trust and decision-making.
arXiv Detail & Related papers (2024-05-31T08:59:20Z) - Online Decision Mediation [72.80902932543474]
Consider learning a decision support assistant to serve as an intermediary between (oracle) expert behavior and (imperfect) human behavior.
In clinical diagnosis, fully-autonomous machine behavior is often beyond ethical affordances.
arXiv Detail & Related papers (2023-10-28T05:59:43Z) - AVIS: Autonomous Visual Information Seeking with Large Language Model
Agent [123.75169211547149]
We propose an autonomous information seeking visual question answering framework, AVIS.
Our method leverages a Large Language Model (LLM) to dynamically strategize the utilization of external tools.
AVIS achieves state-of-the-art results on knowledge-intensive visual question answering benchmarks such as Infoseek and OK-VQA.
arXiv Detail & Related papers (2023-06-13T20:50:22Z) - Decision-Oriented Dialogue for Human-AI Collaboration [62.367222979251444]
We describe a class of tasks called decision-oriented dialogues, in which AI assistants such as large language models (LMs) must collaborate with one or more humans via natural language to help them make complex decisions.
We formalize three domains in which users face everyday decisions: (1) choosing an assignment of reviewers to conference papers, (2) planning a multi-step itinerary in a city, and (3) negotiating travel plans for a group of friends.
For each task, we build a dialogue environment where agents receive a reward based on the quality of the final decision they reach.
arXiv Detail & Related papers (2023-05-31T17:50:02Z) - "There Is Not Enough Information": On the Effects of Explanations on
Perceptions of Informational Fairness and Trustworthiness in Automated
Decision-Making [0.0]
Automated decision systems (ADS) are increasingly used for consequential decision-making.
We conduct a human subject study to assess people's perceptions of informational fairness.
A comprehensive analysis of qualitative feedback sheds light on people's desiderata for explanations.
arXiv Detail & Related papers (2022-05-11T20:06:03Z) - Inverse Online Learning: Understanding Non-Stationary and Reactionary
Policies [79.60322329952453]
We show how to develop interpretable representations of how agents make decisions.
By understanding the decision-making processes underlying a set of observed trajectories, we cast the policy inference problem as the inverse to this online learning problem.
We introduce a practical algorithm for retrospectively estimating such perceived effects, alongside the process through which agents update them.
Through application to the analysis of UNOS organ donation acceptance decisions, we demonstrate that our approach can bring valuable insights into the factors that govern decision processes and how they change over time.
arXiv Detail & Related papers (2022-03-14T17:40:42Z) - Difference-aware Knowledge Selection for Knowledge-grounded Conversation
Generation [101.48602006200409]
We propose a difference-aware knowledge selection method for multi-turn knowledge-grounded dialogs.
It first computes the difference between the candidate knowledge sentences provided at the current turn and those chosen in the previous turns.
Then, the differential information is fused with or disentangled from the contextual information to facilitate final knowledge selection.
arXiv Detail & Related papers (2020-09-20T07:47:26Z) - Tradeoff-Focused Contrastive Explanation for MDP Planning [7.929642367937801]
In real-world applications of planning, planning agents' decisions can involve complex tradeoffs among competing objectives.
It can be difficult for the end-users to understand why an agent decides on a particular planning solution on the basis of its objective values.
We propose an approach, based on contrastive explanation, that enables a multi-objective MDP planning agent to explain its decisions in a way that communicates its tradeoff rationale.
arXiv Detail & Related papers (2020-04-27T17:17:58Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.