Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactions

• URL: http://arxiv.org/abs/2310.14404v1
• Date: Sun, 22 Oct 2023 20:31:35 GMT
• Title: Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactions
• Authors: Kushal Chawla, Ian Wu, Yu Rong, Gale M. Lucas, Jonathan Gratch
• Abstract summary: We find that self-play RL fails to learn the value of compromise in a negotiation. We modify the training procedure in two novel ways to design agents with diverse personalities and analyze their performance with human partners. We find that although both techniques show promise, a selfish agent, which maximizes its own performance while also avoiding walkaways, performs superior to other variants by implicitly learning to generate value for both itself and the negotiation partner.
• Score: 24.266490660606497
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: A natural way to design a negotiation dialogue system is via self-play RL: train an agent that learns to maximize its performance by interacting with a simulated user that has been designed to imitate human-human dialogue data. Although this procedure has been adopted in prior work, we find that it results in a fundamentally flawed system that fails to learn the value of compromise in a negotiation, which can often lead to no agreements (i.e., the partner walking away without a deal), ultimately hurting the model's overall performance. We investigate this observation in the context of the DealOrNoDeal task, a multi-issue negotiation over books, hats, and balls. Grounded in negotiation theory from Economics, we modify the training procedure in two novel ways to design agents with diverse personalities and analyze their performance with human partners. We find that although both techniques show promise, a selfish agent, which maximizes its own performance while also avoiding walkaways, performs superior to other variants by implicitly learning to generate value for both itself and the negotiation partner. We discuss the implications of our findings for what it means to be a successful negotiation dialogue system and how these systems should be designed in the future.

Related papers

• Let's Negotiate! A Survey of Negotiation Dialogue Systems [56.01648785030208]
  Negotiation is a crucial ability in human communication. Recent interest in negotiation dialogue systems aims to create intelligent agents that can assist people in resolving conflicts or reaching agreements.
  arXiv  Detail & Related papers  (2024-02-02T02:12:46Z)
• INA: An Integrative Approach for Enhancing Negotiation Strategies with Reward-Based Dialogue System [22.392304683798866]
  We propose a novel negotiation dialogue agent designed for the online marketplace. We employ a set of novel rewards, specifically tailored for the negotiation task to train our Negotiation Agent. Our results demonstrate that the proposed approach and reward system significantly enhance the agent's negotiation capabilities.
  arXiv  Detail & Related papers  (2023-10-27T15:31:16Z)
• MindDial: Belief Dynamics Tracking with Theory-of-Mind Modeling for Situated Neural Dialogue Generation [62.44907105496227]
  MindDial is a novel conversational framework that can generate situated free-form responses with theory-of-mind modeling. We introduce an explicit mind module that can track the speaker's belief and the speaker's prediction of the listener's belief. Our framework is applied to both prompting and fine-tuning-based models, and is evaluated across scenarios involving both common ground alignment and negotiation.
  arXiv  Detail & Related papers  (2023-06-27T07:24:32Z)
• Language of Bargaining [60.218128617765046]
  We build a novel dataset for studying how the use of language shapes bilateral bargaining. Our work also reveals linguistic signals that are predictive of negotiation outcomes.
  arXiv  Detail & Related papers  (2023-06-12T13:52:01Z)
• Let's Negotiate! A Survey of Negotiation Dialogue Systems [50.8766991794008]
  Negotiation is one of the crucial abilities in human communication. Goal is to empower intelligent agents with such ability to efficiently help humans resolve conflicts or reach beneficial agreements.
  arXiv  Detail & Related papers  (2022-12-18T12:03:53Z)
• Interacting with Non-Cooperative User: A New Paradigm for Proactive Dialogue Policy [83.61404191470126]
  We propose a new solution named I-Pro that can learn Proactive policy in the Interactive setting. Specifically, we learn the trade-off via a learned goal weight, which consists of four factors. The experimental results demonstrate I-Pro significantly outperforms baselines in terms of effectiveness and interpretability.
  arXiv  Detail & Related papers  (2022-04-07T14:11:31Z)
• Towards Emotion-Aware Agents For Negotiation Dialogues [2.1454205511807234]
  Negotiation is a complex social interaction that encapsulates emotional encounters in human decision-making. Virtual agents that can negotiate with humans are useful in pedagogy and conversational AI. We analyze the extent to which emotion attributes extracted from the negotiation help in the prediction.
  arXiv  Detail & Related papers  (2021-07-28T04:42:36Z)
• CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems [11.43342650898619]
  We present CaSiNo: a novel corpus of over a thousand negotiation dialogues in English. Our design results in diverse and linguistically rich negotiations while maintaining a tractable, closed-domain environment. We propose and evaluate a multi-task framework to recognize these strategies in a given utterance.
  arXiv  Detail & Related papers  (2021-03-29T16:07:25Z)
• Improving Dialog Systems for Negotiation with Personality Modeling [30.78850714931678]
  We introduce a probabilistic formulation to encapsulate the opponent's personality type during both learning and inference. We test our approach on the CraigslistBargain dataset and show that our method using ToM inference achieves a 20% higher dialog agreement rate.
  arXiv  Detail & Related papers  (2020-10-20T01:46:03Z)
• You Impress Me: Dialogue Generation via Mutual Persona Perception [62.89449096369027]
  The research in cognitive science suggests that understanding is an essential signal for a high-quality chit-chat conversation. Motivated by this, we propose P2 Bot, a transmitter-receiver based framework with the aim of explicitly modeling understanding.
  arXiv  Detail & Related papers  (2020-04-11T12:51:07Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.