INA: An Integrative Approach for Enhancing Negotiation Strategies with Reward-Based Dialogue System

• URL: http://arxiv.org/abs/2310.18207v1
• Date: Fri, 27 Oct 2023 15:31:16 GMT
• Title: INA: An Integrative Approach for Enhancing Negotiation Strategies with Reward-Based Dialogue System
• Authors: Zishan Ahmad, Suman Saurabh, Vaishakh Sreekanth Menon, Asif Ekbal, Roshni Ramnani, Anutosh Maitra
• Abstract summary: We propose a novel negotiation dialogue agent designed for the online marketplace. We employ a set of novel rewards, specifically tailored for the negotiation task to train our Negotiation Agent. Our results demonstrate that the proposed approach and reward system significantly enhance the agent's negotiation capabilities.
• Score: 22.392304683798866
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: In this paper, we propose a novel negotiation dialogue agent designed for the online marketplace. Our agent is integrative in nature i.e, it possesses the capability to negotiate on price as well as other factors, such as the addition or removal of items from a deal bundle, thereby offering a more flexible and comprehensive negotiation experience. We create a new dataset called Integrative Negotiation Dataset (IND) to enable this functionality. For this dataset creation, we introduce a new semi-automated data creation method, which combines defining negotiation intents, actions, and intent-action simulation between users and the agent to generate potential dialogue flows. Finally, the prompting of GPT-J, a state-of-the-art language model, is done to generate dialogues for a given intent, with a human-in-the-loop process for post-editing and refining minor errors to ensure high data quality. We employ a set of novel rewards, specifically tailored for the negotiation task to train our Negotiation Agent, termed as the Integrative Negotiation Agent (INA). These rewards incentivize the chatbot to learn effective negotiation strategies that can adapt to various contextual requirements and price proposals. By leveraging the IND, we train our model and conduct experiments to evaluate the effectiveness of our reward-based dialogue system for negotiation. Our results demonstrate that the proposed approach and reward system significantly enhance the agent's negotiation capabilities. The INA successfully engages in integrative negotiations, displaying the ability to dynamically adjust prices and negotiate the inclusion or exclusion of items in a bundle deal

Related papers

• Modelling Political Coalition Negotiations Using LLM-based Agents [53.934372246390495]
  We introduce coalition negotiations as a novel NLP task, and model it as a negotiation between large language model-based agents. We introduce a multilingual dataset, POLCA, comprising manifestos of European political parties and coalition agreements over a number of elections in these countries. We propose a hierarchical Markov decision process designed to simulate the process of coalition negotiation between political parties and predict the outcomes.
  arXiv  Detail & Related papers  (2024-02-18T21:28:06Z)
• How Well Can LLMs Negotiate? NegotiationArena Platform and Analysis [50.15061156253347]
  Negotiation is the basis of social interactions; humans negotiate everything from the price of cars to how to share common resources. With rapidly growing interest in using large language models (LLMs) to act as agents on behalf of human users, such LLM agents would also need to be able to negotiate. We develop NegotiationArena: a flexible framework for evaluating and probing the negotiation abilities of LLM agents.
  arXiv  Detail & Related papers  (2024-02-08T17:51:48Z)
• Let's Negotiate! A Survey of Negotiation Dialogue Systems [56.01648785030208]
  Negotiation is a crucial ability in human communication. Recent interest in negotiation dialogue systems aims to create intelligent agents that can assist people in resolving conflicts or reaching agreements.
  arXiv  Detail & Related papers  (2024-02-02T02:12:46Z)
• Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues [47.977032883078664]
  We develop assistive agents based on Large Language Models (LLMs) We simulate business negotiations by letting two LLM-based agents engage in role play. A third LLM acts as a remediator agent to rewrite utterances violating norms for improving negotiation outcomes.
  arXiv  Detail & Related papers  (2024-01-29T09:07:40Z)
• Be Selfish, But Wisely: Investigating the Impact of Agent Personality in Mixed-Motive Human-Agent Interactions [24.266490660606497]
  We find that self-play RL fails to learn the value of compromise in a negotiation. We modify the training procedure in two novel ways to design agents with diverse personalities and analyze their performance with human partners. We find that although both techniques show promise, a selfish agent, which maximizes its own performance while also avoiding walkaways, performs superior to other variants by implicitly learning to generate value for both itself and the negotiation partner.
  arXiv  Detail & Related papers  (2023-10-22T20:31:35Z)
• Language of Bargaining [60.218128617765046]
  We build a novel dataset for studying how the use of language shapes bilateral bargaining. Our work also reveals linguistic signals that are predictive of negotiation outcomes.
  arXiv  Detail & Related papers  (2023-06-12T13:52:01Z)
• Let's Negotiate! A Survey of Negotiation Dialogue Systems [50.8766991794008]
  Negotiation is one of the crucial abilities in human communication. Goal is to empower intelligent agents with such ability to efficiently help humans resolve conflicts or reach beneficial agreements.
  arXiv  Detail & Related papers  (2022-12-18T12:03:53Z)
• CaSiNo: A Corpus of Campsite Negotiation Dialogues for Automatic Negotiation Systems [11.43342650898619]
  We present CaSiNo: a novel corpus of over a thousand negotiation dialogues in English. Our design results in diverse and linguistically rich negotiations while maintaining a tractable, closed-domain environment. We propose and evaluate a multi-task framework to recognize these strategies in a given utterance.
  arXiv  Detail & Related papers  (2021-03-29T16:07:25Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.