An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism

• URL: http://arxiv.org/abs/2102.03588v2
• Date: Tue, 9 Feb 2021 11:34:40 GMT
• Title: An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism
• Authors: Ayan Sengupta, Yasser Mohammad, Shinji Nakadai
• Abstract summary: This work focuses on solving the problem of expert selection and adapting to the opponent's behaviour with our Autonomous Negotiating Agent Framework. Our framework has a reviewer component which enables self-enhancement capability by deciding to include new strategies or replace old ones with better strategies periodically.
• Score: 3.4376560669160394
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Despite abundant negotiation strategies in literature, the complexity of automated negotiation forbids a single strategy from being dominant against all others in different negotiation scenarios. To overcome this, one approach is to use mixture of experts, but at the same time, one problem of this method is the selection of experts, as this approach is limited by the competency of the experts selected. Another problem with most negotiation strategies is their incapability of adapting to dynamic variation of the opponent's behaviour within a single negotiation session resulting in poor performance. This work focuses on both, solving the problem of expert selection and adapting to the opponent's behaviour with our Autonomous Negotiating Agent Framework. This framework allows real-time classification of opponent's behaviour and provides a mechanism to select, switch or combine strategies within a single negotiation session. Additionally, our framework has a reviewer component which enables self-enhancement capability by deciding to include new strategies or replace old ones with better strategies periodically. We demonstrate an instance of our framework by implementing maximum entropy reinforcement learning based strategies with a deep learning based opponent classifier. Finally, we evaluate the performance of our agent against state-of-the-art negotiators under varied negotiation scenarios.

Related papers

• A Fairness-Driven Method for Learning Human-Compatible Negotiation Strategies [19.595627721072812]
  We propose a negotiation framework that incorporates fairness into the reward design and search to learn human-compatible negotiation strategies. Our results show that our method is able to achieve more egalitarian negotiation outcomes and improve negotiation quality.
  arXiv  Detail & Related papers  (2024-09-26T23:16:47Z)
• Towards General Negotiation Strategies with End-to-End Reinforcement Learning [3.332967260145465]
  We develop an end-to-end reinforcement learning method for diverse negotiation problems. We show that our method is effective and that we can learn to negotiate with other agents on never-before-seen negotiation problems.
  arXiv  Detail & Related papers  (2024-06-21T12:24:36Z)
• Strength Lies in Differences! Improving Strategy Planning for Non-collaborative Dialogues via Diversified User Simulation [69.5677514160986]
  We investigate non-collaborative dialogue agents, which are expected to engage in strategic conversations with diverse users. This poses two main challenges for existing dialogue agents. We propose Trip to enhance the capability in tailored strategic planning, incorporating a user-aware strategic planning module and a population-based training paradigm.
  arXiv  Detail & Related papers  (2024-03-11T14:38:16Z)
• All by Myself: Learning Individualized Competitive Behaviour with a Contrastive Reinforcement Learning optimization [57.615269148301515]
  In a competitive game scenario, a set of agents have to learn decisions that maximize their goals and minimize their adversaries' goals at the same time. We propose a novel model composed of three neural layers that learn a representation of a competitive game, learn how to map the strategy of specific opponents, and how to disrupt them. Our experiments demonstrate that our model achieves better performance when playing against offline, online, and competitive-specific models, in particular when playing against the same opponent multiple times.
  arXiv  Detail & Related papers  (2023-10-02T08:11:07Z)
• Rehearsal: Simulating Conflict to Teach Conflict Resolution [54.32934135393982]
  Rehearsal is a system that allows users to rehearse conflicts with a believable simulated interlocutor. Users can utilize Rehearsal to practice handling a variety of predefined conflict scenarios. Rehearsal uses IRP to generate utterances grounded in conflict resolution theory.
  arXiv  Detail & Related papers  (2023-09-21T17:59:20Z)
• Conditional Imitation Learning for Multi-Agent Games [89.897635970366]
  We study the problem of conditional multi-agent imitation learning, where we have access to joint trajectory demonstrations at training time. We propose a novel approach to address the difficulties of scalability and data scarcity. Our model learns a low-rank subspace over ego and partner agent strategies, then infers and adapts to a new partner strategy by interpolating in the subspace.
  arXiv  Detail & Related papers  (2022-01-05T04:40:13Z)
• A Data-Driven Method for Recognizing Automated Negotiation Strategies [13.606307819976161]
  We propose a novel data-driven approach for recognizing an opponent's s negotiation strategy. Our approach includes a data generation method for an agent to generate domain-independent sequences. We perform extensive experiments, spanning four problem scenarios, to demonstrate the effectiveness of our approach.
  arXiv  Detail & Related papers  (2021-07-03T20:43:47Z)
• Moody Learners -- Explaining Competitive Behaviour of Reinforcement Learning Agents [65.2200847818153]
  In a competitive scenario, the agent does not only have a dynamic environment but also is directly affected by the opponents' actions. Observing the Q-values of the agent is usually a way of explaining its behavior, however, do not show the temporal-relation between the selected actions.
  arXiv  Detail & Related papers  (2020-07-30T11:30:42Z)
• Learning Goal-oriented Dialogue Policy with Opposite Agent Awareness [116.804536884437]
  We propose an opposite behavior aware framework for policy learning in goal-oriented dialogues. We estimate the opposite agent's policy from its behavior and use this estimation to improve the target agent by regarding it as part of the target policy.
  arXiv  Detail & Related papers  (2020-04-21T03:13:44Z)
• Automated Configuration of Negotiation Strategies [0.0]
  Bidding and acceptance strategies have a substantial impact on the outcome of negotiations in scenarios with linear additive and nonlinear utility functions. We develop a method leveraging automated algorithm configuration to find the best strategies for a specific set of negotiation settings. We show that our automatically configured agent outperforms all other agents, with a 5.1% increase in negotiation payoff compared to the next-best agent.
  arXiv  Detail & Related papers  (2020-03-31T20:31:33Z)
• A Deep Reinforcement Learning Approach to Concurrent Bilateral Negotiation [6.484413431061962]
  We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free reinforcement learning to learn a strategy expressed as a deep neural network. As a result, we can build automated agents for concurrent negotiations that can adapt to different e-market settings without the need to be pre-programmed.
  arXiv  Detail & Related papers  (2020-01-31T12:05:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.