A Data-Driven Method for Recognizing Automated Negotiation Strategies

• URL: http://arxiv.org/abs/2107.01496v1
• Date: Sat, 3 Jul 2021 20:43:47 GMT
• Title: A Data-Driven Method for Recognizing Automated Negotiation Strategies
• Authors: Ming Li, Pradeep K.Murukannaiah, Catholijn M.Jonker
• Abstract summary: We propose a novel data-driven approach for recognizing an opponent's s negotiation strategy. Our approach includes a data generation method for an agent to generate domain-independent sequences. We perform extensive experiments, spanning four problem scenarios, to demonstrate the effectiveness of our approach.
• Score: 13.606307819976161
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Understanding an opponent agent helps in negotiating with it. Existing works on understanding opponents focus on preference modeling (or estimating the opponent's utility function). An important but largely unexplored direction is recognizing an opponent's negotiation strategy, which captures the opponent's tactics, e.g., to be tough at the beginning but to concede toward the deadline. Recognizing complex, state-of-the-art, negotiation strategies is extremely challenging, and simple heuristics may not be adequate for this purpose. We propose a novel data-driven approach for recognizing an opponent's s negotiation strategy. Our approach includes a data generation method for an agent to generate domain-independent sequences by negotiating with a variety of opponents across domains, a feature engineering method for representing negotiation data as time series with time-step features and overall features, and a hybrid (recurrent neural network-based) deep learning method for recognizing an opponent's strategy from the time series of bids. We perform extensive experiments, spanning four problem scenarios, to demonstrate the effectiveness of our approach.

Related papers

• A Fairness-Driven Method for Learning Human-Compatible Negotiation Strategies [19.595627721072812]
  We propose a negotiation framework that incorporates fairness into the reward design and search to learn human-compatible negotiation strategies. Our results show that our method is able to achieve more egalitarian negotiation outcomes and improve negotiation quality.
  arXiv  Detail & Related papers  (2024-09-26T23:16:47Z)
• Towards General Negotiation Strategies with End-to-End Reinforcement Learning [3.332967260145465]
  We develop an end-to-end reinforcement learning method for diverse negotiation problems. We show that our method is effective and that we can learn to negotiate with other agents on never-before-seen negotiation problems.
  arXiv  Detail & Related papers  (2024-06-21T12:24:36Z)
• AnySkill: Learning Open-Vocabulary Physical Skill for Interactive Agents [58.807802111818994]
  We propose AnySkill, a novel hierarchical method that learns physically plausible interactions following open-vocabulary instructions. Our approach begins by developing a set of atomic actions via a low-level controller trained via imitation learning. An important feature of our method is the use of image-based rewards for the high-level policy, which allows the agent to learn interactions with objects without manual reward engineering.
  arXiv  Detail & Related papers  (2024-03-19T15:41:39Z)
• Mutual-modality Adversarial Attack with Semantic Perturbation [81.66172089175346]
  We propose a novel approach that generates adversarial attacks in a mutual-modality optimization scheme. Our approach outperforms state-of-the-art attack methods and can be readily deployed as a plug-and-play solution.
  arXiv  Detail & Related papers  (2023-12-20T05:06:01Z)
• Look at What I'm Doing: Self-Supervised Spatial Grounding of Narrations in Instructional Videos [78.34818195786846]
  We introduce the task of spatially localizing narrated interactions in videos. Key to our approach is the ability to learn to spatially localize interactions with self-supervision on a large corpus of videos with accompanying transcribed narrations. We propose a multilayer cross-modal attention network that enables effective optimization of a contrastive loss during training.
  arXiv  Detail & Related papers  (2021-10-20T14:45:13Z)
• An Autonomous Negotiating Agent Framework with Reinforcement Learning Based Strategies and Adaptive Strategy Switching Mechanism [3.4376560669160394]
  This work focuses on solving the problem of expert selection and adapting to the opponent's behaviour with our Autonomous Negotiating Agent Framework. Our framework has a reviewer component which enables self-enhancement capability by deciding to include new strategies or replace old ones with better strategies periodically.
  arXiv  Detail & Related papers  (2021-02-06T14:38:03Z)
• Finding Effective Security Strategies through Reinforcement Learning and Self-Play [0.0]
  We show that effective security strategies can emerge from self-play. We address known challenges of reinforcement learning in this domain. Our method is superior to two baseline methods but that policy convergence in self-play remains a challenge.
  arXiv  Detail & Related papers  (2020-09-17T07:41:27Z)
• Learning to Play Sequential Games versus Unknown Opponents [93.8672371143881]
  We consider a repeated sequential game between a learner, who plays first, and an opponent who responds to the chosen action. We propose a novel algorithm for the learner when playing against an adversarial sequence of opponents. Our results include algorithm's regret guarantees that depend on the regularity of the opponent's response.
  arXiv  Detail & Related papers  (2020-07-10T09:33:05Z)
• Adversarial Augmentation Policy Search for Domain and Cross-Lingual Generalization in Reading Comprehension [96.62963688510035]
  Reading comprehension models often overfit to nuances of training datasets and fail at adversarial evaluation. We present several effective adversaries and automated data augmentation policy search methods with the goal of making reading comprehension models more robust to adversarial evaluation.
  arXiv  Detail & Related papers  (2020-04-13T17:20:08Z)
• Dynamic Knowledge Routing Network For Target-Guided Open-Domain Conversation [79.7781436501706]
  We propose a structured approach that controls the intended content of system responses by introducing coarse-grained keywords. We also propose a novel dual discourse-level target-guided strategy to guide conversations to reach their goals smoothly with higher success rate.
  arXiv  Detail & Related papers  (2020-02-04T09:49:36Z)
• A Deep Reinforcement Learning Approach to Concurrent Bilateral Negotiation [6.484413431061962]
  We present a novel negotiation model that allows an agent to learn how to negotiate during concurrent bilateral negotiations in unknown and dynamic e-markets. The agent uses an actor-critic architecture with model-free reinforcement learning to learn a strategy expressed as a deep neural network. As a result, we can build automated agents for concurrent negotiations that can adapt to different e-market settings without the need to be pre-programmed.
  arXiv  Detail & Related papers  (2020-01-31T12:05:46Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.