Meta Policy Learning for Cold-Start Conversational Recommendation

• URL: http://arxiv.org/abs/2205.11788v1
• Date: Tue, 24 May 2022 05:06:52 GMT
• Title: Meta Policy Learning for Cold-Start Conversational Recommendation
• Authors: Zhendong Chu, Hongning Wang, Yun Xiao, Bo Long, Lingfei Wu
• Abstract summary: We study CRS policy learning for cold-start users via meta reinforcement learning. To facilitate policy adaptation, we design three synergetic components.
• Score: 71.13044166814186
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conversational recommender systems (CRS) explicitly solicit users' preferences for improved recommendations on the fly. Most existing CRS solutions employ reinforcement learning methods to train a single policy for a population of users. However, for users new to the system, such a global policy becomes ineffective to produce conversational recommendations, i.e., the cold-start challenge. In this paper, we study CRS policy learning for cold-start users via meta reinforcement learning. We propose to learn a meta policy and adapt it to new users with only a few trials of conversational recommendations. To facilitate policy adaptation, we design three synergetic components. First is a meta-exploration policy dedicated to identify user preferences via exploratory conversations. Second is a Transformer-based state encoder to model a user's both positive and negative feedback during the conversation. And third is an adaptive item recommender based on the embedded states. Extensive experiments on three datasets demonstrate the advantage of our solution in serving new users, compared with a rich set of state-of-the-art CRS solutions.

Related papers

• Towards Empathetic Conversational Recommender Systems [77.53167131692]
  We propose an empathetic conversational recommender (ECR) framework. ECR contains two main modules: emotion-aware item recommendation and emotion-aligned response generation. Our experiments on the ReDial dataset validate the efficacy of our framework in enhancing recommendation accuracy and improving user satisfaction.
  arXiv  Detail & Related papers  (2024-08-30T15:43:07Z)
• Customized Conversational Recommender Systems [45.84713970070487]
  Conversational recommender systems (CRS) aim to capture user's current intentions and provide recommendations through real-time multi-turn conversational interactions. We propose a novel CRS model, coined Customized Conversational Recommender System ( CCRS), which customizes CRS model for users from three perspectives. To provide personalized recommendations, we extract user's current fine-grained intentions from dialogue context with the guidance of user's inherent preferences.
  arXiv  Detail & Related papers  (2022-06-30T09:45:36Z)
• Comprehensive Fair Meta-learned Recommender System [39.04926584648665]
  We propose a comprehensive fair meta-learning framework, named CLOVER, for ensuring the fairness of meta-learned recommendation models. Our framework offers a generic training paradigm that is applicable to different meta-learned recommender systems.
  arXiv  Detail & Related papers  (2022-06-09T22:48:35Z)
• Learning to Learn a Cold-start Sequential Recommender [70.5692886883067]
  The cold-start recommendation is an urgent problem in contemporary online applications. We propose a meta-learning based cold-start sequential recommendation framework called metaCSR. metaCSR holds the ability to learn the common patterns from regular users' behaviors.
  arXiv  Detail & Related papers  (2021-10-18T08:11:24Z)
• Learning to Ask Appropriate Questions in Conversational Recommendation [49.31942688227828]
  We propose the Knowledge-Based Question Generation System (KBQG), a novel framework for conversational recommendation. KBQG models a user's preference in a finer granularity by identifying the most relevant relations from a structured knowledge graph. Finially, accurate recommendations can be generated in fewer conversational turns.
  arXiv  Detail & Related papers  (2021-05-11T03:58:10Z)
• Advances and Challenges in Conversational Recommender Systems: A Survey [133.93908165922804]
  We provide a systematic review of the techniques used in current conversational recommender systems (CRSs) We summarize the key challenges of developing CRSs into five directions. These research directions involve multiple research fields like information retrieval (IR), natural language processing (NLP), and human-computer interaction (HCI)
  arXiv  Detail & Related papers  (2021-01-23T08:53:15Z)
• Offline Meta-level Model-based Reinforcement Learning Approach for Cold-Start Recommendation [27.17948754183511]
  Reinforcement learning has shown great promise in optimizing long-term user interest in recommender systems. Existing RL-based recommendation methods need a large number of interactions for each user to learn a robust recommendation policy. We propose a meta-level model-based reinforcement learning approach for fast user adaptation.
  arXiv  Detail & Related papers  (2020-12-04T08:58:35Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.