Two-stage Voice Application Recommender System for Unhandled Utterances in Intelligent Personal Assistant

• URL: http://arxiv.org/abs/2110.09877v1
• Date: Tue, 19 Oct 2021 11:52:56 GMT
• Title: Two-stage Voice Application Recommender System for Unhandled Utterances in Intelligent Personal Assistant
• Authors: Wei Xiao, Qian Hu, Thahir Mohamed, Zheng Gao, Xibin Gao, Radhika Arava, Mohamed AbdelHady
• Abstract summary: We propose a two-stage shortlister-reranker recommender system to match third-party voice applications to unhandled utterances. We show how to build a new system by using observed data collected from a baseline rule-based system. We present online A/B testing results that show a significant boost on user experience satisfaction.
• Score: 5.475452673163167
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Intelligent personal assistants (IPA) enable voice applications that facilitate people's daily tasks. However, due to the complexity and ambiguity of voice requests, some requests may not be handled properly by the standard natural language understanding (NLU) component. In such cases, a simple reply like "Sorry, I don't know" hurts the user's experience and limits the functionality of IPA. In this paper, we propose a two-stage shortlister-reranker recommender system to match third-party voice applications (skills) to unhandled utterances. In this approach, a skill shortlister is proposed to retrieve candidate skills from the skill catalog by calculating both lexical and semantic similarity between skills and user requests. We also illustrate how to build a new system by using observed data collected from a baseline rule-based system, and how the exposure biases can generate discrepancy between offline and human metrics. Lastly, we present two relabeling methods that can handle the incomplete ground truth, and mitigate exposure bias. We demonstrate the effectiveness of our proposed system through extensive offline experiments. Furthermore, we present online A/B testing results that show a significant boost on user experience satisfaction.

Related papers

• Towards Empathetic Conversational Recommender Systems [77.53167131692]
  We propose an empathetic conversational recommender (ECR) framework. ECR contains two main modules: emotion-aware item recommendation and emotion-aligned response generation. Our experiments on the ReDial dataset validate the efficacy of our framework in enhancing recommendation accuracy and improving user satisfaction.
  arXiv  Detail & Related papers  (2024-08-30T15:43:07Z)
• System-2 Recommenders: Disentangling Utility and Engagement in Recommendation Systems via Temporal Point-Processes [80.97898201876592]
  We propose a generative model in which past content interactions impact the arrival rates of users based on a self-exciting Hawkes process. We show analytically that given samples it is possible to disentangle System-1 and System-2 and allow content optimization based on user utility.
  arXiv  Detail & Related papers  (2024-05-29T18:19:37Z)
• A Transformer-Based User Satisfaction Prediction for Proactive Interaction Mechanism in DuerOS [12.060990859604681]
  We propose a proactive interaction mechanism where the system predicts the user satisfaction with the candidate response before giving it to the user. If the user is not likely to be satisfied according to the prediction, the system will ask the user a suitable question to determine the real intent of the user. We deploy and evaluate our model on DuerOS, and observe a 19% relative improvement on the accuracy of user satisfaction prediction and 2.3% relative improvement on user experience.
  arXiv  Detail & Related papers  (2022-12-05T09:17:49Z)
• Duplex Conversation: Towards Human-like Interaction in Spoken Dialogue System [120.70726465994781]
  multimodal spoken dialogue system enables telephonebased agents to interact with customers like human. We deploy Conversation Duplex Alibaba intelligent customer service to share lessons learned in production. Online A/B experiments show in proposed system can significantly reduce response latency by 50%.
  arXiv  Detail & Related papers  (2022-05-30T12:41:23Z)
• Building an ASR Error Robust Spoken Virtual Patient System in a Highly Class-Imbalanced Scenario Without Speech Data [20.357369521268417]
  A Virtual Patient (VP) is a powerful tool for training medical students to take patient histories. Our method shows significant improvements over strong baselines on the VP intent classification task at various word error rate settings.
  arXiv  Detail & Related papers  (2022-04-11T15:13:33Z)
• Towards Large-Scale Interpretable Knowledge Graph Reasoning for Dialogue Systems [109.16553492049441]
  We propose a novel method to incorporate the knowledge reasoning capability into dialogue systems in a more scalable and generalizable manner. To the best of our knowledge, this is the first work to have transformer models generate responses by reasoning over differentiable knowledge graphs.
  arXiv  Detail & Related papers  (2022-03-20T17:51:49Z)
• Advances and Challenges in Conversational Recommender Systems: A Survey [133.93908165922804]
  We provide a systematic review of the techniques used in current conversational recommender systems (CRSs) We summarize the key challenges of developing CRSs into five directions. These research directions involve multiple research fields like information retrieval (IR), natural language processing (NLP), and human-computer interaction (HCI)
  arXiv  Detail & Related papers  (2021-01-23T08:53:15Z)
• Improving Conversational Question Answering Systems after Deployment using Feedback-Weighted Learning [69.42679922160684]
  We propose feedback-weighted learning based on importance sampling to improve upon an initial supervised system using binary user feedback. Our work opens the prospect to exploit interactions with real users and improve conversational systems after deployment.
  arXiv  Detail & Related papers  (2020-11-01T19:50:34Z)
• NUANCED: Natural Utterance Annotation for Nuanced Conversation with Estimated Distributions [36.00476428803116]
  In this work, we attempt to build a user-centric dialogue system. We first model the user preferences as estimated distributions over the system ontology and map the users' utterances to such distributions. We build a new dataset named NUANCED that focuses on such realistic settings for conversational recommendation.
  arXiv  Detail & Related papers  (2020-10-24T03:23:14Z)
• User Intention Recognition and Requirement Elicitation Method for Conversational AI Services [7.941589241861105]
  We aim to obtain user requirements as accurately as possible in as few rounds as possible. A user intention recognition method based on Knowledge Graph (KG) was developed for fuzzy requirement inference. A requirement elicitation method based on Granular Computing was proposed for dialog policy generation.
  arXiv  Detail & Related papers  (2020-09-03T08:26:39Z)
• Learning to Rank Intents in Voice Assistants [2.102846336724103]
  We propose a novel Energy-based model for the intent ranking task. We show our approach outperforms existing state of the art methods by reducing the error-rate by 3.8%. We also evaluate the robustness of our algorithm on the intent ranking task and show our algorithm improves the robustness by 33.3%.
  arXiv  Detail & Related papers  (2020-04-30T21:51:26Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.