Resolving Intent Ambiguities by Retrieving Discriminative Clarifying
Questions
- URL: http://arxiv.org/abs/2008.07559v1
- Date: Mon, 17 Aug 2020 18:11:13 GMT
- Title: Resolving Intent Ambiguities by Retrieving Discriminative Clarifying
Questions
- Authors: Kaustubh D. Dhole
- Abstract summary: We propose a novel method of generating discriminative questions using a simple rule based system.
Our approach aims at discrimination between two intents but can be easily extended to clarification over multiple intents.
- Score: 6.905422991603534
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: Task oriented Dialogue Systems generally employ intent detection systems in
order to map user queries to a set of pre-defined intents. However, user
queries appearing in natural language can be easily ambiguous and hence such a
direct mapping might not be straightforward harming intent detection and
eventually the overall performance of a dialogue system. Moreover, acquiring
domain-specific clarification questions is costly. In order to disambiguate
queries which are ambiguous between two intents, we propose a novel method of
generating discriminative questions using a simple rule based system which can
take advantage of any question generation system without requiring annotated
data of clarification questions. Our approach aims at discrimination between
two intents but can be easily extended to clarification over multiple intents.
Seeking clarification from the user to classify user intents not only helps
understand the user intent effectively, but also reduces the roboticity of the
conversation and makes the interaction considerably natural.
Related papers
- Clarify When Necessary: Resolving Ambiguity Through Interaction with LMs [58.620269228776294]
We propose a task-agnostic framework for resolving ambiguity by asking users clarifying questions.
We evaluate systems across three NLP applications: question answering, machine translation and natural language inference.
We find that intent-sim is robust, demonstrating improvements across a wide range of NLP tasks and LMs.
arXiv Detail & Related papers (2023-11-16T00:18:50Z) - All Labels Together: Low-shot Intent Detection with an Efficient Label
Semantic Encoding Paradigm [48.02790193676742]
In intent detection tasks, leveraging meaningful semantic information from intent labels can be particularly beneficial for few-shot scenarios.
We present an end-to-end One-to-All system that enables the comparison of an input utterance with all label candidates.
Experiments on three few-shot intent detection tasks demonstrate that One-to-All is especially effective when the training resource is extremely scarce.
arXiv Detail & Related papers (2023-09-07T08:50:45Z) - Is the Elephant Flying? Resolving Ambiguities in Text-to-Image
Generative Models [64.58271886337826]
We study ambiguities that arise in text-to-image generative models.
We propose a framework to mitigate ambiguities in the prompts given to the systems by soliciting clarifications from the user.
arXiv Detail & Related papers (2022-11-17T17:12:43Z) - Zero-Shot Prompting for Implicit Intent Prediction and Recommendation
with Commonsense Reasoning [28.441725610692714]
This paper proposes a framework of multi-domain dialogue systems, which can automatically infer implicit intents based on user utterances.
The proposed framework is demonstrated effective to realize implicit intents and recommend associated bots in a zero-shot manner.
arXiv Detail & Related papers (2022-10-12T03:33:49Z) - Multi-stage Clarification in Conversational AI: The case of
Question-Answering Dialogue Systems [0.27998963147546135]
Clarification resolution plays an important role in various information retrieval tasks such as interactive question answering and conversational search.
We propose a multi-stage clarification mechanism for prompting clarification and query selection in the context of a question answering dialogue system.
Our proposed mechanism improves the overall user experience and outperforms competitive baselines with two datasets.
arXiv Detail & Related papers (2021-10-28T15:45:44Z) - Deciding Whether to Ask Clarifying Questions in Large-Scale Spoken
Language Understanding [28.195853603190447]
A large-scale conversational agent can suffer from understanding user utterances with various ambiguities.
We propose a neural self-attentive model that leverages the hypotheses with ambiguities and contextual signals.
arXiv Detail & Related papers (2021-09-25T22:32:10Z) - Leveraging Acoustic and Linguistic Embeddings from Pretrained speech and
language Models for Intent Classification [81.80311855996584]
We propose a novel intent classification framework that employs acoustic features extracted from a pretrained speech recognition system and linguistic features learned from a pretrained language model.
We achieve 90.86% and 99.07% accuracy on ATIS and Fluent speech corpus, respectively.
arXiv Detail & Related papers (2021-02-15T07:20:06Z) - Interactive Question Clarification in Dialogue via Reinforcement
Learning [36.746578601398866]
We propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query.
The model is trained using reinforcement learning with a deep policy network.
We evaluate our model based on real-world user clicks and demonstrate significant improvements.
arXiv Detail & Related papers (2020-12-17T06:38:04Z) - Learning to Rank Intents in Voice Assistants [2.102846336724103]
We propose a novel Energy-based model for the intent ranking task.
We show our approach outperforms existing state of the art methods by reducing the error-rate by 3.8%.
We also evaluate the robustness of our algorithm on the intent ranking task and show our algorithm improves the robustness by 33.3%.
arXiv Detail & Related papers (2020-04-30T21:51:26Z) - AGIF: An Adaptive Graph-Interactive Framework for Joint Multiple Intent
Detection and Slot Filling [69.59096090788125]
In this paper, we propose an Adaptive Graph-Interactive Framework (AGIF) for joint multiple intent detection and slot filling.
We introduce an intent-slot graph interaction layer to model the strong correlation between the slot and intents.
Such an interaction layer is applied to each token adaptively, which has the advantage to automatically extract the relevant intents information.
arXiv Detail & Related papers (2020-04-21T15:07:34Z) - Efficient Intent Detection with Dual Sentence Encoders [53.16532285820849]
We introduce intent detection methods backed by pretrained dual sentence encoders such as USE and ConveRT.
We demonstrate the usefulness and wide applicability of the proposed intent detectors, showing that they outperform intent detectors based on fine-tuning the full BERT-Large model.
We release our code, as well as a new challenging single-domain intent detection dataset.
arXiv Detail & Related papers (2020-03-10T15:33:54Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.