From Topical Relevance to Answerability: Entailment Distillation for Conversational Retrieval
- URL: http://arxiv.org/abs/2609.03482v1
- Date: Thu, 03 Sep 2026 07:38:36 GMT
- Title: From Topical Relevance to Answerability: Entailment Distillation for Conversational Retrieval
- Abstract summary: We propose CLEAR, a framework that shifts conversational retrieval from topical relevance to answerability.<n>The core of CLEAR is entailment distillation, which transfers answer-passage entailment supervision into a cross-encoder reranker.<n> CLEAR consistently improves top-ranked precision over strong query-rewriting and dense-retrieval baselines.
- Score: 24.372303326753535
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Existing conversational retrievers commonly treat topical relevance as a proxy for answerability. However, a passage that closely matches the dialogue context is not necessarily the one that supports the correct answer. We identify this mismatch as a systematic answerability gap. To address this issue, we propose CLEAR, a framework that shifts conversational retrieval from topical relevance to answerability. The core of CLEAR is entailment distillation, which transfers answer-passage entailment supervision into a cross-encoder reranker so that the reranker discriminates answer-supporting passages from topical distractors at inference time, without requiring answers. CLEAR is complemented by a passage-centric abductive recall module that brings low-similarity yet answerable passages into the candidate pool by inferring answerable queries from passages with an LLM. Across TopiOCQA, QReCC, and out-of-domain TREC CAsT datasets, CLEAR consistently improves top-ranked precision over strong query-rewriting and dense-retrieval baselines, with the largest gains observed in conversations involving heavier topical noise. Moreover, applying our reranker on top of an LLM-driven query rewriter yields further gains.
Related papers
- MMAgent-R$^2$: Learning to Rerank and Reject for Agentic mRAG [50.46218163777298]
Knowledge-based Visual Question Answering (KB-VQA) requires models to retrieve visual entities matching the query image from large-scale encyclopedic knowledge bases and answer related questions.<n>We propose MMAgent-R$2$, an agentic mRAG framework that integrates visual reranking and active rejection as its internal verification mechanism.
arXiv Detail & Related papers (2026-07-08T13:15:39Z) - Verbal-R3: Verbal Reranker as the Missing Bridge between Retrieval and Reasoning [48.15732775780642]
This paper proposes to bridge retrieval results and the Large Language Model's reasoning ability through Verbal s.<n>We introduce Verbal-R3, a novel agentic RAG framework that consists of a Generator and a Verbal Reranker.<n> Verbal-R3 achieves state-of-the-art performance on complex Question Answering benchmarks, validating the effectiveness of the proposed framework.
arXiv Detail & Related papers (2026-05-02T11:43:23Z) - BiCon-Gate: Consistency-Gated De-colloquialisation for Dialogue Fact-Checking [9.866690791407464]
We propose a conservative rewrite candidate for each response claim via staged de-colloquialisation.<n>We then introduce BiCon-Gate, a semantics-aware consistency gate that selects the rewrite candidate only when it is semantically supported by the dialogue context.<n>This gated selection stabilises downstream fact-checking and yields gains in both evidence retrieval and fact verification.
arXiv Detail & Related papers (2026-04-15T20:06:24Z) - When and What to Ask: AskBench and Rubric-Guided RLVR for LLM Clarification [8.391356566325054]
Large language models (LLMs) often respond even when prompts omit critical details or include misleading information.<n>We study how to evaluate and improve LLMs' ability to decide when and what to ask for clarification without sacrificing task performance.<n>We introduce AskBench, an interactive benchmark that converts standard QA pairs into multi-turn interactions with explicit checkpoints.
arXiv Detail & Related papers (2026-02-04T02:21:01Z) - Boosting Conversational Question Answering with Fine-Grained Retrieval-Augmentation and Self-Check [25.63538452425097]
We propose a conversation-level RAG approach, which incorporates fine-grained retrieval augmentation and self-check for conversational question answering.
In particular, our approach consists of three components, namely conversational question refiner, fine-grained retriever and self-check based response generator.
arXiv Detail & Related papers (2024-03-27T04:20:18Z) - SpeechDPR: End-to-End Spoken Passage Retrieval for Open-Domain Spoken Question Answering [76.4510005602893]
Spoken Question Answering (SQA) is essential for machines to reply to user's question by finding the answer span within a given spoken passage.
This paper proposes the first known end-to-end framework, Speech Passage Retriever (SpeechDPR)
SpeechDPR learns a sentence-level semantic representation by distilling knowledge from the cascading model of unsupervised ASR (UASR) and dense text retriever (TDR)
arXiv Detail & Related papers (2024-01-24T14:08:38Z) - Self-RAG: Learning to Retrieve, Generate, and Critique through
Self-Reflection [74.51523859064802]
We introduce a new framework called Self-Reflective Retrieval-Augmented Generation (Self-RAG)
Self-RAG enhances an LM's quality and factuality through retrieval and self-reflection.
It significantly outperforms state-of-the-art LLMs and retrieval-augmented models on a diverse set of tasks.
arXiv Detail & Related papers (2023-10-17T18:18:32Z) - PReGAN: Answer Oriented Passage Ranking with Weakly Supervised GAN [34.96355889356033]
We propose an approach called tttPReGAN for Passage Reranking based on Generative Adversarial Neural networks.
The goal is to force the generator to rank higher a passage that is topically relevant and contains an answer.
arXiv Detail & Related papers (2022-07-05T01:43:35Z) - CONQRR: Conversational Query Rewriting for Retrieval with Reinforcement
Learning [16.470428531658232]
We develop a query rewriting model CONQRR that rewrites a conversational question in context into a standalone question.
We show that CONQRR achieves state-of-the-art results on a recent open-domain CQA dataset.
arXiv Detail & Related papers (2021-12-16T01:40:30Z) - Joint Passage Ranking for Diverse Multi-Answer Retrieval [56.43443577137929]
We study multi-answer retrieval, an under-explored problem that requires retrieving passages to cover multiple distinct answers for a question.
This task requires joint modeling of retrieved passages, as models should not repeatedly retrieve passages containing the same answer at the cost of missing a different valid answer.
In this paper, we introduce JPR, a joint passage retrieval model focusing on reranking. To model the joint probability of the retrieved passages, JPR makes use of an autoregressive reranker that selects a sequence of passages, equipped with novel training and decoding algorithms.
arXiv Detail & Related papers (2021-04-17T04:48:36Z) - Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term
Importance Estimation and Neural Query Rewriting [56.268862325167575]
We tackle conversational passage retrieval (ConvPR) with query reformulation integrated into a multi-stage ad-hoc IR system.
We propose two conversational query reformulation (CQR) methods: (1) term importance estimation and (2) neural query rewriting.
For the former, we expand conversational queries using important terms extracted from the conversational context with frequency-based signals.
For the latter, we reformulate conversational queries into natural, standalone, human-understandable queries with a pretrained sequence-tosequence model.
arXiv Detail & Related papers (2020-05-05T14:30:20Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.