CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search

• URL: http://arxiv.org/abs/2607.19801v1
• Date: Wed, 22 Jul 2026 06:29:17 GMT
• Title: CIR at iKAT SCAI 2026: Exploring Clarification Need Prediction in Agentic Conversational Search
• Abstract summary: This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task.<n>We use an agentic conversational search system, equipped with tools for query rewriting, retrieval and reranking, answer generation, and clarification need prediction and clarification question generation.
• Score: 9.472822069242865
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This paper presents the participation of the Cologne Information Retrieval group in the iKAT SCAI 2026 shared task. We use an agentic conversational search system, equipped with tools for query rewriting, retrieval and reranking, answer generation, and clarification need prediction and clarification question generation. We experiment with two different neural clarification need prediction models.

Related papers

• GRASP: GRanularity-Aware Search Policy for Agentic RAG [35.781196496632035]
  We introduce GRASP, a reinforcement learning framework for training agents to adaptively coordinate complementary retrieval tools.<n> GRASP provides the agent with semantic search, keyword search, and paragraph-reading actions.<n>We train the policy with a reward that jointly accounts for answer accuracy, grounded reading, complementary search, and turn efficiency.
  arXiv  Detail & Related papers  (2026-07-11T19:58:07Z)
• Overview of the TREC 2025 Retrieval Augmented Generation (RAG) Track [52.136178637532886]
  Second edition of the TREC Retrieval Augmented Generation (RAG) Track advances research on systems that integrate retrieval and generation.<n>Building on the foundation of the inaugural 2024 track, this year's challenge introduces long, multi-sentence narrative queries.<n>Participants are tasked with designing pipelines that combine retrieval and generation while ensuring transparency and factual grounding.
  arXiv  Detail & Related papers  (2026-03-10T16:49:18Z)
• A Semantic Search Pipeline for Causality-driven Adhoc Information Retrieval [1.1196974000738733]
  We present a unsupervised semantic search pipeline for the Causality-driven Adhoc Information Retrieval (CAIR-2021) shared task.<n>The CAIR shared task expands traditional information retrieval to support the retrieval of documents containing the likely causes of a query event.<n>A successful system must be able to distinguish between topical documents and documents containing causal descriptions of events that are causally related to the query event.
  arXiv  Detail & Related papers  (2025-03-02T19:59:41Z)
• ELOQ: Resources for Enhancing LLM Detection of Out-of-Scope Questions [52.33835101586687]
  We study out-of-scope questions, where the retrieved document appears semantically similar to the question but lacks the necessary information to answer it.<n>We propose a guided hallucination-based approach ELOQ to automatically generate a diverse set of out-of-scope questions from post-cutoff documents.
  arXiv  Detail & Related papers  (2024-10-18T16:11:29Z)
• The ACM Multimedia 2023 Computational Paralinguistics Challenge: Emotion Share & Requests [66.24715220997547]
  The ACM Multimedia 2023 Paralinguistics Challenge addresses two different problems for the first time under well-defined conditions. In the Emotion Share Sub-Challenge, a regression on speech has to be made; and in the Requests Sub-Challenges, requests and complaints need to be detected. We describe the Sub-Challenges, baseline feature extraction, and classifiers based on the usual ComPaRE features, the auDeep toolkit, and deep feature extraction from pre-trained CNNs using the DeepSpectRum toolkit.
  arXiv  Detail & Related papers  (2023-04-28T14:42:55Z)
• INSCIT: Information-Seeking Conversations with Mixed-Initiative Interactions [47.90088587508672]
  InSCIt is a dataset for Information-Seeking Conversations with mixed-initiative Interactions. It contains 4.7K user-agent turns from 805 human-human conversations. We report results of two systems based on state-of-the-art models of conversational knowledge identification and open-domain question answering.
  arXiv  Detail & Related papers  (2022-07-02T06:18:12Z)
• Local Explanation of Dialogue Response Generation [77.68077106724522]
  Local explanation of response generation (LERG) is proposed to gain insights into the reasoning process of a generation model. LERG views the sequence prediction as uncertainty estimation of a human response and then creates explanations by perturbing the input and calculating the certainty change over the human response. Our results show that our method consistently improves other widely used methods on proposed automatic- and human- evaluation metrics for this new task by 4.4-12.8%.
  arXiv  Detail & Related papers  (2021-06-11T17:58:36Z)
• A Clarifying Question Selection System from NTES_ALONG in Convai3 Challenge [8.656503175492375]
  This paper presents the participation of NetEase Game AI Lab team for the ClariQ challenge at Search-oriented Conversational AI (SCAI) EMNLP workshop in 2020. The challenge asks for a complete conversational information retrieval system that can understanding and generating clarification questions. We propose a clarifying question selection system which consists of response understanding, candidate question recalling and clarifying question ranking.
  arXiv  Detail & Related papers  (2020-10-27T11:22:53Z)
• CR-Walker: Tree-Structured Graph Reasoning and Dialog Acts for Conversational Recommendation [62.13413129518165]
  CR-Walker is a model that performs tree-structured reasoning on a knowledge graph. It generates informative dialog acts to guide language generation. Automatic and human evaluations show that CR-Walker can arrive at more accurate recommendation.
  arXiv  Detail & Related papers  (2020-10-20T14:53:22Z)
• Open-Retrieval Conversational Question Answering [62.11228261293487]
  We introduce an open-retrieval conversational question answering (ORConvQA) setting, where we learn to retrieve evidence from a large collection before extracting answers. We build an end-to-end system for ORConvQA, featuring a retriever, a reranker, and a reader that are all based on Transformers.
  arXiv  Detail & Related papers  (2020-05-22T19:39:50Z)
• Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting [56.268862325167575]
  We tackle conversational passage retrieval (ConvPR) with query reformulation integrated into a multi-stage ad-hoc IR system. We propose two conversational query reformulation (CQR) methods: (1) term importance estimation and (2) neural query rewriting. For the former, we expand conversational queries using important terms extracted from the conversational context with frequency-based signals. For the latter, we reformulate conversational queries into natural, standalone, human-understandable queries with a pretrained sequence-tosequence model.
  arXiv  Detail & Related papers  (2020-05-05T14:30:20Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.