Answer Identification in Collaborative Organizational Group Chat
- URL: http://arxiv.org/abs/2011.08074v1
- Date: Wed, 4 Nov 2020 09:42:54 GMT
- Title: Answer Identification in Collaborative Organizational Group Chat
- Authors: Naama Tepper, Naama Zwerdling, David Naori and Inbal Ronen
- Abstract summary: Group chat is characterized by intertwined conversations and 'always on' availability.
Our Kernel Density Estimation (KDE) based clustering approach termed Ans-Chat implicitly learns discussion patterns as a means for answer identification.
- Score: 4.062043689926534
- License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
- Abstract: We present a simple unsupervised approach for answer identification in
organizational group chat. In recent years, organizational group chat is on the
rise enabling asynchronous text-based collaboration between co-workers in
different locations and time zones. Finding answers to questions is often
critical for work efficiency. However, group chat is characterized by
intertwined conversations and 'always on' availability, making it hard for
users to pinpoint answers to questions they care about in real-time or search
for answers in retrospective. In addition, structural and lexical
characteristics differ between chat groups, making it hard to find a 'one model
fits all' approach. Our Kernel Density Estimation (KDE) based clustering
approach termed Ans-Chat implicitly learns discussion patterns as a means for
answer identification, thus eliminating the need to channel-specific tagging.
Empirical evaluation shows that this solution outperforms other approached.
Related papers
- Do LLMs suffer from Multi-Party Hangover? A Diagnostic Approach to Addressee Recognition and Response Selection in Conversations [11.566214724241798]
We propose a methodological pipeline to investigate model performance across specific structural attributes of conversations.
We focus on Response Selection and Addressee Recognition tasks, to diagnose model weaknesses.
Results show that response selection relies more on the textual content of conversations, while addressee recognition requires capturing their structural dimension.
arXiv Detail & Related papers (2024-09-27T10:07:33Z) - Reasoning in Conversation: Solving Subjective Tasks through Dialogue
Simulation for Large Language Models [56.93074140619464]
We propose RiC (Reasoning in Conversation), a method that focuses on solving subjective tasks through dialogue simulation.
The motivation of RiC is to mine useful contextual information by simulating dialogues instead of supplying chain-of-thought style rationales.
We evaluate both API-based and open-source LLMs including GPT-4, ChatGPT, and OpenChat across twelve tasks.
arXiv Detail & Related papers (2024-02-27T05:37:10Z) - Social Commonsense-Guided Search Query Generation for Open-Domain
Knowledge-Powered Conversations [66.16863141262506]
We present a novel approach that focuses on generating internet search queries guided by social commonsense.
Our proposed framework addresses passive user interactions by integrating topic tracking, commonsense response generation and instruction-driven query generation.
arXiv Detail & Related papers (2023-10-22T16:14:56Z) - ChatGPT Evaluation on Sentence Level Relations: A Focus on Temporal,
Causal, and Discourse Relations [52.26802326949116]
We quantitatively evaluate the performance of ChatGPT, an interactive large language model, on inter-sentential relations.
ChatGPT exhibits exceptional proficiency in detecting and reasoning about causal relations.
It is capable of identifying the majority of discourse relations with existing explicit discourse connectives, but the implicit discourse relation remains a formidable challenge.
arXiv Detail & Related papers (2023-04-28T13:14:36Z) - DialogQAE: N-to-N Question Answer Pair Extraction from Customer Service
Chatlog [34.69426306212259]
We propose N-to-N QA extraction task in which the derived questions and corresponding answers might be separated across different utterances.
We introduce a suite of generative/discriminative tagging based methods with end-to-end and two-stage variants that perform well on 5 customer service datasets.
arXiv Detail & Related papers (2022-12-14T09:05:14Z) - KETOD: Knowledge-Enriched Task-Oriented Dialogue [77.59814785157877]
Existing studies in dialogue system research mostly treat task-oriented dialogue and chit-chat as separate domains.
We investigate how task-oriented dialogue and knowledge-grounded chit-chat can be effectively integrated into a single model.
arXiv Detail & Related papers (2022-05-11T16:01:03Z) - SCAI-QReCC Shared Task on Conversational Question Answering [7.428559907101379]
SCAI'21 was organised as an independent on-line event and featured a shared task on conversational question answering.
We identified evaluation of answer correctness in this settings as the major challenge and a current research gap.
We conducted two crowdsourcing experiments to collect annotations for answer plausibility and faithfulness.
arXiv Detail & Related papers (2022-01-26T18:03:21Z) - Disentangling Online Chats with DAG-Structured LSTMs [55.33014148383343]
DAG-LSTMs are a generalization of Tree-LSTMs that can handle directed acyclic dependencies.
We show that the novel model we propose achieves state of the art status on the task of recovering reply-to relations.
arXiv Detail & Related papers (2021-06-16T18:00:00Z) - Unsupervised Summarization for Chat Logs with Topic-Oriented Ranking and
Context-Aware Auto-Encoders [59.038157066874255]
We propose a novel framework called RankAE to perform chat summarization without employing manually labeled data.
RankAE consists of a topic-oriented ranking strategy that selects topic utterances according to centrality and diversity simultaneously.
A denoising auto-encoder is designed to generate succinct but context-informative summaries based on the selected utterances.
arXiv Detail & Related papers (2020-12-14T07:31:17Z) - Conversational Question Answering over Passages by Leveraging Word
Proximity Networks [33.59664244897881]
CROWN is an unsupervised yet effective system for conversational QA with passage responses.
It supports several modes of context propagation over multiple turns.
CROWN was evaluated on TREC CAsT data, where it achieved above-median performance in a pool of neural methods.
arXiv Detail & Related papers (2020-04-27T19:30:47Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.