Extracting triples from dialogues for conversational social agents

• URL: http://arxiv.org/abs/2412.18364v1
• Date: Tue, 24 Dec 2024 11:48:16 GMT
• Title: Extracting triples from dialogues for conversational social agents
• Authors: Piek Vossen, Selene Báez Santamaría, Lenka Bajčetić, Thomas Belluci,
• Abstract summary: Triple extraction has mostly been developed and tested for Knowledge Base Completion using Wikipedia text and data for training and testing. Phenomena such as co-reference, ellipsis, coordination, and implicit and explicit negation or confirmation are more prominent in conversation than in Wikipedia text. Highest precision is 51.14 for complete triples and 69.32 for triple elements when tested on single utterances.
• Score: 0.9999629695552195
• License:
• Abstract: Obtaining an explicit understanding of communication within a Hybrid Intelligence collaboration is essential to create controllable and transparent agents. In this paper, we describe a number of Natural Language Understanding models that extract explicit symbolic triples from social conversation. Triple extraction has mostly been developed and tested for Knowledge Base Completion using Wikipedia text and data for training and testing. However, social conversation is very different as a genre in which interlocutors exchange information in sequences of utterances that involve statements, questions, and answers. Phenomena such as co-reference, ellipsis, coordination, and implicit and explicit negation or confirmation are more prominent in conversation than in Wikipedia text. We therefore describe an attempt to fill this gap by releasing data sets for training and testing triple extraction from social conversation. We also created five triple extraction models and tested them in our evaluation data. The highest precision is 51.14 for complete triples and 69.32 for triple elements when tested on single utterances. However, scores for conversational triples that span multiple turns are much lower, showing that extracting knowledge from true conversational data is much more challenging.

Related papers

• Learning From Free-Text Human Feedback -- Collect New Datasets Or Extend Existing Ones? [57.16050211534735]
  We investigate the types and frequency of free-text human feedback in commonly used dialog datasets. Our findings provide new insights into the composition of the datasets examined, including error types, user response types, and the relations between them.
  arXiv  Detail & Related papers  (2023-10-24T12:01:11Z)
• KPT: Keyword-guided Pre-training for Grounded Dialog Generation [82.68787152707455]
  We propose KPT (guided Pre-Training), a novel self-supervised pre-training method for grounded dialog generation. Specifically, we use a pre-trained language model to extract the most uncertain tokens in the dialog as keywords. We conduct extensive experiments on various few-shot knowledge-grounded generation tasks, including grounding on dialog acts, knowledge graphs, persona descriptions, and Wikipedia passages.
  arXiv  Detail & Related papers  (2022-12-04T04:05:01Z)
• CGoDial: A Large-Scale Benchmark for Chinese Goal-oriented Dialog Evaluation [75.60156479374416]
  CGoDial is a new challenging and comprehensive Chinese benchmark for Goal-oriented Dialog evaluation. It contains 96,763 dialog sessions and 574,949 dialog turns totally, covering three datasets with different knowledge sources. To bridge the gap between academic benchmarks and spoken dialog scenarios, we either collect data from real conversations or add spoken features to existing datasets via crowd-sourcing.
  arXiv  Detail & Related papers  (2022-11-21T16:21:41Z)
• Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings [41.79937481022846]
  We introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through pre-trained language models have been shown to be feasible. We propose a self-guided contrastive learning approach named dial2vec.
  arXiv  Detail & Related papers  (2022-10-27T11:14:06Z)
• End-to-end Spoken Conversational Question Answering: Task, Dataset and Model [92.18621726802726]
  In spoken question answering, the systems are designed to answer questions from contiguous text spans within the related speech transcripts. We propose a new Spoken Conversational Question Answering task (SCQA), aiming at enabling the systems to model complex dialogue flows. Our main objective is to build the system to deal with conversational questions based on the audio recordings, and to explore the plausibility of providing more cues from different modalities with systems in information gathering.
  arXiv  Detail & Related papers  (2022-04-29T17:56:59Z)
• HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data [87.67278915655712]
  We present a new dialogue dataset, HybriDialogue, which consists of crowdsourced natural conversations grounded on both Wikipedia text and tables. The conversations are created through the decomposition of complex multihop questions into simple, realistic multiturn dialogue interactions.
  arXiv  Detail & Related papers  (2022-04-28T00:52:16Z)
• Summary Grounded Conversation Generation [10.470157142861174]
  We show how pre-trained language models can be used to generate entire conversations, given only a summary of a conversation as the input. We also show that the accuracy of conversation summarization can be improved by augmenting a conversation summarization dataset with generated conversations.
  arXiv  Detail & Related papers  (2021-06-07T04:46:31Z)
• CIDER: Commonsense Inference for Dialogue Explanation and Reasoning [31.354769524093125]
  CIDER -- a manually curated dataset -- contains dyadic dialogue explanations in the form of implicit and explicit knowledge triplets inferred using commonsense inference. We set up three different tasks conditioned on the dataset: Dialogue-level Natural Language Inference, Span Extraction, and Multi-choice Span Selection. Results obtained with transformer-based models reveal that the tasks are difficult, paving the way for promising future research.
  arXiv  Detail & Related papers  (2021-06-01T14:14:46Z)
• Dialogue History Matters! Personalized Response Selectionin Multi-turn Retrieval-based Chatbots [62.295373408415365]
  We propose a personalized hybrid matching network (PHMN) for context-response matching. Our contributions are two-fold: 1) our model extracts personalized wording behaviors from user-specific dialogue history as extra matching information. We evaluate our model on two large datasets with user identification, i.e., personalized dialogue Corpus Ubuntu (P- Ubuntu) and personalized Weibo dataset (P-Weibo)
  arXiv  Detail & Related papers  (2021-03-17T09:42:11Z)
• MultiTalk: A Highly-Branching Dialog Testbed for Diverse Conversations [39.81965687032923]
  We present the MultiTalk dataset, a corpus of over 320,000 sentences of written conversational dialog. We make multiple contributions to study dialog generation in the highly branching setting. Our culminating task is a challenging theory of mind problem, a controllable generation task.
  arXiv  Detail & Related papers  (2021-02-02T02:29:40Z)
• Commonsense Knowledge Mining from Term Definitions [0.20305676256390934]
  We investigate a few machine learning approaches to mining commonsense knowledge triples using dictionary term definitions as inputs. Our experiments show that term definitions contain some valid and novel commonsense knowledge triples for some semantic relations.
  arXiv  Detail & Related papers  (2021-02-01T05:54:02Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.