Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph

• URL: http://arxiv.org/abs/2210.03037v1
• Date: Thu, 6 Oct 2022 16:42:00 GMT
• Title: Conversational Semantic Role Labeling with Predicate-Oriented Latent Graph
• Authors: Hao Fei, Shengqiong Wu, Meishan Zhang, Yafeng Ren, Donghong Ji
• Abstract summary: We propose to automatically induce a predicate-oriented latent graph (POLar) with a predicate-centered Gaussian mechanism. The POLar structure is then dynamically pruned and refined so as to best fit the task need. We additionally introduce an effective dialogue-level pre-trained language model, CoDiaBERT, for better supporting multiple utterance sentences.
• Score: 40.43625257213158
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Conversational semantic role labeling (CSRL) is a newly proposed task that uncovers the shallow semantic structures in a dialogue text. Unfortunately several important characteristics of the CSRL task have been overlooked by the existing works, such as the structural information integration, near-neighbor influence. In this work, we investigate the integration of a latent graph for CSRL. We propose to automatically induce a predicate-oriented latent graph (POLar) with a predicate-centered Gaussian mechanism, by which the nearer and informative words to the predicate will be allocated with more attention. The POLar structure is then dynamically pruned and refined so as to best fit the task need. We additionally introduce an effective dialogue-level pre-trained language model, CoDiaBERT, for better supporting multiple utterance sentences and handling the speaker coreference issue in CSRL. Our system outperforms best-performing baselines on three benchmark CSRL datasets with big margins, especially achieving over 4% F1 score improvements on the cross-utterance argument detection. Further analyses are presented to better understand the effectiveness of our proposed methods.

Related papers

• Multi-grained Hypergraph Interest Modeling for Conversational Recommendation [75.65483522949857]
  We propose a novel multi-grained hypergraph interest modeling approach to capture user interest beneath intricate historical data. In our approach, we first employ the hypergraph structure to model users' historical dialogue sessions and form a session-based hypergraph, which captures coarse-grained, session-level relations. We further conduct multi-grained hypergraph convolution on the two kinds of hypergraphs, and utilize the enhanced representations to develop interest-aware CRS.
  arXiv  Detail & Related papers  (2023-05-04T13:13:44Z)
• GRASP: Guiding model with RelAtional Semantics using Prompt [3.1275060062551208]
  We propose a Guiding model with RelAtional Semantics using Prompt (GRASP) We adopt a prompt-based fine-tuning approach and capture relational semantic clues of a given dialogue with an argument-aware prompt marker strategy. In the experiments, GRASP state-of-the-art performance in terms of both F1 and F1c scores on a DialogRE dataset.
  arXiv  Detail & Related papers  (2022-08-26T08:19:28Z)
• Dialogue Meaning Representation for Task-Oriented Dialogue Systems [51.91615150842267]
  We propose Dialogue Meaning Representation (DMR), a flexible and easily extendable representation for task-oriented dialogue. Our representation contains a set of nodes and edges with inheritance hierarchy to represent rich semantics for compositional semantics and task-specific concepts. We propose two evaluation tasks to evaluate different machine learning based dialogue models, and further propose a novel coreference resolution model GNNCoref for the graph-based coreference resolution task.
  arXiv  Detail & Related papers  (2022-04-23T04:17:55Z)
• Zero-shot Cross-lingual Conversational Semantic Role Labeling [30.28068025468505]
  We present an effective approach to perform zero-shot cross-lingual CSRL. Our model implicitly learns language-agnostic, conversational structure-aware and semantically rich representations with the hierarchical encoders. We confirm the usefulness of CSRL to non-Chinese conversational tasks such as the question-in-context rewriting task in English and the multi-turn dialogue response generation tasks in English, German and Japanese.
  arXiv  Detail & Related papers  (2022-04-11T07:29:39Z)
• CSAGN: Conversational Structure Aware Graph Network for Conversational Semantic Role Labeling [27.528361001332264]
  We present a simple and effective architecture for CSRL which aims to address this problem. Our model is based on a conversational structure-aware graph network which explicitly encodes the speaker dependent information.
  arXiv  Detail & Related papers  (2021-09-23T07:47:28Z)
• Supertagging Combinatory Categorial Grammar with Attentive Graph Convolutional Networks [34.74687603029737]
  We propose attentive graph convolutional networks to enhance neural CCG supertagging through a novel solution of leveraging contextual information. Experiments performed on the CCGbank demonstrate that our approach outperforms all previous studies in terms of both supertagging and parsing.
  arXiv  Detail & Related papers  (2020-10-13T01:58:29Z)
• Semantic Role Labeling Guided Multi-turn Dialogue ReWriter [63.07073750355096]
  We propose to use semantic role labeling (SRL) to highlight the core semantic information of who did what to whom. Experiments show that this information significantly improves a RoBERTa-based model that already outperforms previous state-of-the-art systems.
  arXiv  Detail & Related papers  (2020-10-03T19:50:04Z)
• Improving Conversational Recommender Systems via Knowledge Graph based Semantic Fusion [77.21442487537139]
  Conversational recommender systems (CRS) aim to recommend high-quality items to users through interactive conversations. First, the conversation data itself lacks of sufficient contextual information for accurately understanding users' preference. Second, there is a semantic gap between natural language expression and item-level user preference.
  arXiv  Detail & Related papers  (2020-07-08T11:14:23Z)
• Modelling Hierarchical Structure between Dialogue Policy and Natural Language Generator with Option Framework for Task-oriented Dialogue System [49.39150449455407]
  HDNO is an option framework for designing latent dialogue acts to avoid designing specific dialogue act representations. We test HDNO on MultiWoz 2.0 and MultiWoz 2.1, the datasets on multi-domain dialogues, in comparison with word-level E2E model trained with RL, LaRL and HDSA.
  arXiv  Detail & Related papers  (2020-06-11T20:55:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.