WHoW: A Cross-domain Approach for Analysing Conversation Moderation

• URL: http://arxiv.org/abs/2410.15551v1
• Date: Mon, 21 Oct 2024 00:54:31 GMT
• Title: WHoW: A Cross-domain Approach for Analysing Conversation Moderation
• Authors: Ming-Bin Chen, Lea Frermann, Jey Han Lau,
• Abstract summary: We propose WHoW, an evaluation framework for analyzing the facilitation strategies of moderators across different domains/scenarios. We annotated 5,657 moderation sentences with human judges and 15,494 sentences with GPT-4o from two domains: TV debates and radio panel discussions.
• Score: 30.80591855607426
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: We propose WHoW, an evaluation framework for analyzing the facilitation strategies of moderators across different domains/scenarios by examining their motives (Why), dialogue acts (How) and target speaker (Who). Using this framework, we annotated 5,657 moderation sentences with human judges and 15,494 sentences with GPT-4o from two domains: TV debates and radio panel discussions. Comparative analysis demonstrates the framework's cross-domain generalisability and reveals distinct moderation strategies: debate moderators emphasise coordination and facilitate interaction through questions and instructions, while panel discussion moderators prioritize information provision and actively participate in discussions. Our analytical framework works for different moderation scenarios, enhances our understanding of moderation behaviour through automatic large-scale analysis, and facilitates the development of moderator agents.

Related papers

• Moderation Matters:Measuring Conversational Moderation Impact in English as a Second Language Group Discussion [28.199491435905163]
  English as a Second Language speakers often struggle to engage in group discussions due to language barriers. We develop a dataset comprising 17 sessions from an online ESL conversation club, which includes both moderated and non-moderated discussions. Our findings indicate that moderators help improve the flow of topics and start/end a conversation.
  arXiv  Detail & Related papers  (2025-02-24T12:14:31Z)
• Who Speaks Next? Multi-party AI Discussion Leveraging the Systematics of Turn-taking in Murder Mystery Games [7.946510318969307]
  This study focuses on conversational norms such as adjacency pairs and turn-taking found in conversation analysis. We propose a new framework called "Murder Mystery Agents" that applies these norms to AI agents' dialogue control. The proposed framework integrates next speaker selection based on adjacency pairs and a self-selection mechanism.
  arXiv  Detail & Related papers  (2024-12-06T10:45:54Z)
• Unsupervised Mutual Learning of Discourse Parsing and Topic Segmentation in Dialogue [37.618612723025784]
  In dialogue systems, discourse plays a crucial role in managing conversational focus and coordinating interactions. It consists of two key structures: rhetorical structure and topic structure. We introduce a unified representation that integrates rhetorical and topic structures, ensuring semantic consistency between them. We propose an unsupervised mutual learning framework (UMLF) that jointly models rhetorical and topic structures, allowing them to mutually reinforce each other without requiring additional annotations.
  arXiv  Detail & Related papers  (2024-05-30T08:10:50Z)
• With a Little Help from my (Linguistic) Friends: Topic Segmentation of Multi-party Casual Conversations [0.565395466029518]
  This paper tries to reach a comparable level of accuracy as recent machine learning based topic segmentation models. The features we identify as meaningful for this task help us understand better the topical structure of a conversation.
  arXiv  Detail & Related papers  (2024-02-05T09:48:07Z)
• Multi-turn Dialogue Comprehension from a Topic-aware Perspective [70.37126956655985]
  This paper proposes to model multi-turn dialogues from a topic-aware perspective. We use a dialogue segmentation algorithm to split a dialogue passage into topic-concentrated fragments in an unsupervised way. We also present a novel model, Topic-Aware Dual-Attention Matching (TADAM) Network, which takes topic segments as processing elements.
  arXiv  Detail & Related papers  (2023-09-18T11:03:55Z)
• Dialectical Reconciliation via Structured Argumentative Dialogues [14.584998154271512]
  Our framework enables dialectical reconciliation to address knowledge discrepancies between an explainer (AI agent) and an explainee (human user) Our findings suggest that our framework offers a promising direction for fostering effective human-AI interactions in domains where explainability is important.
  arXiv  Detail & Related papers  (2023-06-26T13:39:36Z)
• Revisiting Conversation Discourse for Dialogue Disentanglement [88.3386821205896]
  We propose enhancing dialogue disentanglement by taking full advantage of the dialogue discourse characteristics. We develop a structure-aware framework to integrate the rich structural features for better modeling the conversational semantic context. Our work has great potential to facilitate broader multi-party multi-thread dialogue applications.
  arXiv  Detail & Related papers  (2023-06-06T19:17:47Z)
• Learning Dialogue Representations from Consecutive Utterances [29.150589618130695]
  We introduce Dialogue Sentence Embedding (DSE), a self-supervised contrastive learning method. DSE learns from dialogues by taking consecutive utterances of the same dialogue as positive pairs for contrastive learning. We evaluate DSE on five downstream dialogue tasks that examine dialogue representation at different semantic granularities.
  arXiv  Detail & Related papers  (2022-05-26T18:15:13Z)
• DEBACER: a method for slicing moderated debates [55.705662163385966]
  Partitioning debates into blocks with the same subject is essential for understanding. We propose a new algorithm, DEBACER, which partitions moderated debates.
  arXiv  Detail & Related papers  (2021-12-10T10:39:07Z)
• Topic-Aware Multi-turn Dialogue Modeling [91.52820664879432]
  This paper presents a novel solution for multi-turn dialogue modeling, which segments and extracts topic-aware utterances in an unsupervised way. Our topic-aware modeling is implemented by a newly proposed unsupervised topic-aware segmentation algorithm and Topic-Aware Dual-attention Matching (TADAM) Network.
  arXiv  Detail & Related papers  (2020-09-26T08:43:06Z)
• Is this Dialogue Coherent? Learning from Dialogue Acts and Entities [82.44143808977209]
  We create the Switchboard Coherence (SWBD-Coh) corpus, a dataset of human-human spoken dialogues annotated with turn coherence ratings. Our statistical analysis of the corpus indicates how turn coherence perception is affected by patterns of distribution of entities. We find that models combining both DA and entity information yield the best performances both for response selection and turn coherence rating.
  arXiv  Detail & Related papers  (2020-06-17T21:02:40Z)
• Dialogue-Based Relation Extraction [53.2896545819799]
  We present the first human-annotated dialogue-based relation extraction (RE) dataset DialogRE. We argue that speaker-related information plays a critical role in the proposed task, based on an analysis of similarities and differences between dialogue-based and traditional RE tasks. Experimental results demonstrate that a speaker-aware extension on the best-performing model leads to gains in both the standard and conversational evaluation settings.
  arXiv  Detail & Related papers  (2020-04-17T03:51:57Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.