Measuring and Forecasting Conversation Incivility: the Role of Antisocial and Prosocial Behaviors

• URL: http://arxiv.org/abs/2412.02911v2
• Date: Thu, 05 Dec 2024 20:19:40 GMT
• Title: Measuring and Forecasting Conversation Incivility: the Role of Antisocial and Prosocial Behaviors
• Authors: Xinchen Yu, Hayden Arnold, Benjamin Su, Eduardo Blanco,
• Abstract summary: We propose new metrics to measure the conversation incivility following replies to hate speech. We show that forecasting the incivility level of conversations following a reply to hate speech is a challenging task.
• Score: 8.996988253757095
• License:
• Abstract: This paper focuses on the task of measuring and forecasting incivility in conversations following replies to hate speech. Identifying replies that steer conversations away from hatred and elicit civil follow-up conversations sheds light into effective strategies to engage with hate speech and proactively avoid further escalation. We propose new metrics that take into account various dimensions of antisocial and prosocial behaviors to measure the conversation incivility following replies to hate speech. Our best metric aligns with human perceptions better than prior work. Additionally, we present analyses on a) the language of antisocial and prosocial posts, b) the relationship between antisocial or prosocial posts and user interactions, and c) the language of replies to hate speech that elicit follow-up conversations with different incivility levels. We show that forecasting the incivility level of conversations following a reply to hate speech is a challenging task. We also present qualitative analyses to identify the most common errors made by our best model.

Related papers

• Hate Cannot Drive out Hate: Forecasting Conversation Incivility following Replies to Hate Speech [12.274054522085107]
  We propose a metric to measure conversation incivility based on the number of civil and uncivil comments. A linguistic analysis uncovers the differences in the language of replies that elicit follow-up conversations with high and low incivility.
  arXiv  Detail & Related papers  (2023-12-08T02:39:17Z)
• Analyzing User Characteristics of Hate Speech Spreaders on Social Media [20.57872238271025]
  We analyze the role of user characteristics in hate speech resharing across different types of hate speech. We find that users with little social influence tend to share more hate speech. Political anti-Trump and anti-right-wing hate is reshared by users with larger social influence.
  arXiv  Detail & Related papers  (2023-10-24T12:17:48Z)
• CoSyn: Detecting Implicit Hate Speech in Online Conversations Using a Context Synergized Hyperbolic Network [52.85130555886915]
  CoSyn is a context-synergized neural network that explicitly incorporates user- and conversational context for detecting implicit hate speech in online conversations. We show that CoSyn outperforms all our baselines in detecting implicit hate speech with absolute improvements in the range of 1.24% - 57.8%.
  arXiv  Detail & Related papers  (2023-03-02T17:30:43Z)
• Collective moderation of hate, toxicity, and extremity in online discussions [1.114199733551736]
  We analyze a large corpus of more than 130,000 discussions on Twitter over four years. We identify different dimensions of discourse that might be related to the probability of hate speech in subsequent tweets. We find that expressing simple opinions, not necessarily supported by facts, relates to the least hate in subsequent discussions.
  arXiv  Detail & Related papers  (2023-03-01T09:35:26Z)
• Hate Speech and Counter Speech Detection: Conversational Context Does Matter [7.333666276087548]
  This paper investigates the role of conversational context in the annotation and detection of online hate and counter speech. We created a context-aware dataset for a 3-way classification task on Reddit comments: hate speech, counter speech, or neutral.
  arXiv  Detail & Related papers  (2022-06-13T19:05:44Z)
• ProsocialDialog: A Prosocial Backbone for Conversational Agents [104.92776607564583]
  We introduce ProsocialDialog, the first large-scale dialogue dataset to teach conversational agents to respond to problematic content following social norms. Created via a human-AI collaborative framework, ProsocialDialog consists of 58K dialogues, with 331K utterances, 160K RoTs, and 497K dialogue safety labels. With this dataset, we introduce a dialogue safety detection module, Canary, capable of generating RoTs given conversational context, and a socially-informed dialogue agent, Prost.
  arXiv  Detail & Related papers  (2022-05-25T11:48:47Z)
• "How Robust r u?": Evaluating Task-Oriented Dialogue Systems on Spoken Conversations [87.95711406978157]
  This work presents a new benchmark on spoken task-oriented conversations. We study multi-domain dialogue state tracking and knowledge-grounded dialogue modeling. Our data set enables speech-based benchmarking of task-oriented dialogue systems.
  arXiv  Detail & Related papers  (2021-09-28T04:51:04Z)
• Perspective-taking and Pragmatics for Generating Empathetic Responses Focused on Emotion Causes [50.569762345799354]
  We argue that two issues must be tackled at the same time: (i) identifying which word is the cause for the other's emotion from his or her utterance and (ii) reflecting those specific words in the response generation. Taking inspiration from social cognition, we leverage a generative estimator to infer emotion cause words from utterances with no word-level label.
  arXiv  Detail & Related papers  (2021-09-18T04:22:49Z)
• Who Responded to Whom: The Joint Effects of Latent Topics and Discourse in Conversation Structure [53.77234444565652]
  We identify the responding relations in the conversation discourse, which link response utterances to their initiations. We propose a model to learn latent topics and discourse in word distributions, and predict pairwise initiation-response links. Experimental results on both English and Chinese conversations show that our model significantly outperforms the previous state of the arts.
  arXiv  Detail & Related papers  (2021-04-17T17:46:00Z)
• Can You be More Social? Injecting Politeness and Positivity into Task-Oriented Conversational Agents [60.27066549589362]
  Social language used by human agents is associated with greater users' responsiveness and task completion. The model uses a sequence-to-sequence deep learning architecture, extended with a social language understanding element. Evaluation in terms of content preservation and social language level using both human judgment and automatic linguistic measures shows that the model can generate responses that enable agents to address users' issues in a more socially appropriate way.
  arXiv  Detail & Related papers  (2020-12-29T08:22:48Z)
• Impact and dynamics of hate and counter speech online [0.0]
  Citizen-generated counter speech is a promising way to fight hate speech and promote peaceful, non-polarized discourse. We analyze 180,000 political conversations that took place on German Twitter over four years.
  arXiv  Detail & Related papers  (2020-09-16T01:43:28Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.