A feast for trolls -- Engagement analysis of counternarratives against online toxicity

• URL: http://arxiv.org/abs/2111.07188v1
• Date: Sat, 13 Nov 2021 20:38:31 GMT
• Title: A feast for trolls -- Engagement analysis of counternarratives against online toxicity
• Abstract summary: Between February 2020 and July 2021, we observed over 15 million toxic messages on social media. Over 1,000 dashboard users responded to toxic messages with combinations of visual memes, text, or AI-generated text.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: This report provides an engagement analysis of counternarratives against online toxicity. Between February 2020 and July 2021, we observed over 15 million toxic messages on social media identified by our fine-grained, multilingual detection AI. Over 1,000 dashboard users responded to toxic messages with combinations of visual memes, text, or AI-generated text, or they reported content. This leads to new, real-life insights on self-regulatory approaches for the mitigation of online hate.

Related papers

• Mapping Election Toxicity on Social Media across Issue, Ideology, and Psychosocial Dimensions [9.017731357825287]
  We present a large-scale analysis of discourse on Twitter during the 2024 U.S. presidential election.<n>We categorize posts into 10 major campaign issues, estimate the ideology of posts, detect harmful content, and then examine the psychological drivers of toxic content.
  arXiv  Detail & Related papers  (2026-04-18T01:13:36Z)
• Multilingual and Explainable Text Detoxification with Parallel Corpora [58.83211571400692]
  We extend parallel text detoxification corpus to new languages. We conduct the first of its kind an automated, explainable analysis of the descriptive features of both toxic and non-toxic sentences. We then experiment with a novel text detoxification method inspired by the Chain-of-Thoughts reasoning approach.
  arXiv  Detail & Related papers  (2024-12-16T12:08:59Z)
• Characterizing Online Toxicity During the 2022 Mpox Outbreak: A Computational Analysis of Topical and Network Dynamics [0.9831489366502301]
  The 2022 Mpox outbreak, initially termed "Monkeypox" but subsequently renamed to mitigate associated stigmas and societal concerns, serves as a poignant backdrop to this issue. We collected more than 1.6 million unique tweets and analyzed them from five dimensions, including context, extent, content, speaker, and intent. We identified five high-level topic categories in the toxic online discourse on Twitter, including disease (46.6%), health policy and healthcare (19.3%), homophobia (23.9%), politics. We found that retweets of toxic content were widespread, while influential users rarely engaged with or countered this toxicity through retweets.
  arXiv  Detail & Related papers  (2024-08-21T19:31:01Z)
• Analyzing Toxicity in Deep Conversations: A Reddit Case Study [0.0]
  This work employs a tree-based approach to understand how users behave concerning toxicity in public conversation settings. We collect both the posts and the comment sections of the top 100 posts from 8 Reddit communities that allow profanity, totaling over 1 million responses. We find that toxic comments increase the likelihood of subsequent toxic comments being produced in online conversations.
  arXiv  Detail & Related papers  (2024-04-11T16:10:44Z)
• Comprehensive Assessment of Toxicity in ChatGPT [49.71090497696024]
  We evaluate the toxicity in ChatGPT by utilizing instruction-tuning datasets. prompts in creative writing tasks can be 2x more likely to elicit toxic responses. Certain deliberately toxic prompts, designed in earlier studies, no longer yield harmful responses.
  arXiv  Detail & Related papers  (2023-11-03T14:37:53Z)
• Understanding writing style in social media with a supervised contrastively pre-trained transformer [57.48690310135374]
  Online Social Networks serve as fertile ground for harmful behavior, ranging from hate speech to the dissemination of disinformation. We introduce the Style Transformer for Authorship Representations (STAR), trained on a large corpus derived from public sources of 4.5 x 106 authored texts. Using a support base of 8 documents of 512 tokens, we can discern authors from sets of up to 1616 authors with at least 80% accuracy.
  arXiv  Detail & Related papers  (2023-10-17T09:01:17Z)
• Detoxifying Text with MaRCo: Controllable Revision with Experts and Anti-Experts [57.38912708076231]
  We introduce MaRCo, a detoxification algorithm that combines controllable generation and text rewriting methods. MaRCo uses likelihoods under a non-toxic LM and a toxic LM to find candidate words to mask and potentially replace. We evaluate our method on several subtle toxicity and microaggressions datasets, and show that it not only outperforms baselines on automatic metrics, but MaRCo's rewrites are preferred 2.1 $times$ more in human evaluation.
  arXiv  Detail & Related papers  (2022-12-20T18:50:00Z)
• Twitter Users' Behavioral Response to Toxic Replies [1.2387676601792899]
  We studied the impact of toxicity on users' online behavior on Twitter. We found that toxicity victims show a combination of the following behavioral reactions: avoidance, revenge, countermeasures, and negotiation. Our results can assist further studies in developing more effective detection and intervention methods for reducing the negative consequences of toxicity on social media.
  arXiv  Detail & Related papers  (2022-10-24T17:36:58Z)
• Annotators with Attitudes: How Annotator Beliefs And Identities Bias Toxic Language Detection [75.54119209776894]
  We investigate the effect of annotator identities (who) and beliefs (why) on toxic language annotations. We consider posts with three characteristics: anti-Black language, African American English dialect, and vulgarity. Our results show strong associations between annotator identity and beliefs and their ratings of toxicity.
  arXiv  Detail & Related papers  (2021-11-15T18:58:20Z)
• RealToxicityPrompts: Evaluating Neural Toxic Degeneration in Language Models [93.151822563361]
  Pretrained neural language models (LMs) are prone to generating racist, sexist, or otherwise toxic language which hinders their safe deployment. We investigate the extent to which pretrained LMs can be prompted to generate toxic language, and the effectiveness of controllable text generation algorithms at preventing such toxic degeneration.
  arXiv  Detail & Related papers  (2020-09-24T03:17:19Z)
• ALONE: A Dataset for Toxic Behavior among Adolescents on Twitter [5.723363140737726]
  This paper provides a dataset of toxic social media interactions between confirmed high school students, called ALONE (AdoLescents ON twittEr) Nearly 66% of internet users have observed online harassment, and 41% claim personal experience, with 18% facing severe forms of online harassment. Our observations show that individual tweets do not provide sufficient evidence for toxic behavior, and meaningful use of context in interactions can enable highlighting or exonerating tweets with purported toxicity.
  arXiv  Detail & Related papers  (2020-08-14T17:02:55Z)
• Using Sentiment Information for Preemptive Detection of Toxic Comments in Online Conversations [0.0]
  Some authors have tried to predict if a conversation will derail into toxicity using the features of the first few messages. We show how the sentiments expressed in the first messages of a conversation can help predict upcoming toxicity.
  arXiv  Detail & Related papers  (2020-06-17T20:41:57Z)
• Racism is a Virus: Anti-Asian Hate and Counterspeech in Social Media during the COVID-19 Crisis [51.39895377836919]
  COVID-19 has sparked racism and hate on social media targeted towards Asian communities. We study the evolution and spread of anti-Asian hate speech through the lens of Twitter. We create COVID-HATE, the largest dataset of anti-Asian hate and counterspeech spanning 14 months.
  arXiv  Detail & Related papers  (2020-05-25T21:58:09Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.