Social bias is prevalent in user reports of hate and abuse online

• URL: http://arxiv.org/abs/2510.04748v2
• Date: Tue, 07 Oct 2025 15:07:13 GMT
• Title: Social bias is prevalent in user reports of hate and abuse online
• Authors: Florence E. Enock, Helen Z. Margetts, Jonathan Bright,
• Abstract summary: We examine the extent of social bias in the flagging of hate and abuse in four different intergroup contexts.<n>Overall, participants reported abuse reliably, with approximately half of the abusive comments in each study reported.<n>However, a pervasive social bias was present whereby ingroup-directed abuse was consistently flagged to a greater extent than outgroup-directed abuse.
• Score: 2.0507758560052207
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: The prevalence of online hate and abuse is a pressing global concern. While tackling such societal harms is a priority for research across the social sciences, it is a difficult task, in part because of the magnitude of the problem. User engagement with reporting mechanisms (flagging) online is an increasingly important part of monitoring and addressing harmful content at scale. However, users may not flag content routinely enough, and when they do engage, they may be biased by group identity and political beliefs. Across five well-powered and pre-registered online experiments, we examine the extent of social bias in the flagging of hate and abuse in four different intergroup contexts: political affiliation, vaccination opinions, beliefs about climate change, and stance on abortion rights. Overall, participants reported abuse reliably, with approximately half of the abusive comments in each study reported. However, a pervasive social bias was present whereby ingroup-directed abuse was consistently flagged to a greater extent than outgroup-directed abuse. Our findings offer new insights into the nature of user flagging online, an understanding of which is crucial for enhancing user intervention against online hate speech and thus ensuring a safer online environment.

Related papers

• Community Moderation and the New Epistemology of Fact Checking on Social Media [124.26693978503339]
  Social media platforms have traditionally relied on independent fact-checking organizations to identify and flag misleading content.<n>X (formerly Twitter) and Meta have shifted towards community-driven content moderation by launching their own versions of crowd-sourced fact-checking.<n>We examine the current approaches to misinformation detection across major platforms, explore the emerging role of community-driven moderation, and critically evaluate both the promises and challenges of crowd-checking at scale.
  arXiv  Detail & Related papers  (2025-05-26T14:50:18Z)
• Toxic behavior silences online political conversations [0.0]
  We investigate the hypothesis that individuals may refrain from expressing minority opinions publicly due to being exposed to toxic behavior.<n>Using hidden Markov models, we identify a latent state consistent with toxicity-driven silence.<n>Our findings offer insights into the intricacies of online political deliberation and emphasize the importance of considering self-censorship dynamics.
  arXiv  Detail & Related papers  (2024-12-07T20:39:20Z)
• Non-Polar Opposites: Analyzing the Relationship Between Echo Chambers and Hostile Intergroup Interactions on Reddit [66.09950457847242]
  We study the activity of 5.97M Reddit users and 421M comments posted over 13 years. We create a typology of relationships between political communities based on whether their users are toxic to each other.
  arXiv  Detail & Related papers  (2022-11-25T22:17:07Z)
• On the Relation Between Opinion Change and Information Consumption on Reddit [22.387666772159974]
  We study the relationship between one user's opinion change episode and subsequent behavioral change on an online social media, Reddit. We find that people who report an opinion change are significantly more likely to change their future participation in a specific subset of online communities.
  arXiv  Detail & Related papers  (2022-07-25T13:34:16Z)
• News consumption and social media regulations policy [70.31753171707005]
  We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content. The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
  arXiv  Detail & Related papers  (2021-06-07T19:26:32Z)
• The User behind the Abuse: A Position on Ethics and Explainability [25.791014642037585]
  We discuss the role that modeling of users and online communities plays in abuse detection. We then explore the ethical challenges of incorporating user and community information. We propose properties that an explainable method should aim to exhibit.
  arXiv  Detail & Related papers  (2021-03-31T16:20:37Z)
• Causal Understanding of Fake News Dissemination on Social Media [50.4854427067898]
  We argue that it is critical to understand what user attributes potentially cause users to share fake news. In fake news dissemination, confounders can be characterized by fake news sharing behavior that inherently relates to user attributes and online activities. We propose a principled approach to alleviating selection bias in fake news dissemination.
  arXiv  Detail & Related papers  (2020-10-20T19:37:04Z)
• AbuseAnalyzer: Abuse Detection, Severity and Target Prediction for Gab Posts [19.32095911241636]
  We present a first of the kind dataset with 7601 posts from Gab which looks at online abuse from the perspective of presence of abuse, severity and target of abusive behavior. We also propose a system to address these tasks, obtaining an accuracy of 80% for abuse presence, 82% for abuse target prediction, and 65% for abuse severity prediction.
  arXiv  Detail & Related papers  (2020-09-30T18:12:50Z)
• ETHOS: an Online Hate Speech Detection Dataset [6.59720246184989]
  We present 'ETHOS', a textual dataset with two variants: binary and multi-label, based on YouTube and Reddit comments validated using the Figure-Eight crowdsourcing platform. Our key assumption is that, even gaining a small amount of labelled data from such a time-consuming process, we can guarantee hate speech occurrences in the examined material.
  arXiv  Detail & Related papers  (2020-06-11T08:59:57Z)
• Information Consumption and Social Response in a Segregated Environment: the Case of Gab [74.5095691235917]
  This work provides a characterization of the interaction patterns within Gab around the COVID-19 topic. We find that there are no strong statistical differences in the social response to questionable and reliable content. Our results provide insights toward the understanding of coordinated inauthentic behavior and on the early-warning of information operation.
  arXiv  Detail & Related papers  (2020-06-03T11:34:25Z)
• Echo Chambers on Social Media: A comparative analysis [64.2256216637683]
  We introduce an operational definition of echo chambers and perform a massive comparative analysis on 1B pieces of contents produced by 1M users on four social media platforms. We infer the leaning of users about controversial topics and reconstruct their interaction networks by analyzing different features. We find support for the hypothesis that platforms implementing news feed algorithms like Facebook may elicit the emergence of echo-chambers.
  arXiv  Detail & Related papers  (2020-04-20T20:00:27Z)
• Quantifying the Vulnerabilities of the Online Public Square to Adversarial Manipulation Tactics [43.98568073610101]
  We use a social media model to quantify the impacts of several adversarial manipulation tactics on the quality of content. We find that the presence of influential accounts, a hallmark of social media, exacerbates the vulnerabilities of online communities to manipulation. These insights suggest countermeasures that platforms could employ to increase the resilience of social media users to manipulation.
  arXiv  Detail & Related papers  (2019-07-13T21:12:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.