Spillover of Antisocial Behavior from Fringe Platforms: The Unintended Consequences of Community Banning

• URL: http://arxiv.org/abs/2209.09803v2
• Date: Wed, 12 Apr 2023 15:23:29 GMT
• Title: Spillover of Antisocial Behavior from Fringe Platforms: The Unintended Consequences of Community Banning
• Authors: Giuseppe Russo, Luca Verginer, Manoel Horta Ribeiro, Giona Casiraghi
• Abstract summary: We show that participating in fringe communities on Reddit increases users' toxicity and involvement with subreddits similar to the banned community. In short, we find evidence for a spillover of antisocial behavior from fringe platforms onto Reddit via co-participation.
• Score: 0.2752817022620644
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online platforms face pressure to keep their communities civil and respectful. Thus, the bannings of problematic online communities from mainstream platforms like Reddit and Facebook are often met with enthusiastic public reactions. However, this policy can lead users to migrate to alternative fringe platforms with lower moderation standards and where antisocial behaviors like trolling and harassment are widely accepted. As users of these communities often remain co-active across mainstream and fringe platforms, antisocial behaviors may spill over onto the mainstream platform. We study this possible spillover by analyzing around 70,000 users from three banned communities that migrated to fringe platforms: r/The_Donald, r/GenderCritical, and r/Incels. Using a difference-in-differences design, we contrast co-active users with matched counterparts to estimate the causal effect of fringe platform participation on users' antisocial behavior on Reddit. Our results show that participating in the fringe communities increases users' toxicity on Reddit (as measured by Perspective API) and involvement with subreddits similar to the banned community -- which often also breach platform norms. The effect intensifies with time and exposure to the fringe platform. In short, we find evidence for a spillover of antisocial behavior from fringe platforms onto Reddit via co-participation.

Related papers

• Stranger Danger! Cross-Community Interactions with Fringe Users Increase the Growth of Fringe Communities on Reddit [14.060809879399386]
  We study the impact of fringe-interactions on the growth of three fringe communities on Reddit. Our results indicate that fringe-interactions attract new members to fringe communities. Interactions using toxic language have a 5pp higher chance of attracting newcomers to fringe communities than non-toxic interactions.
  arXiv  Detail & Related papers  (2023-10-18T07:26:36Z)
• Analyzing Norm Violations in Live-Stream Chat [49.120561596550395]
  We study the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. Our results show that appropriate contextual information can boost moderation performance by 35%.
  arXiv  Detail & Related papers  (2023-05-18T05:58:27Z)
• Online conspiracy communities are more resilient to deplatforming [2.9767849911461504]
  We compare the shift in behavior of users affected by the ban of two large communities on Reddit, GreatAwakening and FatPeopleHate. We estimate how many users migrate, finding that users in the conspiracy community are much more likely to leave Reddit altogether and join Voat. Few migrating zealots drive the growth of the new GreatAwakening community on Voat, while this effect is absent for FatPeopleHate.
  arXiv  Detail & Related papers  (2023-03-21T18:08:51Z)
• Understanding Online Migration Decisions Following the Banning of Radical Communities [0.2752817022620644]
  We study how factors associated with the RECRO radicalization framework relate to users' migration decisions. Our results show that individual-level factors, those relating to the behavior of users, are associated with the decision to post on the fringe platform.
  arXiv  Detail & Related papers  (2022-12-09T10:43:15Z)
• Non-Polar Opposites: Analyzing the Relationship Between Echo Chambers and Hostile Intergroup Interactions on Reddit [66.09950457847242]
  We study the activity of 5.97M Reddit users and 421M comments posted over 13 years. We create a typology of relationships between political communities based on whether their users are toxic to each other.
  arXiv  Detail & Related papers  (2022-11-25T22:17:07Z)
• Quantifying How Hateful Communities Radicalize Online Users [2.378428291297535]
  We measure the impact of joining fringe hateful communities in terms of hate speech propagated to the rest of the social network. We use data from Reddit to assess the effect of joining one type of echo chamber: a digital community of like-minded users exhibiting hateful behavior. We show that the harmful speech does not remain contained within the community.
  arXiv  Detail & Related papers  (2022-09-19T01:13:29Z)
• News consumption and social media regulations policy [70.31753171707005]
  We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content. The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
  arXiv  Detail & Related papers  (2021-06-07T19:26:32Z)
• Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels [20.41491269475746]
  We report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform. In spite of that, users in one of the studied communities showed increases in signals associated with toxicity and radicalization.
  arXiv  Detail & Related papers  (2020-10-20T16:03:06Z)
• Racism is a Virus: Anti-Asian Hate and Counterspeech in Social Media during the COVID-19 Crisis [51.39895377836919]
  COVID-19 has sparked racism and hate on social media targeted towards Asian communities. We study the evolution and spread of anti-Asian hate speech through the lens of Twitter. We create COVID-HATE, the largest dataset of anti-Asian hate and counterspeech spanning 14 months.
  arXiv  Detail & Related papers  (2020-05-25T21:58:09Z)
• Echo Chambers on Social Media: A comparative analysis [64.2256216637683]
  We introduce an operational definition of echo chambers and perform a massive comparative analysis on 1B pieces of contents produced by 1M users on four social media platforms. We infer the leaning of users about controversial topics and reconstruct their interaction networks by analyzing different features. We find support for the hypothesis that platforms implementing news feed algorithms like Facebook may elicit the emergence of echo-chambers.
  arXiv  Detail & Related papers  (2020-04-20T20:00:27Z)
• Quantifying the Vulnerabilities of the Online Public Square to Adversarial Manipulation Tactics [43.98568073610101]
  We use a social media model to quantify the impacts of several adversarial manipulation tactics on the quality of content. We find that the presence of influential accounts, a hallmark of social media, exacerbates the vulnerabilities of online communities to manipulation. These insights suggest countermeasures that platforms could employ to increase the resilience of social media users to manipulation.
  arXiv  Detail & Related papers  (2019-07-13T21:12:08Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.