Perceptions of Moderators as a Large-Scale Measure of Online Community Governance

• URL: http://arxiv.org/abs/2401.16610v2
• Date: Wed, 02 Oct 2024 21:59:36 GMT
• Title: Perceptions of Moderators as a Large-Scale Measure of Online Community Governance
• Authors: Galen Weld, Leon Leibmann, Amy X. Zhang, Tim Althoff,
• Abstract summary: We label 1.89 million posts and comments made on reddit over an 18 month period. We identify types of communities where moderators are perceived particularly positively and negatively. We show that strict rule enforcement is linked to more favorable perceptions of moderators of communities dedicated to certain topics, such as news communities, than others.
• Score: 13.80648276848838
• License:
• Abstract: Millions of online communities are governed by volunteer moderators, who shape their communities by setting and enforcing rules, recruiting additional moderators, and participating in the community themselves. These moderators must regularly make decisions about how to govern, yet measuring the 'success' of governance is complex and nuanced, making it challenging to determine what governance strategies are most successful. Furthermore, prior work has shown that communities have differing values, suggesting that 'one-size-fits-all' approaches to governance are unlikely to serve all communities well. In this work, we assess governance practices on reddit by classifying the sentiment of community members' public discussion of their own moderators. We label 1.89 million posts and comments made on reddit over an 18 month period. We relate these perceptions to characteristics of community governance, and to different actions that community moderators take. We identify types of communities where moderators are perceived particularly positively and negatively, and highlight promising strategies for moderator teams. Amongst other findings, we show that strict rule enforcement is linked to more favorable perceptions of moderators of communities dedicated to certain topics, such as news communities, than others. We investigate what kinds of moderators are associated with improved community perceptions upon their addition to a mod team, and find that moderators who are active community members before and during their mod tenures are seen more favorably. We make all our models, datasets, and code public.

Related papers

• Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster [72.84926097773578]
  We investigate the effect of explanations on the speed of real-world moderators. Our experiments show that while generic explanations do not affect their speed and are often ignored, structured explanations lower moderators' decision making time by 7.4%.
  arXiv  Detail & Related papers  (2024-06-06T14:23:10Z)
• Analyzing Norm Violations in Live-Stream Chat [49.120561596550395]
  We study the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. Our results show that appropriate contextual information can boost moderation performance by 35%.
  arXiv  Detail & Related papers  (2023-05-18T05:58:27Z)
• A User-Driven Framework for Regulating and Auditing Social Media [94.70018274127231]
  We propose that algorithmic filtering should be regulated with respect to a flexible, user-driven baseline. We require that the feeds a platform filters contain "similar" informational content as their respective baseline feeds. We present an auditing procedure that checks whether a platform honors this requirement.
  arXiv  Detail & Related papers  (2023-04-20T17:53:34Z)
• AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User Appeals [7.898353262890439]
  We designed and built AppealMod, a system that induces friction in the appeals process by asking users to provide additional information before their appeals are reviewed by human moderators. We conducted a randomized field experiment in a Reddit community of over 29 million users that lasted for four months. Our system is effective at reducing moderator workload and minimizing their exposure to toxic content while honoring their preference for direct engagement and agency in appeals.
  arXiv  Detail & Related papers  (2023-01-17T20:15:20Z)
• Non-Polar Opposites: Analyzing the Relationship Between Echo Chambers and Hostile Intergroup Interactions on Reddit [66.09950457847242]
  We study the activity of 5.97M Reddit users and 421M comments posted over 13 years. We create a typology of relationships between political communities based on whether their users are toxic to each other.
  arXiv  Detail & Related papers  (2022-11-25T22:17:07Z)
• Governing for Free: Rule Process Effects on Reddit Moderator Motivations [0.0]
  The over 2.8 million "subreddit" communities on Reddit are governed by hundreds of thousands of volunteer moderators, many of whom have no training or prior experience in a governing role. While moderators often devote daily time to community maintenance and cope with the emotional effects of hate comments or disturbing content, Reddit provides no compensation for this position. We investigate how the processes through which subreddit moderators generate community rules increase moderators' motivation through the meeting of social-psychological needs: Procedural Justice and Self Determination, and Self-Other Merging.
  arXiv  Detail & Related papers  (2022-06-11T23:23:38Z)
• Governing online goods: Maturity and formalization in Minecraft, Reddit, and World of Warcraft communities [0.0]
  Building a successful community means governing active populations and limited resources. This study applies institutional analysis frameworks to 80,000 communities across 3 platforms: the sandbox game Minecraft, the MMO game World of Warcraft, and Reddit. We find that online communities employ similar governance styles across platforms, strongly favoring "weak" norms to "strong" requirements.
  arXiv  Detail & Related papers  (2022-02-02T22:45:21Z)
• This Must Be the Place: Predicting Engagement of Online Communities in a Large-scale Distributed Campaign [70.69387048368849]
  We study the behavior of communities with millions of active members. We develop a hybrid model, combining textual cues, community meta-data, and structural properties. We demonstrate the applicability of our model through Reddit's r/place a large-scale online experiment.
  arXiv  Detail & Related papers  (2022-01-14T08:23:16Z)
• What Makes Online Communities 'Better'? Measuring Values, Consensus, and Conflict across Thousands of Subreddits [13.585903247791094]
  We measure community values through the first large-scale survey of community values, including 2,769 reddit users in 2,151 unique subreddits. We show that community members disagree about how safe their communities are, that longstanding communities place 30.1% more importance on trustworthiness than newer communities. These findings have important implications, including suggesting that care must be taken to protect vulnerable community members.
  arXiv  Detail & Related papers  (2021-11-10T18:31:22Z)
• Detecting Community Sensitive Norm Violations in Online Conversations [21.892867827127603]
  We focus on a more complete spectrum of community norms and their violations in the local conversational and global community contexts. We introduce a series of models that use this data to develop context- and community-sensitive norm violation detection.
  arXiv  Detail & Related papers  (2021-10-09T00:39:35Z)
• News consumption and social media regulations policy [70.31753171707005]
  We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content. The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
  arXiv  Detail & Related papers  (2021-06-07T19:26:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.