Reddit Rules and Rulers: Quantifying the Link Between Rules and Perceptions of Governance across Thousands of Communities
- URL: http://arxiv.org/abs/2501.14163v1
- Date: Fri, 24 Jan 2025 01:26:41 GMT
- Title: Reddit Rules and Rulers: Quantifying the Link Between Rules and Perceptions of Governance across Thousands of Communities
- Authors: Leon Leibmann, Galen Weld, Amy X. Zhang, Tim Althoff,
- Abstract summary: We conduct the largest-to-date analysis of rules on Reddit, collecting a set of 67,545 unique rules across 5,225 communities.
More than just a point-in-time study, our work measures how communities change their rules over a 5+ year period.
We are the first to identify the rules most strongly associated with positive community perceptions of governance.
- Score: 13.80648276848838
- License:
- Abstract: Rules are a critical component of the functioning of nearly every online community, yet it is challenging for community moderators to make data-driven decisions about what rules to set for their communities. The connection between a community's rules and how its membership feels about its governance is not well understood. In this work, we conduct the largest-to-date analysis of rules on Reddit, collecting a set of 67,545 unique rules across 5,225 communities which collectively account for more than 67% of all content on Reddit. More than just a point-in-time study, our work measures how communities change their rules over a 5+ year period. We develop a method to classify these rules using a taxonomy of 17 key attributes extended from previous work. We assess what types of rules are most prevalent, how rules are phrased, and how they vary across communities of different types. Using a dataset of communities' discussions about their governance, we are the first to identify the rules most strongly associated with positive community perceptions of governance: rules addressing who participates, how content is formatted and tagged, and rules about commercial activities. We conduct a longitudinal study to quantify the impact of adding new rules to communities, finding that after a rule is added, community perceptions of governance immediately improve, yet this effect diminishes after six months. Our results have important implications for platforms, moderators, and researchers. We make our classification model and rules datasets public to support future research on this topic.
Related papers
- Can Community Notes Replace Professional Fact-Checkers? [49.5332225129956]
Policy changes by Twitter/X and Meta signal a shift away from partnerships with fact-checking organisations.
Our analysis reveals that community notes cite fact-checking sources up to five times more than previously reported.
arXiv Detail & Related papers (2025-02-19T22:26:39Z) - Post Guidance for Online Communities [11.475519304748891]
Post guidance guides users' contributions using rules that trigger interventions as users draft a post to be submitted.
This uniquely community-specific, proactive, and user-centric approach can increase adherence to rules without imposing additional burdens on moderators.
arXiv Detail & Related papers (2024-11-25T15:32:46Z) - Learning Rules from KGs Guided by Language Models [48.858741745144044]
Rule learning methods can be applied to predict potentially missing facts.
Ranking of rules is especially challenging over highly incomplete or biased KGs.
With the recent rise of Language Models (LMs) several works have claimed that LMs can be used as alternative means for KG completion.
arXiv Detail & Related papers (2024-09-12T09:27:36Z) - Perceptions of Moderators as a Large-Scale Measure of Online Community Governance [13.80648276848838]
We label 1.89 million posts and comments made on reddit over an 18 month period.
We identify types of communities where moderators are perceived particularly positively and negatively.
We show that strict rule enforcement is linked to more favorable perceptions of moderators of communities dedicated to certain topics, such as news communities, than others.
arXiv Detail & Related papers (2024-01-29T22:43:12Z) - ChatRule: Mining Logical Rules with Large Language Models for Knowledge
Graph Reasoning [107.61997887260056]
We propose a novel framework, ChatRule, unleashing the power of large language models for mining logical rules over knowledge graphs.
Specifically, the framework is initiated with an LLM-based rule generator, leveraging both the semantic and structural information of KGs.
To refine the generated rules, a rule ranking module estimates the rule quality by incorporating facts from existing KGs.
arXiv Detail & Related papers (2023-09-04T11:38:02Z) - Governing online goods: Maturity and formalization in Minecraft, Reddit,
and World of Warcraft communities [0.0]
Building a successful community means governing active populations and limited resources.
This study applies institutional analysis frameworks to 80,000 communities across 3 platforms: the sandbox game Minecraft, the MMO game World of Warcraft, and Reddit.
We find that online communities employ similar governance styles across platforms, strongly favoring "weak" norms to "strong" requirements.
arXiv Detail & Related papers (2022-02-02T22:45:21Z) - What Makes Online Communities 'Better'? Measuring Values, Consensus, and
Conflict across Thousands of Subreddits [13.585903247791094]
We measure community values through the first large-scale survey of community values, including 2,769 reddit users in 2,151 unique subreddits.
We show that community members disagree about how safe their communities are, that longstanding communities place 30.1% more importance on trustworthiness than newer communities.
These findings have important implications, including suggesting that care must be taken to protect vulnerable community members.
arXiv Detail & Related papers (2021-11-10T18:31:22Z) - Obvious Manipulability of Voting Rules [105.35249497503527]
The Gibbard-Satterthwaite theorem states that no unanimous and non-dictatorial voting rule is strategyproof.
We revisit voting rules and consider a weaker notion of strategyproofness called not obvious manipulability.
arXiv Detail & Related papers (2021-11-03T02:41:48Z) - Detecting Community Sensitive Norm Violations in Online Conversations [21.892867827127603]
We focus on a more complete spectrum of community norms and their violations in the local conversational and global community contexts.
We introduce a series of models that use this data to develop context- and community-sensitive norm violation detection.
arXiv Detail & Related papers (2021-10-09T00:39:35Z) - MCMH: Learning Multi-Chain Multi-Hop Rules for Knowledge Graph Reasoning [46.68583750992613]
We consider a generalized form of multi-hop rules, where each rule is a set of relation chains.
We propose a two-step approach that first selects a small set of relation chains as a rule and then evaluates the confidence of the target relationship.
Empirical results show that our multi-chain multi-hop (MCMH) rules result in superior results compared to the standard single-chain approaches.
arXiv Detail & Related papers (2020-10-05T01:32:20Z) - Certified Robustness of Community Detection against Adversarial
Structural Perturbation via Randomized Smoothing [81.71105567425275]
We develop the first certified robustness guarantee of community detection against adversarial structural perturbation.
We theoretically show that the smoothed community detection method provably groups a given arbitrary set of nodes into the same community.
We also empirically evaluate our method on multiple real-world graphs with ground truth communities.
arXiv Detail & Related papers (2020-02-09T18:39:39Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.