AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User Appeals

• URL: http://arxiv.org/abs/2301.07163v2
• Date: Tue, 9 Jan 2024 19:46:56 GMT
• Title: AppealMod: Inducing Friction to Reduce Moderator Workload of Handling User Appeals
• Authors: Shubham Atreja, Jane Im, Paul Resnick, Libby Hemphill
• Abstract summary: We designed and built AppealMod, a system that induces friction in the appeals process by asking users to provide additional information before their appeals are reviewed by human moderators. We conducted a randomized field experiment in a Reddit community of over 29 million users that lasted for four months. Our system is effective at reducing moderator workload and minimizing their exposure to toxic content while honoring their preference for direct engagement and agency in appeals.
• Score: 7.898353262890439
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: As content moderation becomes a central aspect of all social media platforms and online communities, interest has grown in how to make moderation decisions contestable. On social media platforms where individual communities moderate their own activities, the responsibility to address user appeals falls on volunteers from within the community. While there is a growing body of work devoted to understanding and supporting the volunteer moderators' workload, little is known about their practice of handling user appeals. Through a collaborative and iterative design process with Reddit moderators, we found that moderators spend considerable effort in investigating user ban appeals and desired to directly engage with users and retain their agency over each decision. To fulfill their needs, we designed and built AppealMod, a system that induces friction in the appeals process by asking users to provide additional information before their appeals are reviewed by human moderators. In addition to giving moderators more information, we expected the friction in the appeal process would lead to a selection effect among users, with many insincere and toxic appeals being abandoned before getting any attention from human moderators. To evaluate our system, we conducted a randomized field experiment in a Reddit community of over 29 million users that lasted for four months. As a result of the selection effect, moderators viewed only 30% of initial appeals and less than 10% of the toxically worded appeals; yet they granted roughly the same number of appeals when compared with the control group. Overall, our system is effective at reducing moderator workload and minimizing their exposure to toxic content while honoring their preference for direct engagement and agency in appeals.

Related papers

• Venire: A Machine Learning-Guided Panel Review System for Community Content Moderation [17.673993032146527]
  We develop Venire, an ML-backed system for panel review on Reddit. Venire uses a machine learning model trained on log data to identify the cases where moderators are most likely to disagree. We show that Venire is able to improve decision consistency and surface latent disagreements.
  arXiv  Detail & Related papers  (2024-10-30T20:39:34Z)
• Explainability and Hate Speech: Structured Explanations Make Social Media Moderators Faster [72.84926097773578]
  We investigate the effect of explanations on the speed of real-world moderators. Our experiments show that while generic explanations do not affect their speed and are often ignored, structured explanations lower moderators' decision making time by 7.4%.
  arXiv  Detail & Related papers  (2024-06-06T14:23:10Z)
• Content Moderation Justice and Fairness on Social Media: Comparisons Across Different Contexts and Platforms [23.735552021636245]
  We conduct an online experiment on 200 American social media users of Reddit and Twitter. We find that retributive moderation delivers higher justice and fairness for commercially moderated platforms in illegal violations. We discuss the opportunities for platform policymaking to improve moderation system design.
  arXiv  Detail & Related papers  (2024-03-09T22:50:06Z)
• Perceptions of Moderators as a Large-Scale Measure of Online Community Governance [13.80648276848838]
  We label 1.89 million posts and comments made on reddit over an 18 month period. We identify types of communities where moderators are perceived particularly positively and negatively. We show that strict rule enforcement is linked to more favorable perceptions of moderators of communities dedicated to certain topics, such as news communities, than others.
  arXiv  Detail & Related papers  (2024-01-29T22:43:12Z)
• User Attitudes to Content Moderation in Web Search [49.1574468325115]
  We examine the levels of support for different moderation practices applied to potentially misleading and/or potentially offensive content in web search. We find that the most supported practice is informing users about potentially misleading or offensive content, and the least supported one is the complete removal of search results. More conservative users and users with lower levels of trust in web search results are more likely to be against content moderation in web search.
  arXiv  Detail & Related papers  (2023-10-05T10:57:15Z)
• Analyzing Norm Violations in Live-Stream Chat [49.120561596550395]
  We study the first NLP study dedicated to detecting norm violations in conversations on live-streaming platforms. We define norm violation categories in live-stream chats and annotate 4,583 moderated comments from Twitch. Our results show that appropriate contextual information can boost moderation performance by 35%.
  arXiv  Detail & Related papers  (2023-05-18T05:58:27Z)
• Governing for Free: Rule Process Effects on Reddit Moderator Motivations [0.0]
  The over 2.8 million "subreddit" communities on Reddit are governed by hundreds of thousands of volunteer moderators, many of whom have no training or prior experience in a governing role. While moderators often devote daily time to community maintenance and cope with the emotional effects of hate comments or disturbing content, Reddit provides no compensation for this position. We investigate how the processes through which subreddit moderators generate community rules increase moderators' motivation through the meeting of social-psychological needs: Procedural Justice and Self Determination, and Self-Other Merging.
  arXiv  Detail & Related papers  (2022-06-11T23:23:38Z)
• News consumption and social media regulations policy [70.31753171707005]
  We analyze two social media that enforced opposite moderation methods, Twitter and Gab, to assess the interplay between news consumption and content regulation. Our results show that the presence of moderation pursued by Twitter produces a significant reduction of questionable content. The lack of clear regulation on Gab results in the tendency of the user to engage with both types of content, showing a slight preference for the questionable ones which may account for a dissing/endorsement behavior.
  arXiv  Detail & Related papers  (2021-06-07T19:26:32Z)
• CASS: Towards Building a Social-Support Chatbot for Online Health Community [67.45813419121603]
  The CASS architecture is based on advanced neural network algorithms. It can handle new inputs from users and generate a variety of responses to them. With a follow-up field experiment, CASS is proven useful in supporting individual members who seek emotional support.
  arXiv  Detail & Related papers  (2021-01-04T05:52:03Z)
• Do Platform Migrations Compromise Content Moderation? Evidence from r/The_Donald and r/Incels [20.41491269475746]
  We report the results of a large-scale observational study of how problematic online communities progress following community-level moderation measures. Our results suggest that, in both cases, moderation measures significantly decreased posting activity on the new platform. In spite of that, users in one of the studied communities showed increases in signals associated with toxicity and radicalization.
  arXiv  Detail & Related papers  (2020-10-20T16:03:06Z)
• An Iterative Approach for Identifying Complaint Based Tweets in Social Media Platforms [76.9570531352697]
  We propose an iterative methodology which aims to identify complaint based posts pertaining to the transport domain. We perform comprehensive evaluations along with releasing a novel dataset for the research purposes.
  arXiv  Detail & Related papers  (2020-01-24T22:23:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.