The Effects of Request Alerts on the Diversity and Visibility of Community Notes

• URL: http://arxiv.org/abs/2604.17042v1
• Date: Sat, 18 Apr 2026 15:53:41 GMT
• Title: The Effects of Request Alerts on the Diversity and Visibility of Community Notes
• Abstract summary: We examine the effectiveness of request alerts on Community Notes.<n>We find that request alerts function as an effective interface cue that increases both topical diversity and note visibility.
• Score: 4.784448295763737
• License: http://creativecommons.org/licenses/by-nc-nd/4.0/
• Abstract: Several major social media platforms have shifted toward crowdsourced fact-checking systems like Community Notes to combat misinformation at scale. However, these systems face criticism regarding which content is scrutinized and how visible that scrutiny is. To address these concerns, X allows users to request community notes for specific posts. When sufficient requests accumulate, X displays an alert, formalizing an interface cue intended to guide contributor behavior. In this study, we examine the effectiveness of request alerts. We infer the presence of request alerts at the time each note was written and identify 318 top writers who were repeatedly exposed to these alerts. Through analyzing their contributed 54,874 English notes written with and without request alerts, we find that at the individual level, writers fact-check more diverse and more political content under alerts. Nonetheless, at the collective level, these shifts direct contributions toward the already dominant Politics and Conflict category, thereby increasing content inequality within the Community Notes ecosystem. Finally, using a mixed-effects model that controls for both writer- and topic-level random effects, we estimate that notes written under alerts are between 8.4 and 20.2 percentage points more likely to be classified as helpful and thus visible to the public, compared to non-alerted notes. This visibility gain diminishes as topics diverge further from writers' prior interests, demonstrating a pivot penalty effect. Taken together, our findings show that request alerts function as an effective interface cue that increases both topical diversity and note visibility in Community Notes.

Related papers

• Evaluating Large Language Models for Antisemitic Incident Classification [64.21103964951531]
  We introduce the task of hateful event detection and investigate the ability of AI systems to discover and classify reports of antisemitic events with fine-grained labels.<n>We evaluate OpenAI's GPT-4o and Meta's Llama-3.2-3B-Instruct on datasets containing antisemitic event descriptions from news articles, civil society reports, and official records.
  arXiv  Detail & Related papers  (2026-07-06T10:14:53Z)
• Towards Automated Community Notes Generation with Large Vision Language Models for Combating Contextual Deception [8.79051023144961]
  We study the automated Community Notes generation method for image-based contextual deception.<n>Unlike prior work that primarily focuses on deception detection, Community Notes-style systems need to generate concise and grounded notes.<n>We propose ACCNote, a retrieval-augmented, multi-agent collaboration framework built on large vision-language models.
  arXiv  Detail & Related papers  (2026-03-23T18:21:23Z)
• Hyperactive Minority Alter the Stability of Community Notes [39.13508775153173]
  We study the emergence and visibility of Community Notes on X.<n>We show that contribution activity is highly concentrated.<n>We replicate the notes' emergence process by integrating the open-source implementation of the Community Notes consensus algorithm.
  arXiv  Detail & Related papers  (2026-02-09T18:04:54Z)
• The Benefit of Collective Intelligence in Community-Based Content Moderation is Limited by Overt Political Signalling [0.0]
  We show that community-based content moderation systems can allow political biases to influence the development of notes and the rating processes.<n>We conduct an online experiment in which participants jointly authored notes on political posts.<n>We find that politically diverse teams perform better when evaluating Republican posts, while group composition does not affect perceived note quality for Democrat posts.
  arXiv  Detail & Related papers  (2026-01-29T16:23:50Z)
• Community Notes are Vulnerable to Rater Bias and Manipulation [75.34858521118305]
  We evaluate the Community Notes algorithm using simulated data that models realistic rater and note behaviors.<n>We find that the algorithm suppresses a substantial fraction of genuinely helpful notes and is highly sensitive to rater biases.
  arXiv  Detail & Related papers  (2025-11-04T14:39:34Z)
• From Noise to Knowledge: Interactive Summaries for Developer Alerts [7.092554770996391]
  CLARITY supports interpreting tool-generated warnings through interactive inquiry.<n>As users mark warnings as interesting or uninteresting, CLARITY's rule inference algorithm surfaces common symptoms.<n>Our evaluation suggests that CLARITY's active learning-based summarization enhances interactive warning sensemaking.
  arXiv  Detail & Related papers  (2025-08-10T04:04:15Z)
• Can Community Notes Replace Professional Fact-Checkers? [49.5332225129956]
  Policy changes by Twitter/X and Meta signal a shift away from partnerships with fact-checking organisations.<n>Our analysis reveals that community notes cite fact-checking sources up to five times more than previously reported.<n>Our results show that successful community moderation relies on professional fact-checking and highlight how citizen and professional fact-checking are deeply intertwined.
  arXiv  Detail & Related papers  (2025-02-19T22:26:39Z)
• Rethinking the Evaluation of Dialogue Systems: Effects of User Feedback on Crowdworkers and LLMs [57.16442740983528]
  In ad-hoc retrieval, evaluation relies heavily on user actions, including implicit feedback. The role of user feedback in annotators' assessment of turns in a conversational perception has been little studied. We focus on how the evaluation of task-oriented dialogue systems ( TDSs) is affected by considering user feedback, explicit or implicit, as provided through the follow-up utterance of a turn being evaluated.
  arXiv  Detail & Related papers  (2024-04-19T16:45:50Z)
• Understanding How People Rate Their Conversations [73.17730062864314]
  We conduct a study to better understand how people rate their interactions with conversational agents. We focus on agreeableness and extraversion as variables that may explain variation in ratings.
  arXiv  Detail & Related papers  (2022-06-01T00:45:32Z)
• Dynamic Semantic Matching and Aggregation Network for Few-shot Intent Detection [69.2370349274216]
  Few-shot Intent Detection is challenging due to the scarcity of available annotated utterances. Semantic components are distilled from utterances via multi-head self-attention. Our method provides a comprehensive matching measure to enhance representations of both labeled and unlabeled instances.
  arXiv  Detail & Related papers  (2020-10-06T05:16:38Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.