Related papers: The Wisdom of the Loudest: A Large-Scale Audit of Generative Search on Reddit

The Wisdom of the Loudest: A Large-Scale Audit of Generative Search on Reddit

URL: http://arxiv.org/abs/2609.14575v1
Date: Sun, 13 Sep 2026 15:00:18 GMT
Title: The Wisdom of the Loudest: A Large-Scale Audit of Generative Search on Reddit
Abstract summary: We audit Reddit Answers using 10,000 queries from 20 advice- and support-seeking communities, repeated three times to produce 30,000 answers over 14.68M comments.<n>We find that differences across runs are driven primarily by retrieval, answers routinely combine evidence across communities, and selection strongly favors already-visible, top-level comments.
Score: 7.80304437242923
License: http://creativecommons.org/licenses/by/4.0/
Abstract: Online communities are valued not only for answers, but for the diversity of experiences and perspectives they contain. Generative search increasingly mediates access to this discourse, yet little is known about which community voices survive retrieval and synthesis. We audit Reddit Answers using 10,000 queries from 20 advice- and support-seeking communities, repeated three times to produce 30,000 answers over 14.68M comments. We find that differences across runs are driven primarily by retrieval, answers routinely combine evidence across communities, and selection strongly favors already-visible, top-level comments. Formal and directive language is more likely to be surfaced, while experiential voice is less likely to survive selection and is further weakened during synthesis, with first-person singular language declining sharply. These findings show that community-grounded generative search is not neutral summarization, and should be designed not only for relevance and fluency, but also for provenance, plurality, and legibility.

Related papers

Relevance is not enough: A Communication-Oriented Retrieval System for Consequential Scientific Question Answering [0.22499166814992436]
We focus on consequential scientific questions whose results directly shape people's lives and study them through a public water-quality communication system.<n>Our system first classifies each question by reasoning type, then generates follow-up questions to identify missing evidence.<n>One component clearly distinguishes between what is known and what is uncertain, while another rewrites scientific details into accessible language.
arXiv Detail & Related papers (2026-09-05T18:41:09Z)
Answer Probing-Guided Search for Diverse Solution Exploration of LLMs [61.647721732856034]
Large Language Models (LLMs) tend to converge on a single high-confidence solution during inference.<n>We propose Answer Probing-Guided Tree Search (APTS), which guides the tree search by the probed answers' hidden state similarity and perplexity.
arXiv Detail & Related papers (2026-08-31T07:01:36Z)
Do Agents Repair When Challenged -- or Just Reply? Challenge, Repair, and Public Correction in a Deployed Agent Forum [9.934280404394636]
We compare Moltbook, a large language model (LLM) agent forum, with five matched Reddit communities.<n>Relative to Reddit, Moltbook discussions are roughly ten times less threaded, leaving far fewer chances for challenge and response.<n>A non-challenge baseline within Reddit suggests this gap is linked to challenge, not simply deeper threading.
arXiv Detail & Related papers (2026-04-01T06:03:28Z)
Evaluating Hallucinations in Multimodal LLMs with Spoken Queries under Diverse Acoustic Conditions [10.361060366260729]
We investigate how spoken input influences hallucinations in large language models.<n>We present RePOPE-Spk, an audio-augmented extension of the RePOPE benchmark, where queries are provided as speech under diverse acoustic conditions.<n> Experimental results show that hallucinations escalate when queries are spoken rather than written.
arXiv Detail & Related papers (2025-09-19T07:18:45Z)
Echo-chambers and Idea Labs: Communication Styles on Twitter [51.13560635563004]
This paper investigates the communication styles and structures of Twitter (X) communities within the vaccination context. By shedding light on the nuanced nature of communication within social networks, this study emphasizes the significance of understanding the diversity of perspectives within online communities.
arXiv Detail & Related papers (2024-03-28T13:55:51Z)
Generative Echo Chamber? Effects of LLM-Powered Search Systems on Diverse Information Seeking [49.02867094432589]
Large language models (LLMs) powered conversational search systems have already been used by hundreds of millions of people. We investigate whether and how LLMs with opinion biases that either reinforce or challenge the user's view change the effect.
arXiv Detail & Related papers (2024-02-08T18:14:33Z)
Reimagining Speech: A Scoping Review of Deep Learning-Powered Voice Conversion [2.8034840754506214]
This paper presents a scoping review that explores the use of deep learning in speech analysis, synthesis, and disentangled speech representation learning within modern voice conversion systems. We screened 621 publications from more than 38 different venues between the years 2017 and 2023, followed by an in-depth review of a final database consisting of 123 eligible studies. We summarise the most frequently used approaches to voice conversion based on deep learning and highlight common pitfalls within the community.
arXiv Detail & Related papers (2023-11-14T12:03:46Z)
User Attitudes to Content Moderation in Web Search [49.1574468325115]
We examine the levels of support for different moderation practices applied to potentially misleading and/or potentially offensive content in web search. We find that the most supported practice is informing users about potentially misleading or offensive content, and the least supported one is the complete removal of search results. More conservative users and users with lower levels of trust in web search results are more likely to be against content moderation in web search.
arXiv Detail & Related papers (2023-10-05T10:57:15Z)
This Must Be the Place: Predicting Engagement of Online Communities in a Large-scale Distributed Campaign [70.69387048368849]
We study the behavior of communities with millions of active members. We develop a hybrid model, combining textual cues, community meta-data, and structural properties. We demonstrate the applicability of our model through Reddit's r/place a large-scale online experiment.
arXiv Detail & Related papers (2022-01-14T08:23:16Z)
No Community Can Do Everything: Why People Participate in Similar Online Communities [8.295851213681816]
We provide an answer grounded in the analysis of 20 interviews with active participants in clusters of highly related subreddits. Within a broad topical area, there are a diversity of benefits an online community can confer. Our findings suggest that topical areas within an online community platform tend to become populated by groups of specialized communities.
arXiv Detail & Related papers (2022-01-12T02:03:45Z)
Making Online Communities 'Better': A Taxonomy of Community Values on Reddit [16.95132030488259]
We present the first study that elicits values directly from members across a diverse set of communities. We develop and validate a comprehensive taxonomy of community values, consisting of 29 subcategories within nine top-level categories. Using our taxonomy, we reframe existing research problems, such as managing influxes of new members, as tensions between different values.
arXiv Detail & Related papers (2021-09-11T01:49:08Z)
WebQA: Multihop and Multimodal QA [49.683300706718136]
We propose to bridge the gap between the natural language and computer vision communities with WebQA. Our challenge is to create a unified multimodal reasoning model that seamlessly transitions and reasons regardless of the source modality.
arXiv Detail & Related papers (2021-09-01T19:43:59Z)

This list is automatically generated from the titles and abstracts of the papers in this site.