Collective Narrative Grounding: Community-Coordinated Data Contributions to Improve Local AI Systems

• URL: http://arxiv.org/abs/2601.04201v1
• Date: Fri, 05 Dec 2025 15:44:54 GMT
• Title: Collective Narrative Grounding: Community-Coordinated Data Contributions to Improve Local AI Systems
• Abstract summary: Large language model (LLM) question-answering systems often fail on community-specific queries.<n>We present Collective Narrative Grounding, a participatory protocol that transforms community stories into structured narrative units.
• Score: 3.251276843768091
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Large language model (LLM) question-answering systems often fail on community-specific queries, creating "knowledge blind spots" that marginalize local voices and reinforce epistemic injustice. We present Collective Narrative Grounding, a participatory protocol that transforms community stories into structured narrative units and integrates them into AI systems under community governance. Learning from three participatory mapping workshops with N=24 community members, we designed elicitation methods and a schema that retain narrative richness while enabling entity, time, and place extraction, validation, and provenance control. To scope the problem, we audit a county-level benchmark of 14,782 local information QA pairs, where factual gaps, cultural misunderstandings, geographic confusions, and temporal misalignments account for 76.7% of errors. On a participatory QA set derived from our workshops, a state-of-the-art LLM answered fewer than 21% of questions correctly without added context, underscoring the need for local grounding. The missing facts often appear in the collected narratives, suggesting a direct path to closing the dominant error modes for narrative items. Beyond the protocol and pilot, we articulate key design tensions, such as representation and power, governance and control, and privacy and consent, providing concrete requirements for retrieval-first, provenance-visible, locally governed QA systems. Together, our taxonomy, protocol, and participatory evaluation offer a rigorous foundation for building community-grounded AI that better answers local questions.

Related papers

• Benchmarking LLMs for Community Governance Simulation with Life-history Narratives [46.86050402684712]
  Large language models (LLMs) are scalable to simulate human attitudes and behaviors at low cost.<n>We present an integrated research framework covering dataset, benchmark, algorithm, and system.<n>System integrates curriculum-LoRA into a closed-loop policy-evaluation pipeline.
  arXiv  Detail & Related papers  (2026-05-22T15:48:49Z)
• Voices in the Loop: Mapping Participatory AI [0.0]
  Participatory approaches to artificial intelligence are increasingly documented across public, civic, and humanitarian settings.<n>This paper reports on the construction of an open repository and interactive atlas of participatory AI initiatives.
  arXiv  Detail & Related papers  (2026-05-16T06:07:34Z)
• Pluralistic-Alignment Urbanism: Operationalizing a Right to AI for Inclusive Public Space [0.0]
  This paper proposes a procedural governance framework that treats public-space AI systems as civic infrastructure.<n>The paper examines how disagreement, subgroup variation, bounded predictive scaling, and neutral preference judgments can inform municipal AI governance.
  arXiv  Detail & Related papers  (2026-05-15T23:59:37Z)
• Are We Evaluating the Edit Locality of LLM Model Editing Properly? [68.441768731381]
  We find that existing specificity evaluation protocols are inadequate for this purpose.<n>Existing specificity metrics are weakly correlated with the strength of specificity regularizers.<n>We also find that current metrics lack sufficient sensitivity, rendering them ineffective at distinguishing the specificity performance of different methods.
  arXiv  Detail & Related papers  (2026-01-24T07:07:21Z)
• AskNearby: An LLM-Based Application for Neighborhood Information Retrieval and Personalized Cognitive-Map Recommendations [17.591012444861786]
  "15-minute city" envisions neighborhoods where residents can meet daily needs via a short walk or bike ride. Realizing this vision requires not only physical proximity but also efficient and reliable access to information about nearby places, services, and events.<n>We conceptualize this gap as the Local Life Information Accessibility (LLIA) problem and introduce AskNearby, an AI-driven community application.
  arXiv  Detail & Related papers  (2025-12-02T07:47:31Z)
• LocalBench: Benchmarking LLMs on County-Level Local Knowledge and Reasoning [9.319308493696893]
  Large language models (LLMs) have been widely evaluated on macro-scale geographic tasks, but their ability to handle hyper-local knowledge remains poorly understood.<n>We present LocalBench, the first benchmark designed to evaluate LLMs on county-level local knowledge across the United States.<n>Using LocalBench, we evaluate 13 state-of-the-art LLMs under both closed-book and web-augmented settings.
  arXiv  Detail & Related papers  (2025-11-13T16:26:13Z)
• InteGround: On the Evaluation of Verification and Retrieval Planning in Integrative Grounding [51.80327078402434]
  We introduce "integrative grounding" -- the challenge of retrieving and verifying multiple inter-dependent pieces of evidence to support a hypothesis query.<n>Our investigation reveals two critical findings: First, in groundedness verification, while LLMs are robust to redundant evidence, they tend to rationalize using internal knowledge when information is incomplete.<n>We find that undirected planning can degrade performance through noise introduction, while premise abduction emerges as a promising approach due to its logical constraints.
  arXiv  Detail & Related papers  (2025-09-20T04:48:24Z)
• From Leiden to Pleasure Island: The Constant Potts Model for Community Detection as a Hedonic Game [0.0254890465057467]
  We present a game-theoretic perspective on the Constant Potts Model (CPM) for partitioning networks into disjoint communities.<n>We emphasize its efficiency, robustness, and accuracy.<n>In community tracking scenarios, where initial partitions are used to bootstrap the algorithm with partial ground-truth information, our experiments reveal that robust partitions yield higher accuracy in recovering ground-truth communities.
  arXiv  Detail & Related papers  (2025-09-04T02:50:54Z)
• Teaching Language Models To Gather Information Proactively [53.85419549904644]
  Large language models (LLMs) are increasingly expected to function as collaborative partners.<n>In this work, we introduce a new task paradigm: proactive information gathering.<n>We design a scalable framework that generates partially specified, real-world tasks, masking key information.<n>Within this setup, our core innovation is a reinforcement finetuning strategy that rewards questions that elicit genuinely new, implicit user information.
  arXiv  Detail & Related papers  (2025-07-28T23:50:09Z)
• Community Moderation and the New Epistemology of Fact Checking on Social Media [124.26693978503339]
  Social media platforms have traditionally relied on independent fact-checking organizations to identify and flag misleading content.<n>X (formerly Twitter) and Meta have shifted towards community-driven content moderation by launching their own versions of crowd-sourced fact-checking.<n>We examine the current approaches to misinformation detection across major platforms, explore the emerging role of community-driven moderation, and critically evaluate both the promises and challenges of crowd-checking at scale.
  arXiv  Detail & Related papers  (2025-05-26T14:50:18Z)
• Retrieval-Augmented Generation with Conflicting Evidence [57.66282463340297]
  Large language model (LLM) agents are increasingly employing retrieval-augmented generation (RAG) to improve the factuality of their responses.<n>In practice, these systems often need to handle ambiguous user queries and potentially conflicting information from multiple sources.<n>We propose RAMDocs (Retrieval with Ambiguity and Misinformation in Documents), a new dataset that simulates complex and realistic scenarios for conflicting evidence for a user query.
  arXiv  Detail & Related papers  (2025-04-17T16:46:11Z)
• A Glitch in the Matrix? Locating and Detecting Language Model Grounding with Fakepedia [57.31074448586854]
  Large language models (LLMs) have an impressive ability to draw on novel information supplied in their context. Yet the mechanisms underlying this contextual grounding remain unknown. We present a novel method to study grounding abilities using Fakepedia.
  arXiv  Detail & Related papers  (2023-12-04T17:35:42Z)
• RHO ($\ ho$): Reducing Hallucination in Open-domain Dialogues with Knowledge Grounding [57.46495388734495]
  This paper presents RHO ($rho$) utilizing the representations of linked entities and relation predicates from a knowledge graph (KG) We propose (1) local knowledge grounding to combine textual embeddings with the corresponding KG embeddings; and (2) global knowledge grounding to equip RHO with multi-hop reasoning abilities via the attention mechanism.
  arXiv  Detail & Related papers  (2022-12-03T10:36:34Z)
• Distributed Q-Learning with State Tracking for Multi-agent Networked Control [61.63442612938345]
  This paper studies distributed Q-learning for Linear Quadratic Regulator (LQR) in a multi-agent network. We devise a state tracking (ST) based Q-learning algorithm to design optimal controllers for agents.
  arXiv  Detail & Related papers  (2020-12-22T22:03:49Z)
• Population Mapping in Informal Settlements with High-Resolution Satellite Imagery and Equitable Ground-Truth [1.4414055798999759]
  We propose a generalizable framework for the population estimation of dense, informal settlements in low-income urban areas. We use equitable ground-truth data, which is gathered in collaboration with local communities. We propose a gridded population estimation model, enabling flexible and customizable spatial resolutions.
  arXiv  Detail & Related papers  (2020-09-17T16:37:32Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.