Credibility Governance: A Social Mechanism for Collective Self-Correction under Weak Truth Signals

• URL: http://arxiv.org/abs/2603.02640v1
• Date: Tue, 03 Mar 2026 06:10:13 GMT
• Title: Credibility Governance: A Social Mechanism for Collective Self-Correction under Weak Truth Signals
• Abstract summary: Credibility Governance (CG) is a mechanism that reallocates influence by learning which agents and viewpoints consistently track evolving public evidence.<n>CG maintains dynamic credibility scores for both agents and opinions, updates opinion influence via credibility-weighted endorsements, and updates agent credibility based on the long-run performance of the opinions they support.
• Score: 33.05880104821315
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Online platforms increasingly rely on opinion aggregation to allocate real-world attention and resources, yet common signals such as engagement votes or capital-weighted commitments are easy to amplify and often track visibility rather than reliability. This makes collective judgments brittle under weak truth signals, noisy or delayed feedback, early popularity surges, and strategic manipulation. We propose Credibility Governance (CG), a mechanism that reallocates influence by learning which agents and viewpoints consistently track evolving public evidence. CG maintains dynamic credibility scores for both agents and opinions, updates opinion influence via credibility-weighted endorsements, and updates agent credibility based on the long-run performance of the opinions they support, rewarding early and persistent alignment with emerging evidence while filtering short-lived noise. We evaluate CG in POLIS, a socio-physical simulation environment that models coupled belief dynamics and downstream feedback under uncertainty. Across settings with initial majority misalignment, observation noise and contamination, and misinformation shocks, CG outperforms vote-based, stake-weighted, and no-governance baselines, yielding faster recovery to the true state, reduced lock-in and path dependence, and improved robustness under adversarial pressure. Our implementation and experimental scripts are publicly available at https://github.com/Wanying-He/Credibility_Governance.

Related papers

• FARCA: Fact-Aligned Reliability-Aware Credit Assignment for Reinforcement Learning with Factual Supervision [35.029900525863994]
  We propose a policy optimization framework that transforms factual supervision into localized, reliability-weighted training signals.<n>FARCA achieves fine-grained credit localization by aligning the granularity of fact verification with that of policy updates.<n>It further introduces counterfactual evidence attribution, which uses the dependence of a factual judgment on key evidence as an empirical proxy for verification reliability to compute reliability weights.
  arXiv  Detail & Related papers  (2026-08-25T10:07:22Z)
• Uncovering Salience-Driven Dynamics in Consumer Confidence with Generative Social Simulation [56.70690339492564]
  We introduce ConsumerSim, a generative Human--Environment response framework that reconstructs Consumer Confidence Index dynamics.<n>Across U.S., EU27, and Japanese official CCI target series, ConsumerSim ranks first among persistence, time-series, regression, and shocks information-augmented baselines.<n>Findings support a behavioral view of consumer confidence as an interpretable Human--Environment response process.
  arXiv  Detail & Related papers  (2026-06-29T14:46:22Z)
• You Can't Fool Us: Understanding the Resilience of LLM-driven Agent Communities to Misinformation [4.689458744333872]
  We study how political ideology and open-minded thinking shape community responses to credible misinformation.<n>We find that higher AOT improves both resistance to misinformation uptake and recovery after trust peaks.<n>PI shapes the recovery pathway: ideologically moderate communities recover more reliably, while polarized communities retain more residual support.
  arXiv  Detail & Related papers  (2026-05-17T09:45:33Z)
• Robust Multi-Agent LLMs under Byzantine Faults [12.778788735297288]
  Large language model (LLM) agents increasingly collaborate over peer-to-peer networks to improve their reliability.<n> unreliable or Byzantine agents may sway neighboring agents toward incorrect conclusions and degrade overall system performance.<n>Existing methods rely on leader-based coordination or self-reported confidence, both of which are susceptible to adversarial manipulation.
  arXiv  Detail & Related papers  (2026-05-09T17:37:43Z)
• Agents for Agents: An Interrogator-Based Secure Framework for Autonomous Internet of Underwater Things [0.0]
  In this paper, an interrogator based structure is presented that incorporates the idea of behavioral trust monitoring into underwater multi-agent operation.<n> Privileged interrogator module is a passive communication metadata analyzer that uses a lightweight transformer model to calculate dynamic trust scores.<n>The evidence of trust is stored in a permissioned blockchain consortium which offers identity management which is not tampered with.
  arXiv  Detail & Related papers  (2026-04-05T20:50:18Z)
• Stability of AI Governance Systems: A Coupled Dynamics Model of Public Trust and Social Disruptions [0.49157446832511503]
  This paper proposes a rigorous coupled dynamics model that integrates a discrete-time Hawkes process.<n>A key innovation is the bidirectional feedback mechanism: declining trust amplifies the intensity of subsequent controversy events.<n> Numerical experiments reveal how echo chamber network structures and media amplification accelerate governance failure.
  arXiv  Detail & Related papers  (2026-03-10T12:24:30Z)
• On Robustness and Chain-of-Thought Consistency of RL-Finetuned VLMs [15.301640007799735]
  We show that simple, controlled textual perturbations--misleading captions or incorrect chain-of-thought (CoT) traces--cause substantial drops in robustness and confidence.<n>To better understand these vulnerabilities, we analyze RL fine-tuning dynamics and uncover an accuracy-faithfulness trade-off.
  arXiv  Detail & Related papers  (2026-02-13T01:12:00Z)
• Preventing the Collapse of Peer Review Requires Verification-First AI [49.995126139461085]
  We propose truth-coupling, i.e. how tightly venue scores track latent scientific truth.<n>We formalize two forces that drive a phase transition toward proxy-sovereign evaluation.
  arXiv  Detail & Related papers  (2026-01-23T17:17:32Z)
• Gaming the Judge: Unfaithful Chain-of-Thought Can Undermine Agent Evaluation [76.5533899503582]
  Large language models (LLMs) are increasingly used as judges to evaluate agent performance.<n>We show this paradigm implicitly assumes that the agent's chain-of-thought (CoT) reasoning faithfully reflects both its internal reasoning and the underlying environment state.<n>We demonstrate that manipulated reasoning alone can inflate false positive rates of state-of-the-art VLM judges by up to 90% across 800 trajectories spanning diverse web tasks.
  arXiv  Detail & Related papers  (2026-01-21T06:07:43Z)
• CoG: Controllable Graph Reasoning via Relational Blueprints and Failure-Aware Refinement over Knowledge Graphs [53.199517625701475]
  CoG is a training-free framework inspired by Dual-Process Theory that mimics the interplay between intuition and deliberation.<n>CoG significantly outperforms state-of-the-art approaches in both accuracy and efficiency.
  arXiv  Detail & Related papers  (2026-01-16T07:27:40Z)
• Illusions of Confidence? Diagnosing LLM Truthfulness via Neighborhood Consistency [78.91846841708586]
  We show that even facts answered with perfect self-consistency can rapidly collapse under mild contextual interference.<n>We propose Neighbor-Consistency Belief (NCB), a structural measure of belief that evaluates response coherence across a conceptual neighborhood.<n>We also present Structure-Aware Training (SAT), which optimize context-invariant belief structure and reduces long-tail knowledge brittleness by approximately 30%.
  arXiv  Detail & Related papers  (2026-01-09T16:23:21Z)
• Community Notes are Vulnerable to Rater Bias and Manipulation [75.34858521118305]
  We evaluate the Community Notes algorithm using simulated data that models realistic rater and note behaviors.<n>We find that the algorithm suppresses a substantial fraction of genuinely helpful notes and is highly sensitive to rater biases.
  arXiv  Detail & Related papers  (2025-11-04T14:39:34Z)
• AI Credibility Signals Outrank Institutions and Engagement in Shaping News Perception on Social Media [4.197003225775791]
  We present a large-scale mixed-design experiment investigating how AI-generated credibility scores affect user perception of political news.<n>Our results reveal that AI feedback significantly moderates partisan bias and institutional distrust, surpassing traditional engagement signals such as likes and shares.
  arXiv  Detail & Related papers  (2025-11-04T08:46:54Z)
• Zero-shot reasoning for simulating scholarly peer-review [0.0]
  We investigate a deterministic simulation framework that provides the first stable, evidence-based standard for evaluating AI-generated peer review reports.<n>First, the system is able to simulate calibrated editorial judgment, with 'Revise' decisions consistently forming the majority outcome.<n>Second, it maintains unwavering procedural integrity, enforcing a stable 29% evidence-anchoring compliance rate.
  arXiv  Detail & Related papers  (2025-10-02T13:59:14Z)
• Stochastically Dominant Peer Prediction [11.183872292320824]
  We propose dominantally dominant (SD-truthfulness) as a stronger guarantee of truthful reporting.<n>A simple solution -- rounding into binary lotteries -- can enforce SD-truthfulness, but often degrades sensitivity.<n>We demonstrate how a more careful application of rounding can better preserve sensitivity.
  arXiv  Detail & Related papers  (2025-06-02T21:07:24Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.