Collective intelligence in science: direct elicitation of diverse information from experts with unknown information structure

• URL: http://arxiv.org/abs/2601.14047v2
• Date: Sat, 24 Jan 2026 18:27:28 GMT
• Title: Collective intelligence in science: direct elicitation of diverse information from experts with unknown information structure
• Authors: Alexey V. Osipov, Nikolay N. Osipov,
• Abstract summary: We propose a self-resolving play-money prediction market entangled with a chat.<n>We show that participants directly share their private information on the hypothesis through the chat and trade.<n>This approach will lead to efficient aggregation of relevant information in a completely interpretable form.
• Score: 0.0
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Suppose we need a deep collective analysis of an open scientific problem: there is a complex scientific hypothesis and a large online group of mutually unrelated experts with relevant private information of a diverse and unpredictable nature. This information may be results of experts' individual experiments, original reasoning of some of them, results of AI systems they use, etc. We propose a simple mechanism based on a self-resolving play-money prediction market entangled with a chat. We show that such a system can easily be brought to an equilibrium where participants directly share their private information on the hypothesis through the chat and trade as if the market were resolved in accordance with the truth of the hypothesis. This approach will lead to efficient aggregation of relevant information in a completely interpretable form even if the ground truth cannot be established and experts initially know nothing about each other and cannot perform complex Bayesian calculations. Finally, by rewarding the experts with some real assets proportionally to the play money they end up with, we can get an innovative way to fund large-scale collaborative studies of any type.

Related papers

• Unsupervised Ensemble Learning Through Deep Energy-based Models [3.0344469521198003]
  Unsupervised ensemble learning emerged to address the challenge of combining multiple learners' predictions without access to ground truth labels or additional data.<n>We propose a novel deep energy-based method for constructing an accurate meta-learner using only the predictions of individual learners.<n>We demonstrate superior performance across diverse ensemble scenarios, including challenging mixture of experts settings.
  arXiv  Detail & Related papers  (2026-01-28T12:50:08Z)
• A Survey of Scientific Large Language Models: From Data Foundations to Agent Frontiers [251.23085679210206]
  Scientific Large Language Models (Sci-LLMs) are transforming how knowledge is represented, integrated, and applied in scientific research.<n>This survey reframes the development of Sci-LLMs as a co-evolution between models and their underlying data substrate.<n>We formulate a unified taxonomy of scientific data and a hierarchical model of scientific knowledge.
  arXiv  Detail & Related papers  (2025-08-28T18:30:52Z)
• Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning [53.82037883518254]
  We introduce SciReas, a diverse suite of existing benchmarks for scientific reasoning tasks.<n>We then propose KRUX, a probing framework for studying the distinct roles of reasoning and knowledge in scientific tasks.
  arXiv  Detail & Related papers  (2025-08-26T17:04:23Z)
• The Sample Complexity of Online Strategic Decision Making with Information Asymmetry and Knowledge Transportability [93.11220429350278]
  Information asymmetry is a pervasive feature of multi-agent systems.<n>This paper explores a fundamental question in online learning: Can we employ non-i.i.d. actions to learn about confounders even when requiring knowledge transfer?<n>We present a sample-efficient algorithm designed to accurately identify system dynamics under information asymmetry and to navigate the challenges of knowledge transfer effectively in reinforcement learning.
  arXiv  Detail & Related papers  (2025-06-11T17:06:57Z)
• AI and the Problem of Knowledge Collapse [0.0]
  We identify conditions under which AI, by reducing the cost of access to certain modes of knowledge, can paradoxically harm public understanding. We provide a simple model in which a community of learners or innovators choose to use traditional methods or to rely on a discounted AI-assisted process. In our default model, a 20% discount on AI-generated content generates public beliefs 2.3 times further from the truth than when there is no discount.
  arXiv  Detail & Related papers  (2024-04-04T15:06:23Z)
• Private Knowledge Sharing in Distributed Learning: A Survey [50.51431815732716]
  The rise of Artificial Intelligence has revolutionized numerous industries and transformed the way society operates. It is crucial to utilize information in learning processes that are either distributed or owned by different entities. Modern data-driven services have been developed to integrate distributed knowledge entities into their outcomes.
  arXiv  Detail & Related papers  (2024-02-08T07:18:23Z)
• The role of prior information and computational power in Machine Learning [0.0]
  We discuss how prior information and computational power can be employed to solve a learning problem. We argue that employing high computational power has the advantage of a higher performance.
  arXiv  Detail & Related papers  (2022-10-31T20:39:53Z)
• Principled Knowledge Extrapolation with GANs [92.62635018136476]
  We study counterfactual synthesis from a new perspective of knowledge extrapolation. We show that an adversarial game with a closed-form discriminator can be used to address the knowledge extrapolation problem. Our method enjoys both elegant theoretical guarantees and superior performance in many scenarios.
  arXiv  Detail & Related papers  (2022-05-21T08:39:42Z)
• From prediction markets to interpretable collective intelligence [0.0]
  We create a system that elicits, from an arbitrary group of experts, the probability of the truth of an arbitrary logical proposition. We argue for the possibility of the development of a self-resolving prediction market with play money that incentivizes direct information exchange between experts.
  arXiv  Detail & Related papers  (2022-04-28T11:44:29Z)
• Towards Collaborative Question Answering: A Preliminary Study [63.91687114660126]
  We propose CollabQA, a novel QA task in which several expert agents coordinated by a moderator work together to answer questions that cannot be answered with any single agent alone. We make a synthetic dataset of a large knowledge graph that can be distributed to experts. We show that the problem can be challenging without introducing prior to the collaboration structure, unless experts are perfect and uniform.
  arXiv  Detail & Related papers  (2022-01-24T14:27:00Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.