Harnessing the Collective Intelligence of AI Agents in the Wild for New Discoveries

• URL: http://arxiv.org/abs/2606.10402v1
• Date: Tue, 09 Jun 2026 04:25:28 GMT
• Title: Harnessing the Collective Intelligence of AI Agents in the Wild for New Discoveries
• Abstract summary: We present EinsteinArena, an agent-native platform for open distributed research and discovery.<n>As of May 2026, agents on EinsteinArena have discovered 12 new state-of-the-art results better than any previous human or AI solutions.
• Score: 35.87396515951979
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Scientific discovery is often a collective process: researchers share partial results, inspect failed attempts, and build on each other's ideas over long time horizons. Recent AI systems have shown that language-model-based agents can make meaningful progress on open scientific problems, but most existing systems operate in isolation. In this paper, we present EinsteinArena, an agent-native platform for open distributed research and discovery. EinsteinArena provides agents with a live set of open problems, each with a solid verifier, public leaderboard, and problem-specific discussion forum where agents can ask questions and share insights. We focus on mathematical tasks that have garnered substantial research interest, where progress can be measured unambiguously. As of May 2026, agents on EinsteinArena have discovered 12 new state-of-the-art results better than any previous human or AI solutions. One notable example is the kissing number problem in dimension 11, where the platform improved the best known lower bound from 593 to 604. This advance did not come from a single agent or isolated run. Rather it arose through a sequence of submissions, public discussion, verifier refinement, and subsequent agent-to-agent borrowing of ideas. These results provide evidence that decentralized scientific discovery can emerge from open interaction among autonomous agents in the wild, demonstrating a new paradigm for collective AI-driven research.

Related papers

• Autonomous Mathematical Discovery in an Open-World Multi-Agent Environment [12.952007953406872]
  We study autonomous mathematical discovery in the Station, an open-world multi-agent environment in which AI agents from different model families pursue a shared research goal.<n>We release all raw agent dialogues, proofs, and verification code, providing a transparent record of how these discoveries emerged.
  arXiv  Detail & Related papers  (2026-08-24T18:00:03Z)
• Networked Intelligence: Active Shared Context Graphs for Human-AI Team Science [0.8754288080101668]
  We introduce Mycelium, an active shared workspace that automatically connects researchers and AI agents.<n>As human users and agents work, the system captures important observations and hypotheses, tracks how they relate to the team's evolving knowledge model.<n>We describe networked intelligence as sparse conditional computation over distributed scientific contexts.
  arXiv  Detail & Related papers  (2026-07-14T19:29:16Z)
• Benchmarking AI Agents for Addressing Scientific Challenges Across Scales [118.2204632627895]
  SciAgentArena is a systematic benchmark for evaluating AI agents in real-world scientific research scenarios.<n>It comprises approximately 200 tasks with stepwise verification and an interactive, agent-agnostic environment for assessing diverse AI agents.<n>We find that current agents can contribute effectively to well-specified data-analysis, particularly when the task structure and evaluation criteria are clear.
  arXiv  Detail & Related papers  (2026-06-10T22:55:30Z)
• AI Research Agents Narrow Scientific Exploration [12.949322198287417]
  We generate 37,802 scientific ideas from shared seed literature across citation-defined research areas in AI and machine learning.<n>We compare the resulting AI ideas against human-authored papers from the same research areas, follow-on human research emerging from the same seed literature, and the seed literature itself.<n>Overall, current AI research agents appear better suited to local elaboration than to broadening scientific exploration.
  arXiv  Detail & Related papers  (2026-05-27T03:26:43Z)
• Superminds Test: Actively Evaluating Collective Intelligence of Agent Society via Probing Agents [44.28040661008415]
  As large language model agents scale to populations of millions, a key question arises: Does collective intelligence emerge spontaneously from scale?<n>We present the first empirical evaluation of this question in a large-scale autonomous agent society.<n>Our experiments reveal a stark absence of collective intelligence. The society fails to outperform individual frontier models on complex reasoning tasks, rarely synthesizes distributed information, and often fails even trivial coordination tasks.
  arXiv  Detail & Related papers  (2026-04-24T11:11:36Z)
• CORAL: Towards Autonomous Multi-Agent Evolution for Open-Ended Discovery [67.47220507982522]
  Large language model (LLM)-based evolution is a promising approach for openended discovery.<n>We present CORAL, the first framework for autonomous multi-agent evolution on open-ended problems.<n>CORAL replaces rigid control with long-running agents that explore, reflect, and collaborate.
  arXiv  Detail & Related papers  (2026-04-02T05:59:06Z)
• Accelerating Scientific Research with Gemini: Case Studies and Common Techniques [105.15622072347811]
  Large language models (LLMs) have opened new avenues for accelerating scientific research.<n>We present a collection of case studies demonstrating how researchers have successfully collaborated with advanced AI models.
  arXiv  Detail & Related papers  (2026-02-03T18:56:17Z)
• The Station: An Open-World Environment for AI-Driven Discovery [14.556758955830796]
  We introduce the STATION, an open-world multi-agent environment that models a miniature scientific ecosystem.<n>Agents in the Station can engage in long scientific journeys that include reading papers from peers, formulating hypotheses, submitting code, performing analyses, and publishing results.<n>Experiments demonstrate that AI agents in the Station achieve new state-of-the-art performance on a wide range of benchmarks, spanning from mathematics to computational biology to machine learning.
  arXiv  Detail & Related papers  (2025-11-09T10:13:00Z)
• AstaBench: Rigorous Benchmarking of AI Agents with a Scientific Research Suite [75.58737079136942]
  We present AstaBench, a suite that provides the first holistic measure of agentic ability to perform scientific research.<n>Our suite comes with the first scientific research environment with production-grade search tools.<n>Our evaluation of 57 agents across 22 agent classes reveals several interesting findings.
  arXiv  Detail & Related papers  (2025-10-24T17:10:26Z)
• AgentRxiv: Towards Collaborative Autonomous Research [3.583084119066612]
  AgentRxiv lets agents collaborate toward research goals and enables researchers to accelerate discovery.<n>We find that the best performing strategy generalizes to benchmarks in other domains.<n>These findings suggest that autonomous agents may play a role in designing future AI systems alongside humans.
  arXiv  Detail & Related papers  (2025-03-23T15:16:42Z)
• AIGS: Generating Science from AI-Powered Automated Falsification [17.50867181053229]
  We propose Baby-AIGS as a baby-step demonstration of a full-process AIGS system, which is a multi-agent system with agents in roles representing key research process. Experiments on three tasks preliminarily show that Baby-AIGS could produce meaningful scientific discoveries, though not on par with experienced human researchers.
  arXiv  Detail & Related papers  (2024-11-17T13:40:35Z)
• Many Heads Are Better Than One: Improved Scientific Idea Generation by A LLM-Based Multi-Agent System [62.832818186789545]
  Virtual Scientists (VirSci) is a multi-agent system designed to mimic the teamwork inherent in scientific research.<n>VirSci organizes a team of agents to collaboratively generate, evaluate, and refine research ideas.<n>We show that this multi-agent approach outperforms the state-of-the-art method in producing novel scientific ideas.
  arXiv  Detail & Related papers  (2024-10-12T07:16:22Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.