SwarmResearch: Orchestrating Coding Agents for Open-Ended Discovery
- URL: http://arxiv.org/abs/2607.02807v1
- Date: Thu, 02 Jul 2026 22:47:35 GMT
- Title: SwarmResearch: Orchestrating Coding Agents for Open-Ended Discovery
- Abstract summary: Long-running coding agents such as autoresearch can persistently discover optimizations for open-ended problems.<n>We introduce SwarmResearch, an orchestrator-subagent harness in which a Shepherd Agent uses global context to steer a population of Search Agents.<n>On open-ended optimization tasks, SwarmResearch discovers better or comparable solutions to state-of-the-art LLM-guided evolution and multi-agent techniques.
- Score: 11.64410415121195
- License: http://creativecommons.org/licenses/by/4.0/
- Abstract: Long-running coding agents such as autoresearch can persistently discover optimizations for open-ended problems. However, they tend to converge onto a single high-level approach, then proceed with low-level edits while missing other superior approaches to the problem. We hypothesize two harness-level design choices contribute to this behavior: accumulating context in a single long-running agent and only exposing a single program state to edit. We introduce SwarmResearch, an orchestrator-subagent harness in which a Shepherd Agent uses global context to steer a population of Search Agents, each operating with local context in their respective git branch. On open-ended optimization tasks, SwarmResearch discovers better or comparable solutions to state-of-the-art LLM-guided evolution and multi-agent techniques on 13/15 tasks, driven by higher-level exploration. Compared with fixed scaling of serial and parallel agents, SwarmResearch's orchestrator-guided scaling discovers better-performing solutions by adapting parallelism at different search depths.
Related papers
- Scalable Multi-Agent Maze Traversal with Local Communication [1.2875771631391097]
We propose a distributed algorithm that enables agents to collectively traverse an unknown, possibly cyclic graph.<n>Agents enter sequentially at a designated start node and are tasked to localize and reach an undisclosed goal.<n>At any moment in time, exploration is performed by only one of the agents.
arXiv Detail & Related papers (2026-08-12T10:21:26Z) - The Optimizer Is the Agent: Reasoning-Driven Search across Prompts, Programs, and ML Workflows [72.9051182568928]
We present ReASearch, a unified framework for reasoning-driven optimization.<n>With a shared agent loop and domain-specific tools, ReASearch instantiates the exact same scaffold to optimize prompts, programs, and ML.<n>We observe that complex search behaviors emerge naturally from the agent's reasoning process.
arXiv Detail & Related papers (2026-08-07T02:15:39Z) - WebSwarm: Recursive Multi-Agent Orchestration for Deep-and-Wide Web Search [104.75798763084424]
Large language model (LLM)-based web search agents are transforming information seeking into complex, deep-and-wide search and research-oriented tasks.<n>We propose WebSwarm, a progressive progressive delegation framework that jointly constructs task decomposition and expansion.<n>We show that WebSwarm consistently outperforms single-agent and multi-agent baselines on deep, wide, and interleaved deep-and-wide tasks.
arXiv Detail & Related papers (2026-07-09T16:28:49Z) - COAgents: Multi-Agent Framework to Learn and Navigate Routing Problems Search Space [18.154961815020155]
Vehicle Routing Problems (VRP) are essential to many real-world systems, but they remain intractable at scale due to their complexity.<n>We introduce textbfCOAgents, a cooperative multi-agent framework that models the search process as a graph.<n>Experiments show that COAgents remains competitive with several learn-to-search baselines on CVRP and sets a new state of the art among learning-based methods on the more challenging VRPTW instances.
arXiv Detail & Related papers (2026-05-20T02:07:10Z) - AgentSearchBench: A Benchmark for AI Agent Search in the Wild [21.739444037726418]
We introduce AgentSearchBench, a large-scale benchmark for agent search in the wild.<n>The benchmark formalizes agent search as retrieval and reranking problems under both executable task queries and high-level task descriptions.<n>We show that lightweight behavioral signals, including execution-aware probing, can substantially improve ranking quality.
arXiv Detail & Related papers (2026-04-24T10:53:54Z) - Improving Coherence and Persistence in Agentic AI for System Optimization [9.443037059325086]
Engram organizes exploration into a sequence of agents that iteratively design, test, and analyze mechanisms.<n>We find that Engram exhibits superior performance across diverse domains including multi-cloud multicast inference, LLM request routing, and optimizing KV cache reuse in databases with natural language queries.
arXiv Detail & Related papers (2026-03-22T17:04:50Z) - Agentic-R: Learning to Retrieve for Agentic Search [82.43426728778418]
We propose a novel retriever training framework tailored for agentic search.<n>Unlike retrievers designed for single-turn retrieval-augmented generation (RAG), we propose to use both local query-passage relevance and global answer correctness.<n>Our retriever, termed ours, consistently outperforms strong baselines across different search agents.
arXiv Detail & Related papers (2026-01-17T02:59:54Z) - BOAD: Discovering Hierarchical Software Engineering Agents via Bandit Optimization [41.08366028094234]
Large language models (LLMs) struggle to generalize to real-world software engineering problems.<n>Existing systems often rely on a single agent to handle the entire workflow-interpreting issues.<n>Motivated by how human engineers decompose complex problems, we propose structuring SWE agents as orchestrators coordinating specialized sub-agents.
arXiv Detail & Related papers (2025-12-29T17:41:11Z) - Multi-Agent Collaboration via Evolving Orchestration [55.574417128944226]
Large language models (LLMs) have achieved remarkable results across diverse downstream tasks, but their monolithic nature restricts scalability and efficiency in complex problem-solving.<n>We propose a puppeteer-style paradigm for LLM-based multi-agent collaboration, where a centralized orchestrator ("puppeteer") dynamically directs agents ("puppets") in response to evolving task states.<n> Experiments on closed- and open-domain scenarios show that this method achieves superior performance with reduced computational costs.
arXiv Detail & Related papers (2025-05-26T07:02:17Z) - Multi-Agent Sampling: Scaling Inference Compute for Data Synthesis with Tree Search-Based Agentic Collaboration [81.45763823762682]
This work aims to bridge the gap by investigating the problem of data synthesis through multi-agent sampling.<n>We introduce Tree Search-based Orchestrated Agents(TOA), where the workflow evolves iteratively during the sequential sampling process.<n>Our experiments on alignment, machine translation, and mathematical reasoning demonstrate that multi-agent sampling significantly outperforms single-agent sampling as inference compute scales.
arXiv Detail & Related papers (2024-12-22T15:16:44Z) - Monte-Carlo Tree Search for Multi-Agent Pathfinding: Preliminary Results [60.4817465598352]
We introduce an original variant of Monte-Carlo Tree Search (MCTS) tailored to multi-agent pathfinding.
Specifically, we use individual paths to assist the agents with the the goal-reaching behavior.
We also use a dedicated decomposition technique to reduce the branching factor of the tree search procedure.
arXiv Detail & Related papers (2023-07-25T12:33:53Z) - Multi-agent Deep Covering Skill Discovery [50.812414209206054]
We propose Multi-agent Deep Covering Option Discovery, which constructs the multi-agent options through minimizing the expected cover time of the multiple agents' joint state space.
Also, we propose a novel framework to adopt the multi-agent options in the MARL process.
We show that the proposed algorithm can effectively capture the agent interactions with the attention mechanism, successfully identify multi-agent options, and significantly outperforms prior works using single-agent options or no options.
arXiv Detail & Related papers (2022-10-07T00:40:59Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.