IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation

• URL: http://arxiv.org/abs/2607.22375v1
• Date: Fri, 24 Jul 2026 15:03:14 GMT
• Title: IDEAgent: Agentic Quality-Diversity Search for Research Idea Generation
• Abstract summary: We argue that research ideation should be treated as a conjunction of both objectives and framed as a Quality-Diversity (QD) search.<n>We jointly drive Quality using multi-objective feedback for dedicated repair and refinement, while Diversity is achieved through lightweight sequential memory.<n>We show that IDEAgent outperforms the best baseline by 3.89x on Yield, while achieving non-zero Yield on 8x more topics.
• Score: 43.08002957114291
• License: http://creativecommons.org/licenses/by-nc-sa/4.0/
• Abstract: Large Language Models (LLMs) have significantly automated the process of scientific discovery over the past few years. However, existing systems share one core limitation: they generate and optimize ideas independently for either Quality or Diversity. This often leads to the generation of ideas in close proximity to one another or to a large set of trivial, unsound, or unclear concepts. In this work, we instead argue that research ideation should be treated as a conjunction of both objectives and framed as a Quality-Diversity (QD) search. In line with this perspective, we introduce IDEAgent, a multi-agent framework that manages the evolution of ideas through lineages. We jointly drive Quality using multi-objective feedback for dedicated repair and refinement, while Diversity is achieved through lightweight sequential memory and explicit comparison against completed ideas, their historical ancestors, and rejected proposals. To systematically evaluate this QD conjunction, we develop Yield, a joint metric that computes the largest set of mutually diverse ideas that satisfy a predetermined quality threshold. Finally, through evaluations across 32 topics spanning 8 domains of Computer Science, we show that IDEAgent outperforms the best baseline by 3.89x on Yield, while achieving non-zero Yield on 8x more topics. We further corroborate these findings through an analysis of quality improvements, showing that repair and refinement are crucial for building logical rigor and clarity while preserving non-obviousness. To encourage future research on QD-search-based ideation, we open-source IDEAgent at https://github.com/declare-lab/IDEAgent.

Related papers

• Heuresis: Search Strategies for Autonomous AI Research Agents Across Quality, Diversity and Novelty [39.97857268041792]
  Heuresis is a framework that abstracts the research pipeline into a set of general and composable primitives.<n>We find that completely novel ideas are rare. No idea across our scored runs is rated as "Original", and only a few achieve only "Minor Similarity" to prior work.
  arXiv  Detail & Related papers  (2026-06-23T21:44:08Z)
• Agent-as-Peer-Debriefer: A Multi-Agent Framework with Perspective-Based Refinement for Qualitative Analysis [7.023354761776525]
  We propose Agent-as-Peer-Debriefer, a multi-agent QDA framework that builds peer debriefing into key coding steps.<n>In our framework, a Hierarchical Coding Agent follows the standard QDA process to generate codes, sub-themes, and themes, along with self-explanations and memos.<n>These perspectives are drawn from established human QDA practices that generalize across domains and datasets.
  arXiv  Detail & Related papers  (2026-05-23T14:30:42Z)
• CoSearch: Joint Training of Reasoning and Document Ranking via Reinforcement Learning for Agentic Search [51.911048955965136]
  CoSearch is a framework that jointly trains a multi-step reasoning agent and a generative document ranking model.<n>Our results show that joint training of the reasoning agent and retrieval system is both feasible and strongly performant.
  arXiv  Detail & Related papers  (2026-04-19T17:48:17Z)
• BeyondSWE: Can Current Code Agent Survive Beyond Single-Repo Bug Fixing? [61.247730037229815]
  We introduce BeyondSWE, a comprehensive benchmark that broadens existing evaluations along two axes - resolution scope and knowledge scope.<n>To investigate the role of external knowledge, we develop SearchSWE, a framework that integrates deep search with coding abilities.<n>This work offers both a realistic, challenging evaluation benchmark and a flexible framework to advance research toward more capable code agents.
  arXiv  Detail & Related papers  (2026-03-03T17:52:01Z)
• DIVERGE: Diversity-Enhanced RAG for Open-Ended Information Seeking [10.970797088560323]
  We propose a plug-and-play agentic RAG framework with novel reflection-guided generation and memory-augmented iterative refinement.<n>We demonstrate that DIVERGE achieves the best diversity-quality trade-off compared to competitive baselines.
  arXiv  Detail & Related papers  (2026-01-30T19:03:11Z)
• InnoGym: Benchmarking the Innovation Potential of AI Agents [74.64144272881414]
  InnoGym is the first benchmark designed to evaluate the innovation potential of AI agents.<n>InnoGym introduces two complementary metrics: performance gain, which measures improvement over the best-known solutions, and novelty, which captures methodological differences from prior approaches.
  arXiv  Detail & Related papers  (2025-12-01T16:03:04Z)
• Beyond Brainstorming: What Drives High-Quality Scientific Ideas? Lessons from Multi-Agent Collaboration [59.41889496960302]
  This paper investigates whether structured multi-agent discussions can surpass solitary ideation.<n>We propose a cooperative multi-agent framework for generating research proposals.<n>We employ a comprehensive protocol with agent-based scoring and human review across dimensions such as novelty, strategic vision, and integration depth.
  arXiv  Detail & Related papers  (2025-08-06T15:59:18Z)
• Towards Rationality in Language and Multimodal Agents: A Survey [23.451887560567602]
  This work discusses how to build more rational language and multimodal agents.<n> Rationality is quality of being guided by reason, characterized by decision-making that aligns with evidence and logical principles.
  arXiv  Detail & Related papers  (2024-06-01T01:17:25Z)
• Large Language Models as In-context AI Generators for Quality-Diversity [8.585387103144825]
  In-context QD aims to generate interesting solutions using few-shot and many-shot prompting with quality-diverse examples from the QD archive as context. In-context QD displays promising results compared to both QD baselines and similar strategies developed for single-objective optimization.
  arXiv  Detail & Related papers  (2024-04-24T10:35:36Z)
• MAgIC: Investigation of Large Language Model Powered Multi-Agent in Cognition, Adaptability, Rationality and Collaboration [98.18244218156492]
  Large Language Models (LLMs) have significantly advanced natural language processing.<n>As their applications expand into multi-agent environments, there arises a need for a comprehensive evaluation framework.<n>This work introduces a novel competition-based benchmark framework to assess LLMs within multi-agent settings.
  arXiv  Detail & Related papers  (2023-11-14T21:46:27Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.