Towards Diverse Scientific Hypothesis Search with Large Language Models

• URL: http://arxiv.org/abs/2606.10587v1
• Date: Tue, 09 Jun 2026 08:52:49 GMT
• Title: Towards Diverse Scientific Hypothesis Search with Large Language Models
• Abstract summary: We formulate hypothesis search as a sampling problem, where the objective is to efficiently produce diverse, high-quality hypotheses under a fixed validation budget.<n>Across domains including molecular discovery, equation discovery, and algorithm discovery, our approach consistently improves both hypothesis quality and diversity under the same validation budget.
• Score: 46.83325596046927
• License: http://arxiv.org/licenses/nonexclusive-distrib/1.0/
• Abstract: Large language models (LLMs) are on the rise for accelerating scientific discovery, most recently in advanced tasks such as generating valid scientific hypotheses. Yet in many discovery settings, the goal is not to identify a single best hypothesis since validation can be noisy and expensive, and scientists benefit from a set of high-quality alternative hypotheses that hedge against downstream uncertainty for the best solutions. Nevertheless, commonly used evolutionary search recipes tend to prioritize optimization over exploration in hypothesis generation, and the resulting selection pressure during the search process leads to diversity collapse. Motivated by these limitations, we formulate hypothesis search as a sampling problem, where the objective is to efficiently produce diverse, high-quality hypotheses under a fixed validation budget. Building on this perspective, we propose \ours, an evolutionary framework inspired by the classical parallel tempering algorithm that searches hypotheses at multiple temperature levels and enables principled information exchange across temperatures to improve exploration without disrupting convergence. Across domains including molecular discovery, equation discovery, and algorithm discovery, our approach consistently improves both hypothesis quality and diversity under the same validation budget, and produces candidates that remain robust under more expensive downstream computational validations.

Related papers

• MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery [80.22216005340283]
  We introduce an exploration--exploitation paradigm for ambiguous mesh recovery with multi-hypothesis learning and selection.<n>During exploitation, we propose Hypothesis Selection, a context-aware process for multiple predictions.<n>Our framework achieves state-of-the-art performance in accuracy and diversity across multiple datasets.
  arXiv  Detail & Related papers  (2026-09-09T18:39:03Z)
• Evidence-Informed LLM Beliefs for Continual Scientific Discovery [66.36520571709482]
  We introduce two complementary changes to the original search procedure: belief-update filtering and diversity.<n>We find that embedding-based retrieval-augmented generation over prior discoveries best anticipates eventual posteriors, identifying 37.5% of static surprisals as spurious.<n>We then modify search to avoid these spurious rewards and prioritize hypotheses that remain surprising under non-stationary beliefs.
  arXiv  Detail & Related papers  (2026-06-28T04:06:12Z)
• Accelerating Social Science Research via Agentic Hypothesization and Experimentation [33.55093074029515]
  EXPERIGEN is a framework that operationalizes end-to-end discovery through a Bayesian optimization inspired two-phase search.<n>It consistently discovers 2-4x more statistically significant hypotheses that are 7-17 percent more predictive than prior approaches.<n>We conduct the first A/B test of LLM-generated hypotheses, observing statistically significant results with p less than 1e-6 and a large effect size of 344 percent.
  arXiv  Detail & Related papers  (2026-02-08T14:20:56Z)
• Bayes-Entropy Collaborative Driven Agents for Research Hypotheses Generation and Optimization [4.469102316542763]
  This paper proposes a multi-agent collaborative framework called HypoAgents.<n>It generates hypotheses through diversity sampling and establishes prior beliefs.<n>It then employs etrieval-augmented generation (RAG) to gather external literature evidence.<n>It identifies high-uncertainty hypotheses using information entropy $H = - sum p_ilog p_i$ and actively refines them.
  arXiv  Detail & Related papers  (2025-08-03T13:05:32Z)
• Provable Maximum Entropy Manifold Exploration via Diffusion Models [58.89696361871563]
  Exploration is critical for solving real-world decision-making problems such as scientific discovery.<n>We introduce a novel framework that casts exploration as entropy over approximate data manifold implicitly defined by a pre-trained diffusion model.<n>We develop an algorithm based on mirror descent that solves the exploration problem as sequential fine-tuning of a pre-trained diffusion model.
  arXiv  Detail & Related papers  (2025-06-18T11:59:15Z)
• MOOSE-Chem2: Exploring LLM Limits in Fine-Grained Scientific Hypothesis Discovery via Hierarchical Search [102.11776494401705]
  Large language models (LLMs) have shown promise in automating scientific hypothesis generation.<n>Existing approaches primarily yield coarse-grained hypotheses lacking critical methodological and experimental details.<n>We introduce and formally define the new task of fine-grained scientific hypothesis discovery.
  arXiv  Detail & Related papers  (2025-05-25T16:13:46Z)
• HypoBench: Towards Systematic and Principled Benchmarking for Hypothesis Generation [24.656083479331645]
  We introduce HypoBench, a novel benchmark designed to evaluate hypothesis generation methods across multiple aspects.<n>We evaluate four state-of-the-art LLMs combined with six existing hypothesis-generation methods.<n>Results indicate that there is still significant room for improvement, as current hypothesis generation methods do not fully uncover all relevant or meaningful patterns.
  arXiv  Detail & Related papers  (2025-04-15T18:00:00Z)
• Automated Hypothesis Validation with Agentic Sequential Falsifications [45.572893831500686]
  Many real-world hypotheses are abstract, high-level statements that are difficult to validate directly.<n>Here we propose Popper, an agentic framework for rigorous automated validation of free-form hypotheses.
  arXiv  Detail & Related papers  (2025-02-14T01:46:00Z)
• HypBO: Accelerating Black-Box Scientific Experiments Using Experts' Hypotheses [0.0]
  We exploit expert human knowledge in the form of hypotheses to direct Bayesian searches more quickly to promising regions of chemical space. Our proposed method, which we call HypBO, uses expert human hypotheses to generate improved seed samples.
  arXiv  Detail & Related papers  (2023-08-22T20:59:21Z)
• GFlowNets for AI-Driven Scientific Discovery [74.27219800878304]
  We present a new probabilistic machine learning framework called GFlowNets. GFlowNets can be applied in the modeling, hypotheses generation and experimental design stages of the experimental science loop. We argue that GFlowNets can become a valuable tool for AI-driven scientific discovery.
  arXiv  Detail & Related papers  (2023-02-01T17:29:43Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.