HypBO: Accelerating Black-Box Scientific Experiments Using Experts' Hypotheses

• URL: http://arxiv.org/abs/2308.11787v3
• Date: Sun, 28 Jan 2024 15:29:51 GMT
• Title: HypBO: Accelerating Black-Box Scientific Experiments Using Experts' Hypotheses
• Abstract summary: We exploit expert human knowledge in the form of hypotheses to direct Bayesian searches more quickly to promising regions of chemical space. Our proposed method, which we call HypBO, uses expert human hypotheses to generate improved seed samples.
• Score: 0.0
• License: http://creativecommons.org/licenses/by/4.0/
• Abstract: Robotics and automation offer massive accelerations for solving intractable, multivariate scientific problems such as materials discovery, but the available search spaces can be dauntingly large. Bayesian optimization (BO) has emerged as a popular sample-efficient optimization engine, thriving in tasks where no analytic form of the target function/property is known. Here, we exploit expert human knowledge in the form of hypotheses to direct Bayesian searches more quickly to promising regions of chemical space. Previous methods have used underlying distributions derived from existing experimental measurements, which is unfeasible for new, unexplored scientific tasks. Also, such distributions cannot capture intricate hypotheses. Our proposed method, which we call HypBO, uses expert human hypotheses to generate improved seed samples. Unpromising seeds are automatically discounted, while promising seeds are used to augment the surrogate model data, thus achieving better-informed sampling. This process continues in a global versus local search fashion, organized in a bilevel optimization framework. We validate the performance of our method on a range of synthetic functions and demonstrate its practical utility on a real chemical design task where the use of expert hypotheses accelerates the search performance significantly.

Related papers

• MHE-Former: Multi-Hypothesis Transformers via Entropy Maximization for 3D Mesh Recovery [80.22216005340283]
  We introduce an exploration--exploitation paradigm for ambiguous mesh recovery with multi-hypothesis learning and selection.<n>During exploitation, we propose Hypothesis Selection, a context-aware process for multiple predictions.<n>Our framework achieves state-of-the-art performance in accuracy and diversity across multiple datasets.
  arXiv  Detail & Related papers  (2026-09-09T18:39:03Z)
• Sample Efficient Generative Optimization for Molecular Design [3.488381738536745]
  We introduce Sample Efficient Generative Optimization (SEGO), a framework for Bayesian optimization on adaptively generated molecules.<n>SEGO attains state-of-the-art performance on the practical molecular optimization benchmark using only one tenth of the oracle calls consumed by other methods.
  arXiv  Detail & Related papers  (2026-07-14T08:22:13Z)
• Towards Diverse Scientific Hypothesis Search with Large Language Models [46.83325596046927]
  We formulate hypothesis search as a sampling problem, where the objective is to efficiently produce diverse, high-quality hypotheses under a fixed validation budget.<n>Across domains including molecular discovery, equation discovery, and algorithm discovery, our approach consistently improves both hypothesis quality and diversity under the same validation budget.
  arXiv  Detail & Related papers  (2026-06-09T08:52:49Z)
• Efficient and Principled Scientific Discovery through Bayesian Optimization: A Tutorial [43.112626387235586]
  This tutorial presents Bayesian optimisation (BO), a principled probability-driven framework that formalises and automates scientific discovery.<n>We first frame scientific discovery as an intuitive problem, then unpack BO's core components, end-to-end, and real-world efficacy.<n>We also cover critical technical extensions for scientific applications, including batched experimentation, heteroscedasticity, contextual optimisation, and human-in-the-loop integration.
  arXiv  Detail & Related papers  (2026-04-01T19:14:34Z)
• Operationalizing Serendipity: Multi-Agent AI Workflows for Enhanced Materials Characterization with Theory-in-the-Loop [0.0]
  SciLink is an open-source, multi-agent artificial intelligence framework designed to operationalize serendipity in materials research.<n>It creates a direct, automated link between experimental observation, novelty assessment, and theoretical simulations.<n>We show its application to atomic-resolution and hyperspectral data, its capacity to integrate real-time human expert guidance, and its ability to close the research loop.
  arXiv  Detail & Related papers  (2025-08-07T04:59:17Z)
• Open-ended Scientific Discovery via Bayesian Surprise [63.26412847240136]
  AutoDS is a method for open-ended scientific discovery that instead drives scientific exploration using Bayesian surprise.<n>We evaluate AutoDS in the setting of data-driven discovery across 21 real-world datasets spanning domains such as biology, economics, finance, and behavioral science.
  arXiv  Detail & Related papers  (2025-06-30T22:53:59Z)
• PiFlow: Principle-aware Scientific Discovery with Multi-Agent Collaboration [9.640689981816852]
  We introduce textttPiFlow, an information-theoretical framework for automated scientific discovery.<n>Our method significantly improves discovery efficiency, reflected by a 73.55% increase in the Area Under the Curve.<n>Overall, textttPiFlow serves as a Plug-and-Play method, establishing a novel paradigm shift in highly efficient automated scientific discovery.
  arXiv  Detail & Related papers  (2025-05-21T03:09:39Z)
• Language-Based Bayesian Optimization Research Assistant (BORA) [0.0]
  Contextualizing domain knowledge is a powerful approach to guide searches for fruitful regions. Here, we propose use of Language Models (LLMs) for contextualizing search optimization.
  arXiv  Detail & Related papers  (2025-01-27T17:20:04Z)
• BioDiscoveryAgent: An AI Agent for Designing Genetic Perturbation Experiments [112.25067497985447]
  We introduce BioDiscoveryAgent, an agent that designs new experiments, reasons about their outcomes, and efficiently navigates the hypothesis space to reach desired solutions. BioDiscoveryAgent can uniquely design new experiments without the need to train a machine learning model. It achieves an average of 21% improvement in predicting relevant genetic perturbations across six datasets.
  arXiv  Detail & Related papers  (2024-05-27T19:57:17Z)
• Enhanced Bayesian Optimization via Preferential Modeling of Abstract Properties [49.351577714596544]
  We propose a human-AI collaborative Bayesian framework to incorporate expert preferences about unmeasured abstract properties into surrogate modeling. We provide an efficient strategy that can also handle any incorrect/misleading expert bias in preferential judgments.
  arXiv  Detail & Related papers  (2024-02-27T09:23:13Z)
• DiscoBAX: Discovery of Optimal Intervention Sets in Genomic Experiment Design [61.48963555382729]
  We propose DiscoBAX as a sample-efficient method for maximizing the rate of significant discoveries per experiment. We provide theoretical guarantees of approximate optimality under standard assumptions, and conduct a comprehensive experimental evaluation.
  arXiv  Detail & Related papers  (2023-12-07T06:05:39Z)
• Domain Knowledge Injection in Bayesian Search for New Materials [0.0]
  We propose DKIBO, a Bayesian optimization (BO) algorithm that accommodates domain knowledge to tune exploration in the search space. We empirically demonstrate the practical utility of the proposed method by successfully injecting domain knowledge in a materials design task.
  arXiv  Detail & Related papers  (2023-11-26T01:55:55Z)
• Large Language Models for Automated Open-domain Scientific Hypotheses Discovery [50.40483334131271]
  This work proposes the first dataset for social science academic hypotheses discovery. Unlike previous settings, the new dataset requires (1) using open-domain data (raw web corpus) as observations; and (2) proposing hypotheses even new to humanity. A multi- module framework is developed for the task, including three different feedback mechanisms to boost performance.
  arXiv  Detail & Related papers  (2023-09-06T05:19:41Z)
• A dynamic Bayesian optimized active recommender system for curiosity-driven Human-in-the-loop automated experiments [8.780395483188242]
  We present the development of a new type of human in the loop experimental workflow, via a Bayesian optimized active recommender system (BOARS) This work shows the utility of human-augmented machine learning approaches for curiosity-driven exploration of systems across experimental domains.
  arXiv  Detail & Related papers  (2023-04-05T14:54:34Z)
• GFlowNets for AI-Driven Scientific Discovery [74.27219800878304]
  We present a new probabilistic machine learning framework called GFlowNets. GFlowNets can be applied in the modeling, hypotheses generation and experimental design stages of the experimental science loop. We argue that GFlowNets can become a valuable tool for AI-driven scientific discovery.
  arXiv  Detail & Related papers  (2023-02-01T17:29:43Z)
• Incorporating Expert Prior Knowledge into Experimental Design via Posterior Sampling [58.56638141701966]
  Experimenters can often acquire the knowledge about the location of the global optimum. It is unknown how to incorporate the expert prior knowledge about the global optimum into Bayesian optimization. An efficient Bayesian optimization approach has been proposed via posterior sampling on the posterior distribution of the global optimum.
  arXiv  Detail & Related papers  (2020-02-26T01:57:36Z)

This list is automatically generated from the titles and abstracts of the papers in this site.

This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.